Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Temporary PR to integrate PDL's mass of bug fixes and enhancements #148

Open
wants to merge 132 commits into
base: master
Choose a base branch
from
Open

Temporary PR to integrate PDL's mass of bug fixes and enhancements #148

wants to merge 132 commits into from
+2,274 −517

Commits on Aug 11, 2017

  1. When considering a vm for a job, ask aws if it is still running.

    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    c7f5664 View commit details
    Browse the repository at this point in the history

  2. When number of jobs is larger than the number of available vms, N, 

    jobManager dies after N jobs have finished in the exception handling
of __manage(), if Config.REUSE_VM is set to true.  This commit
simply checks whether "job" is None, to avoid the crash.  This allows
job manager to continue and finish all jobs.
But it may not be the real fix of the root problem which needs further
investigation.
    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    4dcbbb4 View commit details
    Browse the repository at this point in the history

  3. Add pid in the logs of the modules used by jobManager.

    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    6de4692 View commit details
    Browse the repository at this point in the history

  4. When job manager restarts, it empties its vm "total" pool and "free" 

    queue.  Due to misunderstanding of redis, the free queue is not
actually emptied, resulting in vms staying in free queue but not in total
pool.
    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    e2afe8a View commit details
    Browse the repository at this point in the history

  5. Add ability to pull amis from aws and to exact a tag "Name" as the i… 

    …mage

 name for each ami.  The lab author specifies the desired image using
 this name.
    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    97c22e3 View commit details
    Browse the repository at this point in the history

  6. Remove DEFAULT_AMI since amis are automatically loaded from aws now.

    @xyzisinus
    xyzisinus committed Aug 11, 2017
    Configuration menu
    Copy the full SHA
    e66551a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2017

  1. Add script to drive lab submissions into tango.

    @xyzisinus
    xyzisinus committed Aug 15, 2017
    Configuration menu
    Copy the full SHA
    94656b7 View commit details
    Browse the repository at this point in the history

  2. Add scripts to access ec2 and redis.

    @xyzisinus
    xyzisinus committed Aug 15, 2017
    Configuration menu
    Copy the full SHA
    253cb8e View commit details
    Browse the repository at this point in the history

  3. remove trailing lines.

    @xyzisinus
    xyzisinus committed Aug 15, 2017
    Configuration menu
    Copy the full SHA
    45d5fc1 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2017

  1. Check if output file exists before comparing modification time.

    @xyzisinus
    xyzisinus committed Aug 16, 2017
    Configuration menu
    Copy the full SHA
    12139e1 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2017

  1. resetTango should only be called from jobManager. Remove the call fro… 

    …m restful server.
    @xyzisinus
    xyzisinus committed Aug 18, 2017
    Configuration menu
    Copy the full SHA
    d8d0f65 View commit details
    Browse the repository at this point in the history

  2. Add and subtract some logging.

    @xyzisinus
    xyzisinus committed Aug 18, 2017
    Configuration menu
    Copy the full SHA
    9043e3a View commit details
    Browse the repository at this point in the history

  3. Fix a condition for running all students' jobs.

    @xyzisinus
    xyzisinus committed Aug 18, 2017
    Configuration menu
    Copy the full SHA
    4a6bba9 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2017

  1. Use tangoHostPort to distinguish multiple tango containers on the sam… 

    …e host.
    @xyzisinus
    xyzisinus committed Aug 22, 2017
    Configuration menu
    Copy the full SHA
    b92ffba View commit details
    Browse the repository at this point in the history

  2. Add logging in destroyVM.

    @xyzisinus
    xyzisinus committed Aug 22, 2017
    Configuration menu
    Copy the full SHA
    75ca36d View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2017

  1. Modified pool allocation logic to 1) not to allocate all vms allowed 

    by pool size at once and 2) consider vms in free pool first.
    @xyzisinus
    xyzisinus committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    93e60ad View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2017

  1. When job manager restarts, it now destroy the vm instances that not 

    not in the free pools, instead of destroy all vms.
    @xyzisinus
    xyzisinus committed Aug 30, 2017
    Configuration menu
    Copy the full SHA
    76157c3 View commit details
    Browse the repository at this point in the history

  2. Improve tool script that exercises job manager and the code beneath.

    @xyzisinus
    xyzisinus committed Aug 30, 2017
    Configuration menu
    Copy the full SHA
    7674945 View commit details
    Browse the repository at this point in the history

  3. Add ability to submit jobs for a given list of students.

    @xyzisinus
    xyzisinus committed Aug 30, 2017
    Configuration menu
    Copy the full SHA
    cbe01c2 View commit details
    Browse the repository at this point in the history

  4. Fix incomplete test script

    @xyzisinus
    xyzisinus committed Aug 30, 2017
    Configuration menu
    Copy the full SHA
    46ceb59 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2017

  1. Check if the vm still exists before terminating.

    @xyzisinus
    xyzisinus committed Aug 31, 2017
    Configuration menu
    Copy the full SHA
    7fef985 View commit details
    Browse the repository at this point in the history

  2. Check output file for the missing "scores:" line and 

    report them at the end of the run.
    @xyzisinus
    xyzisinus committed Aug 31, 2017
    Configuration menu
    Copy the full SHA
    0febf75 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2017

  1. Fix typos that prevents job manager to start.

    @xyzisinus
    xyzisinus committed Sep 1, 2017
    Configuration menu
    Copy the full SHA
    5b2bda8 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2017

  1. Improvements to run_jobs: ability to run failed submissions, to dry r… 

    …un and

to list failed submissions.
    @xyzisinus
    xyzisinus committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    4ce9534 View commit details
    Browse the repository at this point in the history

  2. Add a separate config file for run_jobs to separate config settings 

    from logic changes.
    @xyzisinus
    xyzisinus committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    0296460 View commit details
    Browse the repository at this point in the history

  3. Separate "class Config" from util.py.

    @xyzisinus
    xyzisinus committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    b1aa4ba View commit details
    Browse the repository at this point in the history

  4. Move student submission range into config file.

    @xyzisinus
    xyzisinus committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    9be308f View commit details
    Browse the repository at this point in the history

  5. Correct a typo.

    @xyzisinus
    xyzisinus committed Sep 5, 2017
    Configuration menu
    Copy the full SHA
    a9e2983 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2017

  1. Better check for output files with missing scores.

    @xyzisinus
    xyzisinus committed Sep 6, 2017
    Configuration menu
    Copy the full SHA
    e0b5253 View commit details
    Browse the repository at this point in the history

  2. remove trailing spaces.

    @xyzisinus
    xyzisinus committed Sep 6, 2017
    Configuration menu
    Copy the full SHA
    79b7ead View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2017

  1. Move logging init in TangoServer to the beginning to capture all 

    logs.  Add aws auto scaling group name in config.
    @xyzisinus
    xyzisinus committed Sep 7, 2017
    Configuration menu
    Copy the full SHA
    2176dfe View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2017

  1. 1. Add ability to shrink preallocated pool. 2. preliminary code to at… 

    …tach

instance to asw auto scaling group.  3. Error handling related to
initializeVM().  4. Consistency assurance in removeVM().
    @xyzisinus
    xyzisinus committed Sep 14, 2017
    Configuration menu
    Copy the full SHA
    a5bc482 View commit details
    Browse the repository at this point in the history

  2. Add ability to test decrementing pool size

    @xyzisinus
    xyzisinus committed Sep 14, 2017
    Configuration menu
    Copy the full SHA
    b3a076f View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2017

  1. Add vm pool low water mark.

    @xyzisinus
    xyzisinus committed Sep 15, 2017
    Configuration menu
    Copy the full SHA
    d896b36 View commit details
    Browse the repository at this point in the history

  2. test for existence of the newly config variables for backward compati… 

    …bility.
    @xyzisinus
    xyzisinus committed Sep 15, 2017
    Configuration menu
    Copy the full SHA
    7805577 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2017

  1. Fix a condition that checks low_water_mark config variable.

    @xyzisinus
    xyzisinus committed Oct 11, 2017
    Configuration menu
    Copy the full SHA
    aaa07eb View commit details
    Browse the repository at this point in the history

  2. A useful suggestive setting for pool low water mark.

    @xyzisinus
    xyzisinus committed Oct 11, 2017
    Configuration menu
    Copy the full SHA
    965b281 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/xyzisinus/Tango

    @xyzisinus
    xyzisinus committed Oct 11, 2017
    Configuration menu
    Copy the full SHA
    e2acaaa View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2017

  1. Add -j flag to list all jobs. Exam output file in next iteration of 

    the loop to make sure that the file is fully copied.
    @xyzisinus
    xyzisinus committed Oct 12, 2017
    Configuration menu
    Copy the full SHA
    7432c4b View commit details
    Browse the repository at this point in the history

  2. When low water mark is zero, the free_destroy vm op works now.

    @xyzisinus
    xyzisinus committed Oct 12, 2017
    Configuration menu
    Copy the full SHA
    d2c86e3 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2017

  1. Add option to direct query to diferent redis servers with port number.

    @xyzisinus
    xyzisinus committed Oct 13, 2017
    Configuration menu
    Copy the full SHA
    9736236 View commit details
    Browse the repository at this point in the history

  2. Sort the lists of vms and pool items.

    @xyzisinus
    xyzisinus committed Oct 13, 2017
    Configuration menu
    Copy the full SHA
    56c71c1 View commit details
    Browse the repository at this point in the history

  3. Wait a bit after requesting an instance from aws. also allows a redis 

    connection to be passed into tangoObjects, for testing purpose.
    @xyzisinus
    xyzisinus committed Oct 13, 2017
    Configuration menu
    Copy the full SHA
    484f435 View commit details
    Browse the repository at this point in the history

  4. Add comments.

    @xyzisinus
    xyzisinus committed Oct 13, 2017
    Configuration menu
    Copy the full SHA
    95ad616 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2017

  1. Fix a problem when failed job is last finished, it's not recognized.

    @xyzisinus
    xyzisinus committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    04e8176 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2017

  1. checkpoint. 1. fix a bug in finding the last submission. 2. scan subm… 

    …issions for exising failures.
    @xyzisinus
    xyzisinus committed Nov 13, 2017
    Configuration menu
    Copy the full SHA
    2544f1c View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2017

  1. report inconsistency between current results and existing.

    @xyzisinus
    xyzisinus committed Nov 16, 2017
    Configuration menu
    Copy the full SHA
    caefb9a View commit details
    Browse the repository at this point in the history

  2. Recover the old content of the config file after a mistaken commit.

    @xyzisinus
    xyzisinus committed Nov 16, 2017
    Configuration menu
    Copy the full SHA
    906bfa5 View commit details
    Browse the repository at this point in the history

  3. When a job is done, report inconsistency between existing result and … 

    …new.
    @xyzisinus
    xyzisinus committed Nov 16, 2017
    Configuration menu
    Copy the full SHA
    3e0cd38 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2017

  1. Now about to print interesting attributes of each instance.

    @xyzisinus
    xyzisinus committed Nov 17, 2017
    Configuration menu
    Copy the full SHA
    b4e7123 View commit details
    Browse the repository at this point in the history

  2. Only look at running instances.

    @xyzisinus
    xyzisinus committed Nov 17, 2017
    Configuration menu
    Copy the full SHA
    9f18890 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2017

  1. print instance launch time in local zone.

    @xyzisinus
    xyzisinus committed Nov 18, 2017
    Configuration menu
    Copy the full SHA
    7580354 View commit details
    Browse the repository at this point in the history

  2. Save the code of tag changing. Its mission is finished now the 

    feature of keeping vm after failure test has been implemented.
    @xyzisinus
    xyzisinus committed Nov 18, 2017
    Configuration menu
    Copy the full SHA
    27fe73b View commit details
    Browse the repository at this point in the history

  3. Add ability to KEEP_VM_AFTER_FAILURE.

    @xyzisinus
    xyzisinus committed Nov 18, 2017
    Configuration menu
    Copy the full SHA
    14251e9 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2017

  1. disable a testing statement in the ec2 tool.

    @xyzisinus
    xyzisinus committed Nov 27, 2017
    Configuration menu
    Copy the full SHA
    1b1ef28 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2017

  1. Move timeout report to the right place. add duration reporting.

    @xyzisinus
    xyzisinus committed Nov 29, 2017
    Configuration menu
    Copy the full SHA
    ebafb72 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2017

  1. temporarily commmit experimental file before moving its useful parts … 

    …into autodriver.
    @xyzisinus
    xyzisinus committed Dec 4, 2017
    Configuration menu
    Copy the full SHA
    39c02fc View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2017

  1. Add config for autodriver logging.

    @xyzisinus
    xyzisinus committed Dec 12, 2017
    Configuration menu
    Copy the full SHA
    c1de4c0 View commit details
    Browse the repository at this point in the history

  2. checkpoint before adding timestamp insersion into user output.

    @xyzisinus
    xyzisinus committed Dec 12, 2017
    Configuration menu
    Copy the full SHA
    a715788 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2017

  1. checkpoint. Add timekeeping thread. change printing macros.

    @xyzisinus
    xyzisinus committed Dec 18, 2017
    Configuration menu
    Copy the full SHA
    fb0d78b View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2017

  1. checkpoint. code complete but need to move file creation to parent proc.

    @xyzisinus
    xyzisinus committed Dec 22, 2017
    Configuration menu
    Copy the full SHA
    364ae40 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2018

  1. checkpoint autodriver, after file creation being moved to parent process

    @xyzisinus
    xyzisinus committed Jan 17, 2018
    Configuration menu
    Copy the full SHA
    3c0dd2f View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2018

  1. Cleanup in autodriver

    @xyzisinus
    xyzisinus committed Jan 23, 2018
    Configuration menu
    Copy the full SHA
    0cefe52 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2018

  1. audodriver should not exit for minor errors

    @xyzisinus
    xyzisinus committed Jan 24, 2018
    Configuration menu
    Copy the full SHA
    6f429ef View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2018

  1. Ready to be made into an image.

    @xyzisinus
    xyzisinus committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    95f8574 View commit details
    Browse the repository at this point in the history

  2. Add an output generator to help test autodriver.

    @xyzisinus
    xyzisinus committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    dc22fd5 View commit details
    Browse the repository at this point in the history

  3. Add pthread lib into build.

    @xyzisinus
    xyzisinus committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    4b1439a View commit details
    Browse the repository at this point in the history

  4. remove old experiment file.

    @xyzisinus
    xyzisinus committed Jan 26, 2018
    Configuration menu
    Copy the full SHA
    bd17429 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2018

  1. Add autodriver timestamp interval in tango config.

    @xyzisinus
    xyzisinus committed Jan 30, 2018
    Configuration menu
    Copy the full SHA
    daaa912 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2018

  1. Remove redundant wording in error messages.

    @xyzisinus
    xyzisinus committed Feb 1, 2018
    Configuration menu
    Copy the full SHA
    9812622 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2018

  1. chown output file to autograde. notify child thread job finish.

    @xyzisinus
    xyzisinus committed Feb 2, 2018
    Configuration menu
    Copy the full SHA
    7351917 View commit details
    Browse the repository at this point in the history

  2. Add new arguments for autodriver. Remove the confusing term autograder.

    @xyzisinus
    xyzisinus committed Feb 2, 2018
    Configuration menu
    Copy the full SHA
    1972a17 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2018

  1. Streamline logging in worker's important run() function.

    @xyzisinus
    xyzisinus committed Feb 9, 2018
    Configuration menu
    Copy the full SHA
    caac9b4 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2018

  1. worker's job exec (copyin/run/copyout) logic flow cleanup complete.

    @xyzisinus
    xyzisinus committed Feb 14, 2018
    Configuration menu
    Copy the full SHA
    c47d889 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2018

  1. jobs with big ids starve after job id wraps. Fix with a timestamp.

    @xyzisinus
    xyzisinus committed Feb 22, 2018
    Configuration menu
    Copy the full SHA
    9565275 View commit details
    Browse the repository at this point in the history

  2. Disable wrap-around of vm ids.

    @xyzisinus
    xyzisinus committed Feb 22, 2018
    Configuration menu
    Copy the full SHA
    c80a5d3 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2018

  1. Move timestamping into appendTrace function and use local time.

    @xyzisinus
    xyzisinus committed Feb 26, 2018
    Configuration menu
    Copy the full SHA
    6c03416 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2018

  1. Remove unused function descrementPoolSize

    @xyzisinus
    xyzisinus committed Feb 28, 2018
    Configuration menu
    Copy the full SHA
    b5730f3 View commit details
    Browse the repository at this point in the history

  2. Cleanup script and add ability to terminate aws instances.

    @xyzisinus
    xyzisinus committed Feb 28, 2018
    Configuration menu
    Copy the full SHA
    f8d3800 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2018

  1. Change boolean variable name to avoid the word "not".

    @xyzisinus
    xyzisinus committed Mar 12, 2018
    Configuration menu
    Copy the full SHA
    c4b98b2 View commit details
    Browse the repository at this point in the history

  2. Remove reference to aws auto scaling group, also fix a problem with t… 

    …he last commit.
    @xyzisinus
    xyzisinus committed Mar 12, 2018
    Configuration menu
    Copy the full SHA
    72c29d7 View commit details
    Browse the repository at this point in the history

  3. make autodriver config variables optional for backward compatibility.

    @xyzisinus
    xyzisinus committed Mar 12, 2018
    Configuration menu
    Copy the full SHA
    ae1751e View commit details
    Browse the repository at this point in the history

  4. Add missing config variable and comments.

    @xyzisinus
    xyzisinus committed Mar 12, 2018
    Configuration menu
    Copy the full SHA
    2c1eac8 View commit details
    Browse the repository at this point in the history

  5. Add a couple of git ignore files.

    @xyzisinus
    xyzisinus committed Mar 12, 2018
    Configuration menu
    Copy the full SHA
    c8fafd0 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2018

  1. Better comments for run_job scripts.

    @xyzisinus
    xyzisinus committed Mar 20, 2018
    Configuration menu
    Copy the full SHA
    fcc8777 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2018

  1. ec2Read can delete vms with name tag matching at the beginning or the… 

    … end.
    @xyzisinus
    xyzisinus committed Apr 9, 2018
    Configuration menu
    Copy the full SHA
    c58c87b View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2018

  1. more comments, isolate timestamp insertion for easy understanding of … 

    …code.
    @xyzisinus
    xyzisinus committed Apr 17, 2018
    Configuration menu
    Copy the full SHA
    70c1ed1 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2018

  1. Add info about the HostPort config variables.

    @xyzisinus
    xyzisinus committed Apr 18, 2018
    Configuration menu
    Copy the full SHA
    d27fb52 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2018

  1. Better error report in case of write failure.

    @xyzisinus
    xyzisinus committed Apr 24, 2018
    Configuration menu
    Copy the full SHA
    c2e1a61 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2018

  1. Change redis port name ec2Read to match the config variable.

    @xyzisinus
    xyzisinus committed Apr 26, 2018
    Configuration menu
    Copy the full SHA
    b880160 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2018

  1. Fix a buffer over-read problem in audodriver.c.

    @xyzisinus
    xyzisinus committed May 14, 2018
    Configuration menu
    Copy the full SHA
    c1aa0ce View commit details
    Browse the repository at this point in the history

  2. Tougher autodriver unit test -- random length long lines.

    @xyzisinus
    xyzisinus committed May 14, 2018
    Configuration menu
    Copy the full SHA
    7580ccf View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2018

  1. Add -l (list instances and pools) and -e (empty pools) to ec2Read.

    @xyzisinus
    xyzisinus committed Jun 12, 2018
    Configuration menu
    Copy the full SHA
    9c9b5e5 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2018

  1. First round of converting all ec2 code to using boto3

    @xyzisinus
    xyzisinus committed Jun 22, 2018
    Configuration menu
    Copy the full SHA
    4cd4f0a View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2018

  1. Clean up the tool that experiments on aws instances and tango vms.

    @xyzisinus
    xyzisinus committed Jun 29, 2018
    Configuration menu
    Copy the full SHA
    559f7aa View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2018

  1. Cleanup the ec2 tool script.

    @xyzisinus
    xyzisinus committed Jul 2, 2018
    Configuration menu
    Copy the full SHA
    9c1acfa View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2018

  1. ec2 tool script uses boto3 API consistent with Tango code.

    @xyzisinus
    xyzisinus committed Jul 5, 2018
    Configuration menu
    Copy the full SHA
    13f7363 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2018

  1. consolidate boto3 connection naming, make aws access id/key work agai… 

    …n and add tests.
    @xyzisinus
    xyzisinus committed Jul 9, 2018
    Configuration menu
    Copy the full SHA
    788ee1d View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2018

  1. Use boto3 resource API to process images for consistent use of boto3 … 

    …api.
    @xyzisinus
    xyzisinus committed Jul 10, 2018
    Configuration menu
    Copy the full SHA
    2b0ea16 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2018

  1. In detachVM, remove the replace_vm feature which allows a "bad" vm (os 

    error returned) to be replaced by creating a new one immediately.
However, it interferes with the "low water mark" feature that aims to
keep free vms below the water mark.  On the other hand, a destroyed vm
will be replaced anyway, when a new job comes in and needs a vm, given the
total vms are below the upper limit.  In such case, the job has to wait
a bit longer for the new vm's readiness, a small price to pay.
    @xyzisinus
    xyzisinus committed Jul 13, 2018
    Configuration menu
    Copy the full SHA
    ce3f9a4 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2018

  1. destroyVM doesn't return a value for ohter vmms modules. remove from … 

    …tashi.
    @xyzisinus
    xyzisinus committed Jul 16, 2018
    Configuration menu
    Copy the full SHA
    721d6c2 View commit details
    Browse the repository at this point in the history

  2. Rework exception catch for vmms/ec2 module.

    @xyzisinus
    xyzisinus committed Jul 16, 2018
    Configuration menu
    Copy the full SHA
    1ffa4ae View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2018

  1. reindent to use 4 spaces.

    @xyzisinus
    xyzisinus committed Jul 17, 2018
    Configuration menu
    Copy the full SHA
    2ba0f33 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2018

  1. Tell autolab web server Tango's timezone and offset from UTC.

    @xyzisinus
    xyzisinus committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    9028de0 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2018

  1. Add OVERRIDE_INST_TYPE to force the aws instance type when necessary.

    @xyzisinus
    xyzisinus committed Aug 6, 2018
    Configuration menu
    Copy the full SHA
    a068e15 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2018

  1. Add ability to create aws instance with specified instance type.

    @xyzisinus
    xyzisinus committed Aug 13, 2018
    Configuration menu
    Copy the full SHA
    da04503 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2018

  1. rework tango's reset code. It fails to remove existing vms on clean r… 

    …estart

(i.e. when redis is restarted, too).
    @xyzisinus
    xyzisinus committed Aug 16, 2018
    Configuration menu
    Copy the full SHA
    cdf8811 View commit details
    Browse the repository at this point in the history

  2. getVMs for ec2 should returns only vms that belongs to Tango (with pr… 

    …efix)
    @xyzisinus
    xyzisinus committed Aug 16, 2018
    Configuration menu
    Copy the full SHA
    d6ee44d View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. Rename TangoMachine's name property to pool. vmms/ec2 is done.

    @xyzisinus
    xyzisinus committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    fe00e97 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2018

  1. remove bad references to locations.

    @xyzisinus
    xyzisinus committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    f9e03c2 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2018

  1. log file copied from vm is now readable to all.

    @xyzisinus
    xyzisinus committed Aug 30, 2018
    Configuration menu
    Copy the full SHA
    88ac6e1 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2018

  1. Add script to check the health of Tango.

    @xyzisinus
    xyzisinus committed Nov 15, 2018
    Configuration menu
    Copy the full SHA
    77a26fa View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2018

  1. check in a working version of check_jobs

    @xyzisinus
    xyzisinus committed Nov 19, 2018
    Configuration menu
    Copy the full SHA
    09bca0a View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2018

  1. fix: timezone issue, default instance type not observed, undefined va… 

    …riable
    @xyzisinus
    xyzisinus committed Nov 20, 2018
    Configuration menu
    Copy the full SHA
    d24fdb4 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2019

  1. Fix check_jobs (cron job in production Autolab): comment its purpose, 

    report file writing failure, always write current trouble jobs into
file
    @xyzisinus
    xyzisinus committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    6b6de4c View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2019

  1. Add README for autodriver

    @xyzisinus
    xyzisinus committed Aug 20, 2019
    Configuration menu
    Copy the full SHA
    8f0ed66 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2019

  1. time.localtime().tm_isdst gives the correct answer to day light saving.

    @xyzisinus
    xyzisinus committed Sep 3, 2019
    Configuration menu
    Copy the full SHA
    7a18dbc View commit details
    Browse the repository at this point in the history

  2. Deal with exception inside exception handler of initializeVM. 

    Or all Tango jobs will be stuck in such cases.
    @xyzisinus
    xyzisinus committed Sep 3, 2019
    Configuration menu
    Copy the full SHA
    48568e9 View commit details
    Browse the repository at this point in the history

  3. Clean existing output files for those student jobs selected to run.

    @xyzisinus
    xyzisinus committed Sep 3, 2019
    Configuration menu
    Copy the full SHA
    0b1b344 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2019

  1. Commit changes to build/admin files.

    @xyzisinus
    xyzisinus committed Sep 9, 2019
    Configuration menu
    Copy the full SHA
    a49c447 View commit details
    Browse the repository at this point in the history

  2. remove the unusual redis port mapping from run_jobs config file.

    @xyzisinus
    xyzisinus committed Sep 9, 2019
    Configuration menu
    Copy the full SHA
    42fb51b View commit details
    Browse the repository at this point in the history

  3. Make redis port available outside the container

    @xyzisinus
    xyzisinus committed Sep 9, 2019
    Configuration menu
    Copy the full SHA
    ae2799f View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2019

  1. Swap the order of wating from pending to running and instance tagging.

    @xyzisinus
    xyzisinus committed Oct 8, 2019
    Configuration menu
    Copy the full SHA
    4e6c345 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2019

  1. Add timed cleanup for untagged stale vms. Add tests

    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    defb37f View commit details
    Browse the repository at this point in the history

  2. Use proper timezone to log instance launch time.

    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    3d60ae0 View commit details
    Browse the repository at this point in the history

  3. Add exception handling to cleanup function.

    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    50f31a5 View commit details
    Browse the repository at this point in the history

  4. Add python pytz package.

    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    870757f View commit details
    Browse the repository at this point in the history

  5. Manually start the cleanup function from test script.

    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    fc2dec6 View commit details
    Browse the repository at this point in the history

  6. ec2SSH is activated from multiple tango services, probably unnecessar… 

    …ily.

But the timed cleanup shouldn't run in each of them.  Now it only runs
in jobManager.
    @xyzisinus
    xyzisinus committed Oct 9, 2019
    Configuration menu
    Copy the full SHA
    0ba4bae View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2019

  1. Remove tool's reference to redis and close redis's open door

    @xyzisinus
    xyzisinus committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    d406a13 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2019

  1. dump the content of an email in 2018 in a file.

    @xyzisinus
    xyzisinus committed Nov 9, 2019
    Configuration menu
    Copy the full SHA
    96c9830 View commit details
    Browse the repository at this point in the history

  2. Add the timestamp in the "major fixes" file.

    @xyzisinus
    xyzisinus committed Nov 9, 2019
    Configuration menu
    Copy the full SHA
    a0a7434 View commit details
    Browse the repository at this point in the history