Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory management: swap+pool #412

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

Commits on Aug 13, 2018

  1. Configuration menu
    Copy the full SHA
    e7f695d View commit details
    Browse the repository at this point in the history
  2. align train.py with vc12

    junzhezhang committed Aug 13, 2018
    Configuration menu
    Copy the full SHA
    2cc6ba4 View commit details
    Browse the repository at this point in the history
  3. revert back train.py

    junzhezhang committed Aug 13, 2018
    Configuration menu
    Copy the full SHA
    611ad3c View commit details
    Browse the repository at this point in the history
  4. revert back train.py

    junzhezhang committed Aug 13, 2018
    Configuration menu
    Copy the full SHA
    9974d5d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7309dc0 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    25fe79d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    fecf34f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c07dcc6 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    8dae4d8 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2018

  1. correct swap_select()

    junzhezhang committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    572fe4d View commit details
    Browse the repository at this point in the history
  2. correct swap_select()

    junzhezhang committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    d2027a9 View commit details
    Browse the repository at this point in the history
  3. enable swap_plan()

    junzhezhang committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    9d84cfc View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2018

  1. documentation

    delay swap_plan() by 3 more iterations
    
    update train
    
    correct swap_sched(), swap_select(),swap_plan()
    
    correct load update in swap_select
    
    vec_run changed to new 3 iterations
    
    correct vec_run36 index issue
    
    correct overhead issue, verify vec_run.t
    
    vec_run duplicate to avoid sorting issue
    junzhezhang committed Aug 29, 2018
    Configuration menu
    Copy the full SHA
    ed73c3a View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2018

  1. impl swap_construct_tables(), swap_update_tables(), DeploySwap()

    verified itm 5 indices in Table_sched
    
    vec_swap_select pass by reference in swap_sched()
    
    impl swap_update_tables(), before DeploySwap(), both at Append()
    
    for time being, remove negative r_idx itms && git push origin vd1
    
    handle last itr by impl sizeSqn and verification to change asyncSwapFlag back to 0
    junzhezhang committed Aug 30, 2018
    Configuration menu
    Copy the full SHA
    650a4e6 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2018

  1. Configuration menu
    Copy the full SHA
    479ad2a View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2018

  1. cross iteration swap, last iteration, milestone

    correct swap_construct_tables(), included negative r_idx for swap_update_tables() and DeploySwap()
    
    include negative r_idx for DeploySwap()
    
    impl GetRealGpuPtr() to swapIn nullptr Block at last iteration
    
    impl GetRealGpuPtr(), and optimize data() and mutable_data()
    
    impl GetRealGpuPtr(), and optimize data() and mutable_data()
    
    verify const issue
    
    change to return tempData instead of updating data_
    
    without remove erasing in Table_not_at_device
    
    milestone of last itr, at 550 MB
    junzhezhang committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    383fffe View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2018

  1. vd2: swap+pool

    new class of pool: SwapPool
    important APIs: PoolOpt(), Malloc(), Free()
    PoolOpt() takes in M/F sequences including those induced by swapping
    cross-iteration variables and last iteration case solved.
    
    record down MF after swap done, for one iteration
    junzhezhang committed Sep 19, 2018
    Configuration menu
    Copy the full SHA
    2fb3f02 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2018

  1. add documentation

    junzhezhang committed Nov 19, 2018
    Configuration menu
    Copy the full SHA
    0f3722d View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2019

  1. Configuration menu
    Copy the full SHA
    8e8a7e1 View commit details
    Browse the repository at this point in the history