Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added Support for Multiple GPU Training through PyTorch Distributed Data Parallel (PyTorch DDP) #22

Merged
merged 44 commits into from
Jan 2, 2024
Merged

Added Support for Multiple GPU Training through PyTorch Distributed Data Parallel (PyTorch DDP) #22

merged 44 commits into from
Jan 2, 2024

Commits on Dec 30, 2023

  1. Attempt 1

    @iSiddharth20
    iSiddharth20 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    e6b7cd0 View commit details
    Browse the repository at this point in the history

  2. Added Debugging Statements

    @iSiddharth20
    iSiddharth20 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    3120b72 View commit details
    Browse the repository at this point in the history

  3. Added Shell Script to Run Code with Environment Variables

    @iSiddharth20
    iSiddharth20 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    c61efb4 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. Changes Shell Script to Set Env Variables

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    a6911cd View commit details
    Browse the repository at this point in the history

  2. Added 'rank' as parameter in Main

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    e668d49 View commit details
    Browse the repository at this point in the history

  3. Updated Model Saving for Device Rank=0

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    6a6045c View commit details
    Browse the repository at this point in the history

  4. Removed Unnecessary Script

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    ba83015 View commit details
    Browse the repository at this point in the history

  5. Reduced File Size for Testing

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    606e297 View commit details
    Browse the repository at this point in the history

  6. Attempt 2

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    adb2e18 View commit details
    Browse the repository at this point in the history

  7. Attempt 3

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    92c7c27 View commit details
    Browse the repository at this point in the history

  8. Removed Redundant Print Statements

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    49a673f View commit details
    Browse the repository at this point in the history

  9. Removed Debugging Statements

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    ff6fc09 View commit details
    Browse the repository at this point in the history

  10. Removed Debugging Statement

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    d7ddb3a View commit details
    Browse the repository at this point in the history

  11. Fized Issue with find_unused_parameters in DDIP

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    4100196 View commit details
    Browse the repository at this point in the history

  12. Removed Debugging Statements

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    9a0b5a0 View commit details
    Browse the repository at this point in the history

  13. Removed Warnings from being printed on Terminal

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    47ec6ed View commit details
    Browse the repository at this point in the history

  14. Changed Warning Printing Mechanish

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    06f9df7 View commit details
    Browse the repository at this point in the history

  15. Atempt to Hide UserWarnings from Console

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    d82c400 View commit details
    Browse the repository at this point in the history

  16. Fixed Parameters in Trainer Initializations

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    83f9a26 View commit details
    Browse the repository at this point in the history

  17. Fixed UserWarning for

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    54e8e38 View commit details
    Browse the repository at this point in the history

  18. Added Env Variables in Script

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    fa8e299 View commit details
    Browse the repository at this point in the history

  19. Updated UserWarnings

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    f916602 View commit details
    Browse the repository at this point in the history

  20. Fixed UserWarnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    aad8403 View commit details
    Browse the repository at this point in the history

  21. Fixed UserWarnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    fa5c7f2 View commit details
    Browse the repository at this point in the history

  22. Fixed UserWarnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    10fd12b View commit details
    Browse the repository at this point in the history

  23. Fixed UserWarnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    fc0fa76 View commit details
    Browse the repository at this point in the history

  24. Fixed UserWarnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    455b6ee View commit details
    Browse the repository at this point in the history

  25. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    b86d3a4 View commit details
    Browse the repository at this point in the history

  26. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    6015b6f View commit details
    Browse the repository at this point in the history

  27. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    c9e4d9d View commit details
    Browse the repository at this point in the history

  28. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    1034b23 View commit details
    Browse the repository at this point in the history

  29. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    cb5b55d View commit details
    Browse the repository at this point in the history

  30. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    e0a707c View commit details
    Browse the repository at this point in the history

  31. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    6cb35b4 View commit details
    Browse the repository at this point in the history

  32. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    ea3bc39 View commit details
    Browse the repository at this point in the history

  33. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    254c126 View commit details
    Browse the repository at this point in the history

  34. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    598e364 View commit details
    Browse the repository at this point in the history

  35. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    8f1156d View commit details
    Browse the repository at this point in the history

  36. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    cac3c48 View commit details
    Browse the repository at this point in the history

  37. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    5529513 View commit details
    Browse the repository at this point in the history

  38. Fixed Warnings for find_unused_parameters

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    2901804 View commit details
    Browse the repository at this point in the history

  39. Run : python main.py 2>/dev/null

    @iSiddharth20
    iSiddharth20 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    5f28ffa View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. Changes AutoEncoder Hidden Layers

    @iSiddharth20
    iSiddharth20 committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    70742a1 View commit details
    Browse the repository at this point in the history

  2. Added Platform Check for init_process_group backend parameter initial… 

    …ization
    @iSiddharth20
    iSiddharth20 committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    290f3a7 View commit details
    Browse the repository at this point in the history