Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for new matmul1d op with gather_in0 #14964

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open

Support for new matmul1d op with gather_in0 #14964

wants to merge 18 commits into from
+1,217 −15

Commits on Nov 26, 2024

  1. #0: Add a basic pytest.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    342885f View commit details
    Browse the repository at this point in the history

  2. #0: Add code path for gather_in0 flag in matmul 1d.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    60c1917 View commit details
    Browse the repository at this point in the history

  3. #0: Add new host code / kernels for matmul1d with gather_in0.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    f423ead View commit details
    Browse the repository at this point in the history

  4. #0: Add another CB for inputs to avoid workaround when using .set_glo… 

    …bally_allocated address.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    69e618a View commit details
    Browse the repository at this point in the history

  5. #0: Add support for matmul to be performed on arbitrary cores. Next s… 

    …tep: choose the correct NOC based on which core is next in the ring. Also, clean up the test.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    30021e2 View commit details
    Browse the repository at this point in the history

  6. #0: WIP debugging cb corruption issue.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    f0639c4 View commit details
    Browse the repository at this point in the history

  7. #0: Fix PCC issue when out_block_w > 4.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    a58f6e2 View commit details
    Browse the repository at this point in the history

  8. #0: Add fix to enable the use of subblock w > 4 when applicable, to g… 

    …et a perf boost.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d8a619b View commit details
    Browse the repository at this point in the history

  9. #0: Add support for the dynamic noc.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    742bc4e View commit details
    Browse the repository at this point in the history

  10. Clean up and add more validation. Remove unused/unsupported functiona… 

    …lity such as fuse_op and bias. TODO: test batch.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    b8913c4 View commit details
    Browse the repository at this point in the history

  11. Add support for fuse_batch shapes in the pytest.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    3aab485 View commit details
    Browse the repository at this point in the history

  12. Add more test cases for fused activation and other shapes.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    0afac94 View commit details
    Browse the repository at this point in the history

  13. Enable the full_dst_sync_en flag in the computer kernel config.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    1400086 View commit details
    Browse the repository at this point in the history

  14. Remove unnecessary code from bmm kernel, and add validation to make s… 

    …ure they are not being used.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d0d239d View commit details
    Browse the repository at this point in the history

  15. Fix get_preferred_noc function. Validate perf on TG for prefetcher co… 

    …re grid configuration.
    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    baa7ebd View commit details
    Browse the repository at this point in the history

  16. Add testing for program caching and relu activation.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    979168e View commit details
    Browse the repository at this point in the history

  17. Rebase and add tests for larger shapes.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    03647bd View commit details
    Browse the repository at this point in the history

  18. WIP testing support for GS.

    @avoraTT
    avoraTT committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    584c83f View commit details
    Browse the repository at this point in the history