Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

modules/zstd: Add ZstdDecoder top level proc #1315

Merged
merged 5 commits into from
Aug 16, 2024
Merged

modules/zstd: Add ZstdDecoder top level proc #1315

merged 5 commits into from
Aug 16, 2024

Commits on Aug 12, 2024

  1. dependency_support: Remove net_zstd 

    net_zstd dependency is not referenced anywhere in XLS.
It was introduced as a transitive dependency of fuzztest.
In fuzztest workspace net_zstd is also a transitive dependency of riegel.
Riegel version used in fuzztest bazel workspace is WORKSPACE-based so transitive dependencies must be defined in workspaces that use that version of riegel.
XLS however uses newer, bzlmod-based version of riegel which does not require that.
That means there is no need for @net_zstd dependency in XLS workspace and it can be removed.

Signed-off-by: Pawel Czarnecki <pczarnecki@antmicro.com>
    @lpawelcz
    lpawelcz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    9af92d4 View commit details
    Browse the repository at this point in the history

  2. dependency_support: Reintroduce com_github_facebook_zstd 

    This dependency was unnecessarily removed in google@5b16a18.
It is required for testing the ZSTD Decoder

Signed-off-by: Pawel Czarnecki <pczarnecki@antmicro.com>
    @lpawelcz
    lpawelcz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    42c7ff4 View commit details
    Browse the repository at this point in the history

  3. dependency_support: rename com_github_facebook -> zstd 

    Signed-off-by: Pawel Czarnecki <pczarnecki@antmicro.com>
    @lpawelcz
    lpawelcz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    db9adc3 View commit details
    Browse the repository at this point in the history

  4. dependency_support: bump zstd version to fdfb2aff 

    Signed-off-by: Pawel Czarnecki <pczarnecki@antmicro.com>
    @lpawelcz
    lpawelcz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    347e8db View commit details
    Browse the repository at this point in the history

  5. modules: Add ZSTD Decoder module 

    This commit adds an initial implementation of the ZSTD Decoder.
It is capable of decoding simple ZSTD frames containing raw and rle
blocks.

This is a squashed commit that was created from the following changes:

modules/zstd: Add buffer library
modules/zstd: Add Buffer use-case example
modules/zstd: Add library for parsing magic number
modules/zstd: Add library for parsing frame header
dependency_support/libzstd: Make zstd_errors.h public
dependency_support: Add decodecorpus binary
modules/zstd: Add data generator library
modules/zstd: Add zstd frame header tests
modules/zstd: Add common zstd definitions
modules/zstd: Add raw block decoder
modules/zstd: Add rle block decoder
modules/zstd: Add block header parsing library
modules/zstd: Add SequenceExecutorPacket to common definitions
modules/zstd: Add block data muxer library
modules/zstd: Add block demuxer library
modules/zstd: Add block decoder module
modules/zstd/common: Specify decoder output format
examples/ram: Export internal RAM API to other modules
modules/zstd: Add Offset type to common zstd definitions
modules/zstd: Add RamPrinter Proc
modules/zstd: Add SequenceExecutor Proc
modules/zstd: Add repacketizer
modules/zstd: Add ZSTD decoder
modules/zstd: Add ZSTD Decoder documentation
CI: Add custom ZSTD module workflow

Co-authored-by: Maciej Dudek <mdudek@antmicro.com>
Co-authored-by: Pawel Czarnecki <pczarnecki@antmicro.com>
Co-authored-by: Robert Winkler <rwinkler@antmicro.com>
Co-authored-by: Roman Dobrodii <rdobrodii@antmicro.com>
Internal-tag: [#52186]
Signed-off-by: Maciej Dudek <mdudek@antmicro.com>
Signed-off-by: Pawel Czarnecki <pczarnecki@antmicro.com>
Signed-off-by: Robert Winkler <rwinkler@antmicro.com>
Signed-off-by: Roman Dobrodii <rdobrodii@antmicro.com>
    @lpawelcz @mtdudek
    @rw1nkler @rdob-ant
    4 people committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    76e650a View commit details
    Browse the repository at this point in the history