Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Add OpenPMD support #1050

Open
wants to merge 94 commits into
base: develop
Choose a base branch
from
Open

WIP: Add OpenPMD support #1050

wants to merge 94 commits into from

Commits on Jan 8, 2024

  1. Add OpenPMD as external lib

    @pgrete
    pgrete committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    49027c7 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. Add OpenPMD skeleto

    @pgrete
    pgrete committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    4525e86 View commit details
    Browse the repository at this point in the history

  2. WIP more Open PMD

    @pgrete
    pgrete committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    4de250c View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. WIP OpenPMD use file id

    @pgrete
    pgrete committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    b906af7 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    108fc7a View commit details
    Browse the repository at this point in the history

  2. Write blocks

    @pgrete
    pgrete committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    79660a2 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    372b585 View commit details
    Browse the repository at this point in the history

  2. Centralize getting var info for output

    @pgrete
    pgrete committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    8d40c91 View commit details
    Browse the repository at this point in the history

  3. WIP openpmd, chunks don't work yet plus check dimensionality

    @pgrete
    pgrete committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    4f20c26 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    4dde705 View commit details
    Browse the repository at this point in the history

  2. Fix chunk extents

    @pgrete
    pgrete committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    f29e8d1 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Write Attributes

    @pgrete
    pgrete committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    a501a5d View commit details
    Browse the repository at this point in the history

  2. Rename restart to restart_hdf5

    @pgrete
    pgrete committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    c0be75c View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. WIP abstract RestartReader

    @pgrete
    pgrete committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    7f03528 View commit details
    Browse the repository at this point in the history

  2. WIP separating RestartReader

    @pgrete
    pgrete committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    56795f2 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Make RestartReader abstract

    @pgrete
    pgrete committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    8587303 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Merge branch 'pgrete/refactor-restart' into pgrete/pmd-output

    @pgrete
    pgrete committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    8bf955b View commit details
    Browse the repository at this point in the history

  2. Add OpenPMD restart skeleton

    @pgrete
    pgrete committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    e3ea8d7 View commit details
    Browse the repository at this point in the history

  3. WIP updating loc logic

    @pgrete
    pgrete committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    33b6261 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    788118c View commit details
    Browse the repository at this point in the history

  2. Fix interface from recent changes in develop

    @pgrete
    pgrete committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    62e54da View commit details
    Browse the repository at this point in the history

  3. Read and Write loc

    @pgrete
    pgrete committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    6309663 View commit details
    Browse the repository at this point in the history

  4. Houston, we have a build

    @pgrete
    pgrete committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    7224f42 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Added OpenPMD restart ReadBlocks

    @pgrete
    pgrete committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    ae1f241 View commit details
    Browse the repository at this point in the history

  2. Fix loc level

    @pgrete
    pgrete committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    19863d7 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Make Series persistent and fix rootlevel typo

    @pgrete
    pgrete committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    e2b2bd1 View commit details
    Browse the repository at this point in the history

  2. WIP Read/Write Params

    @pgrete
    pgrete committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    f9373e8 View commit details
    Browse the repository at this point in the history

  3. Make ReadParams private member

    @pgrete
    pgrete committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    96a3f4c View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    61306a0 View commit details
    Browse the repository at this point in the history

  2. Fix root level in output

    @pgrete
    pgrete committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    56976a8 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Move to mesh per record standard for writing

    @pgrete
    pgrete committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    6199843 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    9fb9f68 View commit details
    Browse the repository at this point in the history

  3. Allow for 2D and 3D output. Fix single dataset reset.

    @pgrete
    pgrete committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    684b7ab View commit details
    Browse the repository at this point in the history

  4. Fix logical loc

    @pgrete
    pgrete committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    251c6ea View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Rename opmd files

    @pgrete
    pgrete committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    03f80c7 View commit details
    Browse the repository at this point in the history

  2. Separate common calls to chunks and names

    @pgrete
    pgrete committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    890fffe View commit details
    Browse the repository at this point in the history

  3. Reuse shared chunk and name for restarts

    @pgrete
    pgrete committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    04359d3 View commit details
    Browse the repository at this point in the history

  4. Add regression test

    @pgrete
    pgrete committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    2b89659 View commit details
    Browse the repository at this point in the history

  5. Somewhat make restarts working

    @pgrete
    pgrete committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    804e60d View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Fix order of arguments for correct flush

    @pgrete
    pgrete committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    a436f55 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    6a3a80d View commit details
    Browse the repository at this point in the history

  3. Fix handling of output variable names

    @pgrete
    pgrete committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    28d725d View commit details
    Browse the repository at this point in the history

  4. Fix reading chunks for sparsely populated output files

    @pgrete
    pgrete committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    a039ea1 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    ae8519f View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Dont tell anyone I spent days on this...

    @pgrete
    pgrete committed May 3, 2024
    Configuration menu
    Copy the full SHA
    7476641 View commit details
    Browse the repository at this point in the history

  2. Temp disable dumping Views from device

    @pgrete
    pgrete committed May 3, 2024
    Configuration menu
    Copy the full SHA
    39d4b99 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed May 22, 2024
    Configuration menu
    Copy the full SHA
    d2ba882 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'pgrete/fix-hasghost-restart' into pgrete/pmd-output

    @pgrete
    pgrete committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    626303d View commit details
    Browse the repository at this point in the history

  2. Dump deref cnt in opmd restart

    @pgrete
    pgrete committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    4241198 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @BenWibking
    BenWibking authored Jun 18, 2024
    Configuration menu
    Copy the full SHA
    101ebf2 View commit details
    Browse the repository at this point in the history

  2. install openpmd in macOS CI

    @BenWibking
    BenWibking committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    60a38b2 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @BenWibking
    BenWibking authored Jun 21, 2024
    Configuration menu
    Copy the full SHA
    461eeaa View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    cd007d3 View commit details
    Browse the repository at this point in the history

  2. Remove extraneous popRegion

    @pgrete
    pgrete committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    28020db View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    5324e00 View commit details
    Browse the repository at this point in the history

  2. Fix formatting

    @pgrete
    pgrete committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    af4b966 View commit details
    Browse the repository at this point in the history

  3. Make format clang16 compatible

    @pgrete
    pgrete committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    0e015d1 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Fix default backend_config parsing

    @pgrete
    pgrete committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    5135aea View commit details
    Browse the repository at this point in the history

  2. another attempt

    @pgrete
    pgrete committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    b344291 View commit details
    Browse the repository at this point in the history

  3. Bump OpenPMD version

    @pgrete
    pgrete committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    7486915 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. pmd: Write scalar particle data

    @pgrete
    pgrete committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    0e3f758 View commit details
    Browse the repository at this point in the history

  2. Code dedup

    @pgrete
    pgrete committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    e39ef61 View commit details
    Browse the repository at this point in the history

  3. Allow writing non-scalar particles

    @pgrete
    pgrete committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    b938511 View commit details
    Browse the repository at this point in the history

  4. Make positions standard compliant

    @pgrete
    pgrete committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    08d6b41 View commit details
    Browse the repository at this point in the history

  5. Allow for particles restarts (serial works)

    @pgrete
    pgrete committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    bf74c7e View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Support particle restarts in parallel

    @pgrete
    pgrete committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    3b37c26 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    0ca5b6f View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b30788a View commit details
    Browse the repository at this point in the history

  2. Add now prefix to pmd outputs

    @pgrete
    pgrete committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    5f95466 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Make linter happy

    @pgrete
    pgrete committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    6811594 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge remote-tracking branch 'origin/develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    c0d7f11 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Bump OPMD version and add delim

    @pgrete
    pgrete committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    b2d7525 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    f229274 View commit details
    Browse the repository at this point in the history

  2. Change delim. Is this stupid?

    @pgrete
    pgrete committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    3283635 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    d59d573 View commit details
    Browse the repository at this point in the history

  2. Make params IO test more flexible

    @pgrete
    pgrete committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    3f95fc4 View commit details
    Browse the repository at this point in the history

  3. Add test case for opmd params IO

    @pgrete
    pgrete committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    1141ff3 View commit details
    Browse the repository at this point in the history

  4. Reading/writing non-ParArray Params works

    @pgrete
    pgrete committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    e6e4d0b View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Allow writing ParArray and Views to Params

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    8230f94 View commit details
    Browse the repository at this point in the history

  2. Read ParArray/View from opmd raw

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e64ae7e View commit details
    Browse the repository at this point in the history

  3. Make basic parsing of Params work

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b789711 View commit details
    Browse the repository at this point in the history

  4. Restore view from opmd params

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    466ecd2 View commit details
    Browse the repository at this point in the history

  5. Fix manual pararray reading

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3aa4c78 View commit details
    Browse the repository at this point in the history

  6. Make linter happy?

    @pgrete
    pgrete committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4c1c70f View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Make restoring HostViews possible

    @pgrete
    pgrete committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    8a1850b View commit details
    Browse the repository at this point in the history

  2. Make reading host arrays work using the direct interface in the unit … 

    …test
    @pgrete
    pgrete committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    1f02ffa View commit details
    Browse the repository at this point in the history

  3. Expands types for read/write to all vec

    @pgrete
    pgrete committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    d6565c5 View commit details
    Browse the repository at this point in the history

  4. Remove debug info

    @pgrete
    pgrete committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    6065213 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @BenWibking
    BenWibking authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    4bf6a92 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    e67f589 View commit details
    Browse the repository at this point in the history

  2. Fix bc interface from PR 1177

    @pgrete
    pgrete committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    503a5b6 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @BenWibking
    BenWibking authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    d064f03 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2024

  1. Merge branch 'develop' into pgrete/pmd-output

    @pgrete
    pgrete committed Nov 29, 2024
    Configuration menu
    Copy the full SHA
    dfbcb27 View commit details
    Browse the repository at this point in the history

  2. Fix output numbering for triggered opmd outputs

    @pgrete
    pgrete committed Nov 29, 2024
    Configuration menu
    Copy the full SHA
    4769a63 View commit details
    Browse the repository at this point in the history