Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Requirement: Conversion tools must perform conversion from MiniSEED 2 without loss of important information #7

Open
krischer opened this issue Jan 3, 2018 · 12 comments

Comments

@krischer
Copy link
Contributor

krischer commented Jan 3, 2018

Conversion tools developed for the new format must perform conversion from miniSEED2 without loss of important information. (although it is preferred that a full miniSEED2 to NGF conversion and then back to miniSEED2 cycle should be possible without loss of information, this is generally not feasible so is not a basic requirement). The loss of information that will arise from conversions for a candidate NGF must be clearly described and agreed by FDSN (which ultimately defines ‘important’).

@chad-earthscope
Copy link
Member

chad-earthscope commented Jan 5, 2018

Being able to convert from miniSEED .2x will no or minimal loss is a very important requirement.

Through the previous discussions and evaluations here is what appears to me to be acceptable loss, i.e. fields/structures lost when converting from miniSEED 2:

  • Beam related blockettes (400 & 405). [Personally I know of none in any archives]
  • Blockette 2000. [Personally I know of none in any archives]
  • Different "clock model" designations if multiple blockette 500s are in a single record.

Edit: Additionally, the flags identified in this comment on #23.

Furthermore, I support two fields required in miniSEED 2.x to be optionally retained during conversion:

  • Sequence number
  • Data header & quality indicator

@tim-iris
Copy link

Based on previous input I think this is essential. Solutions must be lossless when moving from the old to the new format. Thought should be given if networks transcribe their data to the new format however as to is the information really needed in their opinion.

@krischer
Copy link
Contributor Author

Summary

(Please let me know if I missed a point or misunderstood something)

Please vote on the following issues:

  1. Is data-loss acceptable at all? (Yes/No) - all other points will not be valid anymore if this is a "no".
  2. Is it acceptable to loose information regarding the Beam related blockettes (400 & 405)? (Yes/No)
  3. Is it acceptable to loose information for Blockette 2000? (Yes/No)
  4. Is it acceptable to loose different "clock model" designations if multiple blockette 500s are in a single record? (Yes/No)
  5. Is it acceptable if the "Sequence number" field in miniSEED 2.x is only optionally retained? (Yes/No)
  6. Is it acceptable if the "Data header & quality indicator" field in miniSEED 2.x is only optionally retained? (Yes/No)

@crotwell
Copy link

1 Yes
2 Yes
3 Yes
4 Yes
5 Yes
6 Yes

@chad-earthscope
Copy link
Member

  1. Yes.
  2. Yes, unused as far we know.
  3. Yes, as long as any usage of it can stay in miniSEED 2.x format or be mapped to optional headers.
  4. Yes.
  5. Yes.
  6. Yes.

@kaestli
Copy link

kaestli commented Jan 30, 2018

1 Yes
2 Yes
3 Yes
4 Yes
5 Yes
6 Yes

@ozym
Copy link

ozym commented Jan 30, 2018

  1. Yes
  2. Yes
  3. Yes
  4. Yes
  5. Yes
  6. Yes

@claudiodsf
Copy link

  1. Is data-loss acceptable at all? (Yes/No) - all other points will not be valid anymore if this is a "no".

Yes

  1. Is it acceptable to loose information regarding the Beam related blockettes (400 & 405)? (Yes/No)

Yes

  1. Is it acceptable to loose information for Blockette 2000? (Yes/No)

Yes

  1. Is it acceptable to loose different "clock model" designations if multiple blockette 500s are in a single record? (Yes/No)

Yes. But this information should be transferred to metadata.

  1. Is it acceptable if the "Sequence number" field in miniSEED 2.x is only optionally retained? (Yes/No)

Yes

  1. Is it acceptable if the "Data header & quality indicator" field in miniSEED 2.x is only optionally retained? (Yes/No)

No. It should be mandatory. Moving this to metadata would produce too much complexity (a new metadata period every time the quality flag changes)

@chad-earthscope
Copy link
Member

No. It should be mandatory. Moving this to metadata would produce too much complexity (a new metadata period every time the quality flag changes)

To clarify, I do not believe this implied moving the D, R, Q, M value to metadata, but instead to make it optional within the time series data format.

@ihenson-bsl
Copy link

1 Yes
2 Yes
3 Yes
4 Yes
5 Yes
6 Yes

@ValleeMartin
Copy link

1 Yes
2 Yes
3 Yes
4 Yes
5 Yes
6 No

@JoseAntonioJara
Copy link

  1. Yes
  2. Yes
  3. Yes
  4. Yes
  5. Yes
  6. Yes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants