Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature] retrieve the batch periodically #144

Open
dawadam opened this issue Jun 19, 2023 · 2 comments
Open

[feature] retrieve the batch periodically #144

dawadam opened this issue Jun 19, 2023 · 2 comments

Comments

@dawadam
Copy link

dawadam commented Jun 19, 2023

I need to fetch the 1 minute data over a large period.
Under nodeJS, the recovery will be done with a large storage in RAM which will be a problem for me.
Is there a way to retrieve the batch periodically?
Or after each download request?
With a callback function or something like this.

@Leo4815162342
Copy link
Owner

for downloading large volumes of data, I'd recommend doing it via CLI interface.

CLI it does not consume a lot of memory, and outputs data directly to disk periodically

@dawadam
Copy link
Author

dawadam commented Jun 19, 2023

OK I understand.
But that's not practical for my use case.
I can't use CLI, I must use it in nodejs programme, for dynamic interaction.

It would suffice to add a sending mecanisme, per uploaded file or per batch of uploaded files and it would work.
For example an event triggered at each new generation of batches of candles or a callback function.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants