Skip to content
This repository has been archived by the owner on Dec 13, 2022. It is now read-only.

fix import find gap querying limit #33

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

williamchong
Copy link
Contributor

cassandra-drive has a limit of 5000 result per query, so only first 5000 block would be returned
https://github.com/datastax/nodejs-driver#paging

@hlolli
Copy link
Contributor

hlolli commented Feb 20, 2022

Could be, as it's a defer'd sequence, it will paginate until the end, otoh, this doctor namespace, wasn't entierly production ready, not sure it's even used atm.

)(blockQ.rows as { block_height: CassandraTypes.Long }[]);
if (findResult < 0) {
missingHeights.push(height);
for (const subHeightGroup of queryHeightSubGroups) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hats off for using Ramda functions!

could we use for-await here and have the pagination be done automatically, just thinking.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure will come back to this when I have some spare time...

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants