Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Too many disk writes #1095

Open
deemru opened this issue May 15, 2018 · 5 comments
Open

Too many disk writes #1095

deemru opened this issue May 15, 2018 · 5 comments
Assignees

Comments

@deemru
Copy link
Member

deemru commented May 15, 2018

Running node on the mainnet. For ~20 days got ~800 GiB of disk writes.

This doesn`t look rationally as a whole database just ~16 GiB in size. Raw blockchain in sqlite takes ~5 GiB.

leveldb-cache-size does not change anything.

Is it cause by checkpoints or what?

Can we tune disk writes somehow?

@phearnot
Copy link
Member

Could you please tell me how you've measured the amount of data that's been written? We haven't noticed any excessive disk usage on our servers (running either testnet or mainnet nodes), but I'm willing to look into this.

@deemru
Copy link
Member Author

deemru commented May 25, 2018

  • Windows 10 x64
  • java version "1.8.0_162"
  • java -Dwaves.directory=%BASEDIR%waves -server -Xms512m -Xmx4096m -jar waves.jar waves.conf
  • run for few days then check java process writes

Today is 1 month of running node, check my stats (not all values look accurate, but i am checking disk SMART too, write values seem fair):

image

@phearnot
Copy link
Member

phearnot commented Jun 7, 2018

Okay, so I can confirm this. Because of how LevelDB works, the amount of data written to disk exceeds blockchain (and state) size. There's a way to work around this, but it will take some time to implement. Thanks for your report!

@z642d
Copy link

z642d commented Apr 20, 2019

There's a way to work around this, but it will take some time to implement.

Is there any solution for this issue? Can we config leveldb to reduce disk writes?
Node kills SSD drive so fast

@Karasiq
Copy link
Contributor

Karasiq commented Apr 24, 2019

@phearnot

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants