From c1c7a42d2a5fdae8ea33b5b2ded229f6f9efd855 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Dani=C3=ABl=20van=20Eeden?= Date: Thu, 14 Oct 2021 10:29:19 +0200 Subject: [PATCH 1/2] dumpling: add a note about compression --- dumpling-overview.md | 1 + 1 file changed, 1 insertion(+) diff --git a/dumpling-overview.md b/dumpling-overview.md index 45fc27956f8a7..f3b814da871a9 100644 --- a/dumpling-overview.md +++ b/dumpling-overview.md @@ -253,6 +253,7 @@ The exported file is stored in the `./export-` directory by - The `t` option specifies the number of threads for the export. Increasing the number of threads improves the concurrency of Dumpling and the export speed, and also increases the database's memory consumption. Therefore, it is not recommended to set the number too large. - The `-r` option specifies the maximum number of records (or the number of rows in the database) for a single file. When it is enabled, Dumpling enables concurrency in the table to improve the speed of exporting large tables. +- The `--compress gzip` option can be used to compress the dump. This can help to speed up dumping of data if storage is the bottleneck or if storage capacity is a concern. The drawback of this is an increase in CPU usage. With the above options specified, Dumpling can have a quicker speed of data export. From 8d313735b70a73a10275d0cc1879626bd03e25e8 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Dani=C3=ABl=20van=20Eeden?= Date: Mon, 1 Nov 2021 15:47:34 +0100 Subject: [PATCH 2/2] Update based on review --- dumpling-overview.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dumpling-overview.md b/dumpling-overview.md index f3b814da871a9..b732c230033f1 100644 --- a/dumpling-overview.md +++ b/dumpling-overview.md @@ -253,7 +253,7 @@ The exported file is stored in the `./export-` directory by - The `t` option specifies the number of threads for the export. Increasing the number of threads improves the concurrency of Dumpling and the export speed, and also increases the database's memory consumption. Therefore, it is not recommended to set the number too large. - The `-r` option specifies the maximum number of records (or the number of rows in the database) for a single file. When it is enabled, Dumpling enables concurrency in the table to improve the speed of exporting large tables. -- The `--compress gzip` option can be used to compress the dump. This can help to speed up dumping of data if storage is the bottleneck or if storage capacity is a concern. The drawback of this is an increase in CPU usage. +- The `--compress gzip` option can be used to compress the dump. This can help to speed up dumping of data if storage is the bottleneck or if storage capacity is a concern. The drawback of this is an increase in CPU usage. Each file is compressed individually. With the above options specified, Dumpling can have a quicker speed of data export.