v1.0.0-alpha01

Major features

• Improve query performance
  • Utilize the bloom filter stored in the sst meta data to do filtering on the row groups according to the provided predicate
  • Refactor sst cache based on weighted LRU.
  • Add a new async parquet reader.
  • Support get_range api in aliyun oss to avoid OOM when sst is large.
  • Add memory based cache for object store.
• Improve CeresDB cluster mode
  • Implement distributed wal based on kafka.(unstable)
  • Implement expansion and transferLeader control with ceresmeta.(unstable)
  • Refactor cluster metadata management in ceresemta.
• Bug fix
  • Fix some bugs in WAL on OBKV.
  • Fix encoding bug in hybrid storage format.
  • Correct the order of the columns to be consistent with the order in which the user created the table. by @dust1
• SDK
  • Release ceresdb-golang-client
  • Replace grpc-io with tonic in ceresdb-rust-client

What's Changed

• chore: fix error message when table is not found by @ShiKaiWi in #348
• docs: Table operation doc by @MachaelLee in #318
• fix: adopt new parquet api by @jiacai2050 in #351
• refactor: utilize datafuison to support filter before merge procedure by @ygf11 in #326
• Refactor replace protobuf with prost by @ShiKaiWi in #352
• feat: region meta in wal manager on kafka by @Rachelint in #345
• docs: proposal of roadmap by @archerny in #356
• feat: add async parquet reader by @jiacai2050 in #355
• feat: encoding in wal's message queue impl. by @Rachelint in #358
• feat: add tools sst-convert by @jiacai2050 in #361
• fix: apply missing filtering on parquet reader by @ShiKaiWi in #360
• docs: update dynamic cluster mode doc by @ZuLiangWang in #357
• feat: replace ParquetExec with ParquetRecordBatchStream by @jiacai2050 in #368
• feat: region in wal's message queue impl. by @Rachelint in #362
• feat: support equal pruner by @ShiKaiWi in #372
• feat: add block list by @MachaelLee in #359
• feat: enhancement to mq's kafka implementation by @Rachelint in #375
• fix: add ignore to test on message queue's kafka implementation. by @Rachelint in #377
• fix:Disallow defining timestamp key column as Tag column by @QuintinTao in #374
• feat: add table id to LogEntry by @Rachelint in #379
• feat: add bloom filter when write sst by @jiacai2050 in #370
• feat: support like syntax in show tables statement by @QuintinTao in #331
• feat: support filter_row_groups by EqPruner by @ShiKaiWi in #380
• refactor: build row groups from record batch stream by @ShiKaiWi in #381
• refactor: show tables by @jiacai2050 in #382
• refactor: wal unit tests. by @Rachelint in #387
• feat: filter row groups by bloom filter by @ShiKaiWi in #383
• feat: implement region recovery by @Rachelint in #385
• feat: read all bytes out before do async bench by @jiacai2050 in #390
• feat: meta cache for both custom and parquet metadata by @ShiKaiWi in #392
• feat: sst-convert support convert to hybrid format by @jiacai2050 in #398
• feat: support get_range in aliyun oss by @ShiKaiWi in #395
• refactor: support multiple writing in a specific table by @Rachelint in #393
• fix: add meta client timeout by @ZuLiangWang in #399
• chore: update obkv-client to latest version by @chunshao90 in #401
• fix: wrong cargo lock by @ShiKaiWi in #405
• feat: correct column order by @dust1 in #340
• chore: update the ceresdbproto to latest by @ShiKaiWi in #406
• chore: remove manual installation of protoc by @ShiKaiWi in #407
• feat: refacor existing wal implementations to support scanning logs of shard by @Rachelint in #400
• chore: bump client in test harness by @jiacai2050 in #409
• docs: update http api by @jiacai2050 in #410
• test: add case sensitive demo by @jiacai2050 in #411
• feat: add memory based cache for object store by @jiacai2050 in #415
• feat: Impl wal on mq namespace by @Rachelint in #404
• feat: Impl wal on mq setup by @Rachelint in #416
• fix: cleaner bugs of wal on obkv by @Rachelint in #418
• feat: replay from flushed sequence by @Rachelint in #423
• feat: make manifest operations more configurable by @Rachelint in #424
• feat: setup MemCacheStore by @jiacai2050 in #421
• docs: fix broken conventional commit document link(#429) by @Huachao in #430
• fix: fix grpc service metrics by @chunshao90 in #431
• fix: purging buckets in initializing bug by @Rachelint in #432
• fix: load last sequence in obkv wal by @Rachelint in #434
• fix: drop bug of wal on mq, can't not drop runtime by @Rachelint in #433
• fix: hybrid storage encode bug in multi record batch by @chunshao90 in #426
• chore: add logs about replaying by @Rachelint in #438
• chore: return schema not found when schema not exists by @chunshao90 in #439
• refactor: manifest wal config by @Rachelint in #437
• fix: bug in distributed wal(obkv, kafka) by @Rachelint in #422
• chore: bump version to 1.0.0-alpha01 by @jiacai2050 in #440

New Contributors

• @MachaelLee made their first contribution in #318
• @ZuLiangWang made their first contribution in #357
• @Huachao made their first contribution in #430

Full Changelog: v0.4.0...v1.0.0-alhpa01