Skip to content

Java-based service for message deduplication from Kafka. It utilizes rocksDB to store checksum data of previously processed messages, ensuring reliable duplicate detection and preventing redundant processing of the same messages.

License

Notifications You must be signed in to change notification settings

innopolis-university-java-team/deduplication-service-example

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

deduplication-service-example

Java-based service for message deduplication from Kafka. It utilizes rocksDB to store checksum data of previously processed messages, ensuring reliable duplicate detection and preventing redundant processing of the same messages.

About

Java-based service for message deduplication from Kafka. It utilizes rocksDB to store checksum data of previously processed messages, ensuring reliable duplicate detection and preventing redundant processing of the same messages.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 98.9%
  • Dockerfile 1.1%