Skip to content

Advanced data structure and algorithm for system design,系统设计需要了解的算法

License

Notifications You must be signed in to change notification settings

resumejob/system-design-algorithms

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 

Repository files navigation

System design algorithms

Algorithm you should know for preparing system design interview. For example, Learn Geohash / S2 Geometry algorithm for "How to design Uber like system?"

Sponsor

How to contribute

The algorithm and its resources should:

  1. Can answer a system design question. For instance, Building a complete Tweet index can answer "How to implement Twitter search" or "How to implement hashtag in Twitter".
  2. Free to read or watch.
  3. Text would be better than videos.

Requirements

  • Know when to use ☑️
  • Know how it works ✅

Table of contents

  • Bloom filter ✅
  • Consistent hashing ✅
  • Geohash / S2 Geometry ✅
  • Leaky bucket / Token bucket ✅
  • Inverted index ✅
  • Distributed Consensus Algorithms (e.g., Paxos, Raft) ✅
  • Cache Eviction Policies (e.g., LRU, LFU) ✅
  • Rsync algorithm ✅
  • HyperLogLog ✅
  • Trie algorithm ✅
  • Lossy Counting ☑️
  • Frugal Streaming ☑️
  • Operational transformation ☑️
  • Quadtree / Rtree ☑️
  • Ray casting ☑️

Bloom filter

A Bloom filter is a data structure designed to tell you, rapidly and memory-efficiently, whether an element is present in a set.

Consistent hashing

Consistent hashing is an algorithm designed to distribute data across a cluster in a way that minimizes re-distribution when nodes are added or removed. It is particularly useful in distributed systems, such as distributed caches, distributed storage systems, and load balancing.

Geohash / S2 Geometry

Geohash can used by 1) dating apps to find romantic matches within a particular cell, and to create chat apps.2) Find nearby locations, and identify places of interest, restaurants, shops and accommodation establishments in an area. 3) Geohashers go on global expeditions to meet people and explore new places.

Leaky bucket / Token bucket

A mechanism to control the amount and the rate of the traffic sent to the network

Ieversed index

An inverted index is a data structure used primarily in text search engines.

Distributed Consensus Algorithms

Distributed consensus algorithm that enables nodes to agree on a value despite failures, requiring a majority for safety and progress.

Cache Eviction Policies

Cache eviction policies determine which items to remove from a cache when it reaches its capacity, with common strategies including Least Recently Used (LRU), First In First Out (FIFO), and Least Frequently Used (LFU).

Rsync algorithm

The rsync algorithm is a technique for reducing the cost of a file transfer by avoiding the transfer of blocks that are already at the destination.

HyperLogLog

HyperLogLog is an algorithm for the count-distinct problem, approximating the number of distinct elements in a multiset.

Trie algorithm

Trie is an efficient information reTrieval data structure. Using Trie, search complexities can be brought to optimal limit (key length)

Lossy Counting

The lossy count algorithm is an algorithm to identify elements in a data stream whose frequency count exceed a user-given threshold.

Frugal Streaming

Frugal Streaming uses only one unit of memory per group to compute a quantile for each group

Operational transformation

Operational transformation (OT) is a technology for supporting a range of collaboration functionalities in advanced collaborative software systems.

Quadtree / Rtree

Ray casting

Ray casting is the most basic of many computer graphics rendering algorithms that use the geometric algorithm of ray tracing. Given a point with longitude and latitude, return the Country of the point.

About

Advanced data structure and algorithm for system design,系统设计需要了解的算法

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published