Which is the fastest ?

---

Simple framework comparison

---

---

Motivation

There are many frameworks, each one comes with its own advantages and drawbacks. The purpose of this project is to identify them and attempt to measure their differences (performance is only one metric).

What is a framework ?

A framework is a set of components working together. The main intention behind a framework is to facilitate (app or service) creation. The way a framework help any developer could vary from one to an other.

A majority of frameworks could be splitted in 2 parts :

• full-stack meaning it provides all aspects (-stacks-) from data layer to sometimes deployment
• micro meaning it provides only the routing part, and let the developer choose any other component for the others

Requirements

• ruby, all tools are made in ruby
• wrk, results are collected using wrk
• postgresql, results are stored in postgresql
• docker, each implementation is implemented in an isolated container
• jq, processing docker metadata
• docker-machine if you are on macos

Usage

• Setup

bundle install
bundle exec rake config

• Build

⚠️ On macos, you need to use docker-machine to allow docker usage for each framework ⚠️

docker-machine rm default --force
docker-machine create default
eval $(docker-machine env default)

export FRAMEWORK=php/lumen
cd ${FRAMEWORK} 
make -f .Makefile build 

• Run

make -f ${FRAMEWORK}/.Makefile collect

⚠️ You need to be on the project main directory ⚠️

Results (2021-03-16)

Technical details

• CPU : 8 Cores (AMD FX-8320E Eight-Core Processor)
• RAM : 16 Gb
• OS : Fedora

• Docker version 20.10.0-rc1, build 5cc2396
  

Datatable

Computed with https://github.com/wg/wrk + Threads : 8 + Timeout : 8 + Duration : 15s (seconds)

ℹ️ Sorted by max req/s on concurrency 64 ℹ️

	Language	Framework	Speed (64)	Speed (256)	Speed (512)
1	java (11)	activej (4.0)	172 615.83	210 093.20	213 370.57
2	php (7.4)	webman (1.0)	157 543.00	168 103.14	172 068.07
3	php (7.4)	workerman (4.0)	148 394.68	178 247.00	182 907.60
4	go (1.16)	gearbox (1.2)	120 856.29	124 715.10	124 444.98
5	php (7.4)	mark (1.1)	120 699.35	135 092.07	137 388.56
6	go (1.16)	fiber (2.5)	118 637.26	130 929.40	129 984.10
7	go (1.16)	atreugo (11.6)	118 154.79	129 384.46	128 721.56
8	go (1.16)	fasthttp (1.22)	116 265.63	130 110.08	130 592.86
9	nim (1.4)	httpbeast (0.2)	116 194.12	145 329.58	147 989.01
10	go (1.16)	gorouter-fasthttp (4.4)	115 625.81	127 803.55	126 981.75
11	go (1.16)	router (1.3)	115 561.35	128 400.35	128 276.72
12	nim (1.4)	whip (0.2)	113 450.86	140 434.14	143 666.37
13	java (11)	restheart (5.3)	113 428.06	118 059.17	118 685.67
14	java (11)	undertow (2.2)	111 808.83	136 680.68	138 517.60
15	javascript (14.16)	nanoexpress (2.4)	110 904.17	141 439.01	144 766.50
16	clojure (1.1)	donkey (0.5)	110 531.90	113 121.89	114 721.66
17	java (11)	jooby (2.9)	109 328.45	135 433.24	140 013.96
18	kotlin (1.4)	kooby (2.9)	109 267.74	136 412.44	141 336.03
19	javascript (14.16)	sifrr (0.0)	108 321.20	136 833.12	140 589.11
20	java (11)	rapidoid (5.5)	108 020.50	134 621.23	137 157.81
21	c (11)	kore (3.3)	107 625.48	188 888.06	195 637.01
22	go (1.16)	gorilla-mux (1.8)	107 596.20	104 299.44	108 755.09
23	java (11)	light-4j (2.0)	106 251.92	132 257.48	135 419.32
24	java (11)	vertx (4.0)	105 888.66	125 747.88	127 208.69
25	nim (1.4)	jester (0.5)	105 607.16	130 859.67	134 000.39
26	java (11)	vertx4web (4.0)	104 707.78	123 648.49	125 142.76
27	php (7.4)	swoole (4.6)	100 000.19	126 444.42	129 348.17
28	crystal (0.36)	toro (0.4)	99 286.23	122 022.49	122 932.04
29	crystal (0.36)	spider-gazelle (4.2)	97 821.88	121 611.95	122 584.99
30	crystal (0.36)	router.cr (0.2)	97 349.18	121 704.66	122 588.08
31	crystal (0.36)	grip (4.0)	95 265.56	114 144.78	115 243.57
32	crystal (0.36)	runcobo (1.0)	93 830.19	117 176.94	117 643.04
33	java (11)	act (1.9)	93 806.34	114 684.67	117 564.12
34	crystal (0.36)	kemal (0.27)	92 358.16	113 379.84	113 669.53
35	php (7.4)	nano (0.0.9)	92 066.83	138 886.28	149 899.99
36	crystal (0.36)	amber (0.36)	88 864.56	107 163.90	106 946.85
37	php (7.4)	swoole-coroutine (4.6)	88 634.21	126 751.97	136 898.80
38	java (11)	quarkus (1.12)	85 982.57	104 242.70	106 879.76
39	scala (2.13)	akkahttp (10.2)	83 945.38	99 461.76	96 442.36
40	javascript (14.16)	naturaljs-router (0.1.1)	82 515.88	97 203.32	99 383.81
41	go (1.16)	gf (1.15)	82 106.24	89 839.30	91 903.56
42	go (1.16)	rte (0.0)	81 037.89	82 101.29	84 128.40
43	go (1.16)	clevergo (0.5)	80 630.52	82 066.64	84 145.44
44	go (1.16)	echo (4.2)	80 030.89	81 240.58	83 022.87
45	go (1.16)	httprouter (1.3)	79 069.08	80 078.58	81 720.55
46	go (1.16)	gorouter (4.5)	78 683.05	83 283.34	84 376.31
47	go (1.16)	gin (1.6)	78 473.85	82 439.31	83 952.73
48	php (7.4)	simps (1.0)	78 388.93	106 438.09	115 672.24
49	crystal (0.36)	athena (0.13)	77 242.94	85 704.61	80 282.22
50	go (1.16)	aero (1.3)	76 951.10	77 812.73	79 517.00
51	go (1.16)	violetear (7.0)	76 792.28	77 029.69	78 896.27
52	go (1.16)	chi (1.5)	76 259.90	75 319.90	77 664.51
53	go (1.16)	webgo (5.0)	75 638.76	75 340.18	77 368.03
54	scala (2.13)	finatra (21.1)	75 067.74	86 985.68	87 397.14
55	go (1.16)	kami (2.2)	74 894.24	78 977.55	79 489.49
56	c (11)	agoo-c (0.7)	73 970.00	108 118.68	135 103.30
57	go (1.16)	goroute (0.0)	73 017.82	71 735.32	74 250.64
58	python (3.9)	falcon (2.0)	72 864.58	79 354.57	82 114.44
59	fsharp (5.0)	frank (6.2)	72 322.32	83 742.67	86 312.30
60	csharp (8.0)	aspnetcore (5.0)	72 226.47	83 488.43	85 683.29
61	cpp (11)	drogon (1.4)	71 974.65	67 725.45	56 628.00
62	go (1.16)	beego (1.12)	71 722.82	74 442.08	76 323.93
63	fsharp (5.0)	falco (3.0)	71 012.69	82 280.68	84 534.14
64	go (1.16)	goyave (3.7)	70 567.34	70 935.30	73 273.03
65	javascript (14.16)	low-http-server (2.1)	69 824.03	79 331.73	79 008.06
66	csharp (8.0)	carter (5.2)	64 664.71	72 034.66	72 552.32
67	go (1.16)	air (0.21)	64 575.18	63 422.27	65 710.70
68	javascript (14.16)	polkadot (1.0)	63 144.60	68 854.22	70 406.40
69	fsharp (5.0)	saturn (0.14)	61 754.03	67 526.09	67 172.70
70	java (11)	spring (2.4)	61 490.33	64 433.00	65 402.11
71	scala (2.13)	finch (0.32)	60 517.38	67 449.16	67 355.56
72	javascript (14.16)	0http (3.0)	60 318.65	65 881.01	67 589.79
73	javascript (14.16)	restana (4.7)	56 512.78	63 097.86	64 146.78
74	swift (5.3)	hummingbird (0.6)	55 155.94	60 788.28	61 252.53
75	javascript (14.16)	polka (0.5)	55 049.66	60 631.79	60 593.89
76	javascript (14.16)	rayo (1.3)	54 981.93	60 321.85	59 211.32
77	javascript (14.16)	fastify (3.13)	54 070.95	58 949.51	57 505.84
78	elixir (1.11)	cowboy_stream (2.8)	53 912.54	56 941.83	55 192.22
79	rust (1.50)	salvo (0.8)	53 390.16	57 393.51	58 336.83
80	kotlin (1.4)	http4k (3.275)	52 712.17	60 911.10	63 584.66
81	python (3.9)	pyramid (2.0)	52 673.06	56 042.85	56 149.52
82	javascript (14.16)	muneem (2.4)	52 457.15	58 497.04	56 770.93
83	ruby (3.0)	agoo (2.14)	52 065.38	72 327.25	80 260.12
84	swift (5.3)	perfect (3.1)	51 075.21	56 550.10	63 349.64
85	rust (1.50)	actix (3.3)	50 638.98	46 079.50	46 680.35
86	java (11)	javalin (3.9)	50 604.27	54 378.81	54 551.77
87	php (7.4)	hyperf (2.1)	50 385.35	59 208.49	66 133.45
88	java (11)	spark (2.9)	49 917.15	54 430.41	55 578.35
89	kotlin (1.4)	ktor (1.4)	49 888.27	65 788.34	69 121.16
90	java (11)	micronaut (1.2)	49 600.93	57 301.27	57 388.63
91	fsharp (5.0)	websharper (4.7)	49 285.18	55 371.48	55 755.19
92	php (7.4)	one (2.2)	49 108.96	58 353.40	68 418.68
93	javascript (14.16)	nestjs-fastify (7.6)	48 121.36	51 756.43	50 889.28
94	go (1.16)	mars (1.0)	46 356.82	46 499.76	49 700.18
95	javascript (14.16)	iotjs-express (0.0)	45 841.59	49 207.79	47 472.00
96	haskell (8.8)	scotty (0.12)	45 783.23	48 850.15	51 568.08
97	javascript (14.16)	foxify (0.1)	45 541.44	49 029.19	47 719.27
98	clojure (1.1)	coast (1.0)	44 565.76	45 402.54	45 972.58
99	python (3.9)	bottle (0.12)	43 046.73	46 189.60	46 724.84
100	r (4.0)	rserve (1.7)	42 927.18	32 717.89	31 761.34
101	javascript (14.16)	koa (2.13)	40 785.74	43 590.14	42 527.52
102	python (3.9)	asgineer (0.8)	40 207.81	44 835.57	45 756.63
103	dart (2.12)	aqueduct (3.3)	39 102.45	38 628.36	37 860.74
104	javascript (14.16)	fyrejet-uwebsockets (3.0)	38 583.00	40 398.74	59 601.65
105	swift (5.3)	vapor (4.41)	36 603.27	38 225.01	37 927.82
106	elixir (1.11)	cowboy (2.8)	36 151.35	37 457.03	37 690.88
107	php (7.4)	chubbyphp-workerman (3.4)	35 145.42	36 889.96	37 644.80
108	javascript (14.16)	hapi (20.1)	34 808.24	35 817.30	34 587.60
109	swift (5.3)	kitura (2.9)	34 775.08	34 561.31	34 843.25
110	python (3.9)	emmett (2.2)	34 332.57	41 184.28	41 803.58
111	javascript (14.16)	moleculer (0.14)	34 329.10	35 495.83	34 736.27
112	java (11)	jersey3-grizzly2 (3)	34 159.27	38 959.40	38 396.14
113	php (7.4)	siler-swoole (1.7)	33 842.27	42 593.80	45 664.77
114	swift (5.3)	kitura-nio (2.9)	33 801.33	34 110.51	34 184.91
115	cpp (11)	evhtp (1.2)	33 263.10	34 162.92	33 176.95
116	python (3.9)	hug (2.6)	33 222.36	35 036.61	53 664.67
117	java (11)	jersey-grizzly2 (2.33)	33 164.75	37 840.04	37 194.93
118	javascript (14.16)	fyrejet (3.0)	32 933.92	36 157.17	35 732.22
119	scala (2.13)	http4s (0.21)	32 413.10	37 010.94	37 284.19
120	python (3.9)	apidaora (0.28)	32 055.96	38 856.92	39 073.19
121	python (3.9)	sanic (20.12)	31 354.17	34 731.04	35 082.92
122	rust (1.50)	nickel (0.11)	31 314.74	32 681.24	29 513.18
123	fsharp (5.0)	suave (2.6)	30 991.76	29 116.01	25 096.03
124	python (3.9)	blacksheep (1.0)	29 859.47	33 774.70	34 277.41
125	javascript (14.16)	restify (8.5)	29 290.39	30 595.06	29 384.85
126	csharp (8.0)	simplify.web (4.2)	28 910.45	32 028.60	31 711.60
127	php (7.4)	imi (1.2)	28 331.17	32 628.83	33 119.56
128	scala (2.13)	play (2.8)	28 001.73	29 569.49	29 583.94
129	python (3.9)	starlette (0.14)	27 688.92	31 407.21	32 372.93
130	php (7.4)	yii-swoole (2.0)	27 549.77	30 987.08	32 553.98
131	elixir (1.11)	plug (1.11)	27 289.95	28 970.08	28 544.30
132	rust (1.50)	gotham (0.5)	27 031.85	29 956.94	30 866.51
133	php (7.4)	comet (1.2)	27 024.35	27 396.46	26 688.38
134	python (3.9)	index.py (0.16)	25 562.99	29 841.93	30 521.28
135	crystal (0.36)	orion (3.0)	24 817.66	24 318.49	23 729.17
136	python (3.9)	responder (2.0)	24 664.17	32 276.67	31 304.23
137	elixir (1.11)	phoenix (1.5)	24 293.63	26 176.67	25 707.30
138	haskell (8.8)	servant (0.17)	22 693.19	21 496.76	20 670.71
139	clojure (1.1)	luminus (3.98)	22 402.68	21 784.39	21 221.20
140	crystal (0.36)	shivneri (0.17)	21 842.36	21 919.97	19 515.05
141	python (3.9)	clastic (19.9)	21 659.43	23 971.41	26 191.87
142	fsharp (5.0)	giraffe (4.1)	21 632.95	22 087.12	22 147.73
143	nim (1.4)	mike (0.5)	20 471.17	20 089.25	20 366.55
144	python (3.9)	aiohttp (3.7)	20 075.70	23 468.60	23 968.03
145	python (3.9)	molten (1.0)	19 094.91	22 463.92	22 262.17
146	javascript (14.16)	turbo_polka (0.3)	18 265.29	17 419.52	16 405.56
147	nim (1.4)	akane (0.1)	17 311.37	15 510.42	14 446.49
148	php (7.4)	swoft (2.0)	16 918.30	20 585.66	20 866.38
149	ruby (3.0)	hanami-api (0.1)	16 761.31	16 363.60	15 942.00
150	python (3.9)	fastapi (0.63)	16 583.26	21 290.63	21 603.38
151	rust (1.50)	iron (0.6)	16 354.98	16 627.39	16 444.44
152	ruby (3.0)	syro (3.2)	16 224.16	15 699.92	15 445.28
153	nim (1.4)	rosencrantz (0.4)	15 847.56	14 059.56	13 117.77
154	php (7.4)	chubbyphp-swoole (3.4)	15 636.41	18 260.07	18 663.17
155	javascript (14.16)	express (4.17)	15 523.01	17 772.31	17 631.75
156	ruby (3.0)	roda (3.42)	15 348.29	14 846.78	14 685.63
157	javascript (14.16)	feathersjs (4.5)	15 309.79	17 599.50	17 394.37
158	go (1.16)	macaron (1.4)	15 284.18	16 760.26	16 808.74
159	php (7.4)	sw-fw-less (preview)	15 213.83	17 605.58	18 070.07
160	php (7.4)	slim-swoole (4.7)	15 024.46	17 383.06	17 747.33
161	ruby (3.0)	cuba (3.9)	14 080.54	13 633.38	13 470.67
162	swift (5.3)	swifter (1.5)	13 932.52	14 754.55	20 017.57
163	java (11)	struts2 (2.5)	13 766.97	13 995.08	14 035.10
164	ruby (3.0)	rack-routing (0.0)	13 688.22	13 394.74	13 080.59
165	java (11)	blade (2.0)	13 261.73	15 554.41	14 505.27
166	ruby (3.0)	camping (2.1)	12 965.21	12 490.18	12 313.03
167	ruby (3.0)	rack_app (7.7)	12 770.28	12 092.40	11 863.75
168	python (3.9)	flask (1.1)	12 686.98	14 396.86	13 089.87
169	javascript (14.16)	nestjs-express (7.6)	11 547.29	11 488.63	14 090.38
170	go (1.16)	tango (0.6)	11 384.95	11 698.63	11 715.71
171	dart (2.12)	start (0.4)	11 141.84	11 013.98	10 672.81
172	python (3.9)	cherrypy (18.6)	10 263.32	9 929.62	9 642.36
173	php (7.4)	chubbyphp-roadrunner (3.4)	10 073.35	10 306.44	10 416.24
174	go (1.16)	gramework (1.7)	9 926.91	10 122.75	10 129.42
175	php (7.4)	sunrise-router-roadrunner (2.6)	9 813.66	9 968.96	10 182.33
176	php (7.4)	slim-roadrunner (4.7)	9 717.94	9 914.27	10 017.71
177	php (7.4)	spiral (2.7)	9 697.13	9 842.62	9 914.25
178	php (7.4)	laravel-s-lumen (3.7)	9 594.35	9 934.55	9 724.64
179	python (3.9)	guillotina (6.2)	9 076.78	9 398.42	8 894.83
180	ruby (3.0)	sinatra (2.1)	8 598.81	8 348.59	8 333.45
181	pony (0.39)	jennet (0.1)	8 363.85	13 365.85	12 638.68
182	ruby (3.0)	grape (1.5)	7 592.63	7 380.46	7 356.21
183	python (3.9)	quart (0.14)	7 576.66	7 262.92	6 832.35
184	python (3.9)	tonberry (0.2)	7 395.60	6 948.86	6 348.29
185	php (7.4)	phalcon (4.1)	7 182.67	7 485.89	7 481.62
186	php (7.4)	basicphp (0.9)	7 095.68	7 529.16	7 393.25
187	php (7.4)	fastsitephp (1.4)	7 038.85	7 234.47	7 239.83
188	php (7.4)	siler (1.7)	6 790.06	7 168.45	7 078.47
189	php (7.4)	laravel-s-laravel (3.7)	6 403.63	6 409.97	6 322.56
190	php (7.4)	ice (1.5)	6 384.64	6 725.16	6 704.88
191	python (3.9)	django (3.1)	6 198.90	5 835.09	5 746.99
192	clojure (1.1)	yada (1.2)	5 991.23	6 764.83	6 513.46
193	php (7.4)	ubiquity (2.3)	5 851.40	5 948.96	5 855.13
194	python (3.9)	tornado (6.1)	5 795.89	5 966.89	5 623.56
195	php (7.4)	one-fpm (2.2)	5 089.07	5 264.94	5 253.85
196	php (7.4)	fatfree (3.7)	4 957.20	5 174.99	5 084.01
197	php (7.4)	hamlet (3.2)	4 734.15	4 909.87	4 875.59
198	php (7.4)	cubex (4.16)	4 678.96	4 841.44	4 821.19
199	php (7.4)	slim (4.7)	4 377.63	4 530.61	4 528.42
200	javascript (14.16)	sails (1.4)	4 214.82	4 214.02	4 153.02
201	php (7.4)	bearframework (1.3)	4 097.65	4 279.74	4 259.70
202	julia (1.6)	merly (1.0)	3 943.97	6 505.08	4 159.69
203	php (7.4)	sunrise-router (2.6)	3 881.29	3 955.50	3 941.23
204	php (7.4)	nette (3.1)	3 839.37	3 943.39	3 951.88
205	php (7.4)	lumen (8.2)	3 833.71	3 889.30	3 904.63
206	php (7.4)	chubbyphp (3.4)	3 460.20	3 570.98	3 561.05
207	php (7.4)	symfony (5.2)	3 031.12	3 046.35	3 057.91
208	php (7.4)	sunrise-router-annotations (2.6)	2 970.31	3 017.39	3 019.20
209	ruby (3.0)	rails (6.1)	2 780.08	2 754.07	2 769.29
210	php (7.4)	yii (2.0)	2 513.95	2 550.08	2 561.24
211	python (3.9)	masonite (3.0)	2 438.59	2 478.19	2 476.38
212	php (7.4)	antidot (0.2)	2 099.46	696.97	1 293.71
213	r (4.0)	restrserve (0.3)	1 918.37	1 870.43	1 869.27
214	php (7.4)	driftphp (0.1)	1 914.63	661.69	1 584.98
215	r (4.0)	httpuv (1.5)	1 911.61	1 857.24	1 783.75
216	php (7.4)	laminas (3.2)	1 720.48	1 734.95	1 733.42
217	python (3.9)	cyclone (1.3)	1 592.82	1 588.07	1 564.75
218	python (3.9)	klein (20.6)	1 491.97	1 520.48	1 500.71
219	perl (5.32)	dancer2 (0.3)	1 370.14	661.87	389.66
220	python (3.9)	django-ninja (0.11)	1 258.54	1 631.94	1 677.37
221	python (3.9)	nameko (2.13)	1 214.75	1 168.97	1 181.42
222	php (7.4)	codeigniter4 (4.1)	1 190.52	1 206.06	1 204.94
223	php (7.4)	laravel (8.32)	993.48	994.32	988.17
224	php (7.4)	unic (1.0)	549.41	498.23	159.59
225	r (4.0)	plumber (1.0)	285.03	302.85	-94.91
226	cpp (11)	nawa (0.6)	270.49	NaN	NaN