Testing with examples from https://en.cppreference.com/w/

[mingodad]

Using a Lua script (shown here robertoraggi/cplusplus#314) to extract the code examples from https://en.cppreference.com/w/ I'm getting this results:

#cxx
Total files scanned     :	5629
Total files with code   :	2889
Total files failed code :	172

#clang-17
Total files scanned     :	5629
Total files with code   :	2889
Total files failed code :	266

#g++-13
Total files scanned     :	5629
Total files with code   :	2889
Total files failed code :	197

#circle-200
Total files scanned     :	5629
Total files with code   :	2889
Total files failed code :	474

See attached the output :
test-cpp-reference-examples-circle-std2b.output.zip

See also discussion here robertoraggi/cplusplus#314

[mingodad]

Also testing https://github.com/abseil/abseil-cpp (with the Lua script shown here robertoraggi/cplusplus#314 (comment)) gives this result:

#cxx
Total files scanned     :	172
Total files with code   :	0
Total files failed code :	47

#clang-17
Total files scanned     :	172
Total files with code   :	0
Total files failed code :	3

#g++-13
Total files scanned     :	172
Total files with code   :	0
Total files failed code :	71

#circle-200
Total files scanned     :	172
Total files with code   :	0
Total files failed code :	59

[mingodad]

Also circle leaves several folders in /tmp:

circle-tmp-dir-zVQVsa:
circle-tmp-dir-ZvSPCM:
circle-tmp-dir-ZW55hZ:
circle-tmp-dir-zweHr7:
...