In this repository you will find qiskit-humaneval a dataset for evaluating LLM's at writing Qiskit code.
The Qiskit HumanEval dataset is inspired by OpenAI's HumanEval. It includes 151 Qiskit problems written by human Qiskit advocates. The dataset is available as a json line file here.
If you'd like to contribute to the Qiskit HumanEval, please take a look at our contribution guidelines. By participating, you are expected to uphold our code of conduct.
- Terms of use: https://quantum.ibm.com/terms
- Privacy policy: https://quantum.ibm.com/terms/privacy