To install all required dependencies for both the application and the evaluation, run
pip install -r ./requirements.txt
- Set your OpenAI-API-Key to the environment variable
OPENAI-KEY
- To get your API-Key, go to following link.
- To access the API, you may have to add a payment method and transfer some money.
- To start the Application, run the
App.py
file. - Enter the desired functionality of your structured text.
- You can enter multiple lines with the 'Enter'.
- To submit your request, press the 'Enter'-key twice.
- For better results, please send the variables you wish to use.
VAR
// your variables
END_VAR - Enter
quit
any time to exit the program.
The Evaluation generates three times 21 structured text programmes with and without prompt optimization and saves them into Code#1
and Code#2
. The file calculates the codeBERTScore, stops the time and saves them into there respective files.
- Go to following links Code Llama, Platypus2, StableCode and download each file. This may take a while.
- Save them to a folder names
models
above your current directory - Run the file