GPT3 fine tuned model returns additional questions and answers

I have fine tuned a custom dataset using GPT3. I created a simple program to take user input (a question) and return the correct response. The program works, however it returns additional question and answers from the dataset I uploaded to the model.

I tried to reduce the max tokens cap and have set the temperature to 0, but I cannot seem to figure out how to stop the program from returning the additional questions and answers. Has anyone encountered this problem and if so how can I fix it?

Here is my code:

import openai

openai.api_key = "MY_API_KEY"

def respond(prompt):
    completions = openai.Completion.create(
        engine="MY_FINED_TUNED_MODEL",
        prompt=prompt,
        max_tokens=50,
        n=1,
        stop=None,
        temperature=0,
    )

    message = completions.choices[0].text
    return message

while True:
    prompt = input("Enter your question: ")
    if prompt.lower() == "end":
        break
    response = respond(prompt)
    print(response)

You can handle this by providing more explicit details to the prompt and even providing one-shot or many-shot examples in the prompt.

For example say this was a Q&A bot for a computer store:

question = 'Do you sell computers?'

prompt = f"""Act as a question and answer AI. You will be provided with a question and you should respond based on your fine-tuning data. Provide the most appropriate answer to the question. Provide a single answer. Do not provide additional questions and answers.

Example question:
Do you sell cars?

Example response:
Sorry, we are a computer retailer and only sell computers.

Question:
{question}

Response:"""

Depending on your responses from the model you can also use a stop sequence. For example using \r\n will cause the model to stop responding when it generates a new line.

If you provide more details of the types of questions and responses you are getting from the model I can provide you a better prompt.