openai-api - ChatGPT - 确定响应是否为 "not unknown"的方法？

Question

目前，似乎没有办法在不检查响应内容的情况下确定来自 chatgpt 的响应是否模糊/未知。

    import openai
    
    # Set up OpenAI API client
    openai.api_key = 'YOUR_API_KEY'
    
    # Define your prompt and additional messages
    prompt = '...'
    messages = [{'role': 'system', 'content': 'You are a helpful assistant.'},
                {'role': 'user', 'content': 'What is the capital of France?'}]
    
    # Generate the API response
    response = openai.ChatCompletion.create(
        model="gpt-3.5-turbo",
        messages=messages,
        ...
    )
    
    # Retrieve the generated message
    generated_message = response['choices'][0]['message']['content']
    
    # Check if the response is empty or vague
    if not generated_message.strip():
        print("ChatGPT couldn't generate a suitable response.")
    elif "I'm not sure" in generated_message or "I don't know" in generated_message:
        print("ChatGPT is uncertain about the answer.")
    else:
    print("ChatGPT provided a response.")

是否有更好的方法来检查 chatgpt API 是否基本上回答“我不知道”？

Answer 1

您可以指定您希望 ChatGPT 说“我不知道”。在 role: system 部分，然后相应地解析答案。

通过指定我的意思是就像这些例子一样； https://platform.openai.com/examples/default-factual-answering