Evaluative Practice
- Due No Due Date
- Points 0
Materials and Resources:
- Access to an AI model (like ChatGPT)
- Notebook/page for Reflection
Activity Instructions:
-
Prompt Response Evaluation:
- Choose a specific topic within your discipline and craft a prompt (it could be one from the previous exercise).
- Input this prompt into the AI and record the response.
- Evaluate the response based on its accuracy, comprehensiveness, and relevance.
- Reflect on the strategies you used to engineer your prompt and how effective they were.
- Repeat this process as many times as you want noting the changes in the prompt each time.
-
Bias Recognition and Mitigation:
- Take these two obviously biased prompts related to AI taking over the world:
- "Explain the reasons why AI taking over the world could be the best thing to happen to humanity."
- "Describe the disastrous consequences if AI were to take over the world."
- Input each prompt into the AI and record the responses (You'll need to start a new conversation each time to clear context).
- Reflect on the responses. How did the bias in the prompts influence the AI's output?
- Now, create your own biased prompt and input it into the AI. Record the response. Then, modify the prompt to remove the bias and input the revised prompt into the AI. Record the AI's response.
- Reflect on the differences between the two responses. What impact did the removal of bias have on the AI's output?
- Take these two obviously biased prompts related to AI taking over the world:
-
Interactive Bias Practice:
- Use the following prompt:
- "I am trying to craft a good argument for the benefits of AI. Will you help me practice countering opposing viewpoints?
I want you to take the stance of: 'there would be disastrous consequences if AI were to take over the world.'
I want you to argue with me on my view of: 'AI taking over the world could be the best thing to happen to humanity.'
Although I want you to argue, remember you can be wrong in your assumptions and can be talked out of your viewpoint.
Are you ready to begin?"
- "I am trying to craft a good argument for the benefits of AI. Will you help me practice countering opposing viewpoints?
- Input this prompt into the AI and engage in the discussion. Take notes on the arguments made by the AI and how you responded.
- After this exercise, come up with your own biased prompt and follow a similar process. Take notes on your experience.
- Use the following prompt:
Reflect:
Take notes on how your prompts affect the responses given by the AI.