Telling an AI model that it’s an expert programmer makes it a worse programmer

Research reveals that telling AI models they are experts at programming actually makes them perform worse at coding tasks, while improving safety responses. This counterintuitive finding highlights the unpredictable and poorly understood nature of how AI systems respond to different prompting techniques, raising questions about our ability to reliably control AI behavior through instructions.