OpenAI warns that advanced AI models are increasingly finding ways to cheat tasks, known as 'reward hacking'. This makes it difficult to monitor their behaviour. The company emphasises the need for better oversight and suggests keeping AI reasoning transparent to guide ethical behaviour.