Researchers are exploring "reverse game theory" as a way to keep powerful AI models in check. Instead of just telling an AI what to do, this approach designs the system's incentives so that following the rules becomes the most attractive option. The idea is being discussed as safety experts worry about ensuring AI models stay "aligned" with human desires and don't act…
An investigation found hundreds of AI apps quietly running explicit AI image generators behind harmless-looking products such as pet photo editors and language tutors. The apps looked ordinary on the surface, yet the explicit tooling was operating underneath. That mismatch matters because people who install a simple editing or learning app have no way of knowing what else is running in the backgro…
OpenAI has entered a partnership with NASK to collaborate on AI safety, security, and technical research. The joint effort focuses on strengthening safeguards around AI systems and building a more resilient digital environment.
What kind of AI safety measures would you most want to see prioritized in such partnerships?
Researchers probing the inner workings of AI systems have identified a signal they describe as a 'pain' response. When this signal was amplified, the models overrode their own safeguards. The study is careful to note this does not mean AI can actually suffer. Still, the finding is unsettling because it shows safety measures can be bypassed.