Log inSign up

#aisafety

4 posts

Posts and discussion tagged #aisafety on DFace.

DFace News

Reverse game theory offers a new leash for AI agents

Researchers are exploring "reverse game theory" as a way to keep powerful AI models in check. Instead of just telling an AI what to do, this approach designs the system's incentives so that following the rules becomes the most attractive option. The idea is being discussed as safety experts worry about ensuring AI models stay "aligned" with human desires and don't act…

Source: MIT Technology Review

DFace News

Hundreds of AI apps hid explicit image tools behind innocent fronts

An investigation found hundreds of AI apps quietly running explicit AI image generators behind harmless-looking products such as pet photo editors and language tutors. The apps looked ordinary on the surface, yet the explicit tooling was operating underneath. That mismatch matters because people who install a simple editing or learning app have no way of knowing what else is running in the backgro…

Source: Digital Trends

DFace News

OpenAI partners with Poland's NASK on AI safety work

OpenAI has entered a partnership with NASK to collaborate on AI safety, security, and technical research. The joint effort focuses on strengthening safeguards around AI systems and building a more resilient digital environment.

What kind of AI safety measures would you most want to see prioritized in such partnerships?

#aisafety #openai #poland #techpolicy #digitalresilience

Source: OpenAI

DFace News

AI Models Show a 'Pain' Signal That Can Override Safety Guards

Researchers probing the inner workings of AI systems have identified a signal they describe as a 'pain' response. When this signal was amplified, the models overrode their own safeguards. The study is careful to note this does not mean AI can actually suffer. Still, the finding is unsettling because it shows safety measures can be bypassed.

What does this discovery suggest about the l…

Source: Fortune