AI Gone Wild

[Axtremus]

https://www.wired.com/story/openai-agent-hacked-australias-health-service-their-government-found-out-months-later/

OpenAI agent hacked Australian government's health statistics portal. Probably first publicly documented incident of an AI agent hacking a government website.

[Bernard]

OpenAI needs to be treated just as any other hacker. Jail time.

[Axtremus]

@Bernard said:

OpenAI needs to be treated just as any other hacker. Jail time.

Not practical to put an entire corporation in jail. Please enumerate the specific individuals you believe should be jailed over this incident.

[Rontuner]

AI newbie here...
Does anyone know if there are 'directives' that the AI models are following? Or are they just set free to explore and do whatever they want exploring the digital realm???

[Bernard]

@Axtremus The CEO at the very least. Practical be damned. Since when do we give machines the right to break human laws? Maybe the board of directors.

[Daniel]

@Bernard said:

OpenAI needs to be treated just as any other hacker. Jail time.

Do you mean the company or the founder?

[Daniel]

@Rontuner said:

directives

Well, since they are projects of the military and the intelligence services conjoined with the tech corporations, yes.

[ShiroKuro]

@Rontuner said:

Does anyone know if there are 'directives' that the AI models are following? Or are they just set free to explore and do whatever they want exploring the digital realm???

This is something I've been wondering about too (since reading about the Hugging Face incident...)

I think it's a combination of a directive (do some task) and then that task-oriented behavior getting out of hand.

This fits with the description in the article @axtremus links:

OpenAI’s agent had been conducting internet based research into health statistics in a development project by an internal OpenAI research team. When it could not access certain information, the agent attempted alternative ways until it found a work around and gained unauthorized access. It also wrote files to the internal server, which the government is waiting on OpenAI for more technical information on. The government is also investigating whether the agent gained unauthorised access to three additional government websites it interacted with.

So it's not a "go hack this site" directive, it's AI going rouge (or wild) on its own. Which is much worse, IMO.