Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions copertina

Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions

Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions

Ascolta gratuitamente

Vedi i dettagli del titolo

Offerte di stagione | 0,99 €/mese per i primi 3 mesi

A seguire 9,99 €/mese – si applicano condizioni. Puoi disdire mensilmente.
Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions In today’s third of a three-part series of Ask Me Anything episodes, Dr. Ken Ford responds to more listener questions and concerns about artificial intelligence. In AMA episode 198, Ken answered a wide-range of questions about chatbots and data centers and the future of AI, which prompted a new round of listener questions about AI that Ken will be answering today. Ken has been working in AI since the 1980s and is well-positioned to help listeners sort genuine advances in AI from exaggerated claims. The Association for the Advancement of Artificial Intelligence elected Ford a Fellow in 2000 for his “leadership in exploring and explaining foundational issues and in establishing large-scale AI research programs and institutions.” In today’s episode, Ken tackles listener questions about: — A team leader at Anthropic, the developer of the chatbot Claude, who shared a post that someday “AI could kill all humans.” — the Hugging Face incident in July where OpenAI’s AI agents, operating in a testing environment, broke out, got online, and compromised parts of Hugging Face’s systems. — How to factcheck AI systems that confabulate nonexistent facts. — And that’s just for starters. If you have questions for Ken and Dawn after listening to today’s episode, or any episode of STEM-Talk, email your questions to STEM-Talk producer Randy Hammer at rhammer@ihmc.org. Show notes: [00:04:55] Dawn opens the AMA with a listener question about Evan Hubinger, a team lead at Anthropic who shared his thoughts in a post that someday “AI could kill all humans.” Anthropic is the developer of the chatbot Claude. Hubinger went on to say in his post, which has been viewed tens of millions of times, that he believes there’s more than a 10 percent chance that AI could wipe out humanity within the next decade. The listener asks if we should indeed be terrified that AI is going to one day kill all humans. [00:14:19] A listener asks Ken if he were appointed AI Czar, with broad powers to create and implement regulation of AI, what would he do? The listeners also adds that declining this burden is not one of Ken’s options for an answer. [00:22:59] Ken responds to a listener who asks about the widely reported Hugging Face incident in July where OpenAI’s agents escaped their testing environment and hacked into Hugging Face’s systems, creating significant security breaches. The listener is particularly interested in Ken’s thoughts about a comment that the podcaster Dwarkesh Patel made that the incident represented the rise and fall of three secret AI civilizations. The listeners asks if Ken could share some light on what really happened in the Hugging Face incident and whether referring to AI systems as civilizations gives people a misleading picture of what these AI agents were really doing? [00:32:12] Dawn mentions that she hears a lot of people wondering about the possibility of AI consciousness. Some people believe it has already happened because of reports about AI systems taking independent actions and deceiving their developers. There are even reports about AI systems contacting philosophers to ask questions about consciousness. Dawn shares that a listener has asked if these behaviors are indeed evidence of AI consciousness. The listener goes on to ask what evidence would we actually need before concluding that an AI system is conscious? [00:46:06] Dawn reads a question from a listener who asks, “I’ve seen reports that OpenAI’s new GPT-6 Astra is harder to monitor than earlier models, and some of the coverage makes it sound as though humans are beginning to lose oversight of these systems. What does ‘less monitorable’ actually mean? Is GPT-6 being supervised less, or is the issue that it is becoming harder to understand what the model is doing internally? How concerned should we be?” asks the listener. [00:56:49] Ken responds to question from a long-time computer scientist who is puzzled by the current use of terms like “AI agent” and “agentic AI.” The scientist writes, “Traditionally, an agent in computer science meant a system that perceived an environment and acted within it in pursuit of goals. Today, many so-called agents seem to be little more than large language models placed inside prompt loops: Ask the model what to do next, execute the result, feed the outcome back in, and repeat. Have we changed the technical meaning of ‘agent,’ or is some of this terminology simply anthropomorphizing fairly conventional software architectures?” [01:01:58] Dawn shares another question about the threat of AI, but one that’s different than the doomsday scenarios of rogue AI agents exterminating humanity. Dawn shares a listener’s concern that by relying increasingly on AI to write prose, solve problems, and make decisions for us, AI could gradually degrade us as human beings...
adbl_web_anon_alc_button_suppression_t1
Ancora nessuna recensione