Buddhist Catholic Contemplative Evangelical General Christian Hindu Jewish Latter-day Saint Muslim New Visions Progressive Christian

Beliefs

Topics

Columnists

Resource Library

Research Tools

Video

Podcasts

Thought Readers

Faith In Media Tracker

Newsletters

Ad-Free & Subscriber Log-In Subscription Support

Follow Patheos

Home
Progressive Christian
Technology and Religion
AI Brinkmanship: A Prophetic Warning?

AI Brinkmanship: A Prophetic Warning?

Last updated on: July 21, 2023 at 8:05 am by Ted Peters

AI Brinkmanship: A Prophetic Warning? 2023-07-21T08:05:47-07:00 Ted Peters

LOGO Patheos Explore the world's faith through different perspectives on religion and spirituality! Patheos has the views of the prevalent religions and spiritualities of the world.

AI Brinkmanship

A prophetic warning?

Adventures in Artificial Intelligence and Faith, H+ 2004

Singularity Timeline. Daily Mail Online.

Hiking alone in the High Sierras a few years ago, I was daydreaming while walking somewhat nonchalantly near a mountain top at 11,000 feet. Suddenly I reeled back in shock and terror. With one more step I would have fallen over a cliff into a chasm, a vast emptiness that went straight down at least 3,000 feet. With my heart beating faster than an airplane propeller, I stood aghast on the precipice. I had reached the brink and, Gott sei dank, I had stopped at the brink. Whew!

Geoffrey Hinton, nicknamed “Godfather of AI”, has similarly stopped at the brink. Hinton pioneered understanding neural networks and shaped artificial intelligence systems powering many of today’s products. He just announced his resignation from Google. Hinton no longer plays AI brinkmanship. Why? Because generative AI is “scary.”

The Arrival of ChatGPT and OpenAI’s announcement of GPT4 has placed the world’s techies on the AI brink. The voices of Elon Musk, Steve Wozniak, and a chorus of in-the-know computerettes are chanting: pause AI development for six months while we think this over. Here’s their open letter: Pause Giant AI Experiments: An Open Letter. I added my signature to this letter.

Steve Wozniak, Apple Co-Founder

Brinkmanship is the practice of following a dangerous trail toward the limits of safety before stopping. Stop playing AI brinkmanship! That’s today’s prophetic message.

I foresee two brinks, not just one. The first brink is the Singularity–that is, an AI takeover of planetary communication and decision-making. The second brink is more immediate–namely, malicious use of AI power to pillage and destroy.

AI Brink #1: The Singularity and the Takeover by Superintelligence

Daily Mail Online. What about the AI brink?

Our transhumanist friends invite AI brinkmanship, because they envision utopia just beyond the brink. If by the year 2045 superintelligence takes over, as Ray Kurzweil has forecasted, humanity will cross the Singularity threshold when technological growth becomes uncontrollable and irreversible. A new posthuman species will be born and take over management of our world’s systems. Singularity will open the door for a future techno-utopia.

But those who find AI brinkmanship “scary” such as Hinton are issuing a warning. Let’s keep AI management in human hands! To prevent AI brinkmanship, we need guardrails put up by ethics and public policy. Here’s how the Open Letter assesses our situation this side of the brink.

Warnings about the AI brink: Musk, Hinton, Wozniak. Daily Mail Online photo.

“Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders. Powerful AI systems should be developed only once we are confident that their effects will be positive, and their risks will be manageable.”

In a 2023 TED Talk, Eliezer Yudkowsky asks, “Will superintelligent AI end the world?”

It’s time for Homo sapiens to pull the wagons into a circle and consult about ethical issues and formulate the policies which will prevent falling over the brink.

Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.

Regarding a general maxim to guide ethical deliberation broadly, I’m pondering the wisdom of a recent principle enunciated by Noreen Herzfeld. Dr. Herzfeld emphasizes that AI should be thought of as a tool to enhance human wellbeing. Just a tool. Only a tool. Not a person.

We approach the scary AI brink when we try to humanize AI. Why do we pursue AGI? Why do we manufacture sex bots? Why do we refine the chat box? Stop it! Herzfeld’s principle: let AI be AI, and let humans be human. Don’t interbreed them.

Professor Noreen Herzfeld. See her new book, “The Artifice of Intelligence.”

AI Brink #2: Malicious Malware

Is Silicon Valley providing bad actors with the computer equivalent of the AR-15s used by today’s mass murderers? American and Austrian gun manufacturers went over the brink. And now blood flows like rivers in our schoolyards.

Some armies have already launched autonomous lethal weapons. Once released, there’s no calling them back. And sometimes they kill untargeted people. Is this the future our AI techies wish for our planet?

Malicious actors the other side of the AI brink are ready and eager to pull the trigger to flood social media with fake news, re-edit distorting pictures, sway elections, and drain our bank accounts. Should the present generation of AI techies distribute the digitized equivalent of AR-15s to malefactors who are ready to rob, pillage, and destroy?

What we need are carefully constructed guard rails. The human geniuses of AI should unite with one another this side of the AI brink to construct those moral guardrails. That’s what Elon Musk, Geoffrey Hinton, and Steve Wozniak urge us to do before it’s too late.

AI and Faith at the AI Brink

Our Jewish, Muslim, and Christian colleagues at AI and Faith are accepting the Open Letter invitation to contribute to ethical deliberation and public policy formulation. The mission of AI and Faith “is to equip and encourage people of faith to bring time-tested, faith-based values and wisdom to the ethical AI conversation.”

In a newsletter article, David Brenner readies us for the challenge.

“Working together, we have a better chance to affect the larger AI ethics conversation by speaking in respectful, robustly pluralist voices, with no faith tradition toning down its faith beliefs, unified in our common contention that faith values of three quarters of the world’s peoples are essential to the debate. That approach has gained us admission as the only overtly faith-oriented partner among the 106 organizations in the global Partnership on AI.”

Brenner offers what I call public theology at work.

Ethical guard rails this side of the AI brink just might be what safety requires.

Conclusion

“AI has great power to do good and evil,” wrote Elon Musk in a Tweet. “Better the former.”

You betcha, Elon!

This is an excellent resource. Download for free from Santa Clara Univeristy.

Adventures in Artificial Intelligence and Faith

Patheos H+ 2001: Is ChatGPT Intelligent?

Patheos H+ 2002: AI Warning: Utopia or Extinction?

Patheos H+ 2003: Your Robot Pastor is Here

Patheos H+ 2004: AI Brinkmanship
Patheos H+ 2005: Is AI a shortcut to virtue? To holiness?

Patheos H+ 2006: Creating an AI Co-Creator? Philip Hefner’s Mind

▓

Fiction thriller, “Cyrus Twelve,” when AI goes over the brink.

Ted Peters (Ph.D., University of Chicago) is a public theologian directing traffic at the intersection of science, religion, and ethics. Peters is an emeritus professor at the Graduate Theological Union, where he co-edits the journal, Theology and Science, on behalf of the Center for Theology and the Natural Sciences, in Berkeley, California, USA. He recently co-edited Astrobiology: Science, Ethics, and Public Policy (Scrivener 2021) as well as Astrotheology: Science and Theology Meet Extraterrestrial Intelligence (Cascade 2018). He also co-edited Religious Transhumanism and Its Critics (Lexington 2022) and The CRISPR Revolution in Science, Ethics, and Religion (Praeger 2023). Peters is author of Playing God: Genetic Determinism and Human Freedom (Routledge, 2nd ed, 2002) and The Stem Cell Debate (Fortress 2007). See his blogsite [https://www.patheos.com/blogs/publictheology/] and his website [TedsTimelyTake.com].

See his fiction thriller, Cyrus Twelve, with its transhumanist plot.

▓

More Voices

Technology and Religion

About Ted Peters

Ted Peters (Ph.D., University of Chicago) is a public theologian directing traffic at the intersection of science, religion, and ethics. Peters is an emeritus professor at the Graduate Theological Union, where he co-edits the journal, Theology and Science, on behalf of the Center for Theology and the Natural Sciences, in Berkeley, California, USA. He recently co-edited Astrobiology: Science, Ethics, and Public Policy (Scrivener 2021) as well as Astrotheology: Science and Theology Meet Extraterrestrial Intelligence (Cascade 2018). He also co-edited Religious Transhumanism and Its Critics (Lexington 2022) and The CRISPR Revolution in Science, Ethics, and Religion (Praeger 2023). Peters is author of Playing God: Genetic Determinism and Human Freedom (Routledge, 2nd ed, 2002) and The Stem Cell Debate (Fortress 2007). See his blogsite [https://www.patheos.com/blogs/publictheology/] and his website [TedsTimelyTake.com]. You can read more about the author here.

Previous Post

April 28, 2023

The Science-as-Savior Eco-Myth

Next Post

May 11, 2023 How to see a miracle? Miracles 1

Browse Our Archives

Select a Category Afterlife America in Crisis Ancient Alien Apocalypse Art Artificial Intelligence Astrobiology Astrotheology Atheism Big History Buddhist Catholic Christian Nationalism Christmas Comparative Theology Death Ecology Ethics ETI Evangelical Evolution Existential Questions Free Will General Christian Hermeneutics Hindu https://www.patheos.com/blogs/allsetfree/2020/12/sins-we-need-to-talk-about/?utm_source=Newsletter&utm_medium=email&utm_campaign=Christians+For+a+Better+Christianity&utm_content=43&lct Interreligious Islam Jewish Justice Latter-Day Saints Literature Literature and Theology Lutheran Methodism Mormonism Nonreligious ontology Orthodox Pagam Prayer progressive Christian PT 6 Dignity Public Theology Race racial justice Religious Liberty Romance Satan Scapegoat Science & Religion Science and Religion social justice Spirituality SR 8 Transhumanism Systematic Theology Taoism Ted Peters UAP UFO Uncategorized War

Select a Month September 2026 August 2026 July 2026 June 2026 May 2026 April 2026 March 2026 February 2026 December 2025 November 2025 October 2025 September 2025 August 2025 July 2025 June 2025 May 2025 April 2025 March 2025 February 2025 January 2025 December 2024 November 2024 October 2024 September 2024 August 2024 July 2024 June 2024 May 2024 April 2024 March 2024 February 2024 January 2024 December 2023 November 2023 October 2023 September 2023 August 2023 July 2023 June 2023 May 2023 April 2023 March 2023 February 2023 January 2023 December 2022 November 2022 October 2022 September 2022 August 2022 July 2022 June 2022 May 2022 April 2022 March 2022 February 2022 January 2022 December 2021 November 2021 October 2021 September 2021

TAKE THE

Religious Wisdom Quiz

Who was the Amalekite king spared by Saul, contrary to God's command?

Select your answer to see how you score.

Abner Agag Goliath Ish-bosheth