Allan Dafoe's guest appearances

Allan Dafoe

EARadio

Future of Life Institute Podcast

80,000 Hours Podcast

EA Talks

The Nonlinear Library

The Nonlinear Library: EA Forum Top Posts

AI Safety Fundamentals: Alignment

AI Safety Fundamentals: Governance

Jeffrey Ding

William MacAskill

Joshua Greene

Jade Leung

Brian Tomasik

Helen Toner

Peter Singer

David Pearce

Robin Hanson

Rob Wiblin

Baobao Zhang

Jaan Tallinn

Rohin Shah

George Church

Stefan Schubert

OwlTail

AI governance concerns how humanity can best navigate the transition to a world with advanced AI systems. It relates to how decisions are made about AI and what institutions and arrangements would help those decisions to be made well. I believe advances in AI are likely to be among the most impactful global developments in the coming decades, and that AI governance will become among the most important global issue areas. AI governance is a new field and is relatively neglected. I’ll explain here how I think about this as a cause area and my perspective on how best to pursue positive impact in this space. The value of investing in this field can be appreciated whether one is primarily concerned with contemporary policy challenges or long-term risks and opportunities (“longtermism”); this piece is primarily aimed at a longtermist perspective. Differing from some other longtermist work on AI, I emphasize the importance of also preparing for more conventional scenarios of AI development. ## Contemporary Policy Challenges AI systems are increasingly being deployed in important domains: for many kinds of surveillance; by authoritarian governments to shape online discourse; for autonomous weapons systems; for cyber tools and autonomous cyber capabilities; to aid and make consequential decisions such as for employment, loans, and criminal sentencing; in advertising; in education and testing; in self-driving cars and navigation; in social media. Society and policy makers are rapidly trying to catch up, to adapt, to create norms and policies to guide these new areas. We see this scramble in contemporary international tax law, competition/antitrust policy, innovation policy, and national security motivated controls on trade and investment. To understand and advise contemporary policymaking, one needs to develop expertise in specific policy areas (such as antitrust/competition policy or international security) as well as in the relevant technical aspects of AI.Original text:https://forum.effectivealtruism.org/posts/42reWndoTEhFqu6T8/ai-governance-opportunity-and-theory-of-impactNarrated for AGI Safety Fundamentals by TYPE III AUDIO.Share feedback on this narration.

AI governance concerns how humanity can best navigate the transition to a world with advanced AI systems. It relates to how decisions are made about AI and what institutions and arrangements would help those decisions to be made well. I believe advances in AI are likely to be among the most impactful global developments in the coming decades, and that AI governance will become among the most important global issue areas. AI governance is a new field and is relatively neglected. I’ll explain here how I think about this as a cause area and my perspective on how best to pursue positive impact in this space. The value of investing in this field can be appreciated whether one is primarily concerned with contemporary policy challenges or long-term risks and opportunities (“longtermism”); this piece is primarily aimed at a longtermist perspective. Differing from some other longtermist work on AI, I emphasize the importance of also preparing for more conventional scenarios of AI development. ## Contemporary Policy Challenges AI systems are increasingly being deployed in important domains: for many kinds of surveillance; by authoritarian governments to shape online discourse; for autonomous weapons systems; for cyber tools and autonomous cyber capabilities; to aid and make consequential decisions such as for employment, loans, and criminal sentencing; in advertising; in education and testing; in self-driving cars and navigation; in social media. Society and policy makers are rapidly trying to catch up, to adapt, to create norms and policies to guide these new areas. We see this scramble in contemporary international tax law, competition/antitrust policy, innovation policy, and national security motivated controls on trade and investment. To understand and advise contemporary policymaking, one needs to develop expertise in specific policy areas (such as antitrust/competition policy or international security) as well as in the relevant technical aspects of AI.Original text:<a href="https://forum.effectivealtruism.org/posts/42reWndoTEhFqu6T8/ai-governance-opportunity-and-theory-of-impact" rel="noopener noreferrer nofollow" target="_blank">https://forum.effectivealtruism.org/posts/42reWndoTEhFqu6T8/ai-governance-opportunity-and-theory-of-impact</a>Narrated for <a href="https://www.agisafetyfundamentals.com/ai-alignment-curriculum" rel="noopener noreferrer nofollow" target="_blank">AGI Safety Fundamentals</a> by <a href="\" rel="noopener noreferrer nofollow" target="_blank">TYPE III AUDIO</a>.<a href="https://docs.google.com/forms/d/e/1FAIpQLScC_z9tBDWzxoS3D0EfNT0Kcjs_T4rNN3FyVwElSdyanel0rA/viewform?usp=pp_url&amp;entry.584848066=https://forum.effectivealtruism.org/posts/42reWndoTEhFqu6T8/ai-governance-opportunity-and-theory-of-impact" rel="noopener noreferrer nofollow" target="_blank">Share feedback on this narration</a>.

[Week 7] “AI Governance: Opportunity and Theory of Impact” by Allan Dafoe

Jessica Cussins

Experts predict that artificial intelligence could become the most transformative innovation in history, eclipsing both the development of agriculture and the industrial revolution. And the technology is developing far faster than the average bureaucracy can keep up with. How can local, national, and international governments prepare for such dramatic changes and help steer AI research and use in a more beneficial direction?On this month’s podcast, Ariel spoke with Allan Dafoe and Jessica Cussins about how different countries are addressing the risks and benefits of AI, and why AI is such a unique and challenging technology to effectively govern. Allan is the Director of the Governance of AI Program at the Future of Humanity Institute, and his research focuses on the international politics of transformative artificial intelligence. Jessica is an AI Policy Specialist with the Future of Life Institute, and she's also a Research Fellow with the UC Berkeley Center for Long-term Cybersecurity, where she conducts research on the security and strategy implications of AI and digital governance.Topics discussed in this episode include:   - Three lenses through which to view AI’s transformative power   - Emerging international and national AI governance strategies   - The risks and benefits of regulating artificial intelligence   - The importance of public trust in AI systems   - The dangers of an AI race   - How AI will change the nature of wealth and power

Experts predict that artificial intelligence could become the most transformative innovation in history, eclipsing both the development of agriculture and the industrial revolution. And the technology is developing far faster than the average bureaucracy can keep up with. How can local, national, and international governments prepare for such dramatic changes and help steer AI research and use in a more beneficial direction? On this month’s podcast, Ariel spoke with Allan Dafoe and Jessica Cussins about how different countries are addressing the risks and benefits of AI, and why AI is such a unique and challenging technology to effectively govern. Allan is the Director of the Governance of AI Program at the Future of Humanity Institute, and his research focuses on the international politics of transformative artificial intelligence. Jessica is an AI Policy Specialist with the Future of Life Institute, and she's also a Research Fellow with the UC Berkeley Center for Long-term Cybersecurity, where she conducts research on the security and strategy implications of AI and digital governance. Topics discussed in this episode include: - Three lenses through which to view AI’s transformative power - Emerging international and national AI governance strategies - The risks and benefits of regulating artificial intelligence - The importance of public trust in AI systems - The dangers of an AI race - How AI will change the nature of wealth and power

AI: Global Governance, National Policy, and Public Trust with Allan Dafoe and Jessica Cussins

AI will transform employment, wealth, power, and world order, posing tremendous opportunities and risks. Allan Dafoe will reflect on how we can prepare for and steer these transformations.Source: Effective Altruism Global (video).Effective Altruism is a social movement dedicated to finding ways to do the most good possible, whether through charitable donations, career choices, or volunteer projects. EA Global conferences are gatherings for EAs to meet. You can also listen to this talk along with its accompanying video on YouTube. 

AI will transform employment, wealth, power, and world order, posing tremendous opportunities and risks. Allan Dafoe will reflect on how we can prepare for and steer these transformations.Source: Effective Altruism Global (<a href="https://www.eaglobal.org/talks/governance-of-artificial-intelligence/" rel="nofollow" target="_blank">video</a>).<a href="https://www.effectivealtruism.org/" rel="nofollow" target="_blank">Effective Altruism</a> is a social movement dedicated to finding ways to do the most good possible, whether through charitable donations, career choices, or volunteer projects. <a href="https://www.eaglobal.com/" rel="nofollow" target="_blank">EA Global</a> conferences are gatherings for EAs to meet. You can also listen to this talk along with its accompanying video on <a href="https://www.youtube.com/c/EffectiveAltruismVideos" rel="nofollow" target="_blank">YouTube</a>.

EAG 2017 London: Governance of artificial intelligence (Allan Dafoe)