{"id":20247,"date":"2022-10-21T21:36:21","date_gmt":"2022-10-21T21:36:21","guid":{"rendered":"https:\/\/peymantaeidi.net\/stem-cell\/?p=20247"},"modified":"2022-10-21T22:41:35","modified_gmt":"2022-10-21T22:41:35","slug":"5-questions-for-nick-bostrom","status":"publish","type":"post","link":"https:\/\/peymantaeidi.net\/stem-cell\/2022\/10\/21\/5-questions-for-nick-bostrom\/","title":{"rendered":"5 questions for Nick Bostrom"},"content":{"rendered":"<p>.cms-textAlign-left{text-align:left;}.cms-textAlign-center{text-align:center;}.cms-textAlign-right{text-align:right;}<\/p>\n<p><i>With help from Derek Robertson<\/i><\/p>\n<div class=\"story-interrupt pos-alpha format-m\">\n<aside class=\"interrupt-item\">\n<div class=\"story-media\">\n<figure class=\"media-item type-photo\">\n<div class=\"fig-graphic\">\n<p><img decoding=\"async\" data-lazy-img=\"https:\/\/peymantaeidi.net\/stem-cell\/wp-content\/uploads\/2022\/10\/90-4\" src=\"image\/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" alt=\"Nick Bostrom resting his chin on his hand.\" \/>\n<\/div><figcaption>\n<p>\nNick Bostrom. | Wikimedia Commons<\/p>\n<\/figcaption><\/figure>\n<\/div>\n<\/aside>\n<\/div>\n<p><i>Welcome back to our regular Friday feature, <\/i><b><i>The Future in Five Questions<\/i><\/b><i>. Today we have Nick Bostrom, the author of \u201c<\/i><a href=\"https:\/\/www.amazon.com\/Superintelligence-Dangers-Strategies-Nick-Bostrom\/dp\/1501227742\" target=\"_blank\" rel=\"noopener\"><i><u>Superintelligence<\/u><\/i><\/a><i>\u201d \u2014&nbsp;the New York Times bestselling book that united Elon Musk and Bill Gates over concerns about the existential risks of AI. His ongoing research focuses on, among other things, whether AI should have rights. Responses have been edited for length and clarity.<\/i><\/p>\n<p><b>What\u2019s one underrated big idea?<\/b><\/p>\n<p>The moral status of future digital minds. The idea is that as AI systems become more sophisticated and match smaller mammals in their capabilities \u2014 and then even more so, as they approach human capabilities \u2014 that they might begin to have claims to moral status to match.<i> <\/i>This issue is very much on the fringes of the debate, even though it&#8217;s roughly now where AI safety was in the 2012-2014 period.<\/p>\n<p>It would be premature for legislation to enter this area. There are still so many fundamental unknowns here. We don&#8217;t have a good grasp exactly of what the criteria would be for when a digital mind is conscious or when it has other properties that might grant moral status.<\/p>\n<p><b>What\u2019s a technology you think is overhyped?&nbsp;<\/b><\/p>\n<p>A few years ago, I thought 3D printing was overhyped. Like, oh, in the future, everybody will have a 3D printer in their home! It always seemed implausible to me that you would want to print out your little plastic utensils and replace your china with that. Even if you could print out that coffee mug, how much of a limiting factor was getting a hold of a coffee mug for consumers in the first place?<\/p>\n<p><b>What book most shaped your conception of the future?<\/b><\/p>\n<p>K. Eric Drexler\u2019s \u201c<a href=\"https:\/\/www.amazon.com\/Engines-Creation-Nanotechnology-Library-Science\/dp\/0385199732\" target=\"_blank\" rel=\"noopener\"><u>Engines of Creation<\/u><\/a>,\u201d where he laid out his vision for the future of nanotechnology back in 1986.<b> <\/b>Then there was a book by a philosopher, John Leslie, \u201c<a href=\"https:\/\/www.amazon.com\/End-World-Science-Ethics-Extinction\/dp\/0415140439\" target=\"_blank\" rel=\"noopener\"><u>The End of the World<\/u><\/a>,\u201d which was an early example of trying to think about risks to our future. And also a book by Hans Moravec, \u201c<a href=\"https:\/\/www.amazon.com\/Mind-Children-Future-Robot-Intelligence\/dp\/0674576187\" target=\"_blank\" rel=\"noopener\"><u>Mind Children<\/u><\/a>,\u201d that was an early discussion about the future of AI.<\/p>\n<p><b>What could government be doing regarding tech that it isn\u2019t?<\/b><\/p>\n<p>Lawmakers and regulators should be more on top of the rapid advances in synthetic biology.<\/p>\n<p>The culture in the field of nuclear physics looked very different after Hiroshima and Nagasaki. Nuclear physicists realized that what they were doing was not just creative science, but that they had some responsibility and a need for secrecy when their work could be used to manufacture nuclear weapons technology.<\/p>\n<p>That same understanding is not very widespread in the biotech world. There is still an emphasis on democratizing access and open publishing and making tools available, but it is a field as dangerous as nuclear physics \u2014 more so, in fact, because even if you knew exactly all the designs, tools and tips needed to manufacture nuclear weapons, you could still not make one because you\u2019d need very difficult-to-obtain raw materials, whereas in biology, you&#8217;re not really limited to any difficult ingredients \u2014 so all you require is the knowledge.<\/p>\n<p><b>What has surprised you most this year?<\/b><\/p>\n<p>The failure to fund the <a href=\"https:\/\/www.congress.gov\/bill\/117th-congress\/senate-bill\/3799\" target=\"_blank\" rel=\"noopener\"><u>pandemic preparedness bill<\/u><\/a> \u2014 specifically the failure to get it fully funded <a href=\"https:\/\/www.politico.com\/news\/2020\/03\/28\/congress-pandemic-bill-coronavirus-152580\" target=\"_blank\" rel=\"noopener\"><u>the first time around<\/u><\/a>. I had thought, given COVID, this would be one of the few things that would have bipartisan support. I would have thought that a lot of political interests would have been served in pushing for this.<\/p>\n<aside class=\"story-related cl-l db\">\n<\/aside>\n<header class=\"block-p-header\">\n<h2>no cap?<\/h2>\n<\/header>\n<p><b>POLITICO\u2019s Morning Money had a <\/b><a href=\"https:\/\/www.politico.com\/newsletters\/morning-money\/2022\/10\/21\/defi-showdown-at-senate-ag-00062869\" target=\"_blank\" rel=\"noopener\"><b><u>report this morning<\/u><\/b><\/a><b> <\/b>on a proposal to have the Commodity Futures Trading Commission regulate crypto \u2014 and the internecine fight it\u2019s touched off in the industry.<\/p>\n<p>Blockchain Association Executive Director Kristin Smith told MM\u2019s Sam Sutton and Kate Davidson that the legislative proposal \u201cdoesn\u2019t seem to be totally ready for primetime yet,\u201d reflecting the controversy that\u2019s sprouted over a few potential key changes in a <a href=\"https:\/\/github.com\/LeXpunK-Army\/Crypto-CaseLaw\/blob\/main\/DCCPA%20Markup%20Latest%2010.19.22.pdf\" target=\"_blank\" rel=\"noopener\"><u>draft posted<\/u><\/a> by crypto attorney Gabriel Shapiro.<\/p>\n<p>One objection was fairly predictable: Some of those changes would more closely involve the SEC in crypto regulation, something that\u2019s anathema to the industry. The other objection came from unlikely quarters, however: The progressive Center For American Progress, which had endorsed the bill in an attempt to persuade Democrats to back a measure that could at least provide some modicum of regulation and consumer protection for the industry.<\/p>\n<p>Get the <a href=\"https:\/\/www.politico.com\/newsletters\/morning-money\/2022\/10\/21\/defi-showdown-at-senate-ag-00062869\" target=\"_blank\" rel=\"noopener\"><u>whole story<\/u><\/a>, including a threat from CAP\u2019s Todd Phillips that he could still \u201cchange [his] position on the bill and work to defeat it,\u201d over at Morning Money. \u2014 <i>Derek Robertson<\/i><\/p>\n<header class=\"block-p-header\">\n<h2>the state of ai<\/h2>\n<\/header>\n<p><b>As AI takes over the tech world, <\/b>what do the investors with skin in the game think about the past year\u2019s dizzying slate of developments and their potential policy implications?<\/p>\n<p>The pithily titled \u201c<a href=\"https:\/\/www.stateof.ai\/\" target=\"_blank\" rel=\"noopener\"><u>State of AI Report 2022<\/u><\/a>,\u201d from AI investors Nathan Benaich and Ian Hogarth, gives a little bit of insight. The document is packed with analysis of what\u2019s been going on at the cutting edges of research and within the tech industry, but the \u201cpolitics\u201d section of the report has some particularly relevant insights, including:<\/p>\n<ul>\n<li>Academia has almost entirely fallen behind industry when it comes to research, with implications for \u201cAI safety, pursuing diverse ideas, talent concentration, and more\u201d<\/li>\n<li>AI is earning big investments in the defense industry, including Anduril\u2019s $7 billion contract with the Department of Defense<\/li>\n<li>China being cut off from NVIDIA and AMD chips could spark their own homegrown AI R&amp;D<\/li>\n<\/ul>\n<p>The report also tackles safety, noting that the UK and EU are far more proactive on the topic even as researchers across the globe grow increasingly concerned. \u2014 <i>Derek Robertson<\/i><\/p>\n<header class=\"block-p-header\">\n<h2>the future in 5 links<\/h2>\n<\/header>\n<ul>\n<li>Take a look at some of the ways AI is <a href=\"https:\/\/www.nytimes.com\/2022\/10\/21\/technology\/ai-generated-art-jobs-dall-e-2.html\"><b><u>already transforming<\/u><\/b><\/a> artists\u2019 craft.<\/li>\n<li>Microsoft is giving a <a href=\"https:\/\/www.wsj.com\/articles\/microsoft-in-advanced-talks-to-increase-investment-in-openai-11666299548?mod=tech_lead_pos6\"><b><u>major boost<\/u><\/b><\/a> to its investment in OpenAI.<\/li>\n<li>Some Chinese manufacturers are <a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2022-10-21\/one-chinese-chip-startup-shows-key-gap-in-biden-export-curbs?srnd=technology-vp&amp;leadSource=uverify%20wall\"><b><u>already skirting<\/u><\/b><\/a> the Biden administration\u2019s chip bans.<\/li>\n<li>A new age of bloody <a href=\"https:\/\/www.wired.com\/story\/russia-ukraine-drones-shahed-136-iran\/\"><b><u>drone warfare<\/u><\/b><\/a> is dawning in Ukraine.<\/li>\n<li>A Web3 investor thinks Meta needs to pump even <a href=\"https:\/\/techcrunch.com\/2022\/10\/20\/metas-10b-metaverse-investment-is-not-enough-according-to-animoca-brands-yat-siu\/\"><b><u>more money<\/u><\/b><\/a> into the metaverse.<\/li>\n<\/ul>\n<p><i>Stay in touch with the whole team: <\/i><a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection#50322333382235333b393e37352210203f3c392439333f7e333f3d\" target=\"_blank\" rel=\"noopener\"><i><u>Ben Schreckinger<\/u><\/i><\/a><i> (<a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection\" class=\"__cf_email__\" data-cfemail=\"197b6a7a716b7c7a7270777e7c6b59697675706d707a76377a7674\">[email&nbsp;protected]<\/a>); <\/i><a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection#0367716c61667177706c6d43736c6f6a776a606c2d606c6e\" target=\"_blank\" rel=\"noopener\"><i><u>Derek Robertson<\/u><\/i><\/a><i> (<\/i><a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection#385c4a575a5d4a4c4b575678485754514c515b57165b5755\" target=\"_blank\" rel=\"noopener\"><i><u><span class=\"__cf_email__\" data-cfemail=\"95f1e7faf7f0e7e1e6fafbd5e5faf9fce1fcf6fabbf6faf8\">[email&nbsp;protected]<\/span><\/u><\/i><\/a><i>); <\/i><a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection#d0a3b8b5a5a3b5a290a0bfbcb9a4b9b3bffeb3bfbd\" target=\"_blank\" rel=\"noopener\"><i><u>Steve Heuser<\/u><\/i><\/a><i> (<a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection\" class=\"__cf_email__\" data-cfemail=\"6d1e0508181e081f2d1d02010419040e02430e0200\">[email&nbsp;protected]<\/a>); and <\/i><a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection#c2a0abb4a7b182b2adaeabb6aba1adeca1adaf\" target=\"_blank\" rel=\"noopener\"><i><u>Benton Ives<\/u><\/i><\/a><i> (<a href=\"https:\/\/www.politico.com\/cdn-cgi\/l\/email-protection\" class=\"__cf_email__\" data-cfemail=\"85e7ecf3e0f6c5f5eae9ecf1ece6eaabe6eae8\">[email&nbsp;protected]<\/a>). Follow us <\/i><a href=\"https:\/\/www.twitter.com\/DigitalFuture\" target=\"_blank\" rel=\"noopener\"><i><u>@DigitalFuture<\/u><\/i><\/a><i> on Twitter.<\/i><\/p>\n<p><i>If you\u2019ve had this newsletter forwarded to you, you can <\/i><a href=\"https:\/\/www.politico.com\/newsletters\/morning-tech\/archive\" target=\"_blank\" rel=\"noopener\"><i><u>sign up<\/u><\/i><\/a><i> and read <\/i><a href=\"https:\/\/www.politico.com\/newsletters\/digital-future-daily\/2022\/04\/04\/welcome-to-politicos-digital-future-daily-00022481\" target=\"_blank\" rel=\"noopener\"><i><u>our mission statement<\/u><\/i><\/a><i> at the links provided.<\/i><\/p>\n<aside class=\"story-related cl-l db\">\n<\/aside>\n<ul class=\"twitter-authors\">\n<div class=\"twitter-authors__content\">\n<img decoding=\"async\" src=\"https:\/\/peymantaeidi.net\/stem-cell\/wp-content\/uploads\/2022\/10\/icon-twitter-circle-blue402x.png\" class=\"twitter-authors__icon\" alt=\"image\" \/><\/p>\n<\/div>\n<\/ul>\n<div class=\"story-supplement\">\n<nav class=\"content-nav\" role=\"navigation\">\n<div class=\"contextual\">\n<a href=\"https:\/\/www.politico.com\/newsletters\/morning-tech\/archive\" class=\"button\" target=\"_top\" rel=\"noopener\">\u00ab View Archives<\/a><\/div>\n<\/nav>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>.cms-textAlign-left{text-align:left;}.cms-textAlign-center{text-align:center;}.cms-textAlign-right{text-align:right;} With help from Derek Robertson Nick Bostrom. | Wikimedia Commons Welcome back to our<\/p>\n","protected":false},"author":1,"featured_media":20249,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/20247"}],"collection":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/comments?post=20247"}],"version-history":[{"count":3,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/20247\/revisions"}],"predecessor-version":[{"id":20253,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/20247\/revisions\/20253"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/media\/20249"}],"wp:attachment":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/media?parent=20247"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/categories?post=20247"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/tags?post=20247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}