{"id":234477,"date":"2024-06-20T13:57:19","date_gmt":"2024-06-20T13:57:19","guid":{"rendered":"https:\/\/michigandigitalnews.com\/index.php\/2024\/06\/20\/openais-ilya-sutskever-launching-own-startup-for-safe-ai\/"},"modified":"2025-06-25T17:16:36","modified_gmt":"2025-06-25T17:16:36","slug":"openais-ilya-sutskever-launching-own-startup-for-safe-ai","status":"publish","type":"post","link":"https:\/\/michigandigitalnews.com\/index.php\/2024\/06\/20\/openais-ilya-sutskever-launching-own-startup-for-safe-ai\/","title":{"rendered":"OpenAI&#8217;s Ilya Sutskever launching own startup for safe AI"},"content":{"rendered":"<p> [ad_1]<br \/>\n<br \/><img decoding=\"async\" src=\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2024\/06\/GettyImages-1258459915-e1718884508742.jpg?w=2048\" \/><\/p>\n<p>The OpenAI chief scientist who nearly brought down CEO Sam Altman in a failed November mutiny as brief as it was spectacular is launching an AI company of his own.\u00a0<\/p>\n<div>\n<p>Ilya Sutskever revealed on Wednesday he was teaming up with OpenAI colleague Daniel Levy and Daniel Gross, a\u00a0<a href=\"https:\/\/techcrunch.com\/2017\/01\/10\/daniel-gross-of-apple-leaves-to-become-y-combinators-newest-partner\/?guccounter=1&amp;guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&amp;guce_referrer_sig=AQAAADzSkDM63nSoaDe4mawkYSRCgOFdMjGR73IAr1ZcRr_4OmVDWtiWwOvQARo0IPJOOG9c9okyER6aFMGzLXXQ2A1dxFcvQXxsp_VMW4H0e4kbvXFoKbLMw_l2hgc-RJaa3iKitztZp9JOLGwRx6mLwg4W0ZnH8TUO583uacPrJc52\" target=\"_blank\" aria-label=\"Go to https:\/\/techcrunch.com\/2017\/01\/10\/daniel-gross-of-apple-leaves-to-become-y-combinators-newest-partner\/?guccounter=1&amp;guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&amp;guce_referrer_sig=AQAAADzSkDM63nSoaDe4mawkYSRCgOFdMjGR73IAr1ZcRr_4OmVDWtiWwOvQARo0IPJOOG9c9okyER6aFMGzLXXQ2A1dxFcvQXxsp_VMW4H0e4kbvXFoKbLMw_l2hgc-RJaa3iKitztZp9JOLGwRx6mLwg4W0ZnH8TUO583uacPrJc52\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">former AI executive<\/a>\u00a0at <a href=\"https:\/\/fortune.com\/company\/apple\/\" target=\"_blank\" aria-label=\"Go to https:\/\/fortune.com\/company\/apple\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">Apple<\/a>, to found Safe Superintelligence Inc., a moniker chosen to reflect its purpose.<\/p>\n<p>\u201cSSI is our mission, our name and our entire product roadmap, because it is our sole focus.\u201d the three wrote in a\u00a0<a href=\"https:\/\/ssi.inc\/\" target=\"_blank\" aria-label=\"Go to https:\/\/ssi.inc\/\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">statement<\/a>\u00a0on the U.S. startup\u2019s barebones website. Building safe superintelligence, they went on to argue, was \u201cthe most important technical problem of our time.\u201d<\/p>\n<p>Artificial superintelligence, or ASI, is believed to be the ultimate breakthrough in AI, since experts predict machines will not stop developing once they reach the kind of general-purpose intelligence know as AGI that is comparable to humans.\u00a0<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">I am starting a new company: <a href=\"https:\/\/t.co\/BG3K3SI3A1\" target=\"_blank\" aria-label=\"Go to https:\/\/t.co\/BG3K3SI3A1\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">https:\/\/t.co\/BG3K3SI3A1<\/a><\/p>\n<p>\u2014 Ilya Sutskever (@ilyasut) <a href=\"https:\/\/twitter.com\/ilyasut\/status\/1803472978753303014?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/ilyasut\/status\/1803472978753303014?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">June 19, 2024<\/a><\/p><\/blockquote>\n<p>Luminaries in the field like the computer scientist Geoffrey Hinton believe ASI to be an existential danger to mankind and building safeguards that align with our interest as a species was one of the\u00a0<a href=\"https:\/\/openai.com\/index\/introducing-superalignment\/\" target=\"_blank\" aria-label=\"Go to https:\/\/openai.com\/index\/introducing-superalignment\/\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">top missions<\/a>\u00a0Sutskever had at OpenAI.<\/p>\n<p>His\u00a0<a href=\"https:\/\/fortune.com\/2024\/05\/14\/openai-chief-scientist-ilya-sutskever-is-leaving-sam-altman\/\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/14\/openai-chief-scientist-ilya-sutskever-is-leaving-sam-altman\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">high-profile departure<\/a>\u00a0in May came almost six months to the day after he joined independent board directors Helen Toner, Tasha McCauley and Adam D\u2019Angelo in removing Altman as CEO against the will of chair Greg Brockman, who immediately resigned.\u00a0<\/p>\n<h2 class=\"wp-block-heading\">Sutskever came to regret his role in briefly ousting Altman <\/h2>\n<p>The spectacular coup, which Toner recently blamed on a\u00a0<a href=\"https:\/\/fortune.com\/2024\/05\/29\/openai-sam-altman-helen-toner-ted-ouster-non-profit-board\/\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/29\/openai-sam-altman-helen-toner-ted-ouster-non-profit-board\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">pattern of deception<\/a>\u00a0by Altman, threatened to tear the company apart. Sutskever quickly expressed his regret and reversed his position, demanding Altman be reinstated to prevent the potential downfall of OpenAI.\u00a0<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">I deeply regret my participation in the board&#8217;s actions. I never intended to harm OpenAI. I love everything we&#8217;ve built together and I will do everything I can to reunite the company.<\/p>\n<p>\u2014 Ilya Sutskever (@ilyasut) <a href=\"https:\/\/twitter.com\/ilyasut\/status\/1726590052392956028?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/ilyasut\/status\/1726590052392956028?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">November 20, 2023<\/a><\/p><\/blockquote>\n<p>In the <a href=\"https:\/\/openai.com\/index\/review-completed-altman-brockman-to-continue-to-lead-openai\/\" target=\"_blank\" aria-label=\"Go to https:\/\/openai.com\/index\/review-completed-altman-brockman-to-continue-to-lead-openai\/\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">aftermath<\/a>, Toner and McCauley left the non-profit board, while Sutskever seemingly vanished from the public eye all the way up until he announced his departure last month.\u00a0<\/p>\n<p>In his resignation announcement, he implied he was voluntarily going to commit to a project \u201cvery personally meaningful to me\u201d and promised to share details at a later unspecified date.<\/p>\n<p>His departure nonetheless set in motion events that quickly revealed deep governance issues that appeared to confirm the board\u2019s initial suspicions.\u00a0<\/p>\n<p>First, Sutskever\u2019s co-lead Jan Leike accused the company of\u00a0<a href=\"https:\/\/fortune.com\/2024\/05\/17\/openai-researcher-resigns-safety\/?utm_source=search&amp;utm_medium=suggested_search&amp;utm_campaign=search_link_clicks\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/17\/openai-researcher-resigns-safety\/?utm_source=search&amp;utm_medium=suggested_search&amp;utm_campaign=search_link_clicks\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">breaking its promise<\/a>\u00a0to give their AI safety team 20% of its compute resources and\u00a0<a href=\"https:\/\/fortune.com\/2024\/05\/15\/openai-sam-altman-ilya-sutskever-jan-leike\/\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/15\/openai-sam-altman-ilya-sutskever-jan-leike\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">resigned<\/a>. Later it emerged employees at OpenAI were slapped with\u00a0<a href=\"https:\/\/www.vox.com\/future-perfect\/2024\/5\/17\/24158478\/openai-departures-sam-altman-employees-chatgpt-release\" target=\"_blank\" aria-label=\"Go to https:\/\/www.vox.com\/future-perfect\/2024\/5\/17\/24158478\/openai-departures-sam-altman-employees-chatgpt-release\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">water-tight gag orders<\/a>\u00a0that forbade them from criticizing the company after they left, at the penalty of\u00a0<a href=\"https:\/\/x.com\/JacobHHilton\/status\/1794090550863200728?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1794090550863200728%7Ctwgr%5E3948ef0cc0846628d9b4833f066313cf2126faa0%7Ctwcon%5Es1_&amp;ref_url=https%3A%2F%2Ffortune.com%2F2024%2F05%2F29%2Fopenai-sam-altman-helen-toner-ted-ouster-non-profit-board%2F\" target=\"_blank\" aria-label=\"Go to https:\/\/x.com\/JacobHHilton\/status\/1794090550863200728?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1794090550863200728%7Ctwgr%5E3948ef0cc0846628d9b4833f066313cf2126faa0%7Ctwcon%5Es1_&amp;ref_url=https%3A%2F%2Ffortune.com%2F2024%2F05%2F29%2Fopenai-sam-altman-helen-toner-ted-ouster-non-profit-board%2F\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">losing their vested shares<\/a>.\u00a0<\/p>\n<p>Finally, actress Scarlett Johansson\u2014who portrayed an AI chatbot in Spike Jonze\u2019s 2013 sci-fi film <em>Her<\/em>\u2014then sued the company claiming Altman effectively\u00a0<a href=\"https:\/\/fortune.com\/2024\/05\/21\/scarlett-johansson-new-chatgpt-bot-sam-altman-openai\/?utm_source=search&amp;utm_medium=suggested_search&amp;utm_campaign=search_link_clicks\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/21\/scarlett-johansson-new-chatgpt-bot-sam-altman-openai\/?utm_source=search&amp;utm_medium=suggested_search&amp;utm_campaign=search_link_clicks\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">stolen her voice<\/a>\u00a0to use for their latest AI product. OpenAI refuted the claim but pledged to change the sound anyway out of respect for her wishes.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">After almost a decade, I have made the decision to leave OpenAI. \u00a0The company\u2019s trajectory has been nothing short of miraculous, and I\u2019m confident that OpenAI will build AGI that is both safe and beneficial under the leadership of <a href=\"https:\/\/twitter.com\/sama?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/sama?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">@sama<\/a>, <a href=\"https:\/\/twitter.com\/gdb?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/gdb?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">@gdb<\/a>, <a href=\"https:\/\/twitter.com\/miramurati?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/miramurati?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">@miramurati<\/a> and now, under the\u2026<\/p>\n<p>\u2014 Ilya Sutskever (@ilyasut) <a href=\"https:\/\/twitter.com\/ilyasut\/status\/1790517455628198322?ref_src=twsrc%5Etfw\" target=\"_blank\" aria-label=\"Go to https:\/\/twitter.com\/ilyasut\/status\/1790517455628198322?ref_src=twsrc%5Etfw\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">May 14, 2024<\/a><\/p><\/blockquote>\n<p>These instances suggested OpenAI had abandoned its original purpose of developing AI that would benefit all of humanity\u2014instead to pursue commercial success.<\/p>\n<p>\u201cThe people interested in safety like Ilya Sutskever wanted significant resources to be spent on safety, people interested in profits like Sam Altman didn\u2019t,\u201d Hinton told\u00a0<em>Bloomberg<\/em>\u00a0last week.\u00a0<\/p>\n<h2 class=\"wp-block-heading\">A leader in the field since AI\u2019s Big Bang Moment<\/h2>\n<p>Sutskever has long been one of the brightest minds in the field of AI, researching artificial neural networks that conceptually mimic the human brain in order to train computers to learn and abstract based on data.\u00a0<\/p>\n<p>In 2012, he teamed up with\u00a0<a href=\"https:\/\/www.nytimes.com\/2019\/03\/27\/technology\/turing-award-ai.html\" target=\"_blank\" aria-label=\"Go to https:\/\/www.nytimes.com\/2019\/03\/27\/technology\/turing-award-ai.html\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">Hinton<\/a>\u00a0to collaborate on the 2012 landmark development\u00a0\u00a0of Alex Krizhevsky\u2019s deep neural network\u00a0<a href=\"https:\/\/papers.nips.cc\/paper_files\/paper\/2012\/file\/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf\" target=\"_blank\" aria-label=\"Go to https:\/\/papers.nips.cc\/paper_files\/paper\/2012\/file\/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">AlexNet<\/a>, commonly considered AI\u2019s Big Bang moment. It was the first machine learning algorithm that could accurately label images fed to it, revolutionizing the field of computer vision.\u00a0<\/p>\n<p>When OpenAI was founded in December 2015, Sutskever received top billing over co-chairs Altman and Elon Musk even though he was only research director. That made sense at the time, as it was formed originally as a non-profit that would create value for everyone rather than shareholders, prioritizing \u201ca good outcome for all over its own self-interest\u201d.<\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<p><iframe title=\"AI will become smarter than humans: Geoffrey Hinton\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/mqjX8AzfJ_A?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<\/figure>\n<p>Since then, however, OpenAI has effectively become a commercial enterprise, in Altman\u2019s words \u2018<a href=\"https:\/\/fortune.com\/2024\/05\/03\/openai-sam-altman-microsoft-agi-artificial-general-intelligence-costs\/\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/05\/03\/openai-sam-altman-microsoft-agi-artificial-general-intelligence-costs\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">to pay the bills\u2019<\/a>\u00a0for its compute-heavy operations. In the process it adopted a\u00a0<a href=\"https:\/\/openai.com\/our-structure\/\" target=\"_blank\" aria-label=\"Go to https:\/\/openai.com\/our-structure\/\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">complicated structure<\/a>\u00a0with a new for-profit entity where returns were capped for investors like <a href=\"https:\/\/fortune.com\/company\/microsoft\/\" target=\"_blank\" aria-label=\"Go to https:\/\/fortune.com\/company\/microsoft\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">Microsoft<\/a> and Khosla Ventures, but control remained with the non-profit board.<\/p>\n<p>Altman called this convoluted governance necessary at the time in order to keep everyone on board. Recently\u00a0<em>The Information<\/em>\u00a0<a href=\"https:\/\/www.theinformation.com\/articles\/openai-ceo-says-company-could-become-benefit-corporation-akin-to-rivals-anthropic-xai\" target=\"_blank\" aria-label=\"Go to https:\/\/www.theinformation.com\/articles\/openai-ceo-says-company-could-become-benefit-corporation-akin-to-rivals-anthropic-xai\" rel=\"noopener\" class=\"sc-80b85506-0 pUpMT\">reported<\/a>\u00a0he sought to change OpenAI\u2019s legal structure, opening the door for a <a href=\"https:\/\/fortune.com\/2024\/03\/05\/elon-musk-openai-lawsuit-founding-agreement-artificial-general-intelligence\/\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/2024\/03\/05\/elon-musk-openai-lawsuit-founding-agreement-artificial-general-intelligence\/\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">controversial<\/a> IPO.<\/p>\n<p>Sutskever\u2019s new commercial enterprise dedicated to safe superintelligence will be located in Silicon Valley\u2019s Palo Alto and Tel Aviv, Israel, in order to best recruit top talent.\u00a0<\/p>\n<p>\u201cOur team, investors and business model are all aligned to achieve SSI,\u201d they wrote, pledging there would be \u201cno distraction by management overhead or product cycles\u201d.<\/p>\n<p>How he and his two co-founders aim to both create ASI endowed with robust guardrails while also paying the bills and earning a return for their investors was not immediately clear from the statement, however. Whether it too has a capped for-profit structure, for example, was not revealed.\u00a0<\/p>\n<p>They merely said only that the business model of Safe Superintelligence was designed from the outset to be \u201cinsulated from short-term commercial pressures.\u201d<\/p>\n<\/div>\n<div data-cy=\"subscriptionPlea\">Subscribe to the Fortune Next to Lead newsletter to get weekly strategies on how to make it to the corner office. <a href=\"https:\/\/fortune.com\/newsletters\/next-to-lead?&amp;itm_source=fortune&amp;itm_medium=article_tout&amp;itm_campaign=next_to_lead\" target=\"_self\" aria-label=\"Go to https:\/\/fortune.com\/newsletters\/next-to-lead?&amp;itm_source=fortune&amp;itm_medium=article_tout&amp;itm_campaign=next_to_lead\" class=\"sc-80b85506-0 pUpMT\" rel=\"noopener\">Sign up for free<\/a> before it launches on June 24, 2024.<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><br \/>\n<br \/>[ad_2]<br \/>\n<br \/><a href=\"https:\/\/fortune.com\/2024\/06\/20\/openai-ilya-sutskever-sam-altman-safe-superintelligence\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] The OpenAI chief scientist who nearly brought down CEO Sam Altman in a failed November mutiny as brief as it was spectacular is launching<\/p>\n","protected":false},"author":1,"featured_media":234478,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[149],"tags":[],"_links":{"self":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/234477"}],"collection":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/comments?post=234477"}],"version-history":[{"count":0,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/234477\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media\/234478"}],"wp:attachment":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media?parent=234477"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/categories?post=234477"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/tags?post=234477"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}