{"id":206758,"date":"2024-02-22T19:39:01","date_gmt":"2024-02-22T19:39:01","guid":{"rendered":"https:\/\/michigandigitalnews.com\/index.php\/2024\/02\/22\/what-exactly-does-nvidia-do-and-why-are-its-ai-chips-so-valuable\/"},"modified":"2025-06-25T17:21:45","modified_gmt":"2025-06-25T17:21:45","slug":"what-exactly-does-nvidia-do-and-why-are-its-ai-chips-so-valuable","status":"publish","type":"post","link":"https:\/\/michigandigitalnews.com\/index.php\/2024\/02\/22\/what-exactly-does-nvidia-do-and-why-are-its-ai-chips-so-valuable\/","title":{"rendered":"What exactly does Nvidia do and why are its AI chips so valuable?"},"content":{"rendered":"<p> [ad_1]<br \/>\n<br \/><img decoding=\"async\" src=\"https:\/\/content.fortune.com\/wp-content\/uploads\/2024\/02\/GettyImages-1258356137_f2a144-e1708626274327.jpg?w=2048\" \/><\/p>\n<p>Chip designer <a href=\"https:\/\/fortune.com\/company\/nvidia\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Nvidia<\/a> has emerged as the clear winner in not just the early stages of the AI boom but, at least so far, in all of stock market history. The $1.9 trillion AI giant surged to a record high stock price on Thursday, putting it on course to add over $230 billion to its market capitalization and <a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2024-02-22\/nvidia-to-top-meta-record-with-nearly-250-billion-value-jump\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">shatter a one-day record only weeks old<\/a>: Meta\u2019s $197 billion gain in <a href=\"https:\/\/fortune.com\/2024\/02\/02\/meta-stock-earnings-zuckerberg-year-of-efficiency-layoffs-dividend\/\" target=\"_self\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">early February<\/a>. <\/p>\n<div>\n<p>It\u2019s dominating the market, selling over <a href=\"https:\/\/www.nytimes.com\/2023\/08\/21\/technology\/nvidia-ai-chips-gpu.html\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">70% of all AI chips<\/a>, and startups are desperate to spend hundreds of thousands of dollars on Nvidia\u2019s hardware systems. Wall Street can\u2019t get enough, either\u2014Nvidia stock rocketed up an astonishing <a href=\"https:\/\/fortune.com\/2024\/02\/21\/1-7-trillion-chip-giant-nvidia-earnings-report-ai-bubble-market-crash-dotcom-bust\/\" target=\"_self\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">15% after the company smashed its lofty earnings goals last quarter<\/a>, bringing its market cap to over $1.9 trillion on top of its stock value <a href=\"https:\/\/finance.yahoo.com\/news\/nvidia-stock-tripled-past-still-041824134.html\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">tripling in the last year<\/a> alone.\u00a0<\/p>\n<p>So \u2026 why? How is it that a company founded all the way back in 1993 has displaced tech titans <a href=\"https:\/\/fortune.com\/company\/alphabet\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Alphabet<\/a> and <a href=\"https:\/\/fortune.com\/company\/amazon-com\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Amazon<\/a>, leapfrogging them to become the <a href=\"https:\/\/fortune.com\/2024\/02\/15\/nvidia-third-most-valuable-u-s-company-alphabet-microsoft-apple\/\" target=\"_self\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">third-most valuable company in the world<\/a>? It all comes down to Nvidia\u2019s leading semiconductor chips for use in artificial intelligence.<\/p>\n<h2 class=\"wp-block-heading\">The company that \u2018got it\u2019<\/h2>\n<p>Nvidia built up its advantage by playing the long game and investing in AI since years before ChatGPT hit the market, and its chip designs are so far ahead of the competition that analysts wonder if it\u2019s even possible for anyone else to catch up. Designers such as Arm Holdings and <a href=\"https:\/\/fortune.com\/company\/intel\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Intel<\/a>, for instance, haven\u2019t yet integrated hardware with AI-targeted software in the way Nvidia has.<\/p>\n<p>\u201cThis is one of the great observations that we made: we realized that deep learning and AI was not [just] a chip problem \u2026 Every aspect of computing has fundamentally changed,\u201d said Nvidia co-founder and CEO Jensen Huang at the New York Times\u2019 DealBook summit last November. \u201cWe observed and realized that about a decade and a half ago. I think a lot of people are still trying to sort that out.\u201d Jensen said Nvidia just \u201cgot it\u201d before anyone else did. \u201cThe reason why people say we\u2019re practically the only company doing it is because we\u2019re probably the only company that got it. And people are still trying to get it.\u201d<\/p>\n<p>Software has been a key part of that equation. While competitors have focused their efforts on chip design, Nvidia has aggressively pushed its CUDA programming interface that runs on top of its chips. That dual emphasis on software and hardware has made Nvidia chips the must-have tool for any developer looking to get into AI.<\/p>\n<p>\u201cNvidia has done just a masterful job of making it easier to run on CUDA than to run on anything else,\u201d said Edward Wilford, an analyst at tech consultancy Omdia. \u201cCUDA is hands-down the jewel in Nvidia\u2019s crown. It\u2019s the thing that\u2019s gotten them this far. And I think it\u2019s going to carry them for a while longer.\u201d<\/p>\n<p>AI needs computing power\u2014<em>a lot<\/em> of computing power. AI chatbots such as ChatGPT are trained by inhaling vast quantities of data sourced from the internet\u2014<a href=\"https:\/\/www.wired.com\/story\/how-chatgpt-works-large-language-model\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">up to a trillion<\/a> distinct pieces of information. That data is fed into a neural network that catalogs the associations between various words and phrases, which, after human training, can be used to produce responses to user queries in natural language. All those trillions of data points require huge amounts of hardware capacity, and hardware demand is only expected to increase as the AI field continues to grow. That\u2019s put Nvidia, the sector\u2019s biggest seller, in a great position to benefit.<\/p>\n<p>Huang sounded a similar tune on his <a href=\"https:\/\/fortune.com\/2024\/02\/22\/billionaire-jensen-huang-nvidia-ai-tipping-point-whole-new-industry\/\" target=\"_self\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">triumphant earnings call on Wednesday<\/a>. Highlighting the shift from general-purpose computing to what he called \u201caccelerated computing\u201d at data centers, he argued that it\u2019s \u201ca whole new way of doing computing\u201d\u2014and even crowned it \u201ca whole new industry.\u201d\u00a0<\/p>\n<h2 class=\"wp-block-heading\">In early on the AI boom<\/h2>\n<p>Nvidia has been at the forefront of AI hardware from the start. When large-scale AI research from startups such as OpenAI started ramping up in the mid-2010s, Nvidia\u2014through a mixture of luck and smart bets\u2014was in the right place at the right time.<\/p>\n<p>Nvidia had long been known for its innovative GPUs, a type of chip popular for gaming applications. Most standard computer chips, called CPUs, excel at performing complicated calculations in sequence, one at a time. But GPUs can perform many simple calculations at once, making them excellent at supporting the complex graphics processing that video games demand. As it turned out, Nvidia\u2019s GPUs were a perfect fit for the type of computing systems AI developers needed to build and train LLMs.<\/p>\n<p>\u201cTo some extent, you could say they\u2019ve been extremely lucky. But I think that diminishes it\u2014they have capitalized perfectly on every instance of luck on every opportunity they were given,\u201d said Wilford. \u201cIf you go back five or 10 years, you see this ramp-up in console gaming. They rode that, and then when they felt that wave cresting, they got into cryptocurrency mining, and they rode that. And then just as that wave crested, AI started to take off.\u201d<\/p>\n<p>In fact, Nvidia had been quietly developing AI-targeted hardware for years. As far back as 2012, <a href=\"https:\/\/papers.nips.cc\/paper_files\/paper\/2012\/file\/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Nvidia chips were the technical foundation of AlexNet<\/a>, the groundbreaking early neural network developed in part by OpenAI cofounder and former Chief Scientist Ilya Sutskever, who recently left the nonprofit after trying to oust CEO Sam Altman. That first mover advantage has given Nvidia a big leg up over its competitors.\u00a0<\/p>\n<p>\u201cThey were visionaries \u2026 for Jensen, that goes back to his days at Stanford,\u201d said Wilford. \u201cHe\u2019s been waiting for this opportunity the whole time. And he\u2019s kept Nvidia in a position to jump on it whenever the chance came. What we\u2019ve seen in the last few years is that that strategy executed to perfection. I can\u2019t imagine someone doing better with it than Nvidia has.\u201d<\/p>\n<p>Since its early AI investments over a decade ago, Nvidia has poured millions into a hugely profitable AI hardware business. The company sells its flagship <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/technologies\/hopper-architecture\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Hopper GPU<\/a> for a quarter of a million dollars per unit. It\u2019s a 70-pound supercomputer, built from 35,000 individual pieces\u2014and the <a href=\"https:\/\/www.tomshardware.com\/tech-industry\/artificial-intelligence\/wait-times-for-nvidias-ai-gpus-eases-to-three-to-four-months-suggesting-peak-in-near-term-growth-the-wait-list-for-an-h100-was-previously-eleven-months-ubs\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">waiting list for customers to get their hands on one is months long<\/a>. Desperate AI developers are turning to organizations like the <a href=\"https:\/\/sfcompute.com\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">San Francisco Compute Group<\/a>, which rents out computing power by the hour from their collection of Nvidia chips. (As of this article\u2019s publication, they\u2019re booked out for almost a month.)<\/p>\n<p>Nvidia\u2019s AI chip juggernaut is poised to grow even more if AI growth meets analysts\u2019 expectations.\u00a0<\/p>\n<p>\u201cNvidia delivered against what was seemingly a very high bar,\u201d wrote <a href=\"https:\/\/fortune.com\/company\/goldman-sachs-group\/\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Goldman Sachs<\/a> in its Nvidia earnings analysis. \u201cWe expect not only sustained growth in Gen AI infrastructure spending by the large CSPs and consumer internet companies, but also increased development and adoption of AI across enterprise customers representing various industry verticals and, increasingly, sovereign states.\u201d<\/p>\n<p>There are some potential threats to Nvidia\u2019s market domination. For one, investors noted in the company\u2019s most recent earnings that restrictions on exports to China dinged business, and a potential increase in competition from Chinese chip designers could put pressure on Nvidia\u2019s global market share. And Nvidia is also dependent on Taiwanese chip foundry TSMC to actually manufacture many of the chips it designs. The Biden administration has been pushing for more investment in domestic manufacturing through the CHIPS act, but <a href=\"https:\/\/www.youtube.com\/watch?v=Pkj-BLHs6dE\" target=\"_blank\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Jensen himself said<\/a> it will be at least a decade before American foundries could be fully operational.<\/p>\n<p>\u201c[Nvidia is] highly dependent on TSMC in Taiwan, and there are regional complications [associated with that], there are political complications,\u201d said Wilford. \u201c[And] the Chinese government is investing very heavily in developing their own AI capabilities as a result of some of those same tensions.\u201d<\/p>\n<\/div>\n<div data-cy=\"subscriptionPlea\">Subscribe to the Eye on AI newsletter to stay abreast of how AI is shaping the future of business. <a href=\"https:\/\/www.fortune.com\/newsletters\/eye-on-ai?&amp;itm_source=fortune&amp;itm_medium=article_tout&amp;itm_campaign=eye_on_ai\" target=\"_self\" rel=\"noopener\" class=\"sc-47dba8f0-0 iRbseu styledLinkColor \">Sign up<\/a> for free.<\/div>\n<p>[ad_2]<br \/>\n<br \/><a href=\"https:\/\/fortune.com\/2024\/02\/22\/what-does-nvidia-do-chips-ai-jensen-huang\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] Chip designer Nvidia has emerged as the clear winner in not just the early stages of the AI boom but, at least so far,<\/p>\n","protected":false},"author":1,"featured_media":206759,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[149],"tags":[],"_links":{"self":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/206758"}],"collection":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/comments?post=206758"}],"version-history":[{"count":4,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/206758\/revisions"}],"predecessor-version":[{"id":343351,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/posts\/206758\/revisions\/343351"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media\/206759"}],"wp:attachment":[{"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/media?parent=206758"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/categories?post=206758"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michigandigitalnews.com\/index.php\/wp-json\/wp\/v2\/tags?post=206758"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}