\n
![](\"https:\/\/readwrite.com\/wp-content\/uploads\/2024\/07\/0_3-1-900x514.jpg\")
<\/p>\n [ad_1]
\n<\/p>\n
As Meta announces its largest and most capable large language model yet with the Llama 3.1 405B, Mark Zuckerberg says it\u2019s important technology isn\u2019t controlled by a handful of companies.<\/p>\n
Opting for a transparent approach, the CEO wrote a public letter on Tuesday<\/a> (July 23) explaining why the LLM is open source and why this is \u2018good for the world.\u2019<\/p>\n \u201cI believe that open source is necessary for a positive AI future,\u201d writes the billionaire.<\/p>\n Mark is an incredible CEO. <\/p>\n What particularly stood out to me from our conversation was how deeply he thinks about open source and how it’ll benefit Meta (and the world) in the long term.<\/p>\n A few of my favorite moments\/quotes:<\/p>\n On the future of AI agents:<\/p>\n “I think we’re going to\u2026 https:\/\/t.co\/rhuOVcapbW<\/a><\/p>\n \u2014 Rowan Cheung (@rowancheung) July 24, 2024<\/a><\/p>\n<\/blockquote>\n \u00a0<\/p>\n \u201cOpen source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn\u2019t concentrated in the hands of a small number of companies, and that the technology can be deployed more evenly and safely across society.\u201d<\/p>\n The new Llama 3.1 405B is the company\u2019s first frontier-level open source AI model<\/a>. Unlike in previous releases, a greater focus on building a broader ecosystem has now been taken.<\/p>\n The team has been working with a range of companies to grow this, citing \u201cAmazon, Databricks, and NVIDIA\u201d as all having full suites of services to support developers fine-tuning and distilling their own models.<\/p>\n Zuckerberg explains how this move was taken to \u201censure that we always have access to the best technology, and that we\u2019re not locking into a competitor\u2019s closed ecosystem where they can restrict what we build.<\/p>\n \u201cOne of my formative experiences has been building our services constrained by what Apple will let us build on their platforms.<\/p>\n \u201cBetween the way they tax developers, the arbitrary rules they apply, and all the product innovations they block from shipping, Meta and many other companies<\/a> would be freed up to build much better services for people if we could build the best versions of our products and competitors were not able to constrain what we could build.\u201d<\/p>\n Meta officially announced<\/a> Llama 3.1 on Tuesday (July 23) describing it as having \u201cstate-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.\u201d<\/p>\n The LLM was trained on over 15 trillion tokens and model training was pushed to over 16 thousand H100 GPUs, making it the first Llama model to be done at such scale.<\/p>\n Meta says they\u2019ve spoken with the community and realize there\u2019s so much more to generative AI development than just prompting models.<\/p>\n As such, they believe developers can do the following with the ecosystem: \u201creal-time and batch interference, supervised fine-tuning, evaluation of your model for a specific application, continual pre-training, retrieval-augmented generation, function calling, and synthetic data generation.\u201d<\/p>\n Featured Image: Via Anthony Quintano on Flickr<\/a><\/strong><\/em><\/p>\n<\/p><\/div>\n\n
What is the Llama 3.1 405B model by Mark Zuckerberg\u2019s Meta?<\/b><\/h2>\n