\n <\/p>\n
<\/p>\n NVIDIA launches AI Foundry service and NIM microservices, enabling enterprises to create custom Llama 3.1 generative AI models for industry-specific applications.<\/p>\n
NVIDIA has announced the launch of its new NVIDIA AI Foundry service along with NVIDIA NIM\u2122 inference microservices, aimed at revolutionizing generative AI capabilities for enterprises worldwide. The initiative features the Llama 3.1 collection of openly available models, introduced to provide businesses with advanced AI tools.<\/p>\n With the NVIDIA AI Foundry, enterprises and nations can now build bespoke ‘supermodels’ tailored to their specific industry needs using Llama 3.1 and NVIDIA’s technology. These models can be trained with proprietary and synthetic data generated from Llama 3.1 405B and the NVIDIA Nemotron\u2122 Reward model.<\/p>\n The AI Foundry is powered by the NVIDIA DGX\u2122 Cloud AI platform, co-engineered with leading public cloud providers, offering scalable compute resources to meet evolving AI demands. This service aims to support enterprises and nations in developing sovereign AI strategies and custom large language models (LLMs) for domain-specific applications.<\/p>\n Accenture is the first to leverage NVIDIA AI Foundry to create custom Llama 3.1 models for its clients. Companies like Aramco, AT&T, and Uber are among the early adopters of the new Llama NVIDIA NIM microservices, indicating a strong interest across various industries.<\/p>\n \u201cMeta\u2019s openly available Llama 3.1 models mark a pivotal moment for the adoption of generative AI within the world\u2019s enterprises,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cLlama 3.1 opens the floodgates for every enterprise and industry to build state-of-the-art generative AI applications. NVIDIA AI Foundry has integrated Llama 3.1 throughout and is ready to help enterprises build and deploy custom Llama supermodels.\u201d<\/p>\n NVIDIA NIM inference microservices for Llama 3.1 are now available for download, promising up to 2.5x higher throughput compared to traditional inference methods. Enterprises can also pair these with new NVIDIA NeMo Retriever NIM microservices to create advanced AI retrieval pipelines for digital assistants and human avatars.<\/p>\n Accenture, utilizing its AI Refinery\u2122 framework, is pioneering the use of NVIDIA AI Foundry to develop custom Llama 3.1 models. \u201cThe world\u2019s leading enterprises see how generative AI is transforming every industry and are eager to deploy applications powered by custom models,\u201d said Julie Sweet, chair and CEO of Accenture. \u201cAccenture has been working with NVIDIA NIM inference microservices for our internal AI applications, and now, using NVIDIA AI Foundry, we can help clients quickly create and deploy custom Llama 3.1 models to power transformative AI applications for their own business priorities.\u201d<\/p>\n NVIDIA AI Foundry offers an end-to-end service that includes model curation, synthetic data generation, fine-tuning, retrieval, and evaluation. Enterprises can use Llama 3.1 models and the NVIDIA NeMo platform to create domain-specific models, with the option to generate synthetic data to enhance model accuracy.<\/p>\n NVIDIA and Meta have collaborated to provide a distillation recipe for Llama 3.1, enabling developers to build smaller, custom models suitable for a range of infrastructure, from AI workstations to laptops.<\/p>\n Leading companies across healthcare, energy, financial services, retail, transportation, and telecommunications are already integrating NVIDIA NIM microservices for Llama 3.1, trained on over 16,000 NVIDIA H100 Tensor Core GPUs.<\/p>\n Production support for Llama 3.1 NIM and NeMo Retriever NIM microservices is available through NVIDIA AI Enterprise. Additionally, members of the NVIDIA Developer Program will soon have free access to NIM microservices for research, development, and testing.<\/p>\n For more information, visit the NVIDIA Newsroom<\/a>.<\/p>\n
\n Ted Hisokawa<\/a>
\n Jul 23, 2024 18:50<\/span>
\n <\/p>\n
\n
\n ![\"NVIDIA](\"https:\/\/image.blockchain.news:443\/features\/D8E08E86F8EDBDDCD68414CF49BDD8B1401B11A69515DFF98E6B2B03EE9CF9D7.jpg\")
\n <\/a>
\n <\/figure>\nCustom AI Solutions for Enterprises<\/h2>\n
Key Industry Adoption<\/h2>\n
Enhanced AI Capabilities<\/h2>\n
Comprehensive AI Model Services<\/h2>\n
Future Prospects<\/h2>\n