\n
\n
![\"NVIDIA](\"https:\/\/image.blockchain.news:443\/features\/D8E08E86F8EDBDDCD68414CF49BDD8B1401B11A69515DFF98E6B2B03EE9CF9D7.jpg\")
\n
\n <\/a>
\n <\/figure>\n
In a compelling keynote at the Databricks Data + AI Summit 2024, NVIDIA founder and CEO Jensen Huang emphasized the transformative power of accelerated computing in data processing and analytics. Speaking alongside Databricks cofounder and CEO Ali Ghodsi, Huang described business data as a ‘gold mine’ for companies, underscoring the challenges and opportunities in harnessing this valuable resource.<\/p>\n
Databricks Leverages NVIDIA\u2019s Full Stack to Accelerate Generative AI Applications<\/h2>\n
Highlighting a significant development, Huang and Ghodsi announced the integration of NVIDIA\u2019s accelerated computing technology with Databricks Photon, a high-performance data processing engine. This collaboration aims to enhance Databricks SQL’s performance and cost efficiency, leveraging NVIDIA\u2019s capabilities in accelerated computing and generative AI.<\/p>\n
\u201cThis is a big announcement,\u201d Huang remarked, noting the critical role of accelerated computing and generative AI in today’s technological landscape. \u201cNVIDIA and Databricks are combining our expertise to deliver these advancements to enterprises.\u201d<\/p>\n
The integration, which has been five years in the making, involves a set of specialized libraries from NVIDIA to accelerate Photon, enabling faster and more energy-efficient data processing.<\/p>\n
\u201cWe are excited to partner with NVIDIA to utilize GPU acceleration on the Photon engine,\u201d said Ghodsi. \u201cThis will enhance core data processing capabilities and enable them to run on NVIDIA GPUs.\u201d<\/p>\n
Creating Generative AI Factories With NVIDIA NIM<\/h2>\n
Additionally, NVIDIA and Databricks announced that Databricks\u2019 open-source model DBRX is now available as an NVIDIA NIM microservice, accessible via the NVIDIA API catalog. These microservices offer fully optimized, pre-built containers for deployment in various environments, simplifying the integration of generative AI models into applications.<\/p>\n
\u201cCreating these endpoints is complicated,\u201d Huang noted. \u201cWe have optimized everything into a microservice that runs both on the cloud and on-premises, enhancing developer productivity by standardizing the integration of AI models.\u201d<\/p>\n
Launched in March, DBRX leverages Databricks\u2019 comprehensive tools and techniques and is trained using the NVIDIA DGX Cloud platform. Enterprises can customize DBRX with their data to create specific models or use it to develop a mixture of expert models.<\/p>\n
Huang emphasized the importance of accelerating data processing and adopting generative AI, urging companies to engage with these rapidly advancing technologies. \u201cGenerative AI is growing exponentially \u2014 you don\u2019t want to lag behind,\u201d he advised.<\/p>\n
Joining the Conversation<\/h2>\n
Summit attendees were encouraged to participate in sessions and engage with NVIDIA experts to explore the future of AI and data intelligence. Key sessions included:<\/p>\n
- \n
- \u201cDevelopment and Deployment of Generative AI with NVIDIA\u201d at 12:30 p.m. PT<\/li>\n
- \u201cArchitecture Analysis for ETL Processing: CPU vs. GPU\u201d at 4:30 p.m. PT<\/li>\n
- \u201cSpark RAPIDS ML: GPU Accelerated Distributed ML in Spark Clusters\u201d at 1:30 p.m. PT<\/li>\n<\/ul>\n
For more information, visit the NVIDIA Blog<\/a>.<\/p>\n