Zoho to leverage NVIDIA NeMo to build and deploy LLMs for businesses

Zoho has confirmed to invest an additional $10 million in NVIDIA GPUs next year.

NVIDIA NeMo is an end-to-end AI platform. (Express Photo)

Zoho Corporation, on Thursday, at the ongoing NVIDIA AI Summit 2024 in Mumbai, announced it will leverage NVIDIA NeMo, a part of NVIDIA AI Enterprise software, to develop and deploy large language models (LLMs) for its software-as-a-service (SaaS) platforms.

Zoho has already spent over $10 million on NVIDIA GPUs and AI solutions, and the company has confirmed it will invest an additional $10 million on NVIDIA GPUs and AI technologies.

📢 We’re happy to announce our partnership with NVIDIA! 🎉

This investment reinforces our commitment to privacy-first LLMs that will deliver contextual intelligence without using customer data. Ramprakash Ramamoorthy, our director of AI, shares more.👇 https://t.co/WKGDysDL8a pic.twitter.com/1iF5Bm1BmN

— Zoho (@Zoho) October 24, 2024

“Many LLMs on the market today are designed for consumer use, offering limited value for businesses. At Zoho, our mission is to develop LLMs tailored specifically for a wide range of business use cases. Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective,” said Ramprakash Ramamoorthy, director of AI at Zoho Corporation.

Zoho will deploy its AI models on NVIDIA Hopper GPUs using the NeMo end-to-end platform to develop custom LLMs, multimodal, vision, and speech AI.

The company is also testing NVIDIA TensorRT-LLM to further optimise the deployment of LLMs to increase throughput by 60 per cent and reduce latency by 30 per cent.

This is said to help over 700,000+ customers across Zoho platforms throughout the world in deploying and managing large language models on ManageEngine and Zoho.com.

Zoho is currently developing several LLMs, which will be integrated within the company’s corporate customer base. The company states that its AI models will be compliant with privacy regulations from the ground up to help businesses improve return on investment (ROI) using full-stack NVIDIA AI solutions.