Zoho rolls out LLM, prebuilt AI Agents

Zoho has unveiled a suite of artificial intelligence (AI) tools and services, including its proprietary large language model, Zia LLM, more than 25 ready-to-use AI agents, a no-code agent builder called Zia Agent Studio, and a model context protocol (MCP) server.

These tools are designed to help businesses streamline workflows, lower operational costs, and safeguard data privacy.

Built on NVIDIA’s AI-accelerated computing platform, Zia LLM features three models with 1.3 billion, 2.6 billion, and 7 billion parameters, each optimized for specific tasks such as structured data extraction, summarization, retrieval-augmented generation (RAG), and code generation.

Zoho is also introducing two speech recognition models for English and Hindi, designed to run on lower compute resources.

Zia LLM will be deployed across Zoho’s data centers in the US, India, and Europe and made available to customers in the coming months, the company said in a statement.

In addition, Zoho has launched several pre-built AI agents integrated into its products for immediate use.

These include Ask Zia for business intelligence, a Customer Service Agent for Zoho Desk, and agents for sales, hiring, and deal analysis.

The agents can be triggered through automation, user actions, or embedded conversations and are designed to handle real-world business tasks.

Administrators can monitor agent behavior and performance as they function as digital employees.

The Zia Agent Studio enables users to build AI agents without writing code, using prompts and selecting from over 700 Zoho actions.

These agents can then be deployed via the Zia Agent Marketplace, which will also be opened to developers and partners to build and share their own agents.

According to Zoho, this approach allows AI tools to operate seamlessly within existing organizational structures and permission settings.

The company has also implemented the MCP and introduced its own MCP server, enabling third-party AI models to securely connect with Zoho applications and perform tasks under customer-defined permissions.

More than 15 Zoho applications are currently available through the MCP server in its early access phase.

“Today’s announcement emphasizes Zoho’s longstanding aim to build foundational technology focused on protection of customer data, breadth and depth of capabilities, and value,” said Mani Vembu, CEO at Zoho. “Because Zoho’s AI initiatives are developed internally, we are able to provide customers with cutting-edge tool sets without compromising data privacy and organizational flexibility, democratizing the latest technology on a global scale.”