Ritam Digital English
  • Home
  • Nation
  • World
  • Videos
    • Special Updates
    • Entertainment
    • Legal
    • Business
    • History
    • Viral Videos
  • Politics
  • Business
  • Lifestyle
    • Entertainment
    • Health
    • Food
    • Fashion
    • Viral
  • Sports
  • Opinion
No Result
View All Result
Ritam Digital English
  • Home
  • Nation
  • World
  • Videos
    • Special Updates
    • Entertainment
    • Legal
    • Business
    • History
    • Viral Videos
  • Politics
  • Business
  • Lifestyle
    • Entertainment
    • Health
    • Food
    • Fashion
    • Viral
  • Sports
  • Opinion
No Result
View All Result
Ritam Digital English
No Result
View All Result
  • Home
  • Nation
  • World
  • Videos
  • Politics
  • Business
  • Entertainment
  • Lifestyle
  • Sci & Tech
  • Sports
  • Opinion
Home Nation

Sarvam AI Launches OpenHathi: Groundbreaking Hindi Language Model

Sarvam AI, a relatively new player in the AI field, recently introduced OpenHathi-Hi-v0.1, the inaugural model in their OpenHathi series.

Editor Ritam English by Editor Ritam English
Dec 14, 2023, 10:49 am IST
Sarvam AI Launches OpenHathi: Groundbreaking Hindi Language Model

Sarvam AI Launches OpenHathi: Groundbreaking Hindi Language Model

FacebookTwitterWhatsAppTelegram

Sarvam AI, a relatively new player in the AI field, recently introduced OpenHathi-Hi-v0.1, the inaugural model in their OpenHathi series. This Hindi large language model (LLM) is based on Meta AI’s Llama2-7B architecture, known for its robust capabilities. Sarvam AI claims that OpenHathi-Hi-v0.1 performs on par with GPT-3.5 specifically for Indic languages, showcasing its potential in the multilingual AI landscape.

The AI model developed by Sarvam AI extends Llama2-7B’s tokenizer with a substantial 48,000-token addition. The training process is divided into two phases: first, an embedding alignment phase that aligns randomly initialized Hindi embeddings, followed by a bilingual language modeling phase where the model is trained to attend cross-lingually across tokens.

Sarvam AI emphasizes that their model’s effectiveness goes beyond standard Natural Language Generation (NLG) tasks, as they have evaluated its performance in real-world applications. The company collaborated with KissanAI to fine-tune the base model using conversational data collected from interactions between a GPT-powered bot and farmers in various languages.

“We show that our model works as well as, if not better than GPT-3.5 on various Hindi tasks while maintaining its English performance,” the company said in a post on X (formerly Twitter).

In their efforts to enhance Llama-2’s Hindi capabilities, Sarvam AI took steps to improve the efficiency of tokenization on Hindi text. They aimed to make both training and inferencing faster by decreasing the fertility score, which represents the average number of tokens a word is split into. This involved training a sentence-piece tokenizer from a subset of the Sangraha corpus and merging it with the Llama2 tokenizer, resulting in a new tokenizer with a 48,000-word vocabulary.

Founded in July 2023 by Vivek Raghavan and Pratyush Kumar, Sarvam AI has quickly garnered attention and support. In a funding round earlier this month, the startup secured $41 million in investment, with leading contributions from Lightspeed Ventures, and participation from Peak XV Partners and Khosla Ventures. This substantial funding reflects the industry’s confidence in Sarvam AI’s potential and the significance of their contributions to the AI landscape.

Tags: AIArtificial IntelligenceSarvam AIOpenHathiHindi large language modelLlama2-7BIndic languagesLlama2Vivek RaghavanPratyush Kumar
ShareTweetSendShare

Related News

 If History Had Followed Mukherjee’s Path, What Would India Have Been Like?
Nation

 If History Had Followed Mukherjee’s Path, What Would India Have Been Like?

78 Years Ago Today, British Parliament Passed Indian Independence Act
Nation

78 Years Ago Today, British Parliament Passed Indian Independence Act

July 4, 1947: The Secret Turning Point That Led to India’s Historic Independence a Month Later
Nation

July 4, 1947: The Secret Turning Point That Led to India’s Historic Independence a Month Later

The Death of Swami Vivekananda: A Legacy Beyond Mortality
Nation

The Death of Swami Vivekananda: A Legacy Beyond Mortality

The Sedition Trial of Bal Gangadhar Tilak in 1897: A Watershed in Colonial India’s Repression of Dissent
Nation

The Sedition Trial of Bal Gangadhar Tilak in 1897: A Watershed in Colonial India’s Repression of Dissent

Comments

The comments posted here/below/in the given space are not on behalf of Ritam Digital Media Foundation. The person posting the comment will be in sole ownership of its responsibility. According to the central government's IT rules, obscene or offensive statement made against a person, religion, community or nation is a punishable offense, and legal action would be taken against people who indulge in such activities.

Latest News

 If History Had Followed Mukherjee’s Path, What Would India Have Been Like?

 If History Had Followed Mukherjee’s Path, What Would India Have Been Like?

78 Years Ago Today, British Parliament Passed Indian Independence Act

78 Years Ago Today, British Parliament Passed Indian Independence Act

July 4, 1947: The Secret Turning Point That Led to India’s Historic Independence a Month Later

July 4, 1947: The Secret Turning Point That Led to India’s Historic Independence a Month Later

The Death of Swami Vivekananda: A Legacy Beyond Mortality

The Death of Swami Vivekananda: A Legacy Beyond Mortality

The Sedition Trial of Bal Gangadhar Tilak in 1897: A Watershed in Colonial India’s Repression of Dissent

The Sedition Trial of Bal Gangadhar Tilak in 1897: A Watershed in Colonial India’s Repression of Dissent

Shimla Agreement: The Untold Realities Behind a Defining Indo-Pak Treaty

Shimla Agreement: The Untold Realities Behind a Defining Indo-Pak Treaty

A Nation’s Healer and Builder: The Inspiring Legacy of Dr. Bidhan Chandra Roy

A Nation’s Healer and Builder: The Inspiring Legacy of Dr. Bidhan Chandra Roy

What RSS Has Done for Families: From Promoting Fertility to Strengthening Family Values Through Kutumb Prabodhan

What RSS Has Done for Families: From Promoting Fertility to Strengthening Family Values Through Kutumb Prabodhan

How ‘Make in India’ Transformed Indian Manufacturing: A Decade of Massive Growth

How ‘Make in India’ Transformed Indian Manufacturing: A Decade of Massive Growth

Iran-Israel Ceasefire | PM Modi Praises Shubhanshu Shukla | Kharge Criticizes Tharoor | Cloudburst

Iran-Israel Ceasefire | PM Modi Praises Shubhanshu Shukla | Kharge Criticizes Tharoor | Cloudburst

  • Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms & Conditions
  • Disclaimer

© Ritam Digital Media Foundation.
Tech-enabled by Ananthapuri Technologies

No Result
View All Result
  • Home
  • Nation
  • World
  • Videos
  • Politics
  • Business
  • Entertainment
  • Lifestyle
  • Sci & Tech
  • Sports
  • Opinion
  • About & Policies
    • About Us
    • Contact Us
    • Privacy Policy
    • Terms & Conditions
    • Disclaimer

© Ritam Digital Media Foundation.
Tech-enabled by Ananthapuri Technologies