Skip to content
Trending storyDeveloping

NVIDIA, AI4Bharat release Indic corpus

1 reports1 sourcesUpdated 12 hours ago

What you need to know

AI summary

NVIDIA, with IIT Madras and its AI4Bharat lab, released Nemotron-pretraining-Indic-v1, a 2.8-trillion-token Indic pretraining corpus, along with an open pipeline for generating the data. The release targets Indic-language model pretraining, an area with far less open data than English. The corpus and generation pipeline are published together, so the data can be reproduced or extended rather than only downloaded.

Generated by AI from the reporting · updated 12 hours ago

Latest updateOct 16 01:44
NVIDIA and AI4Bharat release Nemotron-pretraining-Indic-v1, a 2.8T-token Indic corpus with an open data generation pipeline

Timeline

Follow the reports to see every side of the story.

Oct 16
  1. Hugging Face BlogFeatured
    NVIDIA and AI4Bharat release Nemotron-pretraining-Indic-v1, a 2.8T-token Indic corpus with an open data generation pipeline

    NVIDIA, with IIT Madras and its AI4Bharat lab, introduced Nemotron-pretraining-Indic-v1.

Heat trend for this story

Current
7
Peak
10Oct 16 03:00
24h change
–

The trend compares only sources observed continuously throughout, so its range may be narrower than the current heat total. Move the pointer or tap the chart to see heat by the hour; use the left and right arrow keys on a keyboard.