NVIDIA to Release Training Data with 2.8 Trillion Tokens Across 22 Indian Languages, in Partnership with IIT Madras and AI4Bharat
NVIDIA has announced plans to release a training dataset of approximately 2.8 trillion tokens covering 22 Indian languages, along with its generation pipeline, in collaboration with IIT Madras and AI4Bharat. The initiative stands out not just for the volume of data, but for opening up the process from translation through quality evaluation and revision.
