Stories
India AI Compute Paradox: GPU Providers Eye Overseas Markets While Startups Struggle
- •India is considering allowing domestic GPU providers to sell computing capacity overseas due to concerns over weak domestic demand.
- •Researchers and startups in India face challenges accessing affordable computing power, citing high rental costs and bureaucratic hurdles.
- •Under the Rs 10372-crore IndiaAI Mission, 14 companies have been empanelled to provide subsidised computing capacity.
- •Industry experts note that India's domestic GPU infrastructure is fragmented and often lacks the scale needed to train frontier AI models.
- •The government has announced plans for the long-term procurement of 10000 AI GPUs with assured five-year usage to provide demand certainty.
Key Questions Answered
The government is considering allowing domestic GPU providers to sell computing power to overseas customers at commercial rates due to concerns that domestic demand is currently insufficient to absorb the added capacity, helping providers recover their heavy investments while the local market develops.
The IndiaAI Mission has a total financial outlay of Rs 10,372 crore to provide computing capacity at subsidised rates through empanelled private companies, with a long-term procurement target of 10,000 GPUs featuring assured usage over five years to offer demand certainty.
Startups and researchers face challenges due to fragmented GPU infrastructure that lacks the scale for frontier model training, rising rental costs, conflicting commercial incentives for private providers, and cumbersome application processes that can drive developers to foreign cloud providers.
