AI Infrastructure

17 articles in ai infrastructure

OpenAI's Jalapeño Chip Delivers Record-Breaking AI Inference Speed
AI Infrastructure Aug 25, 2026

OpenAI's Jalapeño Chip Delivers Record-Breaking AI Inference Speed

OpenAI's custom inference chip Jalapeño shows industry-leading speed and efficiency in early benchmarks, signaling a new era of purpose-built AI hardware.

Groq Among First to Deploy NVIDIA Groq 3 LPX and Vera Rubin NVL72 for Inference
AI Infrastructure Aug 24, 2026

Groq Among First to Deploy NVIDIA Groq 3 LPX and Vera Rubin NVL72 for Inference

Groq announces it will be among the first adopters of NVIDIA Groq 3 LPX with Vera Rubin NVL72, deploying through Dell Technologies to power its inference cloud with 3,400 tokens/sec on agentic workloads.

Cerebras Introduces CS-4 — Up to 30x Faster Inference, 1,000+ Tokens/sec for 10T-Parameter Models
AI Infrastructure Aug 18, 2026

Cerebras Introduces CS-4 — Up to 30x Faster Inference, 1,000+ Tokens/sec for 10T-Parameter Models

Cerebras unveils CS-4, its fourth-generation system with three WSE-3 Turbo processors, delivering up to 30x faster inference than GPUs and 10x more throughput per watt than CS-3.

OpenAI Launches Ultrafast Mode — GPT-5.6 Sol Runs 14x Faster on Cerebras
AI Infrastructure Aug 13, 2026

OpenAI Launches Ultrafast Mode — GPT-5.6 Sol Runs 14x Faster on Cerebras

OpenAI partners with Cerebras to deliver GPT-5.6 Sol at 750 tokens per second — 14x faster than standard inference — enabling real-time AI applications.

Anthropic Begins Hiring Custom Silicon Team to Design Its Own AI Chips
AI Infrastructure Aug 5, 2026

Anthropic Begins Hiring Custom Silicon Team to Design Its Own AI Chips

Anthropic confirmed it is building an in-house chip design team, hiring engineers with silicon experience to co-design hardware and models so Claude runs faster and more efficiently. The move follows similar efforts by OpenAI, Google, and Meta to reduce dependency on Nvidia.

Google's New Community Investments in Virginia Support Local Jobs and Expand Energy Affordability
AI Infrastructure Jun 11, 2026

Google's New Community Investments in Virginia Support Local Jobs and Expand Energy Affordability

Google is expanding its Virginia footprint with new community investments that support thousands of local jobs, fund electrical apprenticeship training, and launch a $15 million Energy Impact Fund.

How the UK Is Turning Sovereign AI Ambition Into Action With NVIDIA Technologies
AI Infrastructure Jun 8, 2026

How the UK Is Turning Sovereign AI Ambition Into Action With NVIDIA Technologies

A year after declaring itself an AI maker, not an AI taker, the UK is scaling sovereign compute with doubled cloud providers and Isambard-AI on 5,400 GH200 Superchips.

NVIDIA and LG Group Build an AI Factory to Advance Physical AI, Mobility and AI Infrastructure
AI Infrastructure Jun 8, 2026

NVIDIA and LG Group Build an AI Factory to Advance Physical AI, Mobility and AI Infrastructure

NVIDIA and LG Group announced an AI factory on the NVIDIA DSX platform spanning robotics, autonomous driving, data centers and GPU cloud services.

Seoul Purpose: How NVIDIA and South Korea Are Building the Future of AI
AI Infrastructure Jun 5, 2026

Seoul Purpose: How NVIDIA and South Korea Are Building the Future of AI

Jensen Huang visited Seoul to meet South Korea's AI builders, unveiling gigawatt-scale AI factory plans with NAVER, LG, SK and Hyundai, plus robotics, memory and RTX Spark partnerships.

SoftBank Pledges €75 Billion to Build Europe's Largest AI Data Centers in France
AI Infrastructure Jun 1, 2026

SoftBank Pledges €75 Billion to Build Europe's Largest AI Data Centers in France

SoftBank announced a €75 billion investment to develop 5 gigawatts of AI data center capacity across three sites in France, the largest single AI infrastructure commitment in European history.

NVIDIA GTC Taipei at COMPUTEX: Live Updates on What's Next in AI
AI Infrastructure May 21, 2026

NVIDIA GTC Taipei at COMPUTEX: Live Updates on What's Next in AI

Live updates from NVIDIA GTC Taipei at COMPUTEX covering Jensen Huang's keynote, Vera Rubin in full production, Nemotron 3 Ultra, RTX Spark and the new AI factory era.

We’re announcing new community investments in Missouri.
AI Infrastructure May 20, 2026

We’re announcing new community investments in Missouri.

Google is deepening its Missouri roots with a new Montgomery County data center, over 500 MW of new capacity with Ameren, a $20 million Energy Impact Fund, and local workforce training.

NVIDIA and Google Cloud Empower the Next Wave of AI Builders
AI Infrastructure May 19, 2026

NVIDIA and Google Cloud Empower the Next Wave of AI Builders

NVIDIA and Google Cloud said their joint developer community has passed 100,000 members, adding JAX and Dynamo learning paths plus Gemma, Nemotron and SynthID resources.

NVIDIA CEO Jensen Huang at Dell Technologies World: 'Demand Is Going Parabolic, Utterly Parabolic'
AI Infrastructure May 18, 2026

NVIDIA CEO Jensen Huang at Dell Technologies World: 'Demand Is Going Parabolic, Utterly Parabolic'

At Dell Technologies World, Jensen Huang joined Michael Dell to unveil the Dell AI Factory refresh — Vera Rubin-based PowerEdge XE9812 servers with up to 10x lower cost-per-token for agentic inference.

Unlocking Asynchronicity in Continuous Batching
AI Infrastructure May 14, 2026

Unlocking Asynchronicity in Continuous Batching

Hugging Face shows how asynchronous continuous batching, using CUDA streams, events, and double-buffered slots, lifted GPU utilization from 76 to 99.4 percent and cut generation time by 22 percent.

Building Blocks for Foundation Model Training and Inference on AWS
AI Infrastructure May 11, 2026

Building Blocks for Foundation Model Training and Inference on AWS

AWS engineers detail the infrastructure building blocks for foundation model training and inference, from B300 GPUs and EFA networking to Slurm, Kubernetes and PyTorch.

Railway secures $100 million to challenge AWS with AI-native cloud infrastructure
AI Infrastructure Jan 22, 2026

Railway secures $100 million to challenge AWS with AI-native cloud infrastructure

Railway, the San Francisco cloud platform that amassed two million developers without marketing, raised a $100 million Series B led by TQ Ventures to fund its sub-second AI-native deployments and own data centers.