What is inference? Explaining the massive new shift in AI computing

The focus of artificial-intelligence spending has gone from training models to using them. Here’s how to understand the ...
Seeking Alpha

Google, Microsoft among those boosting AI inference performance for cloud customers using Nvidia's software Dynamo

Nvidia (NVDA) said leading cloud providers — Amazon's (AMZN) AWS, Alphabet's (GOOG) (GOOGL) Google Cloud, Microsoft (MSFT) Azure and Oracle (ORCL) Cloud Infrastructure — are accelerating AI inference ...
Forbes

BCG’s Chatbot GENE; Using Wider Context Windows And Faster Inference

Forbes contributors publish independent expert analyses and insights. Craig S. Smith, Eye on AI host and former NYT writer, covers AI. While many people have grown accustomed to hearing Alexa, Google ...
The Chosun Ilbo on MSN

NVIDIA enhances AI inference with Samsung-made LPU

NVIDIA unveiled a language processing unit (LPU) specialized for fast inference at its annual conference ‘GTC 2026’. The chip, developed by the startup ‘Groq’ acquired last year, is being manufactured ...
SDxCentral

AI inference crisis: Google engineers on why network latency and memory trump compute

Google researchers have warned that large language model (LLM) inference is hitting a wall amid fundamental problems with memory and networking problems, not compute. In a paper authored by ...
The Motley Fool

Prediction: The AI "Inference Era" Will Crown a New Winner by the End of 2026

Nvidia currently dominates the AI chip market, including for inference. AMD should take some share, helped by its deal with OpenAI. However, Broadcom looks like the biggest inference chip winner. The ...