4BitTorrent Launches BTTInferGrid: The Decentralized Infrastructure Layer for Scalable AI Inference

BTTInferGrid is a decentralized GPU computing network purpose-built for AI inference. By bridging the global supply of idle ...
VentureBeat

Pipeshift cuts GPU usage for AI inferences 75% with modular interface engine

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now DeepSeek’s release of R1 this week was a ...

AI inference provider Baseten reportedly raising $1.5B in funding

Baseten Inc., a startup with a platform for running artificial intelligence inference workloads, is raising $1.5 billion in ...
New Atlas

Next-level AI engine comes top in LLM speed showdown

Responses to AI chat prompts not snappy enough? California-based generative AI company Groq has a super quick solution in its LPU Inference Engine, which has recently outperformed all contenders in ...
The Next Platform

Tensordyne Converts AI Matrix Math To Logs To Crank Up Inference Oomph

Transformations are the key to such codes, and they rely on math that predates computing as we know it by centuries. There ...
SiliconANGLE

New memory architecture targets AI inference bottlenecks

Lightbits Labs Ltd. today is introducing a new architecture aimed at addressing one of the most stubborn bottlenecks in large-scale artificial intelligence inference: the growing mismatch between the ...
Semiconductor Engineering

What’s The Best Way To Sell An Inference Engine?

The burgeoning AI market has seen innumerable startups funded on the strength of their ideas about building faster, lower-power, and/or lower-cost AI inference engines. Part of the go-to-market ...
Morningstar

Skymizer Taiwan Inc. Unveils Breakthrough Architecture Enabling Ultra-Large LLM Inference on a Single Card

Delivers industry-leading performance efficiency and enables 700B-parameter models on a single PCIe card — without GPU clusters or intensive cooling Deploying ultra-large models on-premise has ...
VentureBeat

The team behind continuous batching says your idle GPUs should be running inference, not sitting dark

Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.
Forbes

The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

Shakti P. Singh, Principal Engineer at Intuit and former OCI model inference lead, specializing in scalable AI systems and LLM inference. Generative models are rapidly making inroads into enterprise ...