Tag: transformers

Media Monitor: New Technologies Emerge to Challenge AI's Transformer Foundation

10 Aug 2026 5:00 a.m. · Source: MIT Technology Review

MIT Technology Review reports that the foundational transformer architecture in large language models is showing its age, prompting startups like Subquadratic, Manifest AI, Liquid AI, Inception, and Pathway to develop new, more efficient AI technologies.

Science & Technology Business Artificial Intelligence Computers and Internet Economy Education Large Language Models Transformers Neural Networks Sparse Attention Diffusion Models State Spaces MIT Technology Review MIT science technology