AI optimization startup Neural Magic created software that makes it possible for AI inference models to run efficiently on commodity CPU-based hardware. Credit: Shutterstock Jan. 13, 2025 update: Red Hat announced it has completed its acquisition of Neural Magic, a pioneer in software and algorithms that accelerate gen AI inference workloads. Red Hat first announced its intent to acquire the company on Nov. 12, 2024. Today’s announcement confirms the close of the deal. Red Hat announced plans to acquire Neural Magic, a company that specializes in generative AI performance engineering, model optimization algorithms, and high-performance GPU and CPU inference serving. Neural Magic was spun out of MIT in 2018, and it offers software and algorithms that accelerate generative AI inference workloads. Its expertise in large language models along with Red Hat’s ability to support these models across the hybrid cloud aligns with Red Hat’s stated goal of making gen AI more accessible to more organizations. Red Hat intends to democratize the power of AI through open-source-licensed models that can run anywhere. This will enhance organizations’ abilities to customize large language models, use inference performance engineering for infrastructure efficiency, and partner in the open-source ecosystem to enable broader choices for hardware and chip architecture. “AI workloads need to run wherever customer data lives across the hybrid cloud; this makes flexible, standardized and open platforms and tools a necessity, as they enable organizations to select the environments, resources and architectures that best align with their unique operational and data needs,” said Matt Hicks, Red Hat’s president and CEO, in a statement. Read more Red Hat news Red Hat delivers AI-optimized Linux platform Red Hat seeks to be the platform for enterprise AI Linux in your car: Red Hat’s milestone collaboration with exida Red Hat extends Lightspeed generative AI tool to OpenShift and Enterprise Linux Red Hat unveils image mode for its Linux distro Red Hat introduces ‘policy as code’ for Ansible Cisco, Red Hat extend networking, AI integrations SUBSCRIBE TO OUR NEWSLETTER From our editors straight to your inbox Get started by entering your email address below. Please enter a valid email address Subscribe