Artificial intelligence and other technology companies are pushing their large language models out of the cloud and onto users’ personal devices in a move they say will enhance privacy and security.

(Reuters) - Hewlett Packard Enterprise CEO Antonio Neri pitched a new line of hardware, software and services to businesses interested in deploying various forms of artificial intelligence at its Las Vegas conference on Tuesday.

In the last decade, Deep Learning has rapidly infiltrated the consumer end, mainly thanks to hardware acceleration across devices. However, as we look towards the future, it is evident that isolated hardware will be insufficient. Increasingly complex AI tasks demand shared resources, cross-device collaboration, and multiple data types, all without compromising user privacy or quality of experience.

With data generation expected to reach 175 zettabytes by 2025, the demand for real-time processing has never been bigger and is expected to grow. Globally, the edge artificial intelligence (AI) market was valued at $20 billion in 2023 and is projected to grow to $186 billion by 2032, due to the fact that edge AI enables near-instant data processing and analysis.

Ceva, the pioneering licensor of silicon and software IP that enables Smart Edge devices to connect, sense, and infer data more reliably and efficiently, announces that it has extended its Ceva-NeuPro family of Edge AI NPUs with the introduction of Ceva-NeuPro-Nano NPUs.

The era of On-Device AI has officially begun, marking a significant shift in the landscape of artificial intelligence technology. This new phase is characterized by the emergence of innovative products equipped with On-Device AI, such as Samsung's Galaxy S24 series, Apple Intelligence, and Microsoft's Copilot+PC. These advancements aim to address the limitations of traditional cloud-based AI systems, which have been the backbone of popular services like OpenAI's ChatGPT, Google's Gemini, and Microsoft's Copilot.

ByteDance’s alleged partnership is to acquire a batch of 5-nanometer AI chips. These will then be implemented across the social media networks that ByteDance runs.

Following Microsoft Build and Google I/O, Apple was under a lot of pressure to show its on-device AI might at its Worldwide Developers Conference 2024. And as far as the demos are concerned, Apple has done a great job of integrating generative AI into the user experience across all its devices.