Robert Hallock, vice president and general manager of AI and technical marketing in the Client Computing Group at Intel, shares insights on OpenVINO 2024.0.0, Intel’s NPU Acceleration Library, and a security innovation in collaboration with CrowdStrike.
"Debuting in 2018, OpenVINO is the longest-serving and most mature toolkit for optimizing and deploying AI models on the PC. The OpenVINO 2024.0 release brings several important improvements to developers, including: hardware targeting for the Intel Core Ultra NPU, significant performance and feature enhancements for generative AI, and even easier integration with 3rd party model repos like HuggingFace. These advancements demonstrate that OpenVINO is a leader amongst toolkits for AI PC software development," said Robert Hallock.
"The Intel NPU Acceleration Library is a great way for developers to familiarize themselves with offline AI acceleration via NPU. The library is designed to provide an easy on-ramp to utilizing the NPU, which may be unfamiliar territory for developers accustomed to accelerating inferencing with the GPU. By providing a simple on-ramp, developers can quickly leverage existing code to jumpstart their NPU experience on popular models like LLaMA 2-7B, " said Robert Hallock, vice president and general manager of AI and technical marketing in the Client Computing Group at Intel.
This breakthrough unlocks a realm of new possibilities, moving endpoint detection closer to the source while sending relevant data to the cloud for better in-depth analysis. Furthermore, the decision to dispatch additional data to the cloud is now AI-driven, replacing fixed rules. This empowers expanded, selective cloud data collection, ensuring scalability and minimizing network traffic," said Robert Hallock.
Address:
3003 East Chestnut Expy
STE# 575
Springfield, Mo 65802
Phone: 1-844-277-3386
Fax:417-429-2935
E-Mail: contact@appdevelopermagazine.com