4A0-N01 exam - Nuage Networks VCS Fundamentals Updated: 2023

Industrial handheld devices manufacturer Zebra Technologies Corporation has demonstrated a generative artificial intelligence large language model application running on its Qualcomm-powered mobile computers without needing any connectivity to the cloud.

Large language models, or LLMs, have been the talk of 2023 and have come to life and the attention of the world through the amazing power of cloud computing. However, Zebra - well-known for its wide range of mobile industrial handheld computers - has successfully run a generative AI LLM on one of their devices, without needing any connectivity to the cloud.

LLM use cases include customer support, training, helping staff find company resources, and all kinds of things that allow natural language communication. Running an LLM on a diminutive, possibly offline, handheld computer is no small feat, and is a testament to the research, development and innovation of Zebra. In fact, whether you realise it or not, you'll have seen a Zebra device in action. Companies and industries of all sizes use Zebra devices for receipt or label printing, for store staff to walk around with and communicate or check prices, and all kinds of things. Well, now the devices are ready to provide a whole new range of smart applications.

Zebra says this will unlock exciting productivity gains that will shape the future of work across industries from retail to warehouse and logistics to hospitality and healthcare. On-device execution of GenAI LLMs has the potential to empower front-line workers with new capabilities so they can deliver new outcomes for their end customers.

{loadposition david08}

On-device AI can offer additional personalisation as well as enhanced privacy and security as data remains on the device. It also drives faster performance and lower costs as GenAI searches on the cloud can be expensive. A whitepaper published by Qualcomm Technologies, Inc. suggests that GenAI-based search cost per query is estimated to increase by ten times compared to traditional search methods. By removing the need to utilise the cloud, costs can be reduced.

“Zebra’s devices are powerful platforms with cutting-edge software and AI models which we’re driving forward with our partner ecosystem to solve customer challenges and add value,” said Zebra Technologies CTO Tom Bianculli. “We’re taking GenAI to the mobile edge on-device and applying it to areas such as voice AI, computer vision, and machine vision software powered by deep learning as well as task and workflow software using orchestrated AI.

"Potential use cases for LLMs include improving associate effectiveness by enhancing their product and customer service knowledge, acting as an efficient internal communications tool by answering employee queries on things like store policies, collecting and analysing feedback from associates to identify areas of improvement, enhancing productivity, and increasing job satisfaction levels.

LLMs also have the potential to elevate the customer experience by powering personalised shopping assistants that could provide product recommendations, integrating shopping experiences across in-store, online, and mobile platforms as well as potentially enabling fully voice-activated shopping.

Zebra’s TC53/TC58 and TC73/TC78 mobile computers and ET6x Series tablets powered by Qualcomm Technologies – together with Zebra’s asset visibility and intelligent automation solutions – deliver elevated data insight, analysis and recommendations, problem-solving, planning and creativity. Front-line workers can utilise a smaller on-device model, even in rural, built-up and underground working environments where connection to the cloud may not be possible. Alternatively, users may switch to a cloud-based app or web browser GenAI tool via Zebra’s Wi-Fi 6/6E and 5G-enabled devices.

“On-device generative AI is unlocking new and enhanced experiences across industries,” said Qualcomm Technologies senior director product management Megha Daga. “Qualcomm Technologies’ goal is to drive the transformation of industries, and we are doing that beginning with mobile devices. Zebra’s demonstration is showcasing the type of transformation we aim to achieve.”

This innovative solution from Zebra using a platform from Qualcomm Technologies reduces memory requirements and is built upon a wide array of open-source and third-party models which are a significant part of Zebra’s strategy to deliver effective on-edge AI solutions across multiple industries.

“Zebra recognizes the importance of ethical and responsible AI,” said Zebra Technologies director of AI research Andrea Mirabile. “We are committed to ensuring our AI initiatives are aligned with federal guidance on accountability, ethical purpose and transparency and help set the standard related to delivering solutions to end-users. We also support the Business Roundtable AI Road Map and policy recommendations for responsible, appropriate, and ethical AI development and deployment.”