How AI Pin works

| By:   Tamer Karam           |  April 4, 2024

ai_pin

Announced in November 2023, the Humane AI Pin is a wearable device that allows us to interact with it through our voices.

It can access mobile networks and AI services to make calls, send texts, play music, and answer general questions about weather, books, health, and more. It can also connect to popular apps like email, WhatsApp, and social media, providing summaries of what we’ve missed.

Completely voice-controlled, you only need to tap the touchpad and start talking. The AI Pin analyzes your speech and responds to questions and instructions through its speakers. Plus, a laser projector displays a visual interface on your palm, allowing you to navigate menus and choose options with finger gestures.

In addition to microphones and speakers, the AI Pin also has a camera, allowing you to take photos and videos. However, the laser projector isn’t ideal for viewing them, so you might need to transfer them to another device.

How does it work?

The Humane AI Pin operates on the Cosmos AI operating system which prioritizes user interaction with AI models. Cosmos acts as a bridge between user requests and AI models, whether running in the cloud or embedded directly on the device.

The AI Pin likely relies on cloud computing for complex AI tasks like large language models (LLMs) or large action models (LAMs), while embedded models handle simpler functions. By partnering with Microsoft and OpenAI, the Humane AI Pin gains access to powerful AI models .

On the device itself, AI models are likely used to convert the user’s speech into text. Based on the task, embedded AI models determine if they can handle the request locally or require assistance from cloud-based AI models. After receiving a response, the local AI converts the text back into speech and directs it to the speakers.

Humane recently announced that the AI Pin will soon gain the ability to connect to popular apps like email, calendars, and social media. This suggests the use of a Large Action Model (LAM) running on the cloud to handle user requests that involve checking, modifying, or adding information within those apps. Additionally, developers will be able to create and run custom tasks on the Cosmos AI cloud platform.

The AI Pin also utilizes visual recognition Cloud-based AI models. This allows it to analyze images captured by the camera and provide information about the objects in them. The company has showcased examples related to health, where the AI Pin can potentially estimate the sugar and ingredient ratios in cookies and sweets.

Is it really useful?

The AI Pin will start shipping on April 11, 2024. At that time, we can better assess its functionalities, potential weaknesses, and overall usefulness.

Although its functions are still under development and updating, the user’s initial impressions will undoubtedly shape the public perception about it, which will affect its future development and people’s desire to own it.

Its price of $699 and the requirement of a $24 monthly subscription for cellular service and a T-Mobile phone number raise the level of user expectations, and if its capabilities do not live up to these expectations, it may face strong negative backlash.

Can AI Pin replace smartphones?

While unlikely to replace smartphones entirely, the AI Pin could be an appealing option for those seeking to reduce screen time and prefer a more screen-free lifestyle.

As many people use smartphones for entertainment like watching videos, gaming, and capturing and editing photos and videos, the AI Pin wouldn’t be a direct replacement. However, it could be a valuable wearable for activities where screens are inconvenient, such as playing sports like jogging, cycling, and yoga.


Share