With Cactus our goal has always been to keep the deployment and operations barrier as low as possible for our clients. This is what gave Cactus an edge over its competitors who require specialized hardware and/or forward deployed engineers to visit each site for installations and staff trainings. The team has put a lot of effort to making the mobile app very intuitive, so even first day employees with no prior experience can capture the state of their store, get tasks and report issues.
As we are starting to run pilots with robots and gearing up to full deployments in 2027, we want to keep the same simplicity of operations at the core of our products. But robots are much more complicated and very nascent to the field still, they require a constant eye on them to operate, detect issues early, and run repairs and maintenance as needed. This is why we intend to ship every robotic asset with a pair of Oneshot glasses. Oneshot provides the instructions for our customers to get up to speed with with the new robots easily, ask question freely 24/7, and keep a continuously updated knowledge base that helps ship new updates seamlessly as well as keep track of previous issues.
Mika spent most of the month of May at our hacker house in Hong Kong. He got access to some of our hardware to validate the assumption that interactive manuals on glasses with an AI voice interface are a much more natural and quick way of working with unfamiliar hardware compared to notoriously confusing instructions on the manufacturer's website. In one experiment he conducted, people with no prior experience with robots were given the task to unbox Terri and make him walk (Terri is the name of our Unitree G1 robot). One of them was doing it the traditional way running through Unitree's instructions on their website and the other one was using Oneshot for the task.
The experiment showed more than two times faster setup with the same conditions. The interactive interface made it much easier to ask questions instead of searching the manual when something was unclear. The AI on the glasses also proactively detected the current state of the robot and branched to the right part of the knowledge base.
The core of the technology used to build Oneshot is open source and available for other developers to build upon. This github repository has extensive documentation on how to create an example application for Mentra glasses which reads context from an Auki domain that's tied to a physical location or asset: https://github.com/AugmentedCamel/Shipmemory-auki
This video tutorial will run you through the process in great detail: https://www.tella.tv/video/building-a-smart-glass-co-pilot-9k9y
If you have any questions please feel free to reach out on Discord, we'll be happy to help.
Aukiはポーズメッシュという地球上、そしてその先の1000億の人々、デバイス、AIのための分散型機械認識ネットワークを構築しています。ポーズメッシュは、機械やAIが物理的世界を理解するために使用可能な、外部的かつ協調的な空間感覚です。
私たちの使命は、人々の相互認知能力、つまり私たちが互いに、そしてAIとともに考え、経験し、問題を解決する能力を向上させることです。人間の能力を拡大させる最も良い方法は、他者と協力することです。私たちは、意識を拡張するテクノロジーを構築し、コミュニケーションの摩擦を減らし、心の橋渡しをします。
ポーズメッシュは、分散型で、ブロックチェーンベースの空間コンピューティングネットワークを動かすオープンソースのプロトコルです。
ポーズメッシュは、空間コンピューティングが協調的でプライバシーを保護する未来をもたらすよう設計されています。いかなる組織の監視能力も制限し、空間のプライベートな地図の自己所有権を奨励します。
分散化はまた、特に低レイテンシが重要な共同ARセッションにおいて、競争優位性を有します。ポスメッシュは分散化運動の次のステップであり、成長するテック大手のパワーに対抗するものです。
アウキ・ラボはポスメッシュにより、ポーズメッシュのソフトウェア・インフラの開発を託されました。