An Empirical Study of Latency in an Emerging Class of Edge Computing Applications for Wearable Cognitive Assistance

An emerging class of interactive wearable cognitive assistance  applications is poised to become one of the key demonstrators of edge  computing infrastructure. In this paper, we design seven such  applications and evaluate their performance in terms of latency across a  range of edge computing configurations, mobile hardware, and wireless  networks,

IKEA Stool Assembly: Wearable Cognitive Assistant

IKEA Stool Assembly: Wearable Cognitive AssistantThis Gabriel application was created by Mihir Bala, a talented freshman CS student from the University of Michigan, as an NSF Research Experience for Undergradautes project under the mentorship of Zhuo Chen.   In addition to being another example of a Gabriel application, it offers the

Assisting Users in a World Full of Cameras: A Privacy-aware Infrastructure for Computer Vision Applications

Computer vision based technologies have seen widespread adoption over  the recent years. This use is not limited to the rapid adoption of  facial recognition technology but extends to facial expression  recognition, scene recognition and more. These developments raise  privacy concerns and call for novel solutions to ensure adequate user  awareness,

Edge Computing for Situational Awareness

Situational awareness involves the timely acquisition of knowledge about  real-world events, distillation of those events into higher-level  conceptual constructs, and their synthesis into a coherent  context-sensitive view. We explore how convergent trends in video  sensing, crowd sourcing and edge computing can be harnessed to create a  shared real-time information system

A Scalable and Privacy-Aware IoT Service for Live Video Analytics

We present OpenFace, our new open-source face recognition system that  approaches state-of-the-art accuracy. Integrating OpenFace with  inter-frame tracking, we build RTFace, a mechanism for denaturing video  streams that selectively blurs faces according to specified policies at  full frame rates. This enables privacy management for live video  analytics while providing a

Cloudlet-based Just-in-Time Indexing of IoT Video

As video cameras proliferate, the ability to scalably capture and search their data becomes important. Scalability is improved by performing video analytics on cloudlets at the edge of the Internet, and only shipping extracted index information and meta-data to the cloud. In this setting, we describe interactive data exploration (IDE)

Gabriel on CBS 60 Minutes

Wearable Cognitive Assistance can be viewed as  "Augmented Reality Meets Artificial Intelligence".   This 90-second excerpt from the October 9, 2016 CBS 60 Minutes special edition on Artificial Intelligence highlights the table-tennis wearable cognitive assistant on Google Glass.

IKEA Table Lamp Kit: Wearable Cognitive Assistant

In our talks on Gabriel, we have often mentioned assembly of IKEA kits as an example of how step by step guidance and prompt detection of errors could be valuable.   This video shows a Gabriel application to assemble a genuine IKEA kit (a table lamp) purchased off the shelf at

The Emergence of Edge Computing

Industry investment and research interest in edge computing, in which computing and storage nodes are placed at the Internet's edge in close proximity to mobile devices or sensors, have grown dramatically in recent years. This emerging technology promises to deliver highly responsive cloud services for mobile computing, scalability and privacy-policy