As mobile devices take over the world, researchers now study how to build deep learning networks that can keep up.
One collaboration between academia and industry has analyzed a number of related deep learning frameworks, and the results look promising.
When Facebook suggests new friends, Netflix recommends movies, Spotify recognizes a song, or Uber accurately predicts when your driver will arrive—they all use "deep learning"—complex algorithms that gather data about you and your environment to provide you with better recommendations and service.
"Recent advances in deep learning have greatly changed the way that computing devices process human-centric content such as images, video, speech, and audio. Applying deep neural networks to IoT devices could thus bring about a generation of applications capable of performing complex sensing and recognition tasks to support a new realm of interactions between humans and their physical surroundings," say the authors of "Deep Learning for the Internet of Things," which appears in the May 2018 issue of Computer.
The researchers pose four important questions that need to be answered if mobile apps can effectively implement deep neural network technology:
In short, if deep neural networks can be used successfully in mobile apps, they must be capable of collecting data from a variety of IoT devices, as well as be energy-efficient, accurate, and able to function with minimal data labels.
The authors reviewed a general deep learning framework for inputting data from diverse IoT applications, called DeepSense. The framework contains all the essential elements but can be customized for the learning needs of various IoT apps.
The DeepSense based algorithms (including DeepSense and its three variants) outperform other baseline algorithms by a large margin, as can be seen in the two comparison graphs below.
A particularly effective deep learning compression algorithm, called DeepIoT, can directly compress the structures of commonly used deep neural networks.
It "thins" the network structure by dropping hidden elements and compressing the network.
The compressed model can be deployed on commodity devices, delivering final prediction accuracy while saving energy.
RDeepSense gives simple methods for generating well-calibrated uncertainty estimates for the predictions computed in deep neural networks.
In the two graphs below, RDeepSense comes closest to optimal performance.
Studies show that the semi-supervised strategy, called SenseGAN, greatly reduces the need for labeled data. The researchers use HHAR (heterogeneous human activity recognition) with the DeepSense framework as an example.
One network tries to trick the other.
"The GAN (generative adversarial networks) training strategy is to define a game between two competing networks. The generator network maps a source of noise to the input space. The discriminator network receives either a generated sample or a true data sample and must distinguish between the two. The generator is trained to fool the discriminator. The GAN training strategy leverages the unlabeled data to increase the capacity of generator and discriminator networks, which explicitly improve the discriminating ability of the classifier in return," the researchers explain.
The authors of the new study are Shuochao Yao, Yiran Zhao, Huajie Shao, Chao Zhang, and Professor Tarek Abdelzaher, all of the University of Illinois at Urbana-Champaign; Aston Zhang, an applied scientist at Amazon AI; Shaohan Hu, a research staff member at IBM Thomas J. Watson Research Center; and Lu Su, an assistant professor in the Department of Computer Science and Engineering at State University of New York Buffalo.
Login may be required to access full text.
About Lori Cameron
Lori Cameron is a Senior Writer for the IEEE Computer Society and currently writes regular features for Computer magazine, Computing Edge, and the Computing Now and Magazine Roundup websites. Contact her at l.cameron@computer.org. Follow her on LinkedIn.
