Mobilenets:open-source Models for efficient On-device Vision

Https://research.googleblog.com/2017/06/mobilenets-open-source-models-for.html

Wednesday, June. Posted by Andrew G. Howard, Senior software Engineer and Menglong Zhu, software Engineer

(cross-posted on the Google Open Source Blog)

Deep learning have fueled tremendous progress in the field of computer vision in recent years, with neural networks repeate Dly pushing the frontier of visual recognition technology. While many of those technologies such as object, landmark, logo and text recognition is provided for internet-connected D Evices through the Cloud Vision API, we believe that ever-increasing computational power of mobile devices can enable The delivery of these technologies into the hands of our users, anytime, anywhere, regardless of the Internet connection. However, visual recognition for in device and embedded applications poses many challenges-models must run quickly with H IgH Accuracy in a resource-constrained environment making use of limited computation, power and space.

Today We is pleased to announce the release of Mobilenets, a family of Mobile-firstComputer vision models for TensorFlow, designed to effectively maximize accuracy while being mindful of the restricted res Ources for an on-device or embedded application. Mobilenets is small, low-latency, low-power models parameterized to meet the resource constraints of a variety of use CAs Es. They can built upon for classification, detection, embeddings and segmentation similar to how other popular large scale Models, such as Inception, is used.

Example use cases include detection, Fine-grain classification, attributes and geo-localization.

This release contains the model definition for mobilenets in TensorFlow using Tf-slim, as well as pre-trained ImageNet Classification checkpoints for use on mobile projects of all sizes. The models can be run efficiently on mobile devices with TensorFlow mobile.

Model Checkpoint	Million MACs	Million Parameters	Top-1 Accuracy	Top-5 Accuracy
mobilenet_v1_1.0_224	569	4.24	70.7	89.5
mobilenet_v1_1.0_192	418	4.24	69.3	88.9
mobilenet_v1_1.0_160	291	4.24	67.2	87.5
mobilenet_v1_1.0_128	186	4.24	64.1	85.3
mobilenet_v1_0.75_224	317	2.59	68.4	88.2
mobilenet_v1_0.75_192	233	2.59	67.4	87.3
mobilenet_v1_0.75_160	162	2.59	65.2	86.1
mobilenet_v1_0.75_128	104	2.59	61.8	83.6
mobilenet_v1_0.50_224	150	1.34	64.0	85.4
mobilenet_v1_0.50_192	110	1.34	62.1	84.0
mobilenet_v1_0.50_160	77	1.34	59.9	82.5
mobilenet_v1_0.50_128	49	1.34	56.2	79.6
mobilenet_v1_0.25_224	41	0.47	50.6	75.0
mobilenet_v1_0.25_192	34	0.47	49.0	73.6
mobilenet_v1_0.25_160	21st	0.47	46.0	70.7
mobilenet_v1_0.25_128	14	0.47	41.3	66.2

choose the right mobilenet model to fit your latency and size budget. The size of the network in memory and on disk are proportional to the number of parameters. The latency and power usage of the network scales with the number of multiply-accumulates (MACs) which measures the number of fused multiplication and addition operations. Top-1 and Top-5 accuracies is measured on the ILSVRC dataset.

We is excited to share mobilenets with the Open-source community. Information for getting started can is found at the Tensorflow-slim Image classification Library. To learn how to run models On-device * Go to TensorFlow Mobile. You can read more about the technical details of mobilenets in our paper, Mobilenets:efficient convolutional neural netwo Rks for Mobile Vision applications.

Acknowledgements
Mobilenets were made possible with the hard work of many engineers and researchers throughout Google. Specifically we would like to thank:

Core Contributors: Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Ada M

Special thanks to: Benoit Jacob, Skirmantas kligys, George Papandreou, Liang-chieh Chen, Derek Chow, Sergio Guadarrama, Jonathan Huang, A Ndre Hentz, Pete Warden.

Mobilenets:open-source Models for efficient on-device Vision