TensorFlow serving provides a way to deploy TensorFlow- generated models to online services, including model export,load, and so on.
Installation Reference this
Https://github.com/tensorflow/serving/blob/master/tensorflow_serving/g3doc/setup.md
??
but because of the problem of being Qiang (Googlesource cannot access )
Https://github.com/tensorflow/serving/issues/6
need to modify WORKSPACE File
New_http_archive (
Name = "Gmock_archive",
#url = "Https://googlemock.googlecode.com/files/gmock-1.7.0.zip",
url = "Https://github.com/peter-wangxu/gmock/archive/1.7.0.zip",
#sha256 = "26fcbb5925b74ad5fc8c26b0495dfc96353f4d553492eb97e85a8a6d2f43095b",
sha256 = "9b0018413f4222b8ee5454a431918c324d010062eecb078677b6897d0c76bc42",
Build_file = "Tensorflow/google/protobuf/gmock. BUILD ",
)
??
Git_repository (
Name = "Boringssl_git",
#commit = "436432d849b83ab90f18773e4ae1c7a8f148f48d",
commit = "DB0729054D5964FEAB9E60089BA2D06A181E78B1",
Init_submodules = True,
#remote = "Https://github.com/mdsteele/boringssl-bazel.git",
Remote = "Https://github.com/doubler/boringssl-bazel.git",
)
??
??
Note that you need to enter the TensorFlow path First
./configure, please .
??
??
Bazel Build tensorflow_serving/...
??
Finally verify
./bazel-bin/tensorflow_serving/example/mnist_inference--port=9000 ~/tmp/
I tensorflow_serving/session_bundle/session_bundle.cc:109] Attempting to load a sessionbundle from:/home/gezi/tmp/
E tensorflow_serving/example/mnist_inference.cc:190] Fail to load TensorFlow export:/home/gezi/tmp/export.meta
gezi:~/other/serving$ Bazel Test tensorflow_serving/...
Warning:sandboxed execution is not supported on your system and thus hermeticity of the actions cannot be guaranteed. See http://bazel.io/docs/bazel-user-manual.html#sandboxing for more information. You can turn off this warning via--ignore_unsupported_sandboxing.
Info:found targets and targets test ...
Info:elapsed time:31.664s, Critical path:28.86s
Tensorflow_serving/batching:batch_scheduler_test PASSED in 0.3s
Tensorflow_serving/batching:retrier_test PASSED in 0.2s
Tensorflow_serving/batching:streaming_batch_scheduler_test PASSED in 4.1s
Tensorflow_serving/batching/test_util:puppet_batch_scheduler_test PASSED in 0.2s
Tensorflow_serving/core:availability_helpers_test PASSED in 0.3s
Tensorflow_serving/core:dynamic_manager_benchmark PASSED in 28.5s
Tensorflow_serving/core:dynamic_manager_test PASSED in 0.3s
Tensorflow_serving/core:eager_load_policy_test PASSED in 0.2s
??
??
??
Compilation of TensorFlow serving