As Framework Wrappers

One can bypass all the distributed aspects of MLModelScope and uses the MLModelScope agents as pure wrappers of the frameworks. Some common commands:

  • ./${FRAMEWORK}-agent info models lists the available models.

  • ./${FRAMEWORK}-agent predict evaluates a model with the default setups. ./${FRAMEWORK}-agent predict -h shows the available flags you can set. For example, ./${FRAMEWORK}-agent predict urls --trace_level=FRAMEWORK_TRACE --model_name=Inception_v3.