As Model Servers

One can use a MLModelScope agent as a gRPC server that accepts requests from other processes. The gRPC API is defined in the protobuf file. Start an agent as a gRPC server by

./${FRAMEWORK}-agent  -d -l -v

One can then send gRPC requests to the agent server, or use the web server (through the website or REST API) to interact with the agents.