A MLModelScope agent is a model serving process that is run on a system of interest (within a container or on bare metal) and handles requests from the MLModelScope server. MLModelScope agents continuously listen for jobs and communicate with the MLModelScope server through gRPC. One can also specify experiments to run through an agent directly from the command line on the sytem.
MLModelScope has the corresponding agent for each supported framework. Refer to MLModelScope Agents to install the agents.
<!–
–>