About Model Sercver Configuration

All model server’s configurations are stored in $PROJECT_ROOT_DIR/conf/server folder.

Common Configuration

Use mobilenetv2’s model server configuration for example

host: server’s host address

port: server’s port

max connections: server’s max connections. old connection will be kicked off if no spare connection left. Connections will be refused if no extra connections can be kicked. Enlarge this param when the amount of concurrency is large. You may find some useful disscussion on #issue463, #issue906 and tutorial-05-http_proxy

peer_resp_timeout: the maximum duration for reading or sending out a block of data. The default setting is 15 seconds.

compute_threads: thread nums for computing. -1 mean default nums which equals your cpu core nums

handler_threads: thread nums for network process function and callback function

model_run_timeout: the time limit of a model’s inference process. inference process will be interruptted if cost more time.

server_url: server’s uri path

model_config_file_path: model’s configuration file path. For detailed description of it you may refer to about_model_configuration

Other Web Service Configuration

For other web service configuration you may find help at workflow_docs_about_global_configuration

And if you want to adjust some of those configuration params you may do it by modifying your server’s init function. For example global configuration for mobilenetv2 classification server can be modified at ../src/server/classification/mobilenetv2_server.cpp#L197-L202

Init Workflow Global Configuration Code Snappit