Serving and cost
servectl
Serve a model over HTTP in one command, with metrics.
Install
pip install servectlIf you use uv, also as an isolated CLI:
uv tool install servectlWhat it does
You have a model on disk and want to try it behind an HTTP endpoint without writing an app each time. servectl loads the artifact and serves it: a typed /predict, a /health check and Prometheus metrics ready to scrape.
In action
A real recorded session of the CLI running.
Read it as text
name: model n_features: 23 predict_proba: True
$ servectl info models/model.joblib
name: model
n_features: 23
predict_proba: TrueFeatures
- —Loads scikit-learn-style joblib/pickle artifacts.
- —/predict and /predict_proba with validation.
- —/health and /metrics in Prometheus format.
- —Clean 400 responses on bad input.