AboutServicesProjectsContact
ManifestoBlogOpen SourceUsesNowResumeShall we talk?

Open Source

Command-line tools for the daily work of ML

A small suite of well-made, dependency-light command-line tools for the daily work of machine learning engineering. Each does one thing, runs offline, and fits into CI.

View the organization on GitHub

Data

dsdiffA git-style diff between two datasets, with distribution drift.MoresplitcheckDetect rows leaking between train, validation and test splits.Morepii-sweepScan datasets for PII before sharing them.More

Environment and reproducibility

mlenvSnapshot the ML stack to a file and diff two snapshots.Morerepro-manifestA portable receipt per run to explain why two runs differ.Moregpu-gateWait for a free GPU, claim it, and run your command.More

Evaluation

evalgateDecide whether a metric change is a real regression or noise.MoreslicemapFind the slices where a new model regressed.More

Serving and cost

servectlServe a model over HTTP in one command, with metrics.MoretokenmeterCount tokens and estimate prompt cost before sending.More
hola@jmwebsoluciones.com