Evaluation

slicemap

Find the slices where a new model regressed.

Install

pip install slicemap-cli

Once published to PyPI. Also available now from GitHub:

pip install git+https://github.com/jmweb-org/slicemap

What it does

A new model can lift the overall metric while getting worse on a segment that matters: a country, an age band, a category. slicemap scores every slice and lists where the new model lost ground, ranked by impact.

Features

—Categorical and quantile slicing.
—Accuracy, error and MAE metrics.
—Impact ranking: size times degradation.
—CI gate and JSON output.

View the code on GitHub →

Other tools

dsdiff

A git-style diff between two datasets, with distribution drift.

splitcheck

Detect rows leaking between train, validation and test splits.

pii-sweep

Scan datasets for PII before sharing them.