Software

I have developed various statistical and machine learning methods as part of my research. To make these methods accessible and usable, I have developed open source software libraries that allows users to easily apply these methods in their own work. These libraries are available on GitHub, and I welcome contributions and feedback from the community.

Python libraries

Kernel-based AI Trustworthiness Examiner

KiTE

kernel_calibration

Python

A JAX library for evaluating and improving the local calibration of binary probabilistic classifiers. KiTE helps determine whether a model is locally calibrated, identify the regions where its predictions are over- or under-confident, and learn a recalibration correction when needed.

Test

Run a permutation hypothesis test of whether a model is locally calibrated.

Diagnose

Locate calibration bias across the feature space instead of relying only on a global average.

Recalibrate

Fit a lightweight correction that improves local calibration while preserving the original model's signal.

Install from GitHub pip install git+https://github.com/ritwikvashistha/kernel_calibration.git