Ml Model Eval Benchmark

Calculates classification and regression metrics like accuracy, F1-score, RMSE, and provides confusion matrix to evaluate ML model performance.

Plan reproducible ML experiment runs with explicit parameters, metrics, and artifacts. Use before model training to standardize tracking-ready experiment def...

Double-blind multi-model comparison with automatic de-anonymization and progress polling. Trigger with "mdls" or "modelshow".

Automates training of machine learning models like Random Forest and XGBoost with hyperparameter tuning and export options from provided datasets.

Shadow-test local Ollama models against a cloud baseline with a multi-judge ensemble. Automatically promotes models when statistically proven equivalent — re...

Find the best local LLM for your machine. Tests speed, quality and RAM fit, then tells you if a model is worth running on your hardware.