Algorithm validation

In this chapter we will explore techniques for determining segmentation quality and quality of spot detection algorithms.

See also

• The Analysis of Method Comparison Studies (D.G. Altman and J.M. Bland 1983)

• Method comparison and Bland-Altman plots

• Sklearn: Metrics and scoring

• Lena Maier-Hein, Annika Reinke, et al. Metrics reloaded: Pitfalls and recommendations for image analysis validation

• (Bench)mark: Pitfalls in AI Validation | Annika Reinke

• Quality assurance of segmentation results blog post

Installation of requirements

In this chapter we will use the statsmodels library for statistical testing. You can install it using mamba/conda or pip:

mamba install -c conda-forge statsmodels

pip install statsmodels