Seven KNN hyperparameter tuning strategies compared across 15 datasets: PSO ranks best overall but significantly beats only random search
Under a nested cross-validation framework, this study compared seven hyperparameter tuning strategies for classical KNN over a mixed search space comprising an integer neighborhood size k, a categorical distance metric, and a continuous Minkowski exponent p—grid search, random search, Bayesian optimization, genetic algorithm, surrogate optimization, particle swarm optimization (PSO), and grey wolf optimizer—evaluating them on 15 public classification datasets using accuracy, macro AUC, cross-validation loss, cross-entropy loss, and runtime, and found that PSO achieved the best overall mean rank but held a statistically significant advantage only over random search under Holm-corrected Wilcoxon signed-rank tests.