Try to apply regularization instead of variable selection method Remodify kNN algorithm, if new result still bad, replace it with Radial Basis Function (RBF) Need to apply new ML algorithms like GAM (Generalized Additive Model), Neural Network etc.