Explicit User KNN on ML100K

This page analyzes the hyperparameter tuning results for the User KNN explicit-feedback rating predictor.

Parameter Search Space

Parameter	Type	Distribution	Values
max_nbrs	Integer	Uniform	2 ≤ \(x\) ≤ 50
min_nbrs	Integer	Uniform	1 ≤ \(x\) ≤ 5
min_sim	Float	LogUniform	1e-06 ≤ \(x\) ≤ 0.1

Final Result

Searching selected the following configuration:

{'max_nbrs': 37, 'min_nbrs': 1, 'min_sim': 0.0012637169527385424}

With these metrics:

{
    'RBP': 0.0010060289859405356,
    'NDCG': 0.17350830397361094,
    'RecipRank': 0.015619123653649666,
    'RMSE': 0.8793254349597548,
    'TrainTask': '18030cad-8811-45c7-a944-9b39c50b04d5',
    'TrainTime': 0.03539751500102284,
    'TrainCPU': 0.028187999999999602,
    'TestTask': 'ac8d8462-3b60-4851-ad6f-933af37e6550',
    'TestTime': 1.0681008069987001,
    'TestCPU': 1.0895709999999998,
    'timestamp': 1743028621,
    'checkpoint_dir_name': None,
    'done': True,
    'training_iteration': 1,
    'trial_id': 'ce963_00031',
    'date': '2025-03-26_18-37-01',
    'time_this_iter_s': 1.2261180877685547,
    'time_total_s': 1.2261180877685547,
    'pid': 165947,
    'hostname': 'CCI-ws21',
    'node_ip': '10.248.127.152',
    'config': {'max_nbrs': 37, 'min_nbrs': 1, 'min_sim': 0.0012637169527385424},
    'time_since_restore': 1.2261180877685547,
    'iterations_since_restore': 1,
    'experiment_tag': '31_max_nbrs=37,min_nbrs=1,min_sim=0.0013'
}

Parameter Influence

Neighborhood Size

The max neighbors is one of the more influential properties. Note that this chart may be noisier than typical, because we are plotting the influence from random search, so the other parameters are simultaneously changing.

RMSE

RBP

Minimum Neighbors

We also examine the minimum neighbors, which reduces the model’s willingness to make low-confidence predictions.

Minimum Similarity

Finally, the minimum similarity filters out low-information relationships: