UKNN Explicit

This page analyzes the hyperparameter tuning results for the ItemKNN scorer in explicit-feedback mode.

Parameter Search Space

Parameter Type Distribution Values Selected
max_nbrs Integer Uniform 2 ≤ \(x\) ≤ 50 49
min_nbrs Integer Uniform 1 ≤ \(x\) ≤ 5 1
min_sim Float LogUniform 1e-06 ≤ \(x\) ≤ 0.1 1.55e-05

Final Result

Searching selected the following configuration:

{'max_nbrs': 49, 'min_nbrs': 1, 'min_sim': 1.5514169091512003e-05}

With these metrics:

{
    'RBP': 0.0029005105038726366,
    'NDCG': 0.16350815690075243,
    'RecipRank': 0.01897623450503007,
    'RMSE': 0.8519396178226992,
    'TrainTask': '5ed8fcab-6bb9-4b22-b7b3-2f0b4582e31a',
    'TrainTime': 0.1749053530220408,
    'TrainCPU': 0.1675209999999998,
    'TestTask': '2613e709-1e95-4ec6-ba13-89b550b86933',
    'TestTime': 19.551427870988846,
    'TestCPU': 19.60798,
    'timestamp': 1746310916,
    'checkpoint_dir_name': None,
    'done': True,
    'training_iteration': 1,
    'trial_id': 'd9e67c8b',
    'date': '2025-05-03_18-21-56',
    'time_this_iter_s': 20.58032512664795,
    'time_total_s': 20.58032512664795,
    'pid': 1436884,
    'hostname': 'CCI-ws21',
    'node_ip': '10.248.127.152',
    'config': {'max_nbrs': 49, 'min_nbrs': 1, 'min_sim': 1.5514169091512003e-05},
    'time_since_restore': 20.58032512664795,
    'iterations_since_restore': 1,
    'experiment_tag': '19_max_nbrs=49,min_nbrs=1,min_sim=0.0000'
}

Parameter Behavior

Neighborhood Size

The neighborhood size is key argument to consider, let’s look at RMSE with repspect to that:

Filtering

There are two filtering parameters we also test — minimum neighbors and mininmum simialrity.