FlexMF Explicit

This page analyzes the hyperparameter tuning results for the FlexMF scorer in explicit-feedback mode (a biased matrix factorization model trained with PyTorch).

Parameter Search Space

Parameter	Type	Distribution	Values	Selected
embedding_size	Integer	LogUniform	4 ≤ \(x\) ≤ 512	14
regularization	Float	LogUniform	0.0001 ≤ \(x\) ≤ 10	0.0498
learning_rate	Float	LogUniform	0.001 ≤ \(x\) ≤ 0.1	0.0025
reg_method	Categorical	Uniform	L2, AdamW	L2

Final Result

Searching selected the following configuration:

{
    'embedding_size': 14,
    'regularization': 0.04977041557904842,
    'learning_rate': 0.002501599473184507,
    'reg_method': 'L2',
    'epochs': 7
}

With these metrics:

{
    'RBP': 0.1201926373103401,
    'LogRBP': 1.675580457356915,
    'NDCG': 0.4037863375695813,
    'RecipRank': 0.2678976522436296,
    'RMSE': 0.7612197947196359,
    'TrainTask': '70766d29-5efa-4d7e-b26e-29020730645f',
    'TrainTime': None,
    'TrainCPU': None,
    'max_epochs': 50,
    'done': True,
    'training_iteration': 7,
    'trial_id': 'b668a_00065',
    'date': '2025-05-05_12-16-44',
    'timestamp': 1746461804,
    'time_this_iter_s': 9.56740665435791,
    'time_total_s': 60.67594361305237,
    'pid': 11399,
    'hostname': 'CCI-ws21',
    'node_ip': '10.248.127.152',
    'config': {
        'embedding_size': 14,
        'regularization': 0.04977041557904842,
        'learning_rate': 0.002501599473184507,
        'reg_method': 'L2',
        'epochs': 7
    },
    'time_since_restore': 60.67594361305237,
    'iterations_since_restore': 7
}

Parameter Analysis

Embedding Size

The embedding size is the hyperparameter that most affects the model’s fundamental logic, so let’s look at performance as a fufnction of it:

Learning Parameters

Learning Rate

Regularization

Iteration Completion

How many iterations, on average, did we complete?

How did the metric progress in the best result?

How did the metric progress in the longest results?