FlexMF Explicit

This page analyzes the hyperparameter tuning results for the FlexMF scorer in explicit-feedback mode (a biased matrix factorization model trained with PyTorch).

Parameter Search Space

Parameter	Type	Distribution	Values	Selected
embedding_size	Integer	LogUniform	4 ≤ \(x\) ≤ 512	219
regularization	Float	LogUniform	0.0001 ≤ \(x\) ≤ 10	0.085
learning_rate	Float	LogUniform	0.001 ≤ \(x\) ≤ 0.1	0.00109
reg_method	Categorical	Uniform	L2, AdamW	L2

Final Result

Searching selected the following configuration:

{
    'embedding_size': 219,
    'regularization': 0.08496870229405735,
    'learning_rate': 0.001090068401204834,
    'reg_method': 'L2',
    'epochs': 7
}

With these metrics:

{
    'RBP': 0.12222645114964603,
    'NDCG': 0.37846845679985575,
    'RecipRank': 0.27772795591921196,
    'RMSE': 0.7775135770440101,
    'TrainTask': '6273e4e2-f6ea-44e3-a6c8-e827e15737f0',
    'TrainTime': None,
    'TrainCPU': None,
    'max_epochs': 50,
    'done': True,
    'training_iteration': 7,
    'trial_id': 'b49cc5c4',
    'date': '2025-05-02_11-02-45',
    'timestamp': 1746198165,
    'time_this_iter_s': 17.094162940979004,
    'time_total_s': 121.62569880485535,
    'pid': 734263,
    'hostname': 'CCI-ws21',
    'node_ip': '10.248.127.152',
    'config': {
        'embedding_size': 219,
        'regularization': 0.08496870229405735,
        'learning_rate': 0.001090068401204834,
        'reg_method': 'L2',
        'epochs': 7
    },
    'time_since_restore': 121.62569880485535,
    'iterations_since_restore': 7
}

Parameter Analysis

Embedding Size

The embedding size is the hyperparameter that most affects the model’s fundamental logic, so let’s look at performance as a fufnction of it:

Learning Parameters

Learning Rate

Regularization

Iteration Completion

How many iterations, on average, did we complete?

How did the metric progress in the best result?

How did the metric progress in the longest results?