FlexMF Explicit

This page analyzes the hyperparameter tuning results for the FlexMF scorer in explicit-feedback mode (a biased matrix factorization model trained with PyTorch).

Parameter Search Space

Parameter	Type	Distribution	Values	Selected
embedding_size_exp	Integer	Uniform	3 ≤ \(x\) ≤ 10	3
regularization	Float	LogUniform	0.0001 ≤ \(x\) ≤ 10	0.0792
learning_rate	Float	LogUniform	0.001 ≤ \(x\) ≤ 0.1	0.00701
reg_method	Categorical	Uniform	L2, AdamW	AdamW

Final Result

Searching selected the following configuration:

{
    'embedding_size_exp': 3,
    'regularization': 0.07920205769115246,
    'learning_rate': 0.00701067351316588,
    'reg_method': 'AdamW',
    'epochs': 7
}

With these metrics:

{
    'RBP': 0.019037303703845935,
    'DCG': 0.6707836823820809,
    'NDCG': 0.18833740275810948,
    'RecipRank': 0.07989762170334741,
    'Hit10': 0.16887417218543047,
    'RMSE': 0.8201711773872375,
    'max_epochs': 50,
    'epoch_train_s': 0.06732641509734094,
    'epoch_measure_s': 2.449305384187028,
    'done': False,
    'training_iteration': 7,
    'trial_id': 'fae4e54b',
    'date': '2025-09-30_15-26-55',
    'timestamp': 1759260415,
    'time_this_iter_s': 2.520402431488037,
    'time_total_s': 18.560733795166016,
    'pid': 301878,
    'hostname': 'CCI-ws21',
    'node_ip': '10.248.127.152',
    'config': {
        'embedding_size_exp': 3,
        'regularization': 0.07920205769115246,
        'learning_rate': 0.00701067351316588,
        'reg_method': 'AdamW',
        'epochs': 7
    },
    'time_since_restore': 18.560733795166016,
    'iterations_since_restore': 7
}

Parameter Analysis

Embedding Size

The embedding size is the hyperparameter that most affects the model’s fundamental logic, so let’s look at performance as a fufnction of it:

Learning Parameters

Learning Rate

Regularization

Iteration Completion

How many iterations, on average, did we complete?

How did the metric progress in the best result?

How did the metric progress in the longest results?