CDV
This is a summary view of model performance on the CDs_and_Vinyl data set.
Top-N Recommendation Accuracy
Rating Prediction Accuracy
Resource Consumption
Time
Memory
Power
Leaderboard Table
This provides quick numeric access to the model results by mean metric. Note, however, that simple means can be misleading!
Top-N Recommendation
| RBP | NDCG | RecipRank | ||
|---|---|---|---|---|
| model | variant | |||
| als-implicit | optuna-best | 0.003 | 0.016 | 0.011 |
| als-implicit | default | 0.002 | 0.010 | 0.007 |
| flexmf-logistic | optuna-best | 0.001 | 0.007 | 0.005 |
| flexmf-bpr | optuna-best | 0.001 | 0.007 | 0.004 |
| flexmf-warp | optuna-best | 0.001 | 0.005 | 0.003 |
| bias | optuna-best | 0.001 | 0.004 | 0.003 |
| als-biased | optuna-best | 0.001 | 0.004 | 0.003 |
| popular | default | 0.000 | 0.003 | 0.002 |
| flexmf-explicit | optuna-best | 0.000 | 0.001 | 0.001 |
| als-biased | default | 0.000 | 0.001 | 0.000 |
| flexmf-bpr | default | 0.000 | 0.000 | 0.000 |
| flexmf-explicit | default | 0.000 | 0.000 | 0.000 |
| flexmf-warp | default | 0.000 | 0.000 | 0.000 |
| bias | default | 0.000 | 0.000 | 0.000 |
| flexmf-logistic | default | 0.000 | 0.000 | 0.000 |
Rating Prediction
| RMSE | MAE | ||
|---|---|---|---|
| model | variant | ||
| bias | optuna-best | 0.663 | 0.622 |
| als-biased | optuna-best | 0.672 | 0.626 |
| als-biased | default | 0.696 | 0.647 |
| bias | default | 0.727 | 0.675 |
| flexmf-explicit | optuna-best | 0.728 | 0.687 |
| flexmf-explicit | default | 0.761 | 0.716 |