MusInst

This is a summary view of model performance on the Musical_Instruments data set.

Top-N Recommendation Accuracy

Rating Prediction Accuracy

Resource Consumption

Time

Memory

Power

Leaderboard Table

This provides quick numeric access to the model results by mean metric. Note, however, that simple means can be misleading!

Top-N Recommendation

    RBP NDCG RecipRank
model variant      
popular default 0.004 0.020 0.018
flexmf-bpr optuna-best 0.004 0.022 0.017
als-implicit optuna-best 0.004 0.023 0.016
als-implicit default 0.003 0.021 0.015
flexmf-warp optuna-best 0.002 0.013 0.010
flexmf-logistic optuna-best 0.002 0.012 0.009
als-biased optuna-best 0.002 0.010 0.006
bias optuna-best 0.001 0.004 0.004
flexmf-explicit optuna-best 0.001 0.004 0.003
als-biased default 0.000 0.002 0.001
flexmf-logistic default 0.000 0.001 0.000
flexmf-explicit default 0.000 0.001 0.000
bias default 0.000 0.001 0.000
flexmf-warp default 0.000 0.001 0.000
flexmf-bpr default 0.000 0.001 0.000

Rating Prediction

    RMSE MAE
model variant    
bias optuna-best 0.886 0.816
als-biased default 0.904 0.826
als-biased optuna-best 0.907 0.831
flexmf-explicit optuna-best 0.953 0.882
bias default 0.953 0.871
flexmf-explicit default 0.988 0.913