ML25M Performance Summary

This is a summary view of model performance on the ML25M data set.

part split variant model train_task infer_task train_time train_cpu train_power infer_time infer_cpu infer_power RBP NDCG RecipRank Hit RMSE MAE
0 valid temporal default Bias e2b798ff-44cb-4d5c-9566-63fcaa446365 d844d5bf-8c6f-4271-bcb8-e5e2803b9154 3.028597 3.059772 455.6 3.469883 2.259814 440.4 0.143385 0.070875 0.262279 0.752704 0.815976 0.661763
1 test temporal default Bias cbcc621e-b268-47c8-b010-a6cdd21e6495 6e49a45e-5ec3-4a88-905e-0fa5c8d1b52d 3.780353 3.820491 572.0 4.871075 2.734702 792.0 0.097172 0.050928 0.192547 0.662089 0.835402 0.688162
2 valid temporal grid-best Bias a7825705-5c37-45cc-8b47-731f8cf135fe de10264e-6241-47b7-8031-9854b3b93fb2 3.099390 3.128938 438.3 3.063269 2.206935 479.7 0.143046 0.070429 0.261133 0.776855 0.813037 0.658243
3 test temporal grid-best Bias cf6ba83f-ee06-46b8-ba3b-dab9d1f7e918 3aaa46fc-5624-439c-a3e4-ca48fdf4aced 3.695819 3.737566 618.4 5.160094 2.647310 700.6 0.087144 0.048448 0.174399 0.653757 0.833309 0.684916
4 test temporal random-best Bias 4d5e100e-0c29-47c4-83ae-1f86fec8fcf0 9324551d-a443-48cf-a906-51fe77961c67 4.705755 4.725629 794.9 5.652461 3.415597 2223.0 0.085788 0.047402 0.173555 0.648974 0.834012 0.685182

Rating Prediction Accuracy

Top-N Recommendation Accuracy