ML10M Performance Summary

This is a summary view of model performance on the ML10M data set.

part split variant model train_task infer_task train_time train_cpu train_power train_mem ... infer_time infer_cpu infer_power RBP DCG NDCG RecipRank Hit RMSE MAE
0 valid temporal default als-biased 8c177a75-b69c-43c4-a3d9-8146135d8441 f339beb9-9e74-4945-a17d-213201f86c92 95.791092 2683.468402 23775.426144 3108114432 ... 6.926509 19.212373 965.343554 0.085285 1.328806 0.066927 0.210395 0.806324 0.761080 0.607188
1 test temporal default als-biased 2c76da38-d68e-4d80-bce5-174cd2e549fc 5cb216d4-6595-4abb-840a-3e475b256467 28.670897 474.062710 6750.518188 4335083520 ... 4.882116 19.175169 0.000000 0.071898 1.068465 0.059283 0.191605 0.742511 0.776319 0.625458
2 valid temporal default als-implicit bbd28d2b-1f0c-4ace-a938-9af3c9f82398 36089262-e8fc-4995-86a5-2c6c7eba1468 101.308770 2933.985262 24291.765824 3283038208 ... 5.515087 12.745265 1522.115833 0.137638 2.692886 0.124174 0.264312 0.884058 NaN NaN
3 test temporal default als-implicit 6162f25a-725b-4fa6-8525-4d07b89cccc6 799df2f9-3b5d-45e9-8db8-6b14bc2e7bab 33.700948 760.678886 7295.545666 4559040512 ... 3.515839 12.733245 0.000000 0.118373 2.298255 0.111107 0.227717 0.817081 NaN NaN
4 valid temporal default bias 5514ed5d-84ed-4e41-89a0-4a4dae90c7a3 b28912fc-ae4d-44e9-a101-e82dd41c9729 1.598090 1.599387 0.000000 2303328256 ... 5.491838 9.961210 1702.886312 0.004713 0.614395 0.029832 0.030314 0.734519 0.790592 0.634958

5 rows × 21 columns

Top-N Recommendation Accuracy

Rating Prediction Accuracy