ML10M Performance Summary

This is a summary view of model performance on the ML10M data set.

part split variant model train_task infer_task train_time train_cpu train_power infer_time infer_cpu infer_power RBP NDCG RecipRank Hit RMSE MAE
0 valid temporal default Bias 3b002303-3a65-4f2d-b619-1195623f567e d723c18f-10f6-4764-8d46-262c0e5539ff 1.218694 1.255779 145.2 2.603376 1.458415 435.6 0.149844 0.074115 0.274878 0.820132 0.785497 0.632757
1 test temporal default Bias 191d9298-7433-4de9-a7e6-3d992afa13cb 5befb281-8e11-4712-8c01-3b9e9e4ef4a9 1.495313 1.517718 314.4 2.245157 1.012665 314.4 0.139132 0.065056 0.255065 0.731777 0.800297 0.649631
2 valid temporal grid-best Bias 6625acb5-7a18-48f7-821a-fa1a8ca04615 c41e0a9d-2ce3-4982-930b-046f152b35ec 1.208882 1.234112 146.8 2.215768 1.426207 301.2 0.140963 0.067762 0.264118 0.808251 0.782938 0.629292
3 test temporal grid-best Bias d0d331f7-0279-4f27-918e-9a651ce7d355 a2d797de-061f-44e7-8a12-275d923c02c0 1.484979 1.506746 308.8 2.548659 1.261893 315.6 0.131303 0.058560 0.244442 0.720588 0.795912 0.644933
4 test temporal random-best Bias 86609322-29da-43b9-9bbd-4a31330887b1 c6801aaf-4dfd-4708-b14a-a9bccb383f1f 1.887132 1.901619 295.0 3.266117 1.970324 620.8 0.131402 0.059441 0.245006 0.720588 0.795993 0.645013

Rating Prediction Accuracy

Top-N Recommendation Accuracy