ML20M Performance Summary

This is a summary view of model performance on the ML20M data set.

	part	split	variant	model	train_task	infer_task	train_time	train_cpu	train_power	infer_time	infer_cpu	infer_power	RBP	NDCG	RecipRank	Hit	RMSE	MAE
0	valid	temporal	default	Bias	e0139e80-e093-4269-b837-da6d4c857a90	e7855e57-31f1-45b8-af7b-0da91f5a1144	2.461290	2.501154	382.4	2.998376	2.186378	456.3	0.146706	0.063957	0.266524	0.728453	0.800166	0.649156
1	test	temporal	default	Bias	2311de23-0727-4c9f-80b6-7e6cc791493c	3ff4edd4-168d-4245-a338-85e6d5efaeda	2.975031	3.008255	430.5	3.892306	2.224135	629.5	0.148584	0.068173	0.273992	0.765636	0.773062	0.627979
2	valid	temporal	grid-best	Bias	b24ff93f-ae82-4002-b880-622248fd9f36	797e0858-29b1-42e4-97f9-348483bac23d	2.460335	2.494069	293.5	3.452546	2.326469	450.3	0.148145	0.063629	0.269995	0.771852	0.798504	0.646437
3	test	temporal	grid-best	Bias	de902b7f-7164-45b1-8ce3-6706e1fd1987	8e87d488-7eca-44af-9273-924abf255bb6	2.992184	3.027195	525.5	3.857283	2.346318	585.6	0.177527	0.075617	0.332039	0.784328	0.769423	0.623251
4	test	temporal	random-best	Bias	20a8689f-bf16-443d-a3aa-9b4c2962e974	d3a3bed4-f100-47fd-a925-aede10eed957	3.781010	3.801578	573.9	4.488668	2.609211	740.0	0.183748	0.076517	0.337314	0.783789	0.769610	0.623855

Rating Prediction Accuracy