Data Description

Rating Statistics

Ratings 33,831,794
Users 330,974
Items 83,238
Density 0.123%
Item Gini 0.953
Start Date 1995-01-09 11:46:44
End Date 2023-07-20 08:53:33

Item Statistics

This section describes the distribution of various item statistics from the data set.

Item Popularity

What is the distribution of popularity?

Let’s also look at this as a Lorenz curve, for clarity:

Item Average Rating

What is the distribution of average ratings?

User Statistics

We now turn to the distribution of various user statistics.

User Average Ratings

How are user averages distributed?

User Activity Level

And what is the distribution of user activity levels (# of ratings)?

Ratings over Time

The MovieLens ratings have timestamps, so we’ll also look at a temporal view of the data.

Data Volume

How did the data grow over time?

How many ratings are we getting each month through the life of the data set?

User Activity

Monthly unique users is a good measure of user activity.

How long do users usually stick around?

Parametric Activity Distributions

Some downstream uses benefit from parametric distributions of user/item activity levels.

Item Activity Distributions

This section models the item popularity distribution with various parametric distributions.

Distribution Params Location Scale D(KL) Δ(JS)
Log-normal s=14.821 1 0.101 0.933 0.402
Pareto b=0.283 0.87 0.128 0.198 0.208
Power law a=0.032 0.555 999.226 inf 0.454
Geometric p=0.002 0 2.855 0.598

User Activity Distributions

Now the same, for user activity distributions.

Distribution Params Location Scale D(KL) Δ(JS)
Log-normal s=1.540 0.228 34.467 0.08 0.133
Pareto b=0.246 0 0.988 0.571 0.353
Power law a=0.265 0.529 999.883 inf 0.343
NegBinom n=1.000, p=0.010 1 0.339 0.238
BetaNegBinom n=1.000, a=1.420, b=54.967 1 0.081 0.134