It would be useful to have the option of splitting out ratings for some number/proportion of users upfront into a fixed validation set.