RLHF data
Human feedback data used in reinforcement learning from human feedback: rankings, preferences, and evaluations that teach a model which outputs people consider better. It is produced by human workforces rather than licensed from rights holders, which makes it a different market from training data supply.