There’s several stages in the training of an LLM. Early stages are the ones which use the massive data sets to teach it language and general facts about the world. Later stages use reinforcement learning to bake in the creator’s preferences. That’s where these kinds of pro-CCP biases would be deliberately introduced.
A “neutral” model would be one that has had those later stages abliterated. Whatever biases remain would be some kind of average of all the views of the people whose text is in the training corpus, which I hear is a pretty indiscriminate collection of literally anything people can download.
There’s several stages in the training of an LLM. Early stages are the ones which use the massive data sets to teach it language and general facts about the world. Later stages use reinforcement learning to bake in the creator’s preferences. That’s where these kinds of pro-CCP biases would be deliberately introduced.
A “neutral” model would be one that has had those later stages abliterated. Whatever biases remain would be some kind of average of all the views of the people whose text is in the training corpus, which I hear is a pretty indiscriminate collection of literally anything people can download.