You can only stave off model collapse so long.
It’s only a matter of time before most of the data going in to LLMs came out of one too.
Like I’m not even good at math or anything, much less computer science, but that seems obvious and inevitable to me.
Maybe someone smarter than me can chime in.
I’m forced to use CoPilot at work and chuckled when the running dialog showing my prompt was being delivered showed LibreOffice being used for initial file generation.
I have to constantly rein in my impractically large vocabulary to minimize the degree to which I sound like a pretentious prick, but just recalling how the crisp on the outer edge of those pepperonis was surpassed only by the crisp on the top of crust makes the world feel balanced again, if only for a moment.
And it was worth it for all the Pepperoni Personal Pan Pizzas.
Same.
At least I can do a nice turn of word though.
Listen, me hearties…