

12·
15 hours agoSame, getting ~3 trillion parameters in consumer hardware is rough.
If Nvidia has any foresight they’ll see the writing on the wall and start getting higher memory Spark style SMB inference machines, few people in the long run are going to pay retail API token costs,

Exactly, having the mustard toddler pull fable because of, who knows? That burned trust in the west’s AI companies.
And there is also the question of what they’re doing with the data you send into the models.