I swear they marketed it in a way where previous technologies before LLMS get lumped in with everything else, just so they can say “well what about this life saving technology that runs at 7 watts on a raspberry pi” as if its the same thing. Its fusterating because in so many ways it derails a point because many people don’t know enough to make a distinction. That and all the easy accessable local LLM’s/ai diffusions are pretty much just heavily distilled/quantized versions of the main model, or just porn that still chug power. People aren’t buying an obscure compute puck, building a server, or buying tensor hardware where you actually have to use Python or touch a terminal.
I have struggled with a way to address this issue and the easiest way is to broadly just say fuck all ai and not make the distinction. The people who do use local models are maybe less than a single percentage of people who use ai. I don’t think its nessisary to address it, and I think for most people everything you just typed is going to go in one ear and out the other. Even if you explain it to a random person on the street, I’m likely to believe they will still walk away thinking chatgpt is the just the natural evolution of the apple kicking camera, or algorithms that self tune a guitar.
I swear they marketed it in a way where previous technologies before LLMS get lumped in with everything else, just so they can say “well what about this life saving technology that runs at 7 watts on a raspberry pi” as if its the same thing. Its fusterating because in so many ways it derails a point because many people don’t know enough to make a distinction. That and all the easy accessable local LLM’s/ai diffusions are pretty much just heavily distilled/quantized versions of the main model, or just porn that still chug power. People aren’t buying an obscure compute puck, building a server, or buying tensor hardware where you actually have to use Python or touch a terminal.
I have struggled with a way to address this issue and the easiest way is to broadly just say fuck all ai and not make the distinction. The people who do use local models are maybe less than a single percentage of people who use ai. I don’t think its nessisary to address it, and I think for most people everything you just typed is going to go in one ear and out the other. Even if you explain it to a random person on the street, I’m likely to believe they will still walk away thinking chatgpt is the just the natural evolution of the apple kicking camera, or algorithms that self tune a guitar.