What if you deploy to a different CPU architecture than you develop with? Some languages/libraries use pre-compiled binaries as part of their packages.

I wonder if you could repurpose the cars SIM card (eSIM or otherwise) / cellular modem for your own use? Like presumably the manufacturer is paying a data plan to a cell provider. If the connection is not locked down to specific traffic I wonder if it could be reused

It was the Wild West back then. Good times!

Kinda related but I used to practice guitar in my dreams. If I had been learning something I’d often dream about playing it over and over again, and even going beyond that and figuring out “solos” and melodies and stuff over the chord. Can’t be sure if it translated into any real life skill, but it felt like I was actually learning or at least strongly reinforcing what I’d been practicing.

Was thinking the same honestly. GH is very sticky though, especially when you have actions and all kinds of other integrations set up. But it’s just kind of absurd at this point how many outages they have.

Are there benchmarks of this / what’s the best way to compare it against paid models? With all the rate limiting in Claude/Copilot/etc, running locally is more and more appealing.

Do you use it with ollama? Or something else?

Llama cpp is vastly superior. There was this huge bug that prevented me from using a model in ollama and it took them four months for a “vendor sync” (what they call it) which was just updating ggml which is the underpinning library used by llama cpp (same org makes both). lmstudio/lms is essentially Ollama but with llama cpp as backend. I recommend trying lmstudio since it’s the lowest friction to start

My personal Claude sub (Pro), I can burn through my limit in a couple of hours when using Opus. It's borderline unusable unless you're willing to pay for extended usage or artificially slow yourself down.

To me, it seems like the Pro tier is priced for using Sonnet a lot or Opus a little, and Max for using Opus a lot.

So that seems about what you should expect.

The problem is half the time you don't know you need the better model until the lesser model has made a massive mess. Then you have to do it again on the good model, wasting money. The "auto" modes don't seem to do a good job at picking a model IME.

Agreed. What network are they forgetting here? Pretty sure I've only ever seen that apply to wifi. Are they trying to say you might need to re-pair a bluetooth speaker on a date? I don't get it.