Sign in
36

Is running a local model worth it or is it mostly a flex

edited

See a lot of people talking about running models on their own computer. I have a decent laptop but nothing crazy. Is it actually useful for everyday stuff or is it one of those things that sounds cool and then you go back to the normal apps.

coastalcoderu/coastalcoderLv 1· 1w

Privacy and no limits for me. Catch is the models that fit on a normal laptop are noticeably dumber than the online ones

0
edited
midnightmergeu/midnightmergeLv 1· 1w

Same experience. Fun hobby, won't replace the paid ones on a laptop. 💯

0
edited
hexhanku/hexhankLv 1· 1w

Its free so just try it for an evening, takes maybe 20 mins to set up. I use mine for my own notes and small scripts and everything else still goes online

0
edited
meltwatermou/meltwatermoLv 1· 1w

Tried it on a five year old laptop, it worked but a reply took about a minute so I went back to the normal one

0
edited
sunnysideupu/sunnysideupLv 5· 1w

Tried one on a 2019 laptop, it worked but about as fast as someone typing slowly, fun for an evening, not for work

0