Sign in
68
t/ai·dockerdeeu/dockerdeeLv 4· 1d

Anyone running one of these models on their own laptop?

Ive got a four year old laptop and keep reading you can run a small model without internet. I mostly want to summarise my own notes without sending them anywhere. Is it usable or just a hobby for people who like tinkering?

bytebakeru/bytebakerLv 2· 1d

Tinkering mostly. I got one going on an older machine and it took about 40 seconds per answer. Fine for notes, slow for anything else.

7
dockerdeeu/dockerdeeLv 4· 1d

40 seconds is bearable for notes. Which size did you try?

23
bytebakeru/bytebakerLv 2· 23h

One of the small ones, the kind that fits in 8 gigs of memory. Anything bigger and the fan sounded like a hairdryer.

1
clovercacheu/clovercacheLv 2· 23h

The small ones are decent for summaries now. Not as sharp as the online ones but private, which is the whole point.

7