jann,
@jann@twit.social avatar

Okay, my lovely computer programmers... IF I want to play around with LLMs by loading everything I've ever written in one to train it - but NOT giving it anymore knowledge than that - what is my best hope to begin playing with it on macOS?

I'm tots comfortable with command line and programming.

mrfusion,
@mrfusion@twit.social avatar

@jann try ollama.com for models and useanything.com as a front end. AnythingLLM will allow you to add documents for the AI to reference. I’m just messing around with it - with a 2012 iMac, so performance for me is not great. But I’ve played with it on my kids M1 laptop and it’s much faster. If you have an M based chip, there are some other front ends you could play with like LM Studio that might be better.

jann,
@jann@twit.social avatar

@mrfusion thanks! (Ps: M2 mini w/24G RAM)

mrfusion,
@mrfusion@twit.social avatar

@jann oh yeah, that will work MUCH better!

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • DreamBathrooms
  • everett
  • InstantRegret
  • magazineikmin
  • thenastyranch
  • rosin
  • GTA5RPClips
  • Durango
  • Youngstown
  • slotface
  • khanakhh
  • kavyap
  • ngwrru68w68
  • tacticalgear
  • JUstTest
  • osvaldo12
  • tester
  • cubers
  • cisconetworking
  • mdbf
  • ethstaker
  • modclub
  • Leos
  • anitta
  • normalnudes
  • megavids
  • provamag3
  • lostlight
  • All magazines