gael, (edited ) French
@gael@mastodon.social avatar

Imagine a #LLM running locally on a smartphone...

It could be used to fuel an offline assistant that would be able to easily add an appointment to your calendar, open an app, etc. without #privacy issues.

This has come to reality with this proof of concept using the Phi-2 2.8B transformer model running on /e/OS.

It is slow, so not very usable until we have dedicated chips on SoCs, but works (and #opensource !)

🙏 Stypox

#AI on #mobile 👇 👇 👇

owzim,

@gael I'd say before that happens, running an LLM on your local network is your best bet. Projects like https://ollama.com/ make that incredibly easy. #llm #ollama

essentiel,

All these actions are so so soooo difficult to do manualy! That's a perfectly reasonable motive to add yet another chip, burn some more ressources, use more energy 🙄
@gael

safonas,

@gael add crowdsource training for actions it can perform via assistant api, similar to r1 and we'll have our first OSS assistant... OSSistant? 😁

realsimon,
@realsimon@mastodon.green avatar

@gael lots of potential :ablobcatheart: Especially if it can access third party apps so I can say stuff like 'send [filename] to [contact] via [messenger]'

gael,
@gael@mastodon.social avatar

@realsimon yes, lots of potential!

lutindiscret,
@lutindiscret@mastodon.libre-entreprise.com avatar

@gael speechtotext en français pour pouvoir dicter mes messages et retranscrire les messages vocaux que je reçois bientôt dans /e/ ?

  • All
  • Subscribed
  • Moderated
  • Favorites
  • llm
  • khanakhh
  • magazineikmin
  • mdbf
  • GTA5RPClips
  • everett
  • rosin
  • Youngstown
  • tacticalgear
  • slotface
  • ngwrru68w68
  • kavyap
  • DreamBathrooms
  • thenastyranch
  • tester
  • JUstTest
  • ethstaker
  • cubers
  • osvaldo12
  • cisconetworking
  • Durango
  • InstantRegret
  • normalnudes
  • Leos
  • modclub
  • anitta
  • provamag3
  • megavids
  • lostlight
  • All magazines