kellogh,
@kellogh@hachyderm.io avatar

has anyone made a successor to fuckit.js that uses ?

(fuckit.js ran the script in a loop, randomly deleting lines until it runs successfully)

wagesj45,
@wagesj45@mastodon.jordanwages.com avatar

@kellogh like the llm deletes stuff or we delete stuff from the llm?

kellogh,
@kellogh@hachyderm.io avatar

@wagesj45 idk, either sounds pretty interesting

wagesj45,
@wagesj45@mastodon.jordanwages.com avatar

@kellogh I know pruning works pretty well with diffusion models. I think there's some talk of early-terminating layers and layer removal for LLMs.

I wonder how much you could remove from an LLM before things got weird.

kellogh,
@kellogh@hachyderm.io avatar

@wagesj45 right, but it’s gotta be haphazard

wagesj45,
@wagesj45@mastodon.jordanwages.com avatar

@kellogh I wonder how it could be done... 🤔

Just randomly zero out a vector component maybe. We should ask ChatGPT lol.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • LLMs
  • magazineikmin
  • rosin
  • Youngstown
  • ngwrru68w68
  • khanakhh
  • slotface
  • InstantRegret
  • mdbf
  • GTA5RPClips
  • kavyap
  • thenastyranch
  • DreamBathrooms
  • everett
  • tacticalgear
  • JUstTest
  • tester
  • Durango
  • cubers
  • ethstaker
  • cisconetworking
  • modclub
  • osvaldo12
  • Leos
  • normalnudes
  • megavids
  • provamag3
  • anitta
  • lostlight
  • All magazines