s_mcleod,

M.2 NVMe -> PCIe x16 + some dodgy cabling = Tesla P100 eGPU 😂

Combined with my RTX3090 I can load Q4/Q5 70b models 100% into vRAM with exllama or autogpqt

#LLM #AI #ML #Llama #Nvidia #GPT

image/png
image/jpeg
image/png

s_mcleod,
decryption,
@decryption@aus.social avatar

deleted_by_author

  • Loading...
  • s_mcleod,

    @decryption thanks bro, I haven't had to do a wheel alignment yet though 😉

    decryption,
    @decryption@aus.social avatar

    deleted_by_author

  • Loading...
  • s_mcleod, (edited )

    @decryption haha danno, you've seen the massive turdo' I've bolted to it 😂

    I've actually got a second one here if you know anyone that is in the market for a P100 12GB, happy to print them a fan adapter if they're a good sort.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • llm
  • DreamBathrooms
  • mdbf
  • ethstaker
  • magazineikmin
  • GTA5RPClips
  • rosin
  • thenastyranch
  • Youngstown
  • osvaldo12
  • slotface
  • khanakhh
  • kavyap
  • InstantRegret
  • Durango
  • provamag3
  • everett
  • cisconetworking
  • Leos
  • normalnudes
  • cubers
  • modclub
  • ngwrru68w68
  • tacticalgear
  • megavids
  • anitta
  • tester
  • JUstTest
  • lostlight
  • All magazines