doodlebob

@doodlebob@lemmy.world

This profile is from a federated server and may be incomplete. Browse more on the original instance.

doodlebob, (edited )

Do you know if there is openai API compatibility? More specifically I’d like to get home assistant to interact with the LLM via the custom OpenAI hacs addon

doodlebob,

It starts getting rusty lol They used a stainless steel alloy or something

Music Piracy Is Back, Baby (gizmodo.com)

“Muso, a research firm that studies piracy, concluded that the high prices of streaming services like Spotify and Apple Music are pushing people back towards illegal downloads. Spotify raised its prices by one dollar last year to $10.99 a month, the same price as Apple Music. Instead of coughing up $132 a year, more consumers...

doodlebob,

Do you know if there is anything that locks up to this that will automatically download the music they recommend?

It would be cool to have an app where if you like the track, you give it a thumbs up, but if you don’t you give it a thumbs down and the track is deleted automatically

doodlebob,

I’m sure that’s not that big of a deal to some people. For example, I’m mainly using LLMs for use in my home assistant instance

doodlebob,

Check out onju voice!

doodlebob,

I tried this but much prefer to use oogabooga text generation webui. Couldn’t get your solution to work in unraid for whatever reason

doodlebob,

You’re gonna make me look it up myself?!

doodlebob,

You should probably also sync them. I use orbital sync for this. github.com/mattwebbio/orbital-sync

doodlebob,

I have two 3090 Turbo GPUs and it seems like oobabooga doesn’t split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

doodlebob,

I think you’re right. Saw a post on Reddit basically mentioning the same things I’m seeing.

It looks like autoawq supports it but it might be an issue with how oobabooga implements it or something…

doodlebob,

Yeah it’s mainly subs that aren’t available yet…

I had no idea about that! that’s basically exactly what I was looking for, thank you!

doodlebob,

I was actually thinking an RTX Titan or maybe RTX A4500 only if I could score one for a good price. I’ve been leaning towards Nvidia because it seems easier to use for ML applications

doodlebob,

I ended up going with a gigabyte 3090 turbo!

doodlebob,

Have you run into any issues with willow?

doodlebob,

Honestly even from the demo it didn’t look that jank! But you’re probably right, it’s going to be a solid addition once it matures a bit.

Hopefully the home assistant team and the willow team works on closer integration

doodlebob,

I had no idea about the esp32-box until I saw this project… Immediately bought 2 right after lol

doodlebob,

For the shaper, did you get that at auction? Are these like eBay auctions you’re taking about?

  • All
  • Subscribed
  • Moderated
  • Favorites
  • megavids
  • thenastyranch
  • rosin
  • GTA5RPClips
  • osvaldo12
  • love
  • Youngstown
  • slotface
  • khanakhh
  • everett
  • kavyap
  • mdbf
  • DreamBathrooms
  • ngwrru68w68
  • provamag3
  • magazineikmin
  • InstantRegret
  • normalnudes
  • tacticalgear
  • cubers
  • ethstaker
  • modclub
  • cisconetworking
  • Durango
  • anitta
  • Leos
  • tester
  • JUstTest
  • All magazines