hirad, 2 months ago @nosherwan the one I got requires almost 30gb. You could try 2 or 3 bits ones, but they're not recommended. https://huggingface.co/TheBloke/dolphin-2.7-mixtral-8x7b-GGUF
@nosherwan the one I got requires almost 30gb. You could try 2 or 3 bits ones, but they're not recommended.
https://huggingface.co/TheBloke/dolphin-2.7-mixtral-8x7b-GGUF