obrhoff, 1 month ago The amazing thing about LLMs is how much knowledge they posess in their small size. The llama3-8b model, for instance, weighs only 4.7GB yet can still answer your questions about everything (despite some hallucinations). #llm #ai #ollama #llama3
The amazing thing about LLMs is how much knowledge they posess in their small size. The llama3-8b model, for instance, weighs only 4.7GB yet can still answer your questions about everything (despite some hallucinations). #llm #ai #ollama #llama3
noplasticshower, 1 month ago @obrhoff being DEAD WRONG is not really a "hallucination"...but your point is well taken. Cramming information into a smaller space is amazing. When you re-represent and compress information in the long tails of gradient Gaussians disappears.
@obrhoff being DEAD WRONG is not really a "hallucination"...but your point is well taken. Cramming information into a smaller space is amazing.
When you re-represent and compress information in the long tails of gradient Gaussians disappears.
Add comment