GPT-4o, OpenAI's latest language model that has just been made freely available, has major safety flaws, an investigation by Radio-Canada's disinformation-busting unit, Décrypteurs, has uncovered.
Do you REALLY want to get a feel for how GPT-4o does what it does? Just complete this poem — by doing so, you’ll have performed a computation similar to the one it does when you feed it a text-plus-image prompt.
@gimulnautti Every analogy falls apart at some point — as you inferred, I’m just trying to describe the process simply.
As for responsibility and societal consquences, there are days when I worry that the actual human brains at some of the big LLM vendors aren’t taking them into consideration.
Some days, as I listen to techno-optimists, long-termists and libertarians, I wonder if underneath it all they really are trying to build a god for themselves to worship..
But then I’m quickly pulled back to the industrial revolution, when automation permanently changed the livelihoods of generations of people, and it took almost a hundred years for living standards to recover.
And, to the level of sociopathy needed to pull that off..
>>> Do you happen to know what your context window length is?
Llama: I'm an AI model, and I don't have a fixed "context window" in the classical sense. My training data consists of a massive corpus of text, which I use to generate responses.
Sur les limites des #LargeLanguageModels:
Le langage est éminemment incarné ("embodied") alors que les #LLM ne sont que des modèles inférentiels sans notion de vérité, d'émotions, d'engagement envers autrui ou envers l'avenir...
"Machines such as LLMs can generate text strings that signify emotions and moods. But these are statistical constructions. Having no concerns and no bodies, machines have no emotions and no moods, and no means to develop sensibilities for them."
On one hand, we have new papers that show how just using the language of a specific human group can trigger implicit, hidden biases in #LargeLanguageModels
on the other hand, we have software developers working to build tools that automatically retrieve information that may be of interest, and that try to reason ahead on your interests. Highest point so far: https://new.computer/
The end result, applied across all the peoples of the world, will be a supposedly semantic, smart internet that is filled to the brim with systemic biases and even more bends people’s trajectories towards a stochastic median enforced by a culturally loud minority - or just shits people out the other side and locks them out in various insidious ways.
This trend trashes the ability of humans to be humans. And I do not think we have any artifacts or principle tech that would allow otherwise.
So as interesting and full of potential as this may look on the surface to those that have not had contact with the dialogues that now intersect with the topic of „AI agents“ as people work to quantify the biases and harms that these systems cause.
Beneath that shiny surface is a very rotten ball of gnarled-up strings that would harm, rather than help, most people. The promise cannot be generally realized.
Yeah the amount of good ai can do for the world is staggering, even just giving a speed boost and quality improvement to open source Devs will unlock a lot of new potential.
The problem is people in a certain age bracket often fear change because they feel they’ve put effort into learning how things work and if things change then all that effort will be worthless.
It doesn’t really matter though, gangs of idiots literally smashed the prototype looms when they were demonstrated because despite the cost of cloth being one of the major factors in poverty at the time a handful of people took it on themselves to fight to maintain the status quo – of course we know how it turned out, the same that it always does…
Areas that resisted technological and social growth stagnated and got displaced by those which welcomed it
Does anyone have a good list of logical questions to judge large language models ability to reason?
Questions like "if it takes 3 hours for 3 towels to dry, how long does it take for 9 towels to dry?"
I'm playing around with Mistrals leaked 70b Miqu LLM and want to test it's reasoning skills for a project I'm working on. I've been really impressed so far. It's slower than Mistral & Mixtral but it's been producing the best reasoned answers I've seen from an LLM. And it's running locally!