

This is what the ARC-AGI test by Chollet has also revealed of current AI / LLMs. They have a tendency to approach problems with this trial and error method and can be extremely inefficient (in their current form) with anything involving abstract / deductive reasoning.
Most LLMs do terribly at the test with the most recent breakthrough being with reasoning models. But even the reasoning models struggle.
ARC-AGI is simple, but it demands a keen sense of perception and, in some sense, judgment. It consists of a series of incomplete grids that the test-taker must color in based on the rules they deduce from a few examples; one might, for instance, see a sequence of images and observe that a blue tile is always surrounded by orange tiles, then complete the next picture accordingly. It’s not so different from paint by numbers.
The test has long seemed intractable to major AI companies. GPT-4, which OpenAI boasted in 2023 had “advanced reasoning capabilities,” didn’t do much better than the zero percent earned by its predecessor. A year later, GPT-4o, which the start-up marketed as displaying “text, reasoning, and coding intelligence,” achieved only 5 percent. Gemini 1.5 and Claude 3.7, flagship models from Google and Anthropic, achieved 5 and 14 percent, respectively.
The vast majority of Americans allowed for this by either voting for Trump or refraining from voting at all. There is certainly some global animosity towards the American voting public, though little has been said so far, as we wait to see if the people have any sway over the global recession their choice may cause.
Most of us have come to realize that the American government does not care about the world, which is fine. But this is the first time I’ve seen ordinary people around the world wish economic pain upon the American people, mostly because they know it’s the only reason that their government will change course.
At no point in my lifetime has America’s allies wished pain upon its people. It’s precedent setting and these attitudes are not going to go away overnight. Trust is a very hard to rebuild.
America’s allies invoked Article 5 of the NATO agreement after the attack on September 11th, 2001. Our countrymen then put their lives on the line (some of whom died) for several questionable American led military incursions.
This is a betrayal that likely won’t be forgotten in either of our lifetimes. Anyone who thinks that the US can just vote in a democrat in 2028 and everything will go back to normal is kidding themselves.