• 0 Posts
  • 4.55K Comments
Joined 1 year ago
cake
Cake day: July 26th, 2023

help-circle











  • They hide the thought steps to mask this fact and to prevent others from benefiting from all of the finetuning data they paid for.

    Well possibly but they also hide the chain of thought steps because as they point out in their article it needs to be able to think about things outside of what it’s normally allowed allowed to say which obviously means you can’t show the content. If you’re trying to come up with worst case scenarios for a situation you actually have to be able to think about those worst case scenarios



  • I work in computer science but not really anything to do with AI so I’m only adjacently knowledgeable about it. But my understanding is unfortunately, no not really. The problem would be that if you run a bunch of evolutions in parallel you just get a bunch of independent AIs, all with slightly different parameters but they’re incapable of working together because they weren’t evolved to work together, they were evolved independently.

    In theory you could come up with some kind of file format that allowed for the transfer of AI between each cluster, but you’d probably spend as much time transferring AI as you saved by having multiple iterations run at the same time. It’s n^n problem, where n is the number of AIs you have.


  • No we didn’t, Artificial General Intelligence has been determined since the '90s.

    We’ve always differentiated Artificial Intelligence and Artificial General Intelligence.

    What we have now is AI, I don’t know anyone who’s claiming that it’s AGI though.

    People keep saying people are saying that this is AGI, but I’ve not seen anyone say that, not in this thread or anywhere else. What I have seen said is people saying this is a step on the road to AGI which is debatable but it isn’t the same as saying this thing here is AGI.

    Edit to add proof:

    From Wikipedia although I’m sure you can find other sources if you don’t believe me.

    The term “artificial general intelligence” was used as early as 1997, by Mark Gubrud in a discussion of the implications of fully automated military production and operations. A mathematical formalism of AGI was proposed by Marcus Hutter in 2000.

    So all of this happened long before the rise of large language models so no the term has not been co-opted.


  • To be a little nitpicky most of the AI that can play Mario kart are trained not with a reinforcement learning algorithm, but woth a genetic algorithm, which is a sort of different thing.

    Reinforcement learning is rather like how you teach a child. Show them a bunch of good stuff, and show them a bunch of bad stuff, and tell them which is the good stuff and which is the bad stuff.

    Genetic algorithms are where you just leave it alone, simulate the evolutionary process on an accelerated time scale, and let normal evolutionary processes take over. Much easier, and less processor intensive, plus you don’t need huge corpuses of data. But it takes ages, and it also sometimes results in weird behaviors because evolution finds a solution you never thought of, or it finds a solution to a different problem to the one you were trying to get it to find a solution to.