The most prestigious law school admissions discussion board in the world.
|
 |
 
|
How o3 and Grok 4 Accidentally Vindicated Neurosymbolic AI
| Aphrodisiac Circlehead | 07/13/25 |
| free-loading marketing idea | 07/13/25 |
| Aphrodisiac Circlehead | 07/13/25 |
| Abusive heaven reading party | 07/13/25 |
| free-loading marketing idea | 07/13/25 |
| Sable Public Bath Dog Poop | 07/13/25 |
| Abusive heaven reading party | 07/13/25 |
| Sable Public Bath Dog Poop | 07/13/25 |
| Abusive heaven reading party | 07/13/25 |
| Sable Public Bath Dog Poop | 07/13/25 |
Poast new message in this thread
Date: July 13th, 2025 4:44 PM Author: Aphrodisiac Circlehead https://garymarcus.substack.com/p/how-o3-and-grok-4-accidentally-vindicated (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098231) |
Date: July 13th, 2025 4:46 PM Author: free-loading marketing idea you posting gary marcus says everything (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098239) |
 |
Date: July 13th, 2025 4:47 PM Author: Aphrodisiac Circlehead i don't really have a strong opinion on how AI evolves except that it will be to mankind's detriment (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098242) |
|
Date: July 13th, 2025 5:13 PM Author: Abusive heaven reading party He is always eager to declare victory from a few weak, recent datapoints in a fast moving field. There is now a long history of him excitedly pointing out problems with current models that are resolved by the next generation of connectionist models. I predict the mechanics of these tools are learnable in such a way that anything currently “neurosymbolic” can be learned end to end with a connectionist model. (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098313) |
|
Date: July 13th, 2025 5:24 PM Author: free-loading marketing idea (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098330) |
|
Date: July 13th, 2025 5:40 PM Author: Sable Public Bath Dog Poop I have never understood why symbolic reasoning supposedly cannot be derived from/by connectionist models
This is almost certainly what is happening in the human brain, since symbolic reasoning is not something that humans naturally have 'out-of-the-box', and has to be learned. Until very very recently in our evolutionary history we were not capable of it at all, and probably ~50% of homo sapiens sapiens "humans" living in the world today are still not capable of it
I think he's right about the over-enthusiasm for LLMs in isolation and throwing money at scaling though. But I don't see it as a setback or a point of serious contention. It has still sped things up by dumping an enormous amount of money, resources, attention, and talent into AI, which would not have been dedicated to AI otherwise. It has been unequivocally a good thing |
|
Date: July 13th, 2025 5:55 PM Author: Abusive heaven reading party this is exactly right. symbolic reasoning is being learned by connectionist principles in the brain. it's not like you have synapses that can call a formal logic system to do other types of computations when necessary. it's all just learned connections.
i agree with you about the standard scaling view. i do not see scaling of the generic transformer architecture as likely to produce broad, human level capabilities. connectionism could implemented in many different ways though. i agree with him about the generalization problems with current models, but he makes the leap straight to "therefore we need symbolic methods." i think we just need a different form of connectionism - that's what the biology says. |
|
Date: July 13th, 2025 6:05 PM Author: Sable Public Bath Dog Poop Thank you for the compliment of validating my personal beliefs about neuroscience and artificial intelligence (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49098487) |
|
Date: July 13th, 2025 11:09 PM Author: Abusive heaven reading party (http://www.autoadmit.com/thread.php?thread_id=5749924&forum_id=2Elisa#49099221) |
|
Date: July 13th, 2025 5:31 PM Author: Sable Public Bath Dog Poop Lol fuckin Gary Marcus
He's a great case study on why it's important to not be a fucking clown. He has been right about some things and he is imo right about his criticisms of LLMs but nobody takes him seriously because he's an obnoxious clown who is obviously on a personal crusade against people who he believes have wronged him personally
You can't cry wolf over and over again and expect to make a positive difference in the world or in your chosen field |