7/11/25 AI thread
| gaped place of business | 07/11/25 | | Vibrant pisswyrm | 07/11/25 | | gaped place of business | 07/11/25 | | Vibrant pisswyrm | 07/11/25 | | frozen deranged incel | 07/11/25 | | gaped place of business | 07/11/25 | | Tripping Messiness Office | 07/11/25 | | frozen deranged incel | 07/11/25 | | domesticated quadroon | 07/11/25 | | rusted comical goal in life gaming laptop | 07/11/25 | | Tripping Messiness Office | 07/11/25 | | chest-beating idea he suggested | 07/11/25 | | gaped place of business | 07/11/25 | | chest-beating idea he suggested | 07/11/25 | | gaped place of business | 07/11/25 | | gaped place of business | 07/11/25 | | stimulating misanthropic famous landscape painting multi-billionaire | 07/11/25 | | Vibrant pisswyrm | 07/11/25 | | sepia church building affirmative action | 07/11/25 | | frozen deranged incel | 07/11/25 | | gaped place of business | 07/11/25 | | frozen deranged incel | 07/11/25 | | gaped place of business | 07/11/25 | | gaped place of business | 07/13/25 | | gaped place of business | 07/11/25 | | smoky resort | 07/11/25 | | gaped place of business | 07/11/25 | | Ocher swollen station lettuce | 07/11/25 | | flirting tanning salon | 07/11/25 | | sepia church building affirmative action | 07/12/25 | | exciting foreskin | 07/12/25 | | odious pocket flask meetinghouse | 07/12/25 | | gaped place of business | 07/12/25 | | sepia church building affirmative action | 07/12/25 | | frozen deranged incel | 07/12/25 | | Burgundy fluffy base degenerate | 07/12/25 | | gaped place of business | 07/12/25 | | gaped place of business | 07/12/25 | | exciting foreskin | 07/12/25 | | frozen deranged incel | 07/12/25 | | gaped place of business | 07/12/25 | | exciting foreskin | 07/12/25 | | gaped place of business | 07/12/25 |
Poast new message in this thread
Date: July 11th, 2025 1:36 PM Author: gaped place of business
scholarship wants me to do these daily again
https://x.com/elder_plinius/status/1943171871400194231
system prompt for new grok 4. it has the same line about being allowed to say politically incorrect things, which supports my suspicion that the will stancil-raping version of grok the other day had more tweaks than just this
it appears to now be the strongest AI currently available. they spent a huge amount of compute resources on post-pretraining RL compared to all the other models. this is probably why it's performing so well on reasoning and problem-solving benchmark tests, because RL training helps a lot with this
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49093385) |
Date: July 11th, 2025 5:44 PM Author: gaped place of business
https://x.com/keyonV/status/1943730495264584079
https://arxiv.org/pdf/2507.06952
paper that demonstrates that while LLMs excel at predictive tasks that fall within their training data, they can't generalize that predictive ability into a complete and accurate world model to make correct predictions on tasks that weren't within their training
lecun is right imo. statistical inferences do not lead to the ability to make generalized inferences
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49094177) |
 |
Date: July 11th, 2025 7:05 PM Author: gaped place of business
yeah, i've become convinced that LLMs just fundamentally cannot out-of-distribution generalize. and i don't see how RL could ever solve it. all you're doing is training it on additional specific tasks that it....still can't generalize out of
i think companies are doing RL now as more of a marketing gimmick than anything else. people are saying that the latest grok 4 is only performing so well on benchmarks because its RL training had overlap with the benchmark tests. this is what i mean when i say that they're just gaming the benchmark tests
i think the next few years might end up being the big base models trained with RL into a bunch of different specialized sub-models that are used in larger multi-agent architectures in order to be more useful in practice in different specific contexts
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49094487) |
 |
Date: July 11th, 2025 7:34 PM Author: gaped place of business
https://itcanthink.substack.com/p/what-are-robot-world-models
really good short article explaining how people think that we'll be able to use generative AI video to train robots to have functional world models
the notion of this actually working seems crazy to me but these guys are all very smart so it must be somewhat viable or someone would be calling it out as BS. it would cut robot training time and costs IMMENSELY and make them a lot more commercially viable and speed up robotics development by years
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49094551) |
Date: July 12th, 2025 1:33 AM Author: sepia church building affirmative action
OpenAI got cucked again. They tried to acquire Windsurf but didn’t want Microsoft to have access to its IP. Now the acquisition is off and Google has hired their CEO.
https://x.com/ns123abc/status/1943806065524507007?s=46&t=YKr-jZOYUHE15Tew69wt4w
The Microsoft partnership was key to getting them off the ground, but now it’s an adversarial relationship.
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49095182) |
Date: July 12th, 2025 9:05 AM Author: gaped place of business
https://x.com/Kimi_Moonshot/status/1943687594560332025
China just released a new 32 billion parameter model that is apparently the 2nd best model in the world behind o3 and it's all open source(!)
If China could whip up the infrastructure and hardware for enough inference compute to meet demand, I think they could snap up a bunch of the market share for AI because they could undercut the US labs by so much
(http://www.autoadmit.com/thread.php?thread_id=5749144&forum_id=2Elisa#49095399) |
|
|