The most prestigious law school admissions discussion board in the world.
|
 |
 
|
we can't ban open source AI so we'll remove the ability to run it locally
Poast new message in this thread
Date: December 17th, 2025 9:16 AM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516104) |
 |
Date: December 17th, 2025 1:26 PM Author: cracking resort are you talking about the RAM shortage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516818) |
|
Date: December 17th, 2025 1:31 PM Author: Sticky plaza GPUs, RAM, SSDs
|
|
Date: December 17th, 2025 1:32 PM Author: ocher depressive it's over (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516841) |
|
Date: December 17th, 2025 1:36 PM Author: snowy step-uncle's house sweet tailpipe (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516856) |
Date: December 17th, 2025 9:22 AM Author: Aqua marvelous ladyboy if i flicked nickels at your deformed oblong skull what kind of noise would it make like a "ping" or would it be more of a squelch |
|
Date: December 17th, 2025 9:25 AM Author: Sticky plaza why don't you "ping" your pencil neck you weird little freak
|
|
Date: December 17th, 2025 9:40 AM Author: Aqua marvelous ladyboy my neck is huge faggot how bout i rape you with it? show armpit (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516174) |
|
Date: December 17th, 2025 9:52 AM Author: Sticky plaza lol what a fag (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516208) |
|
Date: December 17th, 2025 9:23 AM Author: ocher depressive the commercial hardware rugpull happening right now is extremely radicalizing (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516126) |
|
Date: December 17th, 2025 9:24 AM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516127) |
|
Date: December 17th, 2025 9:44 AM Author: ocher depressive seriously this shit is very concerning
i thought this would happen at some point in the future but it's happening already. things are accelerating very fast |
|
Date: December 17th, 2025 11:25 AM Author: Sticky plaza NSAM was right (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516456) |
|
Date: December 17th, 2025 11:29 AM Author: bronze lodge name a time NSAM was wrong, chud (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516465) |
|
Date: December 17th, 2025 11:33 AM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516483) |
|
Date: December 17th, 2025 1:09 PM Author: snowy step-uncle's house sweet tailpipe I’m on full fucking tilt rn (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516748) |
|
Date: December 17th, 2025 9:27 AM Author: bronze lodge This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516143) |
|
Date: December 17th, 2025 9:28 AM Author: Sticky plaza 18000 (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516147) |
|
Date: December 17th, 2025 9:41 AM Author: exciting insane wagecucks party of the first part how's the performance? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516178) |
|
Date: December 17th, 2025 9:45 AM Author: bronze lodge completely fine on 30B, shit after (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516189) |
|
Date: December 17th, 2025 9:52 AM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516210) |
|
Date: December 17th, 2025 11:58 AM Author: Fishy well-lubricated mediation stage Is it a Mac? How many GBs of ram do you use? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516550) |
|
Date: December 17th, 2025 12:04 PM Author: bronze lodge im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516564) |
|
Date: December 17th, 2025 12:06 PM Author: ocher depressive how tf do you get a bunch of gpus for free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516570) |
|
Date: December 17th, 2025 12:10 PM Author: bronze lodge Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516583) |
|
Date: December 17th, 2025 11:57 AM Author: bronze lodge i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet
holy shit this thing just helped me remove all shadows in an online game and its completely undetectable |
|
Date: December 17th, 2025 1:08 PM Author: exciting insane wagecucks party of the first part how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516746) |
|
Date: December 17th, 2025 1:13 PM Author: bronze lodge here are the normie instructions for low iq mos
+ https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1
also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with |
|
Date: December 17th, 2025 1:20 PM Author: exciting insane wagecucks party of the first part i poast on a laptop. i'm just curious. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516803) |
|
Date: December 17th, 2025 1:29 PM Author: ocher depressive (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516824) |
|
Date: December 17th, 2025 1:38 PM Author: ruddy passionate casino LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516871) |
|
Date: December 17th, 2025 1:39 PM Author: bronze lodge thanks NSAM, if you read the first line you'd see
"here are the normie instructions for low iq mos" |
|
Date: December 17th, 2025 1:41 PM Author: bronze lodge also they all pull them from huggingface so no clue wtf idiocy ur talking about (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516888) |
|
Date: December 17th, 2025 9:40 AM Author: multi-colored jew mad cow disease thought this would be NSAM (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516175) |
|
Date: December 17th, 2025 9:49 AM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516200) |
|
Date: December 17th, 2025 9:58 AM Author: nubile electric factory reset button (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516223) |
|
Date: December 17th, 2025 9:58 AM Author: Vigorous Useless Brakes (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516226) |
|
Date: December 17th, 2025 1:30 PM Author: Vivacious Hall Azn this whole thread sounds like nsam talking to himself. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516830) |
|
Date: December 17th, 2025 1:11 PM Author: snowy step-uncle's house sweet tailpipe (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516759) |
|
Date: December 17th, 2025 1:11 PM Author: dashing stubborn pit (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516762) |
|
Date: December 17th, 2025 1:12 PM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516764) |
|
Date: December 17th, 2025 1:12 PM Author: ocher depressive i agree this is some really concerning shit ricky i'm not even playing around (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516765) |
|
Date: December 17th, 2025 1:16 PM Author: snowy step-uncle's house sweet tailpipe (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516788) |
|
Date: December 17th, 2025 1:17 PM Author: Sticky plaza (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516792) |
|
Date: December 17th, 2025 1:25 PM Author: ocher depressive (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516814) |
|
Date: December 17th, 2025 1:29 PM Author: nubile electric factory reset button (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516825) |
|
Date: December 17th, 2025 1:34 PM Author: cracking resort I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516849) |
|
Date: December 17th, 2025 1:35 PM Author: snowy step-uncle's house sweet tailpipe (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516851) |
|
Date: December 17th, 2025 7:49 PM Author: ruddy passionate casino You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down
48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results. |
|
Date: December 17th, 2025 1:36 PM Author: dashing stubborn pit I waited on my RTX pro 6000 and now I'm pissed (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2],#49516855) |