The most prestigious law school admissions discussion board in the world.
|
 |
 
|
we can't ban open source AI so we'll remove the ability to run it locally
Poast new message in this thread
Date: December 17th, 2025 9:16 AM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516104) |
 |
Date: December 17th, 2025 1:26 PM Author: irate point are you talking about the RAM shortage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516818) |
|
Date: December 17th, 2025 1:31 PM Author: metal hall GPUs, RAM, SSDs
|
|
Date: December 17th, 2025 1:32 PM Author: Awkward Masturbator it's over (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516841) |
|
Date: December 17th, 2025 1:36 PM Author: Titillating range fanboi (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516856) |
Date: December 17th, 2025 9:22 AM Author: Crawly chartreuse skinny woman boltzmann if i flicked nickels at your deformed oblong skull what kind of noise would it make like a "ping" or would it be more of a squelch |
|
Date: December 17th, 2025 9:25 AM Author: metal hall why don't you "ping" your pencil neck you weird little freak
|
|
Date: December 17th, 2025 9:40 AM Author: Crawly chartreuse skinny woman boltzmann my neck is huge faggot how bout i rape you with it? show armpit (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516174) |
|
Date: December 17th, 2025 9:52 AM Author: metal hall lol what a fag (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516208) |
|
Date: December 17th, 2025 9:23 AM Author: Awkward Masturbator the commercial hardware rugpull happening right now is extremely radicalizing (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516126) |
|
Date: December 17th, 2025 9:24 AM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516127) |
|
Date: December 17th, 2025 9:44 AM Author: Awkward Masturbator seriously this shit is very concerning
i thought this would happen at some point in the future but it's happening already. things are accelerating very fast |
|
Date: December 17th, 2025 11:25 AM Author: metal hall NSAM was right (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516456) |
|
Date: December 17th, 2025 11:29 AM Author: boyish fuchsia parlour name a time NSAM was wrong, chud (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516465) |
|
Date: December 17th, 2025 11:33 AM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516483) |
|
Date: December 17th, 2025 1:09 PM Author: Titillating range fanboi I’m on full fucking tilt rn (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516748) |
|
Date: December 17th, 2025 9:27 AM Author: boyish fuchsia parlour This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516143) |
|
Date: December 17th, 2025 9:28 AM Author: metal hall 18000 (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516147) |
|
Date: December 17th, 2025 9:41 AM Author: Bronze set how's the performance? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516178) |
|
Date: December 17th, 2025 9:45 AM Author: boyish fuchsia parlour completely fine on 30B, shit after (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516189) |
|
Date: December 17th, 2025 9:52 AM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516210) |
|
Date: December 17th, 2025 11:58 AM Author: carnelian stead preventive strike Is it a Mac? How many GBs of ram do you use? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516550) |
|
Date: December 17th, 2025 12:04 PM Author: boyish fuchsia parlour im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516564) |
|
Date: December 17th, 2025 12:06 PM Author: Awkward Masturbator how tf do you get a bunch of gpus for free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516570) |
|
Date: December 17th, 2025 12:10 PM Author: boyish fuchsia parlour Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516583) |
|
Date: December 17th, 2025 11:57 AM Author: boyish fuchsia parlour i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet
holy shit this thing just helped me remove all shadows in an online game and its completely undetectable |
|
Date: December 17th, 2025 1:08 PM Author: Bronze set how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516746) |
|
Date: December 17th, 2025 1:13 PM Author: boyish fuchsia parlour here are the normie instructions for low iq mos
+ https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1
also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with |
|
Date: December 17th, 2025 1:20 PM Author: Bronze set i poast on a laptop. i'm just curious. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516803) |
|
Date: December 17th, 2025 1:29 PM Author: Awkward Masturbator (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516824) |
|
Date: December 17th, 2025 1:38 PM Author: mahogany learning disabled ape LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516871) |
|
Date: December 17th, 2025 1:39 PM Author: boyish fuchsia parlour thanks NSAM, if you read the first line you'd see
"here are the normie instructions for low iq mos" |
|
Date: December 17th, 2025 1:41 PM Author: boyish fuchsia parlour also they all pull them from huggingface so no clue wtf idiocy ur talking about (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516888) |
|
Date: December 17th, 2025 9:40 AM Author: dark hospital dingle berry thought this would be NSAM (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516175) |
|
Date: December 17th, 2025 9:49 AM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516200) |
|
Date: December 17th, 2025 9:58 AM Author: Bateful school cafeteria new version (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516223) |
|
Date: December 17th, 2025 9:58 AM Author: Hideous white theater queen of the night (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516226) |
|
Date: December 17th, 2025 1:30 PM Author: red persian this whole thread sounds like nsam talking to himself. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516830) |
|
Date: December 17th, 2025 1:11 PM Author: Titillating range fanboi (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516759) |
|
Date: December 17th, 2025 1:11 PM Author: appetizing casino mediation (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516762) |
|
Date: December 17th, 2025 1:12 PM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516764) |
|
Date: December 17th, 2025 1:12 PM Author: Awkward Masturbator i agree this is some really concerning shit ricky i'm not even playing around (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516765) |
|
Date: December 17th, 2025 1:16 PM Author: Titillating range fanboi (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516788) |
|
Date: December 17th, 2025 1:17 PM Author: metal hall (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516792) |
|
Date: December 17th, 2025 1:25 PM Author: Awkward Masturbator (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516814) |
|
Date: December 17th, 2025 1:29 PM Author: Bateful school cafeteria new version (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516825) |
|
Date: December 17th, 2025 1:34 PM Author: irate point I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516849) |
|
Date: December 17th, 2025 1:35 PM Author: Titillating range fanboi (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516851) |
|
Date: December 17th, 2025 7:49 PM Author: mahogany learning disabled ape You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down
48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results. |
|
Date: December 17th, 2025 1:36 PM Author: appetizing casino mediation I waited on my RTX pro 6000 and now I'm pissed (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516855) |