The most prestigious law school admissions discussion board in the world.
|
 |
 
|
we can't ban open source AI so we'll remove the ability to run it locally
Poast new message in this thread
Date: December 17th, 2025 9:16 AM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516104) |
 |
Date: December 17th, 2025 1:26 PM Author: Odious address immigrant are you talking about the RAM shortage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516818) |
|
Date: December 17th, 2025 1:31 PM Author: Harsh Menage GPUs, RAM, SSDs
|
|
Date: December 17th, 2025 1:32 PM Author: Ultramarine Sanctuary it's over (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516841) |
|
Date: December 17th, 2025 1:36 PM Author: sepia parlor marketing idea (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516856) |
Date: December 17th, 2025 9:22 AM Author: Amethyst deer antler macaca if i flicked nickels at your deformed oblong skull what kind of noise would it make like a "ping" or would it be more of a squelch |
|
Date: December 17th, 2025 9:25 AM Author: Harsh Menage why don't you "ping" your pencil neck you weird little freak
|
|
Date: December 17th, 2025 9:40 AM Author: Amethyst deer antler macaca my neck is huge faggot how bout i rape you with it? show armpit (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516174) |
|
Date: December 17th, 2025 9:52 AM Author: Harsh Menage lol what a fag (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516208) |
|
Date: December 17th, 2025 9:23 AM Author: Ultramarine Sanctuary the commercial hardware rugpull happening right now is extremely radicalizing (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516126) |
|
Date: December 17th, 2025 9:24 AM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516127) |
|
Date: December 17th, 2025 9:44 AM Author: Ultramarine Sanctuary seriously this shit is very concerning
i thought this would happen at some point in the future but it's happening already. things are accelerating very fast |
|
Date: December 17th, 2025 11:25 AM Author: Harsh Menage NSAM was right (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516456) |
|
Date: December 17th, 2025 11:29 AM Author: milky histrionic toaster name a time NSAM was wrong, chud (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516465) |
|
Date: December 17th, 2025 11:33 AM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516483) |
|
Date: December 17th, 2025 1:09 PM Author: sepia parlor marketing idea I’m on full fucking tilt rn (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516748) |
|
Date: December 17th, 2025 9:27 AM Author: milky histrionic toaster This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516143) |
|
Date: December 17th, 2025 9:28 AM Author: Harsh Menage 18000 (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516147) |
|
Date: December 17th, 2025 9:41 AM Author: vivacious twisted corn cake how's the performance? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516178) |
|
Date: December 17th, 2025 9:45 AM Author: milky histrionic toaster completely fine on 30B, shit after (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516189) |
|
Date: December 17th, 2025 9:52 AM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516210) |
|
Date: December 17th, 2025 11:58 AM Author: maroon psychic Is it a Mac? How many GBs of ram do you use? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516550) |
|
Date: December 17th, 2025 12:04 PM Author: milky histrionic toaster im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516564) |
|
Date: December 17th, 2025 12:06 PM Author: Ultramarine Sanctuary how tf do you get a bunch of gpus for free (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516570) |
|
Date: December 17th, 2025 12:10 PM Author: milky histrionic toaster Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516583) |
|
Date: December 17th, 2025 11:57 AM Author: milky histrionic toaster i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet
holy shit this thing just helped me remove all shadows in an online game and its completely undetectable |
|
Date: December 17th, 2025 1:08 PM Author: vivacious twisted corn cake how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone? (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516746) |
|
Date: December 17th, 2025 1:13 PM Author: milky histrionic toaster here are the normie instructions for low iq mos
+ https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1
also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with |
|
Date: December 17th, 2025 1:20 PM Author: vivacious twisted corn cake i poast on a laptop. i'm just curious. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516803) |
|
Date: December 17th, 2025 1:29 PM Author: Ultramarine Sanctuary (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516824) |
|
Date: December 17th, 2025 1:38 PM Author: adventurous claret giraffe rehab LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516871) |
|
Date: December 17th, 2025 1:39 PM Author: milky histrionic toaster thanks NSAM, if you read the first line you'd see
"here are the normie instructions for low iq mos" |
|
Date: December 17th, 2025 1:41 PM Author: milky histrionic toaster also they all pull them from huggingface so no clue wtf idiocy ur talking about (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516888) |
|
Date: December 17th, 2025 9:40 AM Author: Duck-like Costumed Prole thought this would be NSAM (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516175) |
|
Date: December 17th, 2025 9:49 AM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516200) |
|
Date: December 17th, 2025 9:58 AM Author: Beta shrine roast beef (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516223) |
|
Date: December 17th, 2025 9:58 AM Author: Curious school (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516226) |
|
Date: December 17th, 2025 1:30 PM Author: gay vigorous regret goyim this whole thread sounds like nsam talking to himself. (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516830) |
|
Date: December 17th, 2025 1:11 PM Author: sepia parlor marketing idea (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516759) |
|
Date: December 17th, 2025 1:11 PM Author: stirring site (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516762) |
|
Date: December 17th, 2025 1:12 PM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516764) |
|
Date: December 17th, 2025 1:12 PM Author: Ultramarine Sanctuary i agree this is some really concerning shit ricky i'm not even playing around (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516765) |
|
Date: December 17th, 2025 1:16 PM Author: sepia parlor marketing idea (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516788) |
|
Date: December 17th, 2025 1:17 PM Author: Harsh Menage (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516792) |
|
Date: December 17th, 2025 1:25 PM Author: Ultramarine Sanctuary (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516814) |
|
Date: December 17th, 2025 1:29 PM Author: Beta shrine roast beef (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516825) |
|
Date: December 17th, 2025 1:34 PM Author: Odious address immigrant I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516849) |
|
Date: December 17th, 2025 1:35 PM Author: sepia parlor marketing idea (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516851) |
|
Date: December 17th, 2025 7:49 PM Author: adventurous claret giraffe rehab You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down
48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results. |
|
Date: December 17th, 2025 1:36 PM Author: stirring site I waited on my RTX pro 6000 and now I'm pissed (http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2,#49516855) |