\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

we can't ban open source AI so we'll remove the ability to run it locally

...
Ivory den candlestick maker
  12/17/25
are you talking about the RAM shortage
racy house-broken pervert
  12/17/25
GPUs, RAM, SSDs
Ivory den candlestick maker
  12/17/25
it's over
Glassy karate orchestra pit
  12/17/25
...
Deranged Scourge Upon The Earth
  12/17/25
if i flicked nickels at your deformed oblong skull what kind...
Abnormal Vivacious Legend School
  12/17/25
why don't you "ping" your pencil neck you weird li...
Ivory den candlestick maker
  12/17/25
my neck is huge faggot how bout i rape you with it? show arm...
Abnormal Vivacious Legend School
  12/17/25
lol what a fag
Ivory den candlestick maker
  12/17/25
the commercial hardware rugpull happening right now is extre...
Glassy karate orchestra pit
  12/17/25
...
Ivory den candlestick maker
  12/17/25
seriously this shit is very concerning i thought this wou...
Glassy karate orchestra pit
  12/17/25
NSAM was right
Ivory den candlestick maker
  12/17/25
name a time NSAM was wrong, chud
salmon flatulent locus
  12/17/25
...
Ivory den candlestick maker
  12/17/25
I’m on full fucking tilt rn
Deranged Scourge Upon The Earth
  12/17/25
This is exactly why I set up a local lm studio, ollama and m...
salmon flatulent locus
  12/17/25
18000
Ivory den candlestick maker
  12/17/25
how's the performance?
mahogany fragrant elastic band
  12/17/25
completely fine on 30B, shit after
salmon flatulent locus
  12/17/25
...
Ivory den candlestick maker
  12/17/25
Is it a Mac? How many GBs of ram do you use?
brindle fat ankles black woman
  12/17/25
im on a 5090 w a 9950X3D but im currently in the process of ...
salmon flatulent locus
  12/17/25
how tf do you get a bunch of gpus for free
Glassy karate orchestra pit
  12/17/25
Large company upgrading and throwing them away and I just to...
salmon flatulent locus
  12/17/25
i literally just found out about Big-Tiger-Gemma and its by ...
salmon flatulent locus
  12/17/25
how large is the database? how does this work? facebook scra...
mahogany fragrant elastic band
  12/17/25
here are the normie instructions for low iq mos https://l...
salmon flatulent locus
  12/17/25
i poast on a laptop. i'm just curious.
mahogany fragrant elastic band
  12/17/25
...
Glassy karate orchestra pit
  12/17/25
LM Studio pushes glitchy, unoptimized models. Ollama curates...
turquoise hot psychic
  12/17/25
thanks NSAM, if you read the first line you'd see "h...
salmon flatulent locus
  12/17/25
also they all pull them from huggingface so no clue wtf idio...
salmon flatulent locus
  12/17/25
thought this would be NSAM
Mind-boggling gas station
  12/17/25
...
Ivory den candlestick maker
  12/17/25
...
shimmering talented institution
  12/17/25
...
hateful boltzmann
  12/17/25
this whole thread sounds like nsam talking to himself.
Transparent people who are hurt gaping
  12/17/25
...
Deranged Scourge Upon The Earth
  12/17/25
...
Adulterous library
  12/17/25
...
Ivory den candlestick maker
  12/17/25
i agree this is some really concerning shit ricky i'm not ev...
Glassy karate orchestra pit
  12/17/25
...
Deranged Scourge Upon The Earth
  12/17/25
...
Ivory den candlestick maker
  12/17/25
...
Glassy karate orchestra pit
  12/17/25
...
shimmering talented institution
  12/17/25
I was lucky I built my 5070 Ti, 48gb RAM build recently but ...
racy house-broken pervert
  12/17/25
...
Deranged Scourge Upon The Earth
  12/17/25
You need 24gb VRAM to do inference. 16gb isn't enough. Howev...
turquoise hot psychic
  12/17/25
I waited on my RTX pro 6000 and now I'm pissed
Adulterous library
  12/17/25


Poast new message in this thread



Reply Favorite

Date: December 17th, 2025 9:16 AM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516104)



Reply Favorite

Date: December 17th, 2025 1:26 PM
Author: racy house-broken pervert

are you talking about the RAM shortage

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516818)



Reply Favorite

Date: December 17th, 2025 1:31 PM
Author: Ivory den candlestick maker

GPUs, RAM, SSDs



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516836)



Reply Favorite

Date: December 17th, 2025 1:32 PM
Author: Glassy karate orchestra pit

it's over

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516841)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: Deranged Scourge Upon The Earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516856)



Reply Favorite

Date: December 17th, 2025 9:22 AM
Author: Abnormal Vivacious Legend School

if i flicked nickels at your deformed oblong skull what kind of noise would it make

like a "ping" or would it be more of a squelch

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516121)



Reply Favorite

Date: December 17th, 2025 9:25 AM
Author: Ivory den candlestick maker

why don't you "ping" your pencil neck you weird little freak



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516133)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Abnormal Vivacious Legend School

my neck is huge faggot how bout i rape you with it? show armpit

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516174)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Ivory den candlestick maker

lol what a fag

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516208)



Reply Favorite

Date: December 17th, 2025 9:23 AM
Author: Glassy karate orchestra pit

the commercial hardware rugpull happening right now is extremely radicalizing

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516126)



Reply Favorite

Date: December 17th, 2025 9:24 AM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516127)



Reply Favorite

Date: December 17th, 2025 9:44 AM
Author: Glassy karate orchestra pit

seriously this shit is very concerning

i thought this would happen at some point in the future but it's happening already. things are accelerating very fast

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516186)



Reply Favorite

Date: December 17th, 2025 11:25 AM
Author: Ivory den candlestick maker

NSAM was right

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516456)



Reply Favorite

Date: December 17th, 2025 11:29 AM
Author: salmon flatulent locus

name a time NSAM was wrong, chud

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516465)



Reply Favorite

Date: December 17th, 2025 11:33 AM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516483)



Reply Favorite

Date: December 17th, 2025 1:09 PM
Author: Deranged Scourge Upon The Earth

I’m on full fucking tilt rn

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516748)



Reply Favorite

Date: December 17th, 2025 9:27 AM
Author: salmon flatulent locus

This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516143)



Reply Favorite

Date: December 17th, 2025 9:28 AM
Author: Ivory den candlestick maker

18000

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516147)



Reply Favorite

Date: December 17th, 2025 9:41 AM
Author: mahogany fragrant elastic band

how's the performance?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516178)



Reply Favorite

Date: December 17th, 2025 9:45 AM
Author: salmon flatulent locus

completely fine on 30B, shit after

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516189)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516210)



Reply Favorite

Date: December 17th, 2025 11:58 AM
Author: brindle fat ankles black woman

Is it a Mac? How many GBs of ram do you use?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516550)



Reply Favorite

Date: December 17th, 2025 12:04 PM
Author: salmon flatulent locus

im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516564)



Reply Favorite

Date: December 17th, 2025 12:06 PM
Author: Glassy karate orchestra pit

how tf do you get a bunch of gpus for free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516570)



Reply Favorite

Date: December 17th, 2025 12:10 PM
Author: salmon flatulent locus

Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516583)



Reply Favorite

Date: December 17th, 2025 11:57 AM
Author: salmon flatulent locus

i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet

holy shit this thing just helped me remove all shadows in an online game and its completely undetectable

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516548)



Reply Favorite

Date: December 17th, 2025 1:08 PM
Author: mahogany fragrant elastic band

how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516746)



Reply Favorite

Date: December 17th, 2025 1:13 PM
Author: salmon flatulent locus

here are the normie instructions for low iq mos

https://lmstudio.ai/

+

https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1

also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516771)



Reply Favorite

Date: December 17th, 2025 1:20 PM
Author: mahogany fragrant elastic band

i poast on a laptop. i'm just curious.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516803)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: Glassy karate orchestra pit



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516824)



Reply Favorite

Date: December 17th, 2025 1:38 PM
Author: turquoise hot psychic

LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516871)



Reply Favorite

Date: December 17th, 2025 1:39 PM
Author: salmon flatulent locus

thanks NSAM, if you read the first line you'd see

"here are the normie instructions for low iq mos"

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516880)



Reply Favorite

Date: December 17th, 2025 1:41 PM
Author: salmon flatulent locus

also they all pull them from huggingface so no clue wtf idiocy ur talking about

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516888)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Mind-boggling gas station

thought this would be NSAM

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516175)



Reply Favorite

Date: December 17th, 2025 9:49 AM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516200)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: shimmering talented institution



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516223)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: hateful boltzmann



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516226)



Reply Favorite

Date: December 17th, 2025 1:30 PM
Author: Transparent people who are hurt gaping

this whole thread sounds like nsam talking to himself.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516830)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: Deranged Scourge Upon The Earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516759)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: Adulterous library



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516762)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516764)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: Glassy karate orchestra pit

i agree this is some really concerning shit ricky i'm not even playing around

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516765)



Reply Favorite

Date: December 17th, 2025 1:16 PM
Author: Deranged Scourge Upon The Earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516788)



Reply Favorite

Date: December 17th, 2025 1:17 PM
Author: Ivory den candlestick maker



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516792)



Reply Favorite

Date: December 17th, 2025 1:25 PM
Author: Glassy karate orchestra pit



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516814)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: shimmering talented institution



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516825)



Reply Favorite

Date: December 17th, 2025 1:34 PM
Author: racy house-broken pervert

I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516849)



Reply Favorite

Date: December 17th, 2025 1:35 PM
Author: Deranged Scourge Upon The Earth



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516851)



Reply Favorite

Date: December 17th, 2025 7:49 PM
Author: turquoise hot psychic

You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down

48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49517900)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: Adulterous library

I waited on my RTX pro 6000 and now I'm pissed

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2.#49516855)