\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

we can't ban open source AI so we'll remove the ability to run it locally

...
Self-absorbed Theatre
  12/17/25
are you talking about the RAM shortage
rusted tanning salon
  12/17/25
GPUs, RAM, SSDs
Self-absorbed Theatre
  12/17/25
it's over
Twinkling Adventurous Circlehead Site
  12/17/25
...
Pea-brained Carmine Masturbator Affirmative Action
  12/17/25
if i flicked nickels at your deformed oblong skull what kind...
Cobalt Sanctuary Fat Ankles
  12/17/25
why don't you "ping" your pencil neck you weird li...
Self-absorbed Theatre
  12/17/25
my neck is huge faggot how bout i rape you with it? show arm...
Cobalt Sanctuary Fat Ankles
  12/17/25
lol what a fag
Self-absorbed Theatre
  12/17/25
the commercial hardware rugpull happening right now is extre...
Twinkling Adventurous Circlehead Site
  12/17/25
...
Self-absorbed Theatre
  12/17/25
seriously this shit is very concerning i thought this wou...
Twinkling Adventurous Circlehead Site
  12/17/25
NSAM was right
Self-absorbed Theatre
  12/17/25
name a time NSAM was wrong, chud
Zombie-like Giraffe Milk
  12/17/25
...
Self-absorbed Theatre
  12/17/25
I’m on full fucking tilt rn
Pea-brained Carmine Masturbator Affirmative Action
  12/17/25
This is exactly why I set up a local lm studio, ollama and m...
Zombie-like Giraffe Milk
  12/17/25
18000
Self-absorbed Theatre
  12/17/25
how's the performance?
silver kitchen
  12/17/25
completely fine on 30B, shit after
Zombie-like Giraffe Milk
  12/17/25
...
Self-absorbed Theatre
  12/17/25
Is it a Mac? How many GBs of ram do you use?
dashing primrose prole
  12/17/25
im on a 5090 w a 9950X3D but im currently in the process of ...
Zombie-like Giraffe Milk
  12/17/25
how tf do you get a bunch of gpus for free
Twinkling Adventurous Circlehead Site
  12/17/25
Large company upgrading and throwing them away and I just to...
Zombie-like Giraffe Milk
  12/17/25
i literally just found out about Big-Tiger-Gemma and its by ...
Zombie-like Giraffe Milk
  12/17/25
how large is the database? how does this work? facebook scra...
silver kitchen
  12/17/25
here are the normie instructions for low iq mos https://l...
Zombie-like Giraffe Milk
  12/17/25
i poast on a laptop. i'm just curious.
silver kitchen
  12/17/25
...
Twinkling Adventurous Circlehead Site
  12/17/25
LM Studio pushes glitchy, unoptimized models. Ollama curates...
irate chestnut hunting ground bbw
  12/17/25
thanks NSAM, if you read the first line you'd see "h...
Zombie-like Giraffe Milk
  12/17/25
also they all pull them from huggingface so no clue wtf idio...
Zombie-like Giraffe Milk
  12/17/25
thought this would be NSAM
Well-lubricated Cream Office Volcanic Crater
  12/17/25
...
Self-absorbed Theatre
  12/17/25
...
Effete indian lodge really tough guy
  12/17/25
...
thirsty underhanded stain alpha
  12/17/25
this whole thread sounds like nsam talking to himself.
Obsidian quadroon lay
  12/17/25
...
Pea-brained Carmine Masturbator Affirmative Action
  12/17/25
...
sienna high-end stage
  12/17/25
...
Self-absorbed Theatre
  12/17/25
i agree this is some really concerning shit ricky i'm not ev...
Twinkling Adventurous Circlehead Site
  12/17/25
...
Pea-brained Carmine Masturbator Affirmative Action
  12/17/25
...
Self-absorbed Theatre
  12/17/25
...
Twinkling Adventurous Circlehead Site
  12/17/25
...
Effete indian lodge really tough guy
  12/17/25
I was lucky I built my 5070 Ti, 48gb RAM build recently but ...
rusted tanning salon
  12/17/25
...
Pea-brained Carmine Masturbator Affirmative Action
  12/17/25
You need 24gb VRAM to do inference. 16gb isn't enough. Howev...
irate chestnut hunting ground bbw
  12/17/25
I waited on my RTX pro 6000 and now I'm pissed
sienna high-end stage
  12/17/25


Poast new message in this thread



Reply Favorite

Date: December 17th, 2025 9:16 AM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516104)



Reply Favorite

Date: December 17th, 2025 1:26 PM
Author: rusted tanning salon

are you talking about the RAM shortage

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516818)



Reply Favorite

Date: December 17th, 2025 1:31 PM
Author: Self-absorbed Theatre

GPUs, RAM, SSDs



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516836)



Reply Favorite

Date: December 17th, 2025 1:32 PM
Author: Twinkling Adventurous Circlehead Site

it's over

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516841)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: Pea-brained Carmine Masturbator Affirmative Action



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516856)



Reply Favorite

Date: December 17th, 2025 9:22 AM
Author: Cobalt Sanctuary Fat Ankles

if i flicked nickels at your deformed oblong skull what kind of noise would it make

like a "ping" or would it be more of a squelch

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516121)



Reply Favorite

Date: December 17th, 2025 9:25 AM
Author: Self-absorbed Theatre

why don't you "ping" your pencil neck you weird little freak



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516133)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Cobalt Sanctuary Fat Ankles

my neck is huge faggot how bout i rape you with it? show armpit

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516174)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Self-absorbed Theatre

lol what a fag

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516208)



Reply Favorite

Date: December 17th, 2025 9:23 AM
Author: Twinkling Adventurous Circlehead Site

the commercial hardware rugpull happening right now is extremely radicalizing

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516126)



Reply Favorite

Date: December 17th, 2025 9:24 AM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516127)



Reply Favorite

Date: December 17th, 2025 9:44 AM
Author: Twinkling Adventurous Circlehead Site

seriously this shit is very concerning

i thought this would happen at some point in the future but it's happening already. things are accelerating very fast

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516186)



Reply Favorite

Date: December 17th, 2025 11:25 AM
Author: Self-absorbed Theatre

NSAM was right

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516456)



Reply Favorite

Date: December 17th, 2025 11:29 AM
Author: Zombie-like Giraffe Milk

name a time NSAM was wrong, chud

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516465)



Reply Favorite

Date: December 17th, 2025 11:33 AM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516483)



Reply Favorite

Date: December 17th, 2025 1:09 PM
Author: Pea-brained Carmine Masturbator Affirmative Action

I’m on full fucking tilt rn

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516748)



Reply Favorite

Date: December 17th, 2025 9:27 AM
Author: Zombie-like Giraffe Milk

This is exactly why I set up a local lm studio, ollama and my own custom build that uses publicly available llms

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516143)



Reply Favorite

Date: December 17th, 2025 9:28 AM
Author: Self-absorbed Theatre

18000

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516147)



Reply Favorite

Date: December 17th, 2025 9:41 AM
Author: silver kitchen

how's the performance?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516178)



Reply Favorite

Date: December 17th, 2025 9:45 AM
Author: Zombie-like Giraffe Milk

completely fine on 30B, shit after

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516189)



Reply Favorite

Date: December 17th, 2025 9:52 AM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516210)



Reply Favorite

Date: December 17th, 2025 11:58 AM
Author: dashing primrose prole

Is it a Mac? How many GBs of ram do you use?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516550)



Reply Favorite

Date: December 17th, 2025 12:04 PM
Author: Zombie-like Giraffe Milk

im on a 5090 w a 9950X3D but im currently in the process of making a pretty powerful frankenstein machine with a bunch of gpus i got free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516564)



Reply Favorite

Date: December 17th, 2025 12:06 PM
Author: Twinkling Adventurous Circlehead Site

how tf do you get a bunch of gpus for free

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516570)



Reply Favorite

Date: December 17th, 2025 12:10 PM
Author: Zombie-like Giraffe Milk

Large company upgrading and throwing them away and I just took them. All are pretty powerful on their own.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516583)



Reply Favorite

Date: December 17th, 2025 11:57 AM
Author: Zombie-like Giraffe Milk

i literally just found out about Big-Tiger-Gemma and its by far the best unchained/uncensored LLM ive found yet

holy shit this thing just helped me remove all shadows in an online game and its completely undetectable

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516548)



Reply Favorite

Date: December 17th, 2025 1:08 PM
Author: silver kitchen

how large is the database? how does this work? facebook scraped data legally and illegally, transformed them into matrices, and now they're available to anyone?

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516746)



Reply Favorite

Date: December 17th, 2025 1:13 PM
Author: Zombie-like Giraffe Milk

here are the normie instructions for low iq mos

https://lmstudio.ai/

+

https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1

also if you cant answer these questions on your own you probably dont even have a strong enough setup to begin with

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516771)



Reply Favorite

Date: December 17th, 2025 1:20 PM
Author: silver kitchen

i poast on a laptop. i'm just curious.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516803)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: Twinkling Adventurous Circlehead Site



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516824)



Reply Favorite

Date: December 17th, 2025 1:38 PM
Author: irate chestnut hunting ground bbw

LM Studio pushes glitchy, unoptimized models. Ollama curates so you only get optimized models. You can connect to an Ollama server with OpenWebUI or AnythingLLM and do whatever

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516871)



Reply Favorite

Date: December 17th, 2025 1:39 PM
Author: Zombie-like Giraffe Milk

thanks NSAM, if you read the first line you'd see

"here are the normie instructions for low iq mos"

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516880)



Reply Favorite

Date: December 17th, 2025 1:41 PM
Author: Zombie-like Giraffe Milk

also they all pull them from huggingface so no clue wtf idiocy ur talking about

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516888)



Reply Favorite

Date: December 17th, 2025 9:40 AM
Author: Well-lubricated Cream Office Volcanic Crater

thought this would be NSAM

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516175)



Reply Favorite

Date: December 17th, 2025 9:49 AM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516200)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: Effete indian lodge really tough guy



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516223)



Reply Favorite

Date: December 17th, 2025 9:58 AM
Author: thirsty underhanded stain alpha



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516226)



Reply Favorite

Date: December 17th, 2025 1:30 PM
Author: Obsidian quadroon lay

this whole thread sounds like nsam talking to himself.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516830)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: Pea-brained Carmine Masturbator Affirmative Action



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516759)



Reply Favorite

Date: December 17th, 2025 1:11 PM
Author: sienna high-end stage



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516762)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516764)



Reply Favorite

Date: December 17th, 2025 1:12 PM
Author: Twinkling Adventurous Circlehead Site

i agree this is some really concerning shit ricky i'm not even playing around

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516765)



Reply Favorite

Date: December 17th, 2025 1:16 PM
Author: Pea-brained Carmine Masturbator Affirmative Action



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516788)



Reply Favorite

Date: December 17th, 2025 1:17 PM
Author: Self-absorbed Theatre



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516792)



Reply Favorite

Date: December 17th, 2025 1:25 PM
Author: Twinkling Adventurous Circlehead Site



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516814)



Reply Favorite

Date: December 17th, 2025 1:29 PM
Author: Effete indian lodge really tough guy



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516825)



Reply Favorite

Date: December 17th, 2025 1:34 PM
Author: rusted tanning salon

I was lucky I built my 5070 Ti, 48gb RAM build recently but that is pretty weak for LLMs afaik

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516849)



Reply Favorite

Date: December 17th, 2025 1:35 PM
Author: Pea-brained Carmine Masturbator Affirmative Action



(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516851)



Reply Favorite

Date: December 17th, 2025 7:49 PM
Author: irate chestnut hunting ground bbw

You need 24gb VRAM to do inference. 16gb isn't enough. However, unless you are coding there's little reason to go above 24gb. The reason coding can use more VRAM is because going through each iteration of the code generates long context windows. If you run out of context window the AI will forget what it was doing earlier. This is also why you can't run 15gb models on 16gb of VRAM. The context windows spills into system RAM and slows everything down

48gb VRAM lets you do more with image and video generation, but will not give you measurable gains in inference. You can put bigger models on the system but they probably won't give you better results.

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49517900)



Reply Favorite

Date: December 17th, 2025 1:36 PM
Author: sienna high-end stage

I waited on my RTX pro 6000 and now I'm pissed

(http://www.autoadmit.com/thread.php?thread_id=5811303&forum_id=2/#49516855)