\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Airdrop

Have you ever actually read Claude Shannon's 1948 paper which built the internet

here you go: https://people.math.harvard.edu/~ctm/home/te...
trip dun dragon
  04/08/25
...
Exciting aqua codepig
  04/08/25
gotta be honest; i'm not done reading this yet. in fact, i ...
trip dun dragon
  04/18/25
...
aphrodisiac chestnut meetinghouse
  04/22/25
ty i'm just starting let's do the book club talk next week
dashing market
  04/22/25
i'm still committed to doing this btw. i got massively side...
trip dun dragon
  10/27/25
would love to read and discuss this with you friend but they...
Contagious set halford
  10/27/25
i don't think we're going to focus on specific equations as ...
trip dun dragon
  10/27/25
or how does marconi work? The telephone? How was the first m...
spruce cuckoldry
  10/27/25
...
unhinged corner
  11/11/25
my body is getting ready for this. i literally haven't read...
trip dun dragon
  12/29/25
Of course. Multiple times, in fact.
Slap-happy Cyan Parlor Trust Fund
  12/29/25
okay now wait until i actually read this stuff and then we c...
trip dun dragon
  12/29/25
...
Slap-happy Cyan Parlor Trust Fund
  12/29/25
...
dashing market
  12/29/25
this is an extremely good paper so far. i'm not ready to di...
trip dun dragon
  01/17/26
a few more preliminary concepts which will be important here...
trip dun dragon
  01/19/26
...
Fragrant sapphire locus dog poop
  02/02/26
i've read the whole thing, i've done some collateral reading...
trip dun dragon
  04/11/26
i thought al gore invented the internet
Anal Mewling Parlour Mother
  04/11/26
Only the series of interconnecting tubes
Slap-happy Cyan Parlor Trust Fund
  04/11/26
don't worry; i haven't forgotten this. i'll be delivering s...
trip dun dragon
  06/22/26
Strasserites rise up
Contagious set halford
  06/22/26


Poast new message in this thread



Reply

Date: April 8th, 2025 9:03 PM
Author: trip dun dragon

here you go:

https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf

let's all read this and have a confab kind of thing next week. we never really talk about information theory on here; time to change that.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#48829263)



Reply

Date: April 8th, 2025 10:05 PM
Author: Exciting aqua codepig



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#48829468)



Reply

Date: April 18th, 2025 11:35 PM
Author: trip dun dragon

gotta be honest; i'm not done reading this yet. in fact, i have barely started. i am unilaterally postponing our colloquium to may 2nd.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#48862023)



Reply

Date: April 22nd, 2025 8:53 AM
Author: aphrodisiac chestnut meetinghouse



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#48870130)



Reply

Date: April 22nd, 2025 8:53 AM
Author: dashing market

ty i'm just starting let's do the book club talk next week

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#48870131)



Reply

Date: October 27th, 2025 4:16 AM
Author: trip dun dragon

i'm still committed to doing this btw. i got massively sidetracked by a whole lot of tracks. preliminarily, let's do this in january or so.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49377980)



Reply

Date: October 27th, 2025 4:20 AM
Author: Contagious set halford

would love to read and discuss this with you friend but they nuked my soul and now i'm retarded

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49377982)



Reply

Date: October 27th, 2025 4:39 AM
Author: trip dun dragon

i don't think we're going to focus on specific equations as much as more general ideas.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49377984)



Reply

Date: October 27th, 2025 5:09 AM
Author: spruce cuckoldry

or how does marconi work? The telephone? How was the first machine-production factory built without preexisting machines?

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49378005)



Reply

Date: November 11th, 2025 5:13 PM
Author: unhinged corner



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49421417)



Reply

Date: December 29th, 2025 8:55 AM
Author: trip dun dragon

my body is getting ready for this. i literally haven't read the paper yet, but i feel like it's almost time to swallow it down in one gulp like fish TP's christmas carp.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49546731)



Reply

Date: December 29th, 2025 8:56 AM
Author: Slap-happy Cyan Parlor Trust Fund

Of course. Multiple times, in fact.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49546732)



Reply

Date: December 29th, 2025 9:16 AM
Author: trip dun dragon

okay now wait until i actually read this stuff and then we can have some kind of discourse. estimated time maybe 15 days.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49546750)



Reply

Date: December 29th, 2025 7:11 PM
Author: Slap-happy Cyan Parlor Trust Fund



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49548152)



Reply

Date: December 29th, 2025 6:18 PM
Author: dashing market



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49548045)



Reply

Date: January 17th, 2026 8:13 AM
Author: trip dun dragon

this is an extremely good paper so far. i'm not ready to discuss the whole thing yet, but i'm into it a bit, and i should lay down some very preliminary ideas to begin to ground this whole thing for non-experts.

shannon's job here is to formalize the problem of communication. not some sort of habermas generality about psycho-emotive human communication, but the actual components of a 'message' in theory. what does it even mean to 'communicate' anything at all?

shannon's approach is to decompose 'message' into its barest constituent units, which he cites other theorists before himself as describing in terms of 'bits.' for example, when he talks about television transmissions, he describes them in terms of XY grid coordinates (the individual dots appearing on a screen) at any given moment, and then each coordinate has a motion in terms of time.

there is a unit of time in which each XY coordinate shifts value. in his era, it would have been the standard refresh rate in terms of hertz, which was the rate at which a cathode ray tube could scan a particular field. or around 30 frames per second.

in this type of 'message,' we now have a specific set of data (dots per image and image per unit of time) which must now be transmitted between a sender and a receiver. this data can be described in terms of bits to express the overall size of the transmission. easy enough, no?

NO!

because we have INTERFERENCE. interference is any sort of additional data contributed to the set of data which defines our original message. interference can come from any source (weather, hackers, animals chewing through wires, etc.). in terms of our analog TV example, interference visually represents as STATIC. static is the shit we don't want.

shannon's task from this point forward is to establish methods by which to deal with interference, and to reconstruct - as best he can - the original and purest form of the 'message' prior to its transmission.

to be continued, probably.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49596052)



Reply

Date: January 19th, 2026 12:02 AM
Author: trip dun dragon

a few more preliminary concepts which will be important here:

-logarithms: if you forgot math, the log is basically the inverse of doing an exponent. logs are important in information theory, because we will be dealing with problems like the rates at which possible symbol values increase over a unit of time, which often end up as log functions.

-the concept of a CHANNEL via which symbols/messages are transmitted. the channel is the vector by which our transmission factors are limited and often defined. shannon formalizes the channel in various ways; it is not a vague term for him.

-the markov/markoff chain and stochastic processes. the upshot here is that symbols within systems such as latin letters or TV pixel values are not usually random. they can be calculated in terms of probabilities (letter frequency, for example) and in terms of what has come prior (which also applies to words and larger units rather than just individual symbols).

-'states' as an abstraction for more particular entities such as letters or telegraphy dots/dashes. shannon is trying to move these things into a more abstracted form. if you shift from letter A to letter B, a formalized description would be that you have moved from a system state 1 (in this case, A) to a system state 2. as noted above, the probability of a particular state-shift is one of the major problems under consideration, because this is not going to be random if a coherent message is being transmitted rather than pure noise or static.

-ergodicity. a simple example would be something like letter frequencies in english words. if you start sending coherent english text, you would be expected to arrive at the same letter frequency over time as someone else doing the same thing, even though your texts are unrelated in terms of content. this is because english in this case is an ergodic system with specific frequency properties.

all of this will be significant as the paper moves along.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49600223)



Reply

Date: February 2nd, 2026 9:09 AM
Author: Fragrant sapphire locus dog poop



(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49640746)



Reply

Date: April 11th, 2026 8:16 AM
Author: trip dun dragon

i've read the whole thing, i've done some collateral readings, and i'm definitely going to come back around to this. just you wait. it's going to happen. hold on for a bit.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49810149)



Reply

Date: April 11th, 2026 8:19 AM
Author: Anal Mewling Parlour Mother

i thought al gore invented the internet

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49810152)



Reply

Date: April 11th, 2026 8:46 AM
Author: Slap-happy Cyan Parlor Trust Fund

Only the series of interconnecting tubes

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49810165)



Reply

Date: June 22nd, 2026 8:33 AM
Author: trip dun dragon

don't worry; i haven't forgotten this. i'll be delivering some HOT TAKES on the rest of the paper before long, or at least before what *I* consider to be particularly long. it'll be interesting and fun. don't even worry about it. this thing is in the bag, mostly.

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49955038)



Reply

Date: June 22nd, 2026 8:37 AM
Author: Contagious set halford

Strasserites rise up

(https://xoxohth.com/thread.php?thread_id=5707716&forum_id=2#49955045)