using computers to compare jerkcity to great novels

The Something Awful Forums > Discussion > Serious Hardware/Software Crap > YOSPOS > using computers to compare jerkcity to great novels

A Wheezy Steampunk: Jul 16, 2006; High School Grads Eligible!

I decided to analyze Jerkcity and compare it to a number of great novels:

As you can see from this cluster dendrogram of the 500 most frequently used words, Jerkcity places near White People and Wuthering Heights. Emily would have been proud. Surprisingly, it is very distant from Dracula which I found to be odd, considering both involve a lot of sucking.

This next chart lists the most frequent words, stripping out so-called "content-free" words:

If you would like to know more, the CSV of word counts is available for you to do your own research: http://pastebin.com/NKww1BJV

Likewise, if you have any questions I would be more than happy to answer them.

# ? Aug 14, 2014 00:08

Adbot: ADBOT LOVES YOU

# ? Apr 28, 2024 22:46

theadder: Dec 30, 2011

im sorry op

# ? Aug 14, 2014 00:16

pram: Jun 10, 2001

pity bumping this steaming shitpile

# ? Aug 14, 2014 01:34

Fax Sender: Aug 11, 2013; kiss my ass

human being poo poo

# ? Aug 14, 2014 02:21

indigi: Jul 20, 2004; ^{how can we not talk about family

when family's all that we got?}

read a little book about Vlad the Impaler ^{Vlad the Impaler ^{Vlad the Impaler}}

# ? Aug 14, 2014 02:27

Silver Alicorn: Mar 30, 2008; 𝓪 𝓻𝓮𝓭 𝓹𝓪𝓷𝓭𝓪 𝓲𝓼 𝓪 𝓬𝓾𝓻𝓲𝓸𝓾𝓼 𝓼𝓸𝓻𝓽 𝓸𝓯 𝓬𝓻𝓮𝓪𝓽𝓾𝓻𝓮

now do the same thing for leisure town

# ? Aug 14, 2014 02:40

Pittsburgh Fentanyl Cloud: Apr 7, 2003

I wish someone would snatch your body, op

# ? Aug 14, 2014 02:45

Captain Foo: May 11, 2004; we vibin'
we slidin'
we breathin'
we dyin'

posting in a jerkcity thread

# ? Aug 14, 2014 02:54

SymmetryrtemmyS: Jul 13, 2013; I got super tired of seeing your avatar throwing those fuckin' glasses around in the astrology thread so I fixed it to a .jpg

Good work op well done

Not! pfhahabahahshahahahahaha

# ? Aug 14, 2014 03:27

Progressive JPEG: Feb 19, 2003

did you ocr the more recent jerkcitys or did you just use one of those old .txts floating around

seems like itd be pretty easy to ocr given the consistent font, but the comic cell layout probably makes it a lil tricky

# ? Aug 14, 2014 06:07

H.P. Hovercraft: Jan 12, 2004; one thing a computer can do that most humans can't is be sealed up in a cardboard box and sit in a warehouse; Slippery Tilde

ARE THERE UNLICKED DICKS IN THIS THREAD

# ? Aug 14, 2014 06:11

Symbolic Butt: Mar 22, 2009; (_!_); Buglord

dracula is a terrible book

# ? Aug 14, 2014 08:34

A Wheezy Steampunk: Jul 16, 2006; High School Grads Eligible!

Progressive JPEG posted:

did you ocr the more recent jerkcitys or did you just use one of those old .txts floating around

seems like itd be pretty easy to ocr given the consistent font, but the comic cell layout probably makes it a lil tricky

Good question! I went to http://jerkcity.com/jerkcity.txt and then stripped out everything but the dialogue.

# ? Aug 14, 2014 10:47

Progressive JPEG: Feb 19, 2003

A Wheezy Steampunk posted:

Good question! I went to http://jerkcity.com/jerkcity.txt and then stripped out everything but the dialogue.

oh poo poo thats awesome thanks

HOLY CHRIST JUST DONGS EVERYWHERE AND SO SUDDENLY -- POKING AND WHAPPING ME -- IT'S LIKE I'M RUNNING BACKWARDS NAKED THROUGH A CORNFIELD

e: for a while id been looking for a big ol dump to use against this markov chain lib id made, all the dumps id found cut off in like 2006

Progressive JPEG fucked around with this message at 16:15 on Aug 14, 2014

# ? Aug 14, 2014 16:09

GameCube: Nov 21, 2006

stick it in a markov, please.

# ? Aug 14, 2014 16:10

Captain Foo: May 11, 2004; we vibin'
we slidin'
we breathin'
we dyin'

I don't think jerkcity.text has been updated for years tho

# ? Aug 14, 2014 16:15

Progressive JPEG: Feb 19, 2003

Werthog 95 posted:

stick it in a markov, please.

Captain Foo posted:

I don't think jerkcity.text has been updated for years tho

that one looks like it's got this month at the bottom, maybe its got a big gap in the middle idk??

# ? Aug 14, 2014 16:16

GameCube: Nov 21, 2006

Captain Foo posted:

I don't think jerkcity.text has been updated for years tho

well, that blows.

# ? Aug 14, 2014 16:16

Captain Foo: May 11, 2004; we vibin'
we slidin'
we breathin'
we dyin'

Progressive JPEG posted:

that one looks like it's got this month at the bottom, maybe its got a big gap in the middle idk??

Would be p sweet if it did start up again but I'd guess there is a huge gap idk

Be even sweeter if it got back filled

# ? Aug 14, 2014 16:20

Progressive JPEG: Feb 19, 2003

aight i gotta go to work but heres how you could get markovin':

get/build the markov tool:

code:

$ sudo apt-get install build-essential cmake git libsqlite3-dev libgtest-dev
$ git clone git://github.com/nickbp/marky.git
$ cd marky
$ mkdir bin
$ cd bin
$ cmake -DCMAKE_BUILD_TYPE=Release ..
$ make -j4

then some garbage to get the content and IN THE CORRECT CAPS:

code:

# strip.py
f = open("jerkcity.txt")
lines = f.readlines()
for l in lines:
    if not ':' in l:
        continue
    if 'JERKCITY #' in l:
        continue
    s = ':'.join(l.split(':')[1:]).strip().upper()
    print s

then makin some chains from the content:

code:

$ cd marky/bin/apps # get in apps dir from build output above
$ python strip.py > jerkcity-stripped.txt
$ ./marky-file -p jerkcity-stripped.txt -n 10 # random
$ ./marky-file -p jerkcity-stripped.txt -n 10 -s CORN # search "CORN"

some outputs from the above:

10 random:
CAN DO YOU SAID *AT THE HUMPTY-DUMP AS WESTERN JER
OH SHUT THE NEW REPUBLIC HAS BEEN LIKE YOUR BEESWAX
RUNNING AWAY
THESE STONE MOVIES, NOT THE COUNTER STRIKE DICK FROM L.A. LAW & MOUSE....... LET'S JACK HIM
HMM
HOLD ON DICK WITHOUT ME AGAIN
YOU DON'T TELL ANYONE CAN I CAN START A COLLAGE OF JERKCITY
PERSONALLY I HAVE ENDURED SOMETHING OR ??? SIGNED UP
OW GOD I'LL BE DIFFICULT DUE TO THE DARK
WHAT THESE NOTES, IT SIR YOU DON'T PIPE DOWN HERE TO ESCROW WITHOUT ACTUALLY WATCHING AND ON BUSINESS

10 with "CORN" search:
SQUEEZING, STARING AT OTHER STUPID FACE GOT SOME KIND OF CORN
COVER YOUR COCK OF CORN AND TOM GREEN CLOVERS
T SPIGOT I'M A TUNA-FISH CAN COMPILE AND HURTING MY AFFINITY FOR YOU HIGH FRUCTOSE CORN AND AGAIN (CUPPING MY BONER'S FLOATING THROUGH THE OTHER TIMES A STORMTROOPER'S LASER GUN I WOULD ENJOY A STICKIER, MORE SENSIBLE SOLUTION PEOPLE DIE DIE LIKE NEW ZEALAND OR FAILURE?
HUGE BEND IN MUCH TO BE HARD SMOKING CRACK CORN AND DORKUS
PANTS ARE ALIVE NUGGGGGGGGGGGGGGGGH ANAL UHBLALAG SPIT IT WRONG TO IGNORE THOSE HAMS THIS HIGH FRUCTOSE CORN
WOOOOOOOOOOOOOOO BRAZIL AND SMOKE CRACK CORN AND I'M ALL OF THE FACE WITH NEW-FOUND STRENGTH
LOOK AT 3 HAS THE gently caress UP WITH ME HIGH FRUCTOSE CORN IN DATA'S DREAM DREAM
I'M A LITTLE JIMMY CRACK CORN
YOU !!!! CAN'T BUILD A ONE CLUSTER TO BE CORN SYRUP ON
PLEASE SECEDE FROM HEAVFEN TO A MINUTE IS HE AND FOR ME A PATCH OF MY BACK IN YOUR WAY INTO THE DOLE POSTERS????? PAMPHLETS???? WHAT DO I MEAN TO ME WITH YOUR HOUSE IS HOW CAN I READ A VARIETY OF CORN AND MY MODEST LITTLE MAYBE WE WILL DO K:SFJLKSJFLSKDFJLSKDFJLSFJ

marky also does sqlite caching via -i/-e but its not rly necessary unless u wanna be a speed demon w/ ur chains

# ? Aug 14, 2014 16:52

Captain Foo: May 11, 2004; we vibin'
we slidin'
we breathin'
we dyin'

God I love jerkcity

# ? Aug 14, 2014 17:02

Sham bam bamina!: Nov 6, 2012; ƨtupid cat

Progressive JPEG posted:

10 random:
CAN DO YOU SAID *AT THE HUMPTY-DUMP AS WESTERN JER
OH SHUT THE NEW REPUBLIC HAS BEEN LIKE YOUR BEESWAX
RUNNING AWAY
THESE STONE MOVIES, NOT THE COUNTER STRIKE DICK FROM L.A. LAW & MOUSE....... LET'S JACK HIM
HMM
HOLD ON DICK WITHOUT ME AGAIN
YOU DON'T TELL ANYONE CAN I CAN START A COLLAGE OF JERKCITY
PERSONALLY I HAVE ENDURED SOMETHING OR ??? SIGNED UP
OW GOD I'LL BE DIFFICULT DUE TO THE DARK
WHAT THESE NOTES, IT SIR YOU DON'T PIPE DOWN HERE TO ESCROW WITHOUT ACTUALLY WATCHING AND ON BUSINESS

10 with "CORN" search:
SQUEEZING, STARING AT OTHER STUPID FACE GOT SOME KIND OF CORN
COVER YOUR COCK OF CORN AND TOM GREEN CLOVERS
T SPIGOT I'M A TUNA-FISH CAN COMPILE AND HURTING MY AFFINITY FOR YOU HIGH FRUCTOSE CORN AND AGAIN (CUPPING MY BONER'S FLOATING THROUGH THE OTHER TIMES A STORMTROOPER'S LASER GUN I WOULD ENJOY A STICKIER, MORE SENSIBLE SOLUTION PEOPLE DIE DIE LIKE NEW ZEALAND OR FAILURE?
HUGE BEND IN MUCH TO BE HARD SMOKING CRACK CORN AND DORKUS
PANTS ARE ALIVE NUGGGGGGGGGGGGGGGGH ANAL UHBLALAG SPIT IT WRONG TO IGNORE THOSE HAMS THIS HIGH FRUCTOSE CORN
WOOOOOOOOOOOOOOO BRAZIL AND SMOKE CRACK CORN AND I'M ALL OF THE FACE WITH NEW-FOUND STRENGTH
LOOK AT 3 HAS THE gently caress UP WITH ME HIGH FRUCTOSE CORN IN DATA'S DREAM DREAM
I'M A LITTLE JIMMY CRACK CORN
YOU !!!! CAN'T BUILD A ONE CLUSTER TO BE CORN SYRUP ON
PLEASE SECEDE FROM HEAVFEN TO A MINUTE IS HE AND FOR ME A PATCH OF MY BACK IN YOUR WAY INTO THE DOLE POSTERS????? PAMPHLETS???? WHAT DO I MEAN TO ME WITH YOUR HOUSE IS HOW CAN I READ A VARIETY OF CORN AND MY MODEST LITTLE MAYBE WE WILL DO K:SFJLKSJFLSKDFJLSKDFJLSFJ

# ? Aug 14, 2014 17:07

Sham bam bamina!: Nov 6, 2012; ƨtupid cat

Captain Foo posted:

Would be p sweet if it did start up again but I'd guess there is a huge gap idk

Be even sweeter if it got back filled

i don't see a gap

# ? Aug 14, 2014 17:08

Adbot: ADBOT LOVES YOU

# ? Apr 28, 2024 22:46

Captain Foo: May 11, 2004; we vibin'
we slidin'
we breathin'
we dyin'

Sham bam bamina! posted:

i don't see a gap

the gap is your anus

# ? Aug 14, 2014 19:34

The Something Awful Forums > Discussion > Serious Hardware/Software Crap > YOSPOS > using computers to compare jerkcity to great novels