Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
pram
Jun 10, 2001
im clearly already doing that

Adbot
ADBOT LOVES YOU

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer
yeah but you have to sleep sometime

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer
i mean what if it's three AM and i need someone to tell me i suck and am gay

big scary monsters
Sep 2, 2011

-~Skullwave~-
just wake up your boyfriend dude

power botton
Nov 2, 2011

call your wife's bf

Captain Foo
May 11, 2004

we vibin'
we slidin'
we breathin'
we dyin'

a prambot might pass the Turing test

Maximum Leader
Dec 5, 2014

Trig Discipline posted:

i mean what if it's three AM and i need someone to tell me i suck and am gay

just go play cod on xbox live

Bloody
Mar 3, 2013

Captain Foo posted:

a prambot might pass the Turing test

or pram might fail the Turing test

Captain Foo
May 11, 2004

we vibin'
we slidin'
we breathin'
we dyin'

Bloody posted:

or pram might fail the Turing test

makes u think

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer
dammit, polov is dead and i'm traveling now. i'll restart it on my laptop once i get to the institute i'm staying at

You Am I
May 20, 2001

Me @ your poasting

Trig Discipline posted:

dammit, polov is dead and i'm traveling now. i'll restart it on my laptop once i get to the institute i'm staying at

Eduroamin' like a pro

qntm
Jun 17, 2009
a Markov chain bot built using Mars Volta lyrics would probably be indistinguishable from real Mars Volta lyrics

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer

You Am I posted:

Eduroamin' like a pro

u know it

the goddamn twitscraper keeps dying before it successfully re-scrapes, so polov is going to be lovely for a while until it manages to make it all the way through once

Captain Foo
May 11, 2004

we vibin'
we slidin'
we breathin'
we dyin'

Trig Discipline posted:

u know it

the goddamn twitscraper keeps dying before it successfully re-scrapes, so polov is going to be lovely for a while until it manages to make it all the way through once

well, it already sent death threats to quig

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer

Captain Foo posted:

well, it already sent death threats to quig

yeah it particualrly likes to single out quigs and booloo for some reason

Cocoa Crispies
Jul 20, 2001

Vehicular Manslaughter!

Pillbug

qntm posted:

a Markov chain bot built using Mars Volta lyrics would probably be indistinguishable from real Mars Volta lyrics

same with neutral milk hotel

vodkat
Jun 30, 2012



cannot legally be sold as vodka
I made a huge corpus (2 million +) word corpus for markov botman from stupid silicon valley VC but he's still not generating very good tweets. I'm gonna try and write a better tweet generator over the next few days and report back with the results.

Smythe
Oct 12, 2003

pram posted:

:five: :newlol: pizza balls friend of the family trump :newlol: :five:

NoneMoreNegative
Jul 20, 2000
GOTH FASCISTIC
PAIN
MASTER




shit wizard dad

pram posted:

:five: :newlol: pizza balls friend of the family trump :newlol: :five:

@gbs_ebooks

Roargasm
Oct 21, 2010

Hate to sound sleazy
But tease me
I don't want it if it's that easy
done with work and I'm writing an html scraper for azlyrics.com. What the gently caress is wrong with me

Roargasm
Oct 21, 2010

Hate to sound sleazy
But tease me
I don't want it if it's that easy
lmao azlyrics autobans you if you make too many connections but my poo poo works. Powershell v3+

I was able to get 1.3 megs of lyrics.txt before they got me on my VPN

http://www.azlyrics.com
PHP code:
$webClient = New-Object System.Net.WebClient
$webClient2 = New-Object System.Net.WebClient
$artistURL = Read-Host -Prompt "enter URL of lyrics to grab (like http://www.azlyrics.com/n/nickiminaj.html)"
$outFile = 'c:\files\rihanna.txt'


$artistBase = $webClient.DownloadString("$artistURL")
$artistOne = $artistBase.Split()
$artistTwo = $artistOne | Select-String -Pattern 'h:"../lyrics' | out-string


$artistTwo = $artistTwo.Replace('h:"..','http://www.azlyrics.com')
$artistTwo = $artistTwo.Replace('",','')

$lyricURLs = $artistTwo.Split()



foreach ($URL in $lyricURLs) {
    try{   
    $lyricBase = $webClient2.DownloadString("$URL") 
     
    $lyricStart = $lyricBase.LastIndexOf('Sorry about that. -->')
    $lyricEnd = $lyricBase.LastIndexOf('<br><br>')
    $totalChars = $lyricEnd - $lyricStart
    $songLyrics = $lyricBase.Substring($lyricStart, $totalChars)
    $clearedLyrics = $songLyrics.replace('</div>','').Replace('<br>',"`n").Replace('<div>','').Replace('<i>','') `
	.Replace('</i>','').Replace('Sorry about that. -->',"`n")
    echo $clearedLyrics >> $outFile
    }
    catch {}
    }

Roargasm fucked around with this message at 04:32 on Feb 23, 2016

Moist von Lipwig
Oct 28, 2006

by FactsAreUseless
Tortured By Flan
just rate limit it, jeez

Bloody
Mar 3, 2013

'lol this service whose main product is being a database bans you if you try to download their whole database'

Pile Of Garbage
May 28, 2007



Roargasm posted:

lmao azlyrics autobans you if you make too many connections but my poo poo works. Powershell v3+

I was able to get 1.3 megs of lyrics.txt before they got me on my VPN

http://www.azlyrics.com
PHP code:
$webClient = New-Object System.Net.WebClient
$webClient2 = New-Object System.Net.WebClient
$artistURL = Read-Host -Prompt "enter URL of lyrics to grab (like [url]http://www.azlyrics.com/n/nickiminaj.html[/url])"
$outFile = 'c:\files\rihanna.txt'


$artistBase = $webClient.DownloadString("$artistURL")
$artistOne = $artistBase.Split()
$artistTwo = $artistOne | Select-String -Pattern 'h:"../lyrics' | out-string


$artistTwo = $artistTwo.Replace('h:"..','http://www.azlyrics.com')
$artistTwo = $artistTwo.Replace('",','')

$lyricURLs = $artistTwo.Split()



foreach ($URL in $lyricURLs) {
    try{   
    $lyricBase = $webClient2.DownloadString("$URL") 
     
    $lyricStart = $lyricBase.LastIndexOf('Sorry about that. -->')
    $lyricEnd = $lyricBase.LastIndexOf('<br><br>')
    $totalChars = $lyricEnd - $lyricStart
    $songLyrics = $lyricBase.Substring($lyricStart, $totalChars)
    $clearedLyrics = $songLyrics.replace('</div>','').Replace('<br>',"`n").Replace('<div>','').Replace('<i>','') `
	.Replace('</i>','').Replace('Sorry about that. -->',"`n")
    echo $clearedLyrics >> $outFile
    }
    catch {}
    }

why are you using system.net.webclient, just use invoke-webrequest: https://technet.microsoft.com/en-us/library/hh849901.aspx

edit: lol im the .replace.replace.replace.replace.replace.replace.replace. just put the strings in an array and loop through it

Pile Of Garbage fucked around with this message at 05:41 on Feb 23, 2016

Fuzzy Mammal
Aug 15, 2001

Lipstick Apathy
has anyone applied some deep learning convolutional neural networks to this yet?

not me, though, i'm just the ideas guy

BooLoo
Oct 18, 2010

SLAM TIME

Trig Discipline posted:

yeah it particualrly likes to single out quigs and booloo for some reason

has it got over its pleasure kevin thing yet?

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer

BooLoo posted:

has it got over its pleasure kevin thing yet?

seems so, but you never know when the pleasure of kevin will suck him back in

Bloody
Mar 3, 2013

Fuzzy Mammal posted:

has anyone applied some deep learning convolutional neural networks to this yet?

not me, though, i'm just the ideas guy

no, because nobody actually knows how to

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer
yospos.txt

https://twitter.com/markov_polov/status/702374914364481536

craisins
May 17, 2004

A DRIIIIIIIIIIIIVE!

Bloody posted:

'lol this service whose main product is being a database bans you if you try to download their whole database'

still scraped all of capgeek before it went down

coffeetable
Feb 5, 2006

TELL ME AGAIN HOW GREAT BRITAIN WOULD BE IF IT WAS RULED BY THE MERCILESS JACKBOOT OF PRINCE CHARLES

YES I DO TALK TO PLANTS ACTUALLY

vodkat posted:

I made a huge corpus (2 million +) word corpus for markov botman from stupid silicon valley VC but he's still not generating very good tweets. I'm gonna try and write a better tweet generator over the next few days and report back with the results.

post the file

Progressive JPEG
Feb 19, 2003

coffeetable posted:

post the file

cinci zoo sniper
Mar 15, 2013




remember to use code tags

NoneMoreNegative
Jul 20, 2000
GOTH FASCISTIC
PAIN
MASTER




shit wizard dad

ideas man: mine Kickstarter for a new bot that produces exciting new KS projects.

Trig Discipline
Jun 3, 2008

Please leave the room if you think this might offend you.
Grimey Drawer

NoneMoreNegative posted:

ideas man: mine Kickstarter for a new bot that produces exciting new KS projects.

yeah but then you're going to be stuck with five million dollars and a bunch of nerds yelling at you because your combination vape / bitcoin miner is six months late

maniacdevnull
Apr 18, 2007

FOUR CUBIC FRAMES
DISPROVES SOFT G GOD
YOU ARE EDUCATED STUPID

NoneMoreNegative posted:

ideas man: mine Kickstarter for a new bot that produces exciting new KS projects.

Too real

vodkat
Jun 30, 2012



cannot legally be sold as vodka

coffeetable posted:

post the file

https://www.dropbox.com/s/rzzrbzi8wl104ks/Archive.zip?dl=0

lovely script also included

Dolomite
Jul 26, 2000
Cars & Legs


push the button, frank

Randel Candygram
Jun 21, 2008

College Slice

Fuzzy Mammal posted:

has anyone applied some deep learning convolutional neural networks to this yet?

not me, though, i'm just the ideas guy

i'm working on a recurrent neural network shitposter. it's slow as balls to train, though, and i don't have nearly enough data

Adbot
ADBOT LOVES YOU

cinci zoo sniper
Mar 15, 2013




Randel Candygram posted:

i'm working on a recurrent neural network shitposter. it's slow as balls to train, though, and i don't have nearly enough data
my friend, have you heard of a this shitpost gallery, "grey forums"?

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply