Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Stunt_enby
Feb 6, 2010

by Jeffrey of YOSPOS
https://forums.somethingawful.com/showthread.php?threadid=3928980&userid=0&perpage=40&pagenumber=1
That is all.

Adbot
ADBOT LOVES YOU

hazardousmouse
Dec 17, 2010
Are there any tools to rip the contents of a thread? I'd like to copy the astral horror recc thread for future reference

Totally Huge
Mar 10, 2006

Cold brew got me like...

College Slice

Raptor1033 posted:

Are there any tools to rip the contents of a thread? I'd like to copy the astral horror recc thread for future reference

I would really like this too. Going to see how difficult it would be to whip something up tonight if I don’t come across something that already exists.

Edit: this is my favorite forum to lurk. Is there a discord I don’t know about?

Sham bam bamina!
Nov 6, 2012

ƨtupid cat

Totally Huge posted:

I would really like this too. Going to see how difficult it would be to whip something up tonight if I don’t come across something that already exists.

Edit: this is my favorite forum to lurk. Is there a discord I don’t know about?

Hieronymous Alloy posted:

Just putting up a reminder link for the Book Barn discord:

https://discord.gg/jgBDB25

Totally Huge
Mar 10, 2006

Cold brew got me like...

College Slice
Thank you. I missed that somehow.

Safety Biscuits
Oct 21, 2010

Raptor1033 posted:

Are there any tools to rip the contents of a thread? I'd like to copy the astral horror recc thread for future reference

I copied this from the Fiction Writing thread, I have no idea if it works:

quote:

A while ago, some goon wrote a thread scraper for SA.

I forked the code and fixed the error messages, then did it again when chrome started hating on http connections or something. It's now the single thing I have available on github, because it would be rude not to let the orginal author know that somebody still loves his dead gay code:

https://github.com/Fumblemouse/SA-Archiving-Tool

To use:

Hit the big green Clone button and download it as a zip file.

Extract the zip file somewhere on your local hard drive.

In Chrome, go Settings -> More Tools -> Extensions and flick the Developer Mode switch on the top right.

There should now be an option to Load Unpacked on the left. Ignoring the untold comedy potential for that phrase, click the option and find the folder you extracted the zip to - by default, SA-Archiving-Tool-master. Select that folder and click the Open button.

All going well you should now have a hard-to-see SA icon on the chrome extension bar. If you visit a SA thread with a thread ID, eg https://forums.somethingawful.com/s...hreadid=3903748 the icon should now be clickable with a single option...Archive.

Click that link, and your local PC will think for a while, depending on your local tubespeed, then display a single page with the entire thread on it. CTRL+S or Rightclick Save As and save it whereever you want. WebPage, Complete will save images also.

Because nothing in life is easy, the saved page's HTML CSS tags refers to something set up by the chrome extension, so it will look a bit crappy in another browser or if you remove the extension. This can be fixed by changing the CSS reference in the Saved As HTML file to the files in the /archive folder from the extracted zipfile - or you could copy the /archive css files into the HTML file's folder and just have the tags as direct links to files (no folder references)

Go crazy!

Thanks sebmojo.

Adbot
ADBOT LOVES YOU

hazardousmouse
Dec 17, 2010
I've been on an off site for obvious reasons so didn't check back in here. The scraper totally works, there's a PYF where people were posting archives of their fav threads. Here's the cosmic horror thread.

Be good to one another!

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply