The Usenet Megathread - No invite discussion!

The Something Awful Forums > Discussion > Serious Hardware / Software Crap > The Usenet Megathread - No invite discussion!

«‹›315 »

BeastOfExmoor: Aug 19, 2003; I will be gone, but not forever.

On the off chance anyone else running Docker and runs into errors about no free space, I thought I'd link this post from the Linux thread that just solved my problem:

https://forums.somethingawful.com/showthread.php?threadid=2389159&pagenumber=810#post512339070

Basically Linux's filesystem uses something called 'inodes' as part of its filesystem and having a bunch of tiny files can exhaust the supply of inodes without actually filling the disk. For some reason a Plex Docker image generated several million tiny files and exhausted my supply of inodes.

There's probably a good way to solve this longterm, but running

code:

sudo du  --inodes /var/lib/docker | sort -n

helped me find and delete the problem tmp directory.

# ? Feb 8, 2021 02:19

Adbot: ADBOT LOVES YOU

# ? Feb 28, 2021 03:19

originalnickname: Mar 9, 2005; tree

BeastOfExmoor posted:

On the off chance anyone else running Docker and runs into errors about no free space, I thought I'd link this post from the Linux thread that just solved my problem:

https://forums.somethingawful.com/showthread.php?threadid=2389159&pagenumber=810#post512339070

Basically Linux's filesystem uses something called 'inodes' as part of its filesystem and having a bunch of tiny files can exhaust the supply of inodes without actually filling the disk. For some reason a Plex Docker image generated several million tiny files and exhausted my supply of inodes.

There's probably a good way to solve this longterm, but running
code:
sudo du  --inodes /var/lib/docker | sort -n
helped me find and delete the problem tmp directory.

I had a very severe inode exhaustion problem when I was using a deprecated filesystem overlay. When I upgraded docker to use overlay2 the problem never came up again. (the upgrade is unfortunately destructive, so back up/get your compose files updated). Before I upgraded, i was using devicemapper. That's not going to help with plex making millions of tiny files, but it might buy some more headroom.

originalnickname fucked around with this message at 02:35 on Feb 8, 2021

# ? Feb 8, 2021 02:29

nexus6: Sep 2, 2011; If only you could see what I've seen with your eyes

Lol, a 'register account' link has appeared on NZB Geeks but all it does is tell you registrations are closed.

# ? Feb 15, 2021 17:30

PirateDentist: Mar 28, 2006; Sailing The Seven Seas Searching For Scurvy

nexus6 posted:

Lol, a 'register account' link has appeared on NZB Geeks but all it does is tell you registrations are closed.

There is still no way to pay for VIP, so they�re probably waiting until they get that sorted out. In the meantime they just turned off the expiration date if you had it already.

# ? Feb 16, 2021 13:43

Craptacular!: Jul 9, 2001; Fuck the DH

BeastOfExmoor posted:

Basically Linux's filesystem uses something called 'inodes' as part of its filesystem and having a bunch of tiny files can exhaust the supply of inodes without actually filling the disk.

fwiw: the easiest solution to this is not to use ext4 for your disk partition, which is the common default partition type for home user desktop focused distros like Ubuntu because it's versatile and things like playing Windows games in WINE can mess up on other partition types. So if you're using Debian/Ubuntu as your system, consider not just accepting the default settings for your partition.

This is why Red Hat's corporate and datacentre focused distro defaults to XFS. The other big corporate distro, SuSE, uses btrfs for the root system partition and XFS for user storage. Because each inode does use up a certain tiny amount of drive space on a hard disk, XFS dynamically scales up the number of inodes available as more and more files populate the system. ext4 is great if you're using Linux to play Counter-Strike or watch YouTube, but data hoarding media server types should keep things to XFS. Or btrfs if you know how to make snapshots and want that function but are okay potentially losing everything forever.

Command to see the percentages of inodes in use on a partition: df -i

Craptacular! fucked around with this message at 21:27 on Feb 18, 2021

# ? Feb 18, 2021 21:20

norp: Jan 20, 2004; TRUMP TRUMP TRUMP

let's invade New Zealand, they have oil

Doesn't zfs have proper Linux support now? (Even if you have to use fuse)
Last I heard the FreeBSD foundation were looking to change their upstream from illumios to ZoL sometime in the next 12 months

# ? Feb 20, 2021 09:14

Sudden Loud Noise: Feb 18, 2007

Anyone that uses Newshosting experiencing really lovely performance the past few days? 1/8 usual speeds, and getting occasional "too many connections" errors. If anyone has alternative suggestions I'll take 'em. I moved from supernews to newshosting and had been pretty happy with the switch up until now. (Also their support page refuses to let me submit a ticket.)

Sudden Loud Noise fucked around with this message at 00:10 on Feb 24, 2021

# ? Feb 24, 2021 00:05

EL BROMANCE: Jun 10, 2006; COWABUNGA DUDES!

No problems here, just moved about 100gb in 20 minutes including the unpack etc.

# ? Feb 24, 2021 01:29

wolrah: May 8, 2006; what?

norp posted:

Doesn't zfs have proper Linux support now? (Even if you have to use fuse)

So that depends on what you mean by proper support.

ZFS on FUSE is just flat dead. It hadn't really kept up with OpenZFS to begin with and AFAIK it hasn't had any development since the early 2010s. The official stuff seems to be down and the latest copy I could find of the repo stops in 2012.

OpenZFS/ZFS-on Linux will never land in the mainline kernel as long as the license remains CDDL, but some distros like Ubuntu decided to bundle it anyways and there are trivially installed packages for basically every other distro that matters so it's not like it requires compiling kernels.

Beyond that, we have...

quote:

Last I heard the FreeBSD foundation were looking to change their upstream from illumios to ZoL sometime in the next 12 months

The tl;dr version is that in the OpenZFS 1.x era there were really two main codebases, the Illumos code that the BSDs, Mac, and most other ports just lightly shimmed to fit their needs and the ZoL code. A lot of bugfixes were getting developed on Linux and for one reason or another not getting brought in to the Illumos code, thus not making it to the BSDs unless they went out of their way to go look. As a result FreeBSD decided to start work on porting the Linux code, that effort snowballed, and OpenZFS 2.0 released in December with the entire project rebased on to the Linux code.

FreeBSD 13 includes OpenZFS 2.0 and is thus based on ZoL.

At this point the unofficial Linux port is more or less the official open source version of ZFS.

wolrah fucked around with this message at 22:43 on Feb 24, 2021

# ? Feb 24, 2021 22:37

alexandriao: Jul 20, 2019; "What're quantum mechanics?"
"I don't know. People who repair quantums, I suppose."

Ok so I have a bit of a conundrum. If this isn't the right place to post this, or if this shouldn't be posted on these here forums at all, pm me and I'll strike the post down like the wrath of hell (probes scare me

)

I was doing a nice comfy watchfest with my friends of a show, that i had torrented onto my VPS. I got dmca'd and accordingly removed the content, but I have a strike against my account now. I and my friends have been getting pretty depressed since we can't watch those shows together now, because I don't want to get kicked off my provider, and I'm not really sure how to set things up now.

I figure I have three options for proceeding:

Somehow set it up to run the traffic through my VPN -- every time I've tried this the internet to the server broke entirely.
Use a seedbox, transfer the files over to the VPN -- most cheap (sub $5) seedboxes don't ignore dmcas, the ones I've found say they'll remove the account if too many are had, this is the same situation I'm in now.
Pivot to Usenet for pulling stuff down.

Given the difficulties I've had from the first two options, Usenet is looking pretty attractive. I don't mind shelling out $15/yr + a small monthly charge, and I don't require anything more than 500GiB download, really. These are small 720p/420p files (Preferably they're h264+aac before I download, but I could run an ffmpeg job on them during the week to fix that). I've tried to do research on these options but the information on the internet is scattered, and it's difficult to find anything reliable.

From what I can tell my vps provider doesn't really filter traffic (I'm happy to disclose who it is as long as that doesn't violate any of the rules here

), so do yall think Usenet would be a good option here?

alexandriao fucked around with this message at 22:26 on Feb 27, 2021

# ? Feb 27, 2021 22:22

Burden: Jul 25, 2006; yospos

alexandriao posted:

Ok so I have a bit of a conundrum. If this isn't the right place to post this, or if this shouldn't be posted on these here forums at all, pm me and I'll strike the post down like the wrath of hell (probes scare me )

I was doing a nice comfy watchfest with my friends of a show, that i had torrented onto my VPS. I got dmca'd and accordingly removed the content, but I have a strike against my account now. I and my friends have been getting pretty depressed since we can't watch those shows together now, because I don't want to get kicked off my provider, and I'm not really sure how to set things up now.

I figure I have three options for proceeding:

Somehow set it up to run the traffic through my VPN -- every time I've tried this the internet to the server broke entirely.

Use a seedbox, transfer the files over to the VPN -- most cheap (sub $5) seedboxes don't ignore dmcas, the ones I've found say they'll remove the account if too many are had, this is the same situation I'm in now.

Pivot to Usenet for pulling stuff down.

Given the difficulties I've had from the first two options, Usenet is looking pretty attractive. I don't mind shelling out $15/yr + a small monthly charge, and I don't require anything more than 500GiB download, really. These are small 720p/420p files (Preferably they're h264+aac before I download, but I could run an ffmpeg job on them during the week to fix that). I've tried to do research on these options but the information on the internet is scattered, and it's difficult to find anything reliable.

From what I can tell my vps provider doesn't really filter traffic (I'm happy to disclose who it is as long as that doesn't violate any of the rules here ), so do yall think Usenet would be a good option here?

Yeah usenet will work fine. You are in luck as this seems like a good time to get started You'll need to get a server. Right now Eweka has a deal for €2.99 a month which is under $4.00 US. They are highly regarded and have really good retention. If you won't be downloading a lot you can also look into block accounts where you purchase a set amount of data to download and it doesn't expire.
Next you will need a good indexer NZBgeek is open again, but they are only using crypto for payment at the moment but they say are opening up other payment options shortly.
After you get those two you just need to figure out what application you want to use (Sabnzbd or Nzbget) to download from Usenet and if you want to automate the downloads.

# ? Feb 27, 2021 23:10

Bank: Feb 20, 2004; I paid five bucks and all I got was this custom title.

FWIW I use Usenet for most of my stuff, and once in a blue moon I have to resort to other means but I have a seedbox from Kimsufi for that. It's based somewhere in Europe and I've never had a notification for anything but to pay my bill.

I think it's around $5/month and it works great. I use SFTP to transfer things home and once that happens I wipe off the server. I'm sure there are ways to automate it, but I'm not determined enough to set that up.

# ? Feb 27, 2021 23:59

Slimy Hog: Apr 22, 2008

I'm new to usenet so please correct me if I'm wrong, but in my experience it's harder to find niche or older stuff on usenet than my private torrent trackers I use. So if that's a consideration, sign up for some free indexers +block account and see if your content is available

# ? Feb 28, 2021 00:44

EL BROMANCE: Jun 10, 2006; COWABUNGA DUDES!

DMCA guy : get Usenet subscription to grab your stuff, then use Watch Together feature on Plex to do a watch along with your friends.

Above me guy : niche stuff is always going to need as many sources as you can get your hands on, really. Half the fun in getting it tbh. I�ve downloaded a ton of weird and wacky stuff from Usenet that I couldn�t find elsewhere and Vice versa.

(Sorry on phone and too lazy to quote button properly, just got home from work and brain is bit fried).

# ? Feb 28, 2021 00:50

That Works: Jul 21, 2006; Every revolution evaporates and leaves behind only the slime of a new bureaucracy

Slimy Hog posted:

I'm new to usenet so please correct me if I'm wrong, but in my experience it's harder to find niche or older stuff on usenet than my private torrent trackers I use. So if that's a consideration, sign up for some free indexers +block account and see if your content is available

This is a great way to see if usenet will work for the content you're looking for without much expense / effort.

# ? Feb 28, 2021 00:52

cryptoclastic: Jul 3, 2003; The Jesus

EL BROMANCE posted:

Above me guy : niche stuff is always going to need as many sources as you can get your hands on, really. Half the fun in getting it tbh. I�ve downloaded a ton of weird and wacky stuff from Usenet that I couldn�t find elsewhere and Vice versa.

I finally got my hands on something I had been searching for for over a year. Such a good feeling.

# ? Feb 28, 2021 00:56

EL BROMANCE: Jun 10, 2006; COWABUNGA DUDES!

cryptoclastic posted:

I finally got my hands on something I had been searching for for over a year. Such a good feeling.

https://www.instagram.com/p/Bx0XGwAlB9b/?igshid=orr9jh1o875j my white whale. Japanese low budget effects horror that just seems impossible to find. I spend a few hours once or twice a year just in case it�s popped up since, but nothing. That guy is the only person I know with a copy, I messaged him and saw the �person is typing...� notice then nothing ever came back.

I have a separate plex library just for weird stuff that I don�t give all my friends access to, and I�m sure I�m judged by the ones who do.

# ? Feb 28, 2021 01:14

alexandriao: Jul 20, 2019; "What're quantum mechanics?"
"I don't know. People who repair quantums, I suppose."

Burden posted:

Yeah usenet will work fine. You are in luck as this seems like a good time to get started You'll need to get a server. Right now Eweka has a deal for €2.99 a month which is under $4.00 US. They are highly regarded and have really good retention. If you won't be downloading a lot you can also look into block accounts where you purchase a set amount of data to download and it doesn't expire.
Next you will need a good indexer NZBgeek is open again, but they are only using crypto for payment at the moment but they say are opening up other payment options shortly.
After you get those two you just need to figure out what application you want to use (Sabnzbd or Nzbget) to download from Usenet and if you want to automate the downloads.

Ahhh this is great, thank you

Bank posted:

FWIW I use Usenet for most of my stuff, and once in a blue moon I have to resort to other means but I have a seedbox from Kimsufi for that. It's based somewhere in Europe and I've never had a notification for anything but to pay my bill.

I think it's around $5/month and it works great. I use SFTP to transfer things home and once that happens I wipe off the server. I'm sure there are ways to automate it, but I'm not determined enough to set that up.

Thanks, I'll add this to my consideration

The seedboxes I'd earmarked were USB's lancer tier, and SonicBit, however the problem is while sonicbit helpfully says "public trackers" in the listing, there's no information on them, and for USB I kept seeing mixed information on DMCA stuff

Slimy Hog posted:

I'm new to usenet so please correct me if I'm wrong, but in my experience it's harder to find niche or older stuff on usenet than my private torrent trackers I use. So if that's a consideration, sign up for some free indexers +block account and see if your content is available

Any free indexers you suggest?

Edit: I meant to mention. Right now I'm with vultr, but for what you actually get the price isn't that good. Netcup looks more hopeful with respect to price, but I've heard (on reddit, usually) stuff about German vps-es doing file hash searches with a general warning to stay away from them if you want to hold content there for a bit -- is any of that true?

alexandriao fucked around with this message at 01:26 on Feb 28, 2021

# ? Feb 28, 2021 01:24

Bank: Feb 20, 2004; I paid five bucks and all I got was this custom title.

Kimsufi is legit, but it's hard to get the cheapest plan..it took me about two months of checking on and off until I was able to add it. Just as a heads up.

# ? Feb 28, 2021 01:27

Slimy Hog: Apr 22, 2008

alexandriao posted:

Any free indexers you suggest?

Lurk around /r/UsenetInvites on reddit and someone will come around with Drunken Slug invites (I know at least one person in this thread has offered them in the past too)

# ? Feb 28, 2021 02:47

Adbot: ADBOT LOVES YOU

# ? Feb 28, 2021 03:19

alexandriao: Jul 20, 2019; "What're quantum mechanics?"
"I don't know. People who repair quantums, I suppose."

Slimy Hog posted:

Lurk around /r/UsenetInvites on reddit and someone will come around with Drunken Slug invites (I know at least one person in this thread has offered them in the past too)

Thank you!

Burden posted:

Right now Eweka has a deal for €2.99 a month which is under $4.00 US. They are highly regarded and have really good retention. If you won't be downloading a lot you can also look into block accounts where you purchase a set amount of data to download and it doesn't expire.

Oh! The deal is only for 12 months, I was hoping for something shorter to try it out

Do you (or anyone else) know how long the deal is going to be around for? (I tried looking but couldn't find anything eep) If it's immediate I can shell out fine, but otherwise I'd probably prefer to sit on it and search around a wee bit

Also I feel I'm low-key making GBS threads up the thread lmbo, so sorry for that

# ? Feb 28, 2021 03:05

The Something Awful Forums > Discussion > Serious Hardware / Software Crap > The Usenet Megathread - No invite discussion!

«‹›315 »