Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
pumped up for school
Nov 24, 2010

Smashing Link posted:

I would actually find that relaxing if I could find 4-5 hours to go through them all :)

In a goon "underrated software" thread someone introduced me to https://www.bulkrenameutility.co.uk/

Adbot
ADBOT LOVES YOU

H110Hawk
Dec 28, 2006

codo27 posted:

I've never had to clone a drive before. Faced with a case where its just going to be easier. How contrary is this process over matching capacity from the new drive to the old one? Its a 500gb HDD so do I have to get a 500gb SSD or will 480 do? Will it overcomplicate things if I went down so far as a 240gb SSD?

When you say "clone" what exactly do you want to accomplish? Do you just want a copy of the files onto another disk? Do you need it to be bit-for-bit accurate? Are you trying to wholesale move a bootable OS disk onto a different disk? Is this something forensic?

Copying the files nothing matters, as long as you have free space go for it. Cloning it suddenly becomes OS and Filesystem dependent. What is your source and destination for everything here? Physical? Virtual? P2V? V2P? Cloud to Butt?

BlankSystemDaemon
Mar 13, 2009



Bit-for-bit cloning is also dependent on the physical sector size of the disk; you do not want to be cloning from a 512B sector disk to a 4kB or 8kB sector disk.

codo27
Apr 21, 2008

H110Hawk posted:

When you say "clone" what exactly do you want to accomplish? Do you just want a copy of the files onto another disk? Do you need it to be bit-for-bit accurate? Are you trying to wholesale move a bootable OS disk onto a different disk? Is this something forensic?

Copying the files nothing matters, as long as you have free space go for it. Cloning it suddenly becomes OS and Filesystem dependent. What is your source and destination for everything here? Physical? Virtual? P2V? V2P? Cloud to Butt?

Want to change nothing but the drive basically. Laptop currently running a HDD, but has m.2 slot. I want to insert a nvme, clone the HDD to that, remove the HDD and continue as if nothing changed besides the performance gain.

H110Hawk
Dec 28, 2006

BlankSystemDaemon posted:

Bit-for-bit cloning is also dependent on the physical sector size of the disk; you do not want to be cloning from a 512B sector disk to a 4kB or 8kB sector disk.

This too.

codo27 posted:

Want to change nothing but the drive basically. Laptop currently running a HDD, but has m.2 slot. I want to insert a nvme, clone the HDD to that, remove the HDD and continue as if nothing changed besides the performance gain.

Which os? Which filesystem?

Smashing Link
Jul 8, 2003

I'll keep chucking bombs at you til you fall off that ledge!
Grimey Drawer

BlankSystemDaemon posted:

FileBot exists to do this automatically, and it can pull information (including metadata) from various media info sites.

It's also part of why I use FlexGet, because it can do it as part of the download+sorting process that I've set up for it with its plugin system.

pumped up for school posted:

In a goon "underrated software" thread someone introduced me to https://www.bulkrenameutility.co.uk/

Thanks for these tips!

Enos Cabell
Nov 3, 2004


codo27 posted:

Want to change nothing but the drive basically. Laptop currently running a HDD, but has m.2 slot. I want to insert a nvme, clone the HDD to that, remove the HDD and continue as if nothing changed besides the performance gain.

You want to use Macrium Reflect, I've used it several times for that exact process. (on Windows at least) https://www.macrium.com/reflectfree

tuyop
Sep 15, 2006

Every second that we're not growing BASIL is a second wasted

Fun Shoe
The solution for legitimate media acquisition and organizing is Sonarr and Radarr paired with Jackett and sabnzbd if you want to use Usenet, in my opinion.

wolrah
May 8, 2006
what?

codo27 posted:

I've never had to clone a drive before. Faced with a case where its just going to be easier. How contrary is this process over matching capacity from the new drive to the old one? Its a 500gb HDD so do I have to get a 500gb SSD or will 480 do? Will it overcomplicate things if I went down so far as a 240gb SSD?
As long as you're not actually using more space than the target drive has available it's pretty easy as long as you don't have any weird partitioning to deal with (basically as long as the big partition is at the end). I do this all the time for SSD upgrades.

My process uses the DRBL Live bootable USB key, but any Linux on which Clonezilla and GParted are available works fine.

I start by shrinking the data partition in GParted, leaving any boot partitions that may exist alone. I make it a few gigs smaller than the destination just to be sure it fits. This usually takes a minute or so, unless the partition is heavily fragmented in which case it may take some time to move data from the end of the partition to the new locations.

I then use Clonezilla and tell it to ignore the target disk size because the actual data will fit fine. The time this takes depends on the amount of data being copied.

I then go back to GParted and expand the partition on the target device to fill it up. This is almost instant.

Done.

There are probably easier ways using commercial tools, but my way is easy enough and totally free no matter what.

TraderStav
May 19, 2006

It feels like I was standing my entire life and I just sat down


Haven't checked everything out but this looks great!

Incessant Excess
Aug 15, 2005

Cause of glitch:
Pretentiousness

KozmoNaut posted:

I'm running Pi-Hole on a Pi 3 on a standard Raspbian install. It's using less than 10% of the 1GB RAM on the Pi, and I'm using a huge-rear end blocklist.

6GB is way crazy.

Also, this is just nonsense:

Is there a better tutorial for setting up pi-hole on a Synology NAS, if that guys is not to be recommended?

codo27
Apr 21, 2008

H110Hawk posted:

Which os? Which filesystem?

Its Windows 10, NTFS I would imagine. Basically out of box state Lenovo laptop in terms of those configurations. I have looked at Macrium Reflect and am leaning towards that, I just need to get the drive.

Nitrousoxide
May 30, 2011

do not buy a oneplus phone



Smashing Link posted:

Very important question for the thread. I am thinking of organizing my "unsorted" movie folder (~1400 movie files) into folders A-Z (and a folder for numeric titles). How should I address movies beginning with "The"? Go with first letter of second word of title, put all in "T" folder, or separate "The" folder. Inclined toward first option.

I use Sonarr, Radarr, and Lidarr, to organize my media.

They may have other uses as well.

Incessant Excess
Aug 15, 2005

Cause of glitch:
Pretentiousness
Radarr by default ignores the "The" at the beginning of a title, same with Plex and Kodi if I recall correctly.

SolusLunes
Oct 10, 2011

I now have several regrets.

:barf:

TraderStav posted:



Haven't checked everything out but this looks great!

:toot:

TraderStav
May 19, 2006

It feels like I was standing my entire life and I just sat down

Tested a few files on the drive and all is well! This is my first time using the protective features of UnRaid and REALLY impressed at how well it worked. As much as I read about the parity approach I still can't grok it fully but happy that I can have more confidence going forward!

Thinking I need to make a redundant array on another server for backup as this highlights that unraid is NOT backup, I had to buy a drive and manually copy, won't have that luxury in a real failure.

SolusLunes
Oct 10, 2011

I now have several regrets.

:barf:

TraderStav posted:

Tested a few files on the drive and all is well! This is my first time using the protective features of UnRaid and REALLY impressed at how well it worked. As much as I read about the parity approach I still can't grok it fully but happy that I can have more confidence going forward!

Thinking I need to make a redundant array on another server for backup as this highlights that unraid is NOT backup, I had to buy a drive and manually copy, won't have that luxury in a real failure.

tl;dr for Unraid array parity: you have as many tolerable disk failures as you have parity disks. This is generally applicable to all raid-like systems, but not always. (Unraid pool parity is slightly different, but probably not relevant to your interests at the moment.)

As far as backups, while you absolutely can make a redundant array on another server, consider cloud backup options- Backblaze is a popular one at $5/mo/TB, if you only have a small amount of data you want to back up, Crashplan is $10/mo/unlimited space, but their client is... meh, and they do have slower ingestion rates and are generally not as good as Backblaze. But, well, $10/mo for unlimited space.

Additionally, for Crashplan, there's a docker container in community apps, and it's dead simple to use. It's what I do.

H110Hawk
Dec 28, 2006

codo27 posted:

Its Windows 10, NTFS I would imagine. Basically out of box state Lenovo laptop in terms of those configurations. I have looked at Macrium Reflect and am leaning towards that, I just need to get the drive.

Cool, yeah it should work. Make sure if you have bitlocker on you backup a recovery key before you start. It's a easy wizard in the bitlocker control panel. Never used that particular piece of software.

TraderStav
May 19, 2006

It feels like I was standing my entire life and I just sat down

SolusLunes posted:

tl;dr for Unraid array parity: you have as many tolerable disk failures as you have parity disks. This is generally applicable to all raid-like systems, but not always. (Unraid pool parity is slightly different, but probably not relevant to your interests at the moment.)

As far as backups, while you absolutely can make a redundant array on another server, consider cloud backup options- Backblaze is a popular one at $5/mo/TB, if you only have a small amount of data you want to back up, Crashplan is $10/mo/unlimited space, but their client is... meh, and they do have slower ingestion rates and are generally not as good as Backblaze. But, well, $10/mo for unlimited space.

Additionally, for Crashplan, there's a docker container in community apps, and it's dead simple to use. It's what I do.

Yup, I use CrashPlan but it's dog slow. I wouldn't mind a cheap server to have quick restoration in the event of a failure and CrashPlan for catastrophic event.

SolusLunes
Oct 10, 2011

I now have several regrets.

:barf:

TraderStav posted:

Yup, I use CrashPlan but it's dog slow. I wouldn't mind a cheap server to have quick restoration in the event of a failure and CrashPlan for catastrophic event.

Gotcha. I think Unraid did actually build in functionality for backing up to another unraid server in 6.9.x, but I haven't done a thing with it, so I haven't a clue how it works.

Smashing Link
Jul 8, 2003

I'll keep chucking bombs at you til you fall off that ledge!
Grimey Drawer

SolusLunes posted:

Gotcha. I think Unraid did actually build in functionality for backing up to another unraid server in 6.9.x, but I haven't done a thing with it, so I haven't a clue how it works.

I would love for them to make a tool that is as functional and easy to use as Synology's HyperBackup.

phosdex
Dec 16, 2005

If anyone has a Western Digital My Book, there are reports of them being remote factory reset, resulting in loss of all data.
https://arstechnica.com/gadgets/2021/06/mass-data-wipe-in-my-book-devices-prompts-warning-from-western-digital/

Thwomp
Apr 10, 2003

BA-DUHHH

Grimey Drawer

phosdex posted:

If anyone has a Western Digital My Book, there are reports of them being remote factory reset, resulting in loss of all data.
https://arstechnica.com/gadgets/2021/06/mass-data-wipe-in-my-book-devices-prompts-warning-from-western-digital/

If you have any of these, the immediate recommendation is to unplug them for now.

Chilled Milk
Jun 22, 2003

No one here is alone,
satellites in every home

Nitrousoxide posted:

I use Sonarr, Radarr, and Lidarr, to organize my media.

They may have other uses as well.

They can be some work to set up and get your existing stuff into, but it doesn't take too long for it to pay off. Especially if you're adding new media regularly.

Impotence
Nov 8, 2010
Lipstick Apathy
anyone using unraid know if i can pass through a usb-enclosure ssd as a standalone share? i've been googling and only finding 2011s-era outdated results.

it shows up in dmesg as "scsi direct-access hynix ssd 1tb", it shows up in device info as "ASMedia Technology Inc. ASM2115 SATA 6Gb/s bridge", but there's no new item on the array listing nor any unassigned devices

Scruff McGruff
Feb 13, 2007

Jesus, kid, you're almost a detective. All you need now is a gun, a gut, and three ex-wives.

Biowarfare posted:

anyone using unraid know if i can pass through a usb-enclosure ssd as a standalone share? i've been googling and only finding 2011s-era outdated results.

it shows up in dmesg as "scsi direct-access hynix ssd 1tb", it shows up in device info as "ASMedia Technology Inc. ASM2115 SATA 6Gb/s bridge", but there's no new item on the array listing nor any unassigned devices

I haven't tried it myself but the Unassigned Devices plugin is supposed to allow you to do this I think.

Enos Cabell
Nov 3, 2004


Yeah, Unassigned Devices will definitely do that for you. As always, SpaceInvader One has a pretty good video on it if you run into trouble

https://www.youtube.com/watch?v=Wz4-YlH1lTk

Impotence
Nov 8, 2010
Lipstick Apathy

Scruff McGruff posted:

I haven't tried it myself but the Unassigned Devices plugin is supposed to allow you to do this I think.

thanks, this was it.

i wonder why something that seems like it should be both obvious and native needs two separate third party plugins

Chilled Milk
Jun 22, 2003

No one here is alone,
satellites in every home
I'm one of the 12 people left still ripping discs in 2021. Because desktop PC cases aggressively ditched 5.25 bays and my server has plenty of those and the files go there anyway I want to move my ripping to that machine. I installed the drive and I can see it with the host OS (TrueNAS). I can't quite figure out how to pass the block(? I'm not too familiar with the FreeBSD conventions here) device through to a VM. BHyve seems capable of this but not with the options I'm given in the web ui?

Searching through freebsd/freenas forums I found a handful of other people of trying this and not figuring it out. I'm guessing the ultimate solution is to not do this and instead move to a real hypervisor, or wait until the Debian based TrueNAS is stable and use that instead. But I'd figure I'd ask here and see if anyone had ideas.

BlankSystemDaemon
Mar 13, 2009



The Milkman posted:

I'm one of the 12 people left still ripping discs in 2021. Because desktop PC cases aggressively ditched 5.25 bays and my server has plenty of those and the files go there anyway I want to move my ripping to that machine. I installed the drive and I can see it with the host OS (TrueNAS). I can't quite figure out how to pass the block(? I'm not too familiar with the FreeBSD conventions here) device through to a VM. BHyve seems capable of this but not with the options I'm given in the web ui?

Searching through freebsd/freenas forums I found a handful of other people of trying this and not figuring it out. I'm guessing the ultimate solution is to not do this and instead move to a real hypervisor, or wait until the Debian based TrueNAS is stable and use that instead. But I'd figure I'd ask here and see if anyone had ideas.

Block devices are gone from FreeBSD.
CAM is the framework responsible for dealing with all disk and disk-like access (everything from harddisks, CDs/DVDs, tape drives, and even MMC/SD cards depending on configuration), and camcontrol devlist (as a privileged user) will give you the all the disk devices including the optical disk drive which is probably /dev/cd0.
To pass through a device, as you've found out, you need to use the ATAPI emulation via the -s flag as documented in the bhyve(8) manual page, but if TrueNAS doesn't expose it, I don't know what to tell you.

BlankSystemDaemon fucked around with this message at 21:58 on Jun 30, 2021

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb
I was watching Colbert last night and noticed some lovely shelves of hard drives:


I'm guessing they store the raw files from the cameras on these?

Chilled Milk
Jun 22, 2003

No one here is alone,
satellites in every home

BlankSystemDaemon posted:

Block devices are gone from FreeBSD.
CAM is the framework responsible for dealing with all disk and disk-like access (everything from harddisks, CDs/DVDs, tape drives, and even MMC/SD cards depending on configuration), and camcontrol devlist (as a privileged user) will give you the all the disk devices including the optical disk drive which is probably /dev/cd0.
To pass through a device, as you've found out, you need to use the ATAPI emulation via the -s flag as documented in the bhyve(8) manual page, but if TrueNAS doesn't expose it, I don't know what to tell you.

Yeah, it's there under /dev/cd0 and I can mess with it with cdcontrol. I was looking at the bhyve docs and see I need something like `-s ahci-cd /dev/cd0` but the TrueNAS UI in this case doesn't have a place for additional flags, and the devices config for a VM doesn't cover this case. Thanks I'll ask over on the official forums.

I also looked into running the ripping software in a Jail since abcde and makemkv look like they're in Ports but getting access to the drive in a jail was also a hurdle with how truenas configures things.

SolusLunes
Oct 10, 2011

I now have several regrets.

:barf:

The Milkman posted:

Yeah, it's there under /dev/cd0 and I can mess with it with cdcontrol. I was looking at the bhyve docs and see I need something like `-s ahci-cd /dev/cd0` but the TrueNAS UI in this case doesn't have a place for additional flags, and the devices config for a VM doesn't cover this case. Thanks I'll ask over on the official forums.

I also looked into running the ripping software in a Jail since abcde and makemkv look like they're in Ports but getting access to the drive in a jail was also a hurdle with how truenas configures things.

There's always the jank option of getting a sata-to-usb converter, plugging it into your USB header via that, and then passing through the USB device to a VM. It's not ideal, but it works for me.

Warbird
May 23, 2012

America's Favorite Dumbass

For any goons with the recent Synology update, have you had any issues with facial recognition results being ported in from Moments to Photos? Mine don't seem to want to index for lord knows what reason.

Mega Comrade
Apr 22, 2004

Listen buddy, we all got problems!

Warbird posted:

For any goons with the recent Synology update, have you had any issues with facial recognition results being ported in from Moments to Photos? Mine don't seem to want to index for lord knows what reason.

This the auto index or does the force reindex also not work?

Warbird
May 23, 2012

America's Favorite Dumbass

Bouncing the NAS appears to have shaken our whatever was held up and now I at least have a progress percentage. It’ll take a month or three at the rate I’m seeing. It seems like it didn’t want to index a cache of photos for lord knows what reason and was held up on that. It may have been my converting the old photos folder to Windows ACL or whatever permissions though.

Mega Comrade
Apr 22, 2004

Listen buddy, we all got problems!
Everything synology does is slow. It seems to be a design philosophy of 'never effect the performance of the nas' which is commendable but I'd like to be able to force things to just use all the resources, even if the nas become unusable while it does it.

H110Hawk
Dec 28, 2006

Mega Comrade posted:

Everything synology does is slow. It seems to be a design philosophy of 'never effect the performance of the nas' which is commendable but I'd like to be able to force things to just use all the resources, even if the nas become unusable while it does it.

Unless you have a commercial unit it's likely using 100% of your cpu time to do whatever photo analysis it's doing. Have you looked at the process monitor? Or ssh'd in and run "top"? Those cpus are slow. Doesn't take much to be a NAS.

Incessant Excess
Aug 15, 2005

Cause of glitch:
Pretentiousness
I noticed that DSM 7 has been released by Synology, has anyone upgraded from DSM 6 and can share impressions? I'm running Plex and Docker on my DS918+ and am curious if it's worth it to bother upgrading.

Adbot
ADBOT LOVES YOU

smax
Nov 9, 2009

Incessant Excess posted:

I noticed that DSM 7 has been released by Synology, has anyone upgraded from DSM 6 and can share impressions? I'm running Plex and Docker on my DS918+ and am curious if it's worth it to bother upgrading.

I just did it yesterday. Looks slick and seems to be more user friendly, but I haven’t put it through the paces yet. I don’t use it for many specialized services though.

Plex may not be on the official release channel yet, but there should at least be a beta.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply