Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
IT Guy
Jan 12, 2010

You people drink like you don't want to live!

Ivan Dolvich posted:

I have been thinking about getting the DS411j, with the primary purpose being streaming media to my TV. Have you used it all in this capacity? Would you still recommend a higher end model if this is all I will be using it for?

If you're not streaming hi-def content then you'd be fine. I would go with something a little better if you are streaming hi-def though. Really, the N40L is your best option for cost. Synology are great boxes and easy to setup, but to get decent speeds you need the non "j" version. I use mine for backups only so I've never used it as a upnp server. FreeNAS is coming out with a upnp server in 8.2 and in addition, you can install PS3 media server (not just for the PS3) on the current release.

Unrelated, has anyone had success in setting up SSH keys for FreeNAS using puttygen? I'm copying the openssh key but FreeNAS keeps refusing my keys. I know they work because I'm using the same key pair with my Synology box. I've tried making the keys on both puttygen and using ssh-keygen on the server.

Edit: I fixed my SSH keys issue. It was directory permissions causing it.
I did a "tail /var/log/auth.log and saw this:
"Apr 5 15:06:13 luna sshd[8524]: Authentication refused: bad ownership or modes for directory /mnt/data/homes/ryan"
the ownership was root:wheel which I changed to ryan:wheel and it worked.

IT Guy fucked around with this message at 20:09 on Apr 5, 2012

Adbot
ADBOT LOVES YOU

fletcher
Jun 27, 2003

ken park is my favorite movie

Cybernetic Crumb

UndyingShadow posted:

I'm using a N40L with an intel nic on FreeNAS, with 2-tb green drives (1 wd green drive and 5 samsung eco green drives) in a raidz2 array.

How did you fit 6 drives in there? This gives you ~4x2TB of usable space, right?

IT Guy
Jan 12, 2010

You people drink like you don't want to live!

fletcher posted:

How did you fit 6 drives in there? This gives you ~4x2TB of usable space, right?

Another user posted this: http://www.frozencpu.com/products/8923/hdc-65/Noiseblocker_NB_X-Swing_HDD_Adapter_Noise_Reducer.html

Which allows you to mount another two drives in the 3.5" spot. You also need a eSATA to SATA cable.

DEAD MAN'S SHOE
Nov 23, 2003

We will become evil and the stars will come alive
Better make sure to get some air flow up to them if you're going to put them there.

kri kri
Jul 18, 2007

Roving Reporter posted:

After reading the past 10+ pages, I'm looking towards a N40L once another sale pops up. The $180/190/200 prices are too good, especially since I already have 2 x 4TB drives. Then, roll that saving into another 2TB drive or i3 HTPC to transcode/stream/SABnzbd/etc. So, far my OS prospects are WHS2011 with either Flexnas/DriveBender/DrivePool.

Most of my data is replaceable media, so allowing me to duplicate only the files/folders I care about is key instead of a RAID solution. Plus, I really would rather not spend too much time learning something new.

I was looking at the Synology boxes with 4 bays(mainly the DS411 variations), and while seemingly nice, are much more expensive than the N40L. The feature set doesn't seem to be that much more than WHS2011, only that it comes installed with their own propriety OS, right? I'm trying to see the comparison along with pros and cons and price difference.

I have WHS 2011 and Drivepool. Everything works perfectly fine, and the UI is pretty nice even if I hardly use it. I added some disks and its dead simple. I would say if you want to run a windows-based setup you can't go wrong with WHS 2011 (which is currently on sale at newegg for $43 or so I think) and one of the drive pooling addons. I can't really come up with any negatives.

Is there a recommended external esata enclosure thats not stupid expensive to go along with the n40l? My homebuilt machine I am tiring of, fairly loud and overkill for what I use my server for.

Prince John
Jun 20, 2006

Oh, poppycock! Female bandits?

IT Guy posted:

If you're not streaming hi-def content then you'd be fine. I would go with something a little better if you are streaming hi-def though.

Anecdote ahoy, but my 411j has no problem streaming 1080p content either to my TV or other computers, despite the specs. I'm glad I didn't go for a more expensive model.

IT Guy
Jan 12, 2010

You people drink like you don't want to live!

Col posted:

Anecdote ahoy, but my 411j has no problem streaming 1080p content either to my TV or other computers, despite the specs. I'm glad I didn't go for a more expensive model.

Just curious, but can you please screenshot your fastest transfer speed with said device. There is only so much you can push out of a 1.2ghz processor and 128MB RAM.

You're able to stream uncompressed 1080p 10GB .mkv files?

IT Guy fucked around with this message at 04:15 on Apr 6, 2012

Muslim Wookie
Jul 6, 2005
Guys I've gone ahead and bought myself a bunch of kit for a ZFS build and it's all hosed.

That is to say, I get transfer speeds over CIFS of like 10kb/s. zpool commands take a long rear end time to run. What the hell is going on here?

Hardware:

Intel 2700k
Asrock Extreme4 Gen3 mb
16gb RAM
10*2tb disks of varying manufacturers
1 addonics port multiplier

I've installed ESXi 5.0 on a thumbdrive, and created a VM to run the storage. I've mapped the drives through to the VM as RDMs.

I've tried FreeNAS but it's slow as gently caress to do anything - often the webgui will just time out. Once a zpool is created, the web gui will often even fail to load properly anymore.

Tried OpenIndiana and napp-it, zpool creates are super slow, and writing to the shares is super slow.

What am I missing here?? I'm super pissed off, feel like I've wasted a stack of cash.

Galler
Jan 28, 2008


Have you tried it without using ESXi? ESXi should work but I would try to keep things as simple as possible (FreeNAS straight on the thumb drive) to verify it's functioning and then build up from there.

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams
The thing that sticks out of me about that hardware is the port multiplier. You'd be much better off getting a SAS card like the IBM M1015 to drive those drives.

Muslim Wookie
Jul 6, 2005
You know, thanks for saying the boot from USB thing. I've plainly just been blinded by rage at this poo poo not working while I can see in reports that it works for basically EVERYBODY ELSE so after trying to boot from USB with OpenIndiana and that failing I threw in the towel on that front and didn't revisit it. I have real anger issues when it comes to spending money. :S

So I've just tried FreeNAS and that has given me hope, I can get ~20mb/s write speeds now and the expected 100mb/s read speeds.

The port multiplier, I hear ya, but this isn't for high bandwidth requirements this box. Yes, I need better than 20mb/s, but I don't think that's down to the port multiplier. There are only 3 drives attached to that PM at the moment, so at worst, the whole array is down to 1/3rd the performance of a SATAII port, and a single drive can't even max out a SATAII port anyway. But, I do appreciate the input, and if I can't get any better write performance fairly soon, I will remove the PM, create a zpool with 8 drives instead of 10 and see how that goes performance wise. If it's not already obvious, I have the PM because I have 10 drives for the zpool, and this motherboard only has 8 SATA ports. Further, I don't want to spend a fair bit of cash on a "real" RAID card which I will not be using any hardware RAID features, and I've read reports that some RAID cards actually increase disk latency even when just in pass-through mode.

Edit: Speaking of, does anyone have any suggestions on troubleshooting commands I should be running, or steps I can try to use to increase my write speed, via CIFS?

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams
If you only need 2 more ports, a 2 port SATA card is like $30. The problem with the multiplier is driver support, which could be causing your problems. Whenever I looked into it I couldn't find anything that said they would work in any form in Solaris.

Making an 8 drive pool is a good test (this is RAIDZ2, right? Don't do RAIDZ1). You can also try and eliminate the networking. Do a dd from /dev/random to the pool to test write speeds, and a dd from the pool to /dev/null to test read speeds.

Muslim Wookie
Jul 6, 2005
I think I've ruled out network:

dd write: 28556104 bytes / sec (28MB/s)

dd read: 82035806 bytes / sec (82MB/s)

The dd read is slower than what my CIFS read was but I will put that down to how Windows reports things.

Yup, everything I do is raidz2.

On port multipliers, my understanding is that they are an entirely passive device, your OS doesn't need drivers for it, only the chipset on the mainboard needs to support port multipliers.

Another observation - cifs write transfer are very bursty. I will see high speed initially, then it slowing down, but not uniformly, the transfer will just "stop", then burst a bit, then stop, then burst a bit, so on until the end. So I get the feeling it's transferring at say 40MB/s for a few seconds, then transferring nothing for another 5 or 10 seconds, then transferring at 40MB/s again, etc.

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams
My knowledge of port multipliers is old, since I stopped caring about it when I discovered SAS, but my understanding was that the multiplier had a chipset, and that chipset has to be understood by the OS. I guess the fact that you can see the drives means I could be wrong, because if what I thought was true is, then you wouldn't be able to see them at all.

I'm guessing that's with all 10 drives? I'd try to eliminate the PM and see what that does. The whole array is going to run at the speed of your slowest drive, so of the PM is slowing those disks down, it'll slow down the whole array.

It's also possible, depending on the disks, that one of them could be bad. You could boot an Ubuntu Live CD and run some SMART tests to see.

Muslim Wookie
Jul 6, 2005
I've got FreeNAS running some SMART tests now (at least, I think I do, I've scheduled them and they should have started 18 minutes ago but seeing as FreeNAS doesn't really give you any feedback as to whether they are running, I guess I will know if in 4 hours I don't receive an email with the results). Come to think of it, one of the drives might have sounded more noisy than usual... but that could be my imagination as well.

Also, just to be clear, I'm not one of those posters ignoring everyone's advice because I don't like the sound of it, it's just that if I can't use the PM I'm sort of hosed because of some time limits I'm under, so I'm gonna try everything else first. After these tests run, I'll probably bypass the PM and do some testing without it.

Crackbone
May 23, 2003

Vlaada is my co-pilot.

IT Guy posted:

Just curious, but can you please screenshot your fastest transfer speed with said device. There is only so much you can push out of a 1.2ghz processor and 128MB RAM.

You're able to stream uncompressed 1080p 10GB .mkv files?

File transfer speed is almost completely unrelated to ram and cpu power, at least for streaming video. (Transcoding is a different story, but I don't think we're talking about that.)

An uncompressed bluray video stream is a trivial amount of bandwidth - you can do that over a USB 2.0 connection. I've got a Synology 411j and I can do a 14GB mkv + a couple other streams of various types. It's just not that taxing an activity.

More important is you network infrastructure, the protocols you're using, and the devices on the other end of the NAS.

For reference, it's a Snyology 411j (4 Spinpoint 1TBs in RAID5), connected to my streamers via a 500Mb powerline networking kit (actual transfer speed ~60Mb), and to several iDevices via wireless N/G.

Crackbone fucked around with this message at 15:03 on Apr 6, 2012

IT Guy
Jan 12, 2010

You people drink like you don't want to live!

marketingman posted:

I've got FreeNAS running some SMART tests now (at least, I think I do, I've scheduled them and they should have started 18 minutes ago but seeing as FreeNAS doesn't really give you any feedback as to whether they are running, I guess I will know if in 4 hours I don't receive an email with the results). Come to think of it, one of the drives might have sounded more noisy than usual... but that could be my imagination as well.

Also, just to be clear, I'm not one of those posters ignoring everyone's advice because I don't like the sound of it, it's just that if I can't use the PM I'm sort of hosed because of some time limits I'm under, so I'm gonna try everything else first. After these tests run, I'll probably bypass the PM and do some testing without it.

by default FreeNAS won't email you the SMART report unless something is wrong. So in 4 hours you may not even get a report.

SSH into it and type the following commands as root:

smartctl -H /dev/(dev name)

That will give you the overall health.

smartctl -a /dev/(dev name)

That will give you the current status and past results of tests on that drive.

IT Guy fucked around with this message at 15:06 on Apr 6, 2012

Factory Factory
Mar 19, 2010

This is what
Arcane Velocity was like.

Crackbone posted:

An uncompressed bluray video stream is a trivial amount of bandwidth - you can do that over a USB 2.0 connection.

For clarity because I can easily see someone asking, that means "not compressed any further than it is already on the disc." It does not mean "uncompressed 1920x1080 24p video." BluRay video has a specified maximum, audio-included bitrate of 54 Mbps, or 6.75 MB/s.

Crackbone
May 23, 2003

Vlaada is my co-pilot.

Factory Factory posted:

For clarity because I can easily see someone asking, that means "not compressed any further than it is already on the disc." It does not mean "uncompressed 1920x1080 24p video." BluRay video has a specified maximum, audio-included bitrate of 54 Mbps, or 6.75 MB/s.

Yeah, and even then you don't see 50Mb bit rates on most discs. Also, unless you're doing a direct rip from the source, most MKVs have a significantly lower bitrate, like 4-5Mb.

Crackbone fucked around with this message at 15:38 on Apr 6, 2012

IT Guy
Jan 12, 2010

You people drink like you don't want to live!
I suppose it was anecdotal then. Something must be wrong with the way mine is setup. I'll have to look at it.

Muslim Wookie
Jul 6, 2005

IT Guy posted:

by default FreeNAS won't email you the SMART report unless something is wrong. So in 4 hours you may not even get a report.

SSH into it and type the following commands as root:

smartctl -H /dev/(dev name)

That will give you the overall health.

smartctl -a /dev/(dev name)

That will give you the current status and past results of tests on that drive.

Hey, thanks for the advice. Having said that, after I posted I decided I needed to have a look at what FreeNAS was actually doing and read up on smartd/smartctl/smartmon etc. After 4.5 hours I logged in and did a smartctl -a and most of the HDDs were at "10% to completion" and a couple were at 20%. That was something like 5 hours ago and I haven't had an email since then - maybe that means everything is AOK or it means a drive is stuck at 90% - a symptom I've seen described elsewhere of a dying drive. I guess I'll find out tomorrow when I have a chance to check it out.

IT Guy
Jan 12, 2010

You people drink like you don't want to live!
Those of you with a DS411j, what are your xfer speeds? I'm starting to think mine is hosed.

BlankSystemDaemon
Mar 13, 2009



IT Guy posted:

Those of you with a DS411j, what are your xfer speeds? I'm starting to think mine is hosed.
I have a Synology DS210+ and it's getting ~100MBps over iSCSI with a RAID1 of 2x WD20EVDS 2TB.

Stealth-edit: I looked up the disks, and even had the model number wrong. It's been offline for quite some time because it's noisy (the fan, I suspect) and isn't even up-to-date software-wise as I'm currently upgrading from DSM 3.2-1955 to 4.0-2198.

BlankSystemDaemon fucked around with this message at 20:39 on Apr 6, 2012

IT Guy
Jan 12, 2010

You people drink like you don't want to live!

D. Ebdrup posted:

I have a Synology DS210J and it's getting ~100MBps over iSCSI with a RAID1 of 2x WD20EVDS 2TB.

Stealth-edit: I looked up the disks.

I just ran some tests on mine. I'm getting 10MB/s read and 4MB/s writes over CIFS. 60MB/s read 40MB/s write over FTP.

Something is hosed up. Perhaps that is why I can't stream hi def.

I have 4x Samsung Spinpoint F4 2TB drives with the updated firmware.

BlankSystemDaemon
Mar 13, 2009



IT Guy posted:

I just ran some tests on mine. I'm getting 10MB/s read and 4MB/s writes over CIFS. 60MB/s read 40MB/s write over FTP.

Something is hosed up. Perhaps that is why I can't stream hi def.
Once I've updated, I'll delete the iSCSI that was on there (not used for anything) and setup SMB and FTP and do some benchmarks, then report back.

Those drives are fine drives, I have the exact same number in my N36L, and there I can fully saturate 2x LAGG'd gigabit NICs on read and almost on write (dd: 400MBps read and 170MBps write, from memory)

IT Guy
Jan 12, 2010

You people drink like you don't want to live!

D. Ebdrup posted:

Once I've updated, I'll delete the iSCSI that was on there (not used for anything) and setup SMB and FTP and do some benchmarks, then report back.

Awesome thanks. I don't have much data on mine and it's all backed up so I think I'm going to factory reset this and set it up again.

BlankSystemDaemon
Mar 13, 2009



Just using Windows file transfer default values (no enlarged buffer) 9k jumbo frames, I get ~100MBps read and 60MBps write.

Crackbone
May 23, 2003

Vlaada is my co-pilot.

I've got 411j, 4x1TB Spinpoints, CIFS and Windows File Sharing turned on. I have some wonky connection types, but:

- Over the powerline networking my streamer reports ~60MB/s reads on average (can't test writes)
- Copying to and from a Windows box over 5Ghz wireless N maxes out the connection at 10MB/s. Even at 10MB/s I can stream large (10GB) mkvs flawlessly - that's only about a 1.5MB/s transfer rate.

Crackbone fucked around with this message at 21:29 on Apr 6, 2012

IT Guy
Jan 12, 2010

You people drink like you don't want to live!
So, I factory reset my DS411j, reloaded the DSM software and reconfigured everything from scratch. I'm now seeing 40MB/s writes and 60MB/s reads with 1500 MTU.

Not sure what was going on before but I've been using it like that for about a year and just assumed it was because of the specs.

Here is my write speeds before:



And now:



As you can see my CPU was maxing out in the first image. Something was definitely wrong.

Muslim Wookie
Jul 6, 2005
Follow up: I've removed the port multiplier, and dd write has given me ~90MB/s.

CIFS is giving me 85MB/s to 90MB/s.

To do this test, I actually only unplugged the PM and replugged in one of the HDDs direct to the mainboard, so the pool is running degraded.

I'm going to put on my cowboy hat, migrate all the data to the pool in this state, then add the 2 drives back in. Reason being that the read stats were fine even with the PM in place, and those speeds will do until I can get a real RAID card.

Having said that, I'm finding it difficult to believe I was so wrong on how the PM works that I'm going to be doing a bunch more research and testing to ensure I didn't configure things incorrectly.

Jolan
Feb 5, 2007
I just got a NAS (Freecom SilverStore 2) and it gives me four options to configure the drives in it: single disk, stripe, span, and mirror. I'm guessing single disk is raid-0 and mirror is raid-1, but I can't seem to find a proper layman's explanation as to what the other two are. Can anyone shed a light on this?

Factory Factory
Mar 19, 2010

This is what
Arcane Velocity was like.
Single disk = Exactly what it sounds like. You get one disk.
Stripe = RAID 0
Mirror = RAID 1
Span = concatenation - it's like RAID 0 without striping. Data is distributed across all drives and presented as a single volume, but purely for convenience reasons. Generally easier to recover data in case of a failure. No extra performance gain from striping, no extra data security from mirroring.

Otis Reddit
Nov 14, 2006
welp. managed to post this in the wrong thread entirely. please delete!

Otis Reddit fucked around with this message at 15:32 on Apr 7, 2012

Jolan
Feb 5, 2007

Factory Factory posted:

Single disk = Exactly what it sounds like. You get one disk.
Stripe = RAID 0
Mirror = RAID 1
Span = concatenation - it's like RAID 0 without striping. Data is distributed across all drives and presented as a single volume, but purely for convenience reasons. Generally easier to recover data in case of a failure. No extra performance gain from striping, no extra data security from mirroring.

Thank you, that's exactly what I needed.

Another question: what's the difference between enabling an iTunes server and just having your files on the NAS and imported (but not copied) into your local iTunes library?

evil_bunnY
Apr 2, 2003

ITunes server probably keeps track of changes on the NAS.

wang souffle
Apr 26, 2002

FISHMANPET posted:

The thing that sticks out of me about that hardware is the port multiplier. You'd be much better off getting a SAS card like the IBM M1015 to drive those drives.
This makes me think. What's the cheapest way to reliably run an ESXi box with BSD/OpenIndiana as a VM but with raw drive access to ensure ZFS performance is solid? I would assume a decent RAID/SAS card would be necessary. Would the IBM M1015 fit the bill or is the ESXi setup not a reasonable request?

Edit: Looks like a processor with support for VT-d (Virtualization Technology for Directed I/O) is likely needed here. Sucks that I have an i3 ready for this box.

And an unrelated question: can I assume that converting from RAIDZ1 to RAIDZ2 is not possible?

wang souffle fucked around with this message at 22:18 on Apr 7, 2012

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams

Jolan posted:

Thank you, that's exactly what I needed.

Another question: what's the difference between enabling an iTunes server and just having your files on the NAS and imported (but not copied) into your local iTunes library?

http://en.wikipedia.org/wiki/Firefly_Media_Server

It let's the server act as an iTunes shared library, but it doesn't work with recent versions of iTunes.

Trillest Parrot
Jul 9, 2006

trill parrots don't die
Any suggestions for S.M.A.R.T. monitoring for WHS? I don't know if I should trust the little green "Healthy" icon and no other info.

IOwnCalculus
Apr 2, 2003





wang souffle posted:

This makes me think. What's the cheapest way to reliably run an ESXi box with BSD/OpenIndiana as a VM but with raw drive access to ensure ZFS performance is solid? I would assume a decent RAID/SAS card would be necessary. Would the IBM M1015 fit the bill or is the ESXi setup not a reasonable request?

Edit: Looks like a processor with support for VT-d (Virtualization Technology for Directed I/O) is likely needed here. Sucks that I have an i3 ready for this box.

You're absolutely on the right track there. I have this setup in concept, except that I haven't yet added a M1015 and OI/ZFS yet because I don't have any intermediary storage to migrate the data off of my mdraid array. I am passing the onboard SATA controller directly to an Ubuntu VM and picking up the individual drives that way, and performance is just as good as native...even a bit better than the old / much lower horsepower system it was on before when it was running natively on the hardware.

VT-d is actually better supported on AMD than Intel, because Intel wants to use it as a means to push you towards Xeons. With current-gen stuff you have to have at least an i5 processor, and it can't be a -K version. You also need a motherboard that both supports it and has it enabled, which is mostly server boards like Supermicro, but the Intel DQ67SWB3 also works (and is basically a server board minus the ECC support).

If cost is your primary concern, and you don't get a screaming deal on a lightly used DQ67SWB3 and i5 2400 (thanks, kill your idols!) then the cheapest way to go is the AMD AM3 processor of your choice, and the Asus M5A97 board (this bad boy). AMD treats VT-d/IOMMU as an entirely chipset-based feature, so in theory it should be fine with even a shitass Sempron, though I only tested it myself with an FX-6100.

Adbot
ADBOT LOVES YOU

Rukus
Mar 13, 2007

Hmph.

urbancontra posted:

Any suggestions for S.M.A.R.T. monitoring for WHS? I don't know if I should trust the little green "Healthy" icon and no other info.

Check out Home Server SMART: http://www.dojonorthsoftware.net/Freebies/HomeServerSMART.aspx

WHS 2011's version is in a public beta right now, but it's very close to completion.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply