|
Devian666 posted:I'm always trying to avoid building a freenas box for home use but I know I'll end up at that point sometime in the next year. However I know that there are a lot of data hoarders here. How many of you have considered using GlusterFS when one nas box isn't enough?
|
#
?
Feb 5, 2013 04:18
|
|
|
|
| # ? May 6, 2024 06:56 |
|
|
Longinus00 posted:Industry standard has been to slash warranties on consumer HDs. As has been mentioned WD Blacks are 5 years but unfortunately they're also relatively expensive and 7200rpm. Yeah, thats what I figured. 3 years is what I'll target. Thanks for the info.
|
|
#
?
Feb 5, 2013 06:03
|
|
|
I'm currently retrying a virtual ZFS fileserver setup. This time with FreeBSD, which runs remarkably well under Hyper-V, I have to say. I get up to 30MB/s of network traffic on an emulated network adapter without jumbo frames, and Samba 3.x of all things. I tried to stick to Storage Spaces, but it's so goddamn retarded right now, it's practically useless. For one, it can't balance disk space properly, when mixing different redundancies over drives added at different points of time (resulting in varying fill grades), and actual resilience relies on the file system on top. And the really only practical option is ReFS, which isn't shipped by default with client Windows (yet), and is relatively kneecapped in functionality, too (i.e. it can only recover from mirrors, but not parity spaces, for whatever reason). Kind of sad that Windows has an installable file system API, but no one even considered porting ZFS over. Combat Pretzel fucked around with this message at 14:47 on Feb 5, 2013 |
|
#
?
Feb 5, 2013 14:43
|
|
|
I'm soon to be emigrating from the UK to Canada and I'll be taking my Microserver with me. I've never transported something like this before, and don't know the best practice. Do i ship all the drives together, or do I do split or individual shipments? My array consists of five drives and is RAIDZ2. I'm thinking the drives will go by DHL or something, then send the chassis along with my furniture as freight. Also, does anyone know where I can buy decent packaging for shipping drives? Preferably cardboard with padding, kinda like the ones new HDDs come in?
|
|
#
?
Feb 5, 2013 20:32
|
|
|
How much actual data do you have? Might be worth buying 1 3tb drive and backing your data up to it just in case, then shipping the whole server with drives and all.
|
|
#
?
Feb 5, 2013 22:38
|
|
|
tarepanda posted:Does anyone have a source for hot swap drive caddies that fit in the N40L bay? The HP replacements are ridiculously expensive. If anyone else was wondering, I measured the Proliant caddies and they won't fit -- they're something like 15 cm too long and use the opposite orientation. :x Any other options? Replacement drive cages?
|
|
#
?
Feb 5, 2013 22:52
|
|
|
We have a Promise SmartStore DS4600 connected to a Mac Mini via Firewire. Our network file transfers have recently become very slow, which I have verified with a local disk benchmarking program. Writes are only going about 4MB/s but reads are going 30-40MB/s depending on whether I connect using FW800 or USB 2.0. I loaded Promise's SmartNAVI program but SMART the drives are fine. There are two 2TB WD20EARS-00MVWB0, one is F/W 51.0AB51 and the other is 50.0AB50. Should I buy a whole new NAS (we're using 1.5TB right now) or just get two new drives to replace what's in there? We backup each night to another external HD so I'm not worried about the data itself, I just don't want to spend a whole day re-initializing two brand new drives, restore our data, and then have the unit still act up.
|
|
#
?
Feb 5, 2013 22:55
|
|
|
Those are 4k-sector drives, and the performance you're describing sounds like an alignment issue. Those drives aren't on the original compatibility list for that device, but they are on the most recent version. You might need to do a firmware update to ensure compatibility, but that still won't fix the current alignment issue without reinitializing the disks.
|
|
#
?
Feb 5, 2013 22:59
|
|
|
Star War Sex Parrot posted:Those are 4k-sector drives, and the performance you're describing sounds like an alignment issue. Those drives aren't on the original compatibility list for that device, but they are on the most recent version. You might need to do a firmware update to ensure compatibility, but that still won't fix the current alignment issue without reinitializing the disks. An alignment problem isn't going to just pop up over the weekend, right? This setup has been running for like 3 years. I'm almost thinking of replacing it just go with a 3TB or 4TB model because it looks like we might cross the 2TB mark in a year or so.
|
|
#
?
Feb 5, 2013 23:09
|
|
|
Bob Morales posted:An alignment problem isn't going to just pop up over the weekend, right?
|
|
#
?
Feb 5, 2013 23:12
|
|
|
A year ago I built a Freenas machine using an AMD E350 motherboard and 6 2TB drives in RaidZ2. It's worked great but I'm running low on space so I need to upgrade. Now, I could buy 6 3TB drives and do the slow replace/resilver dance, adding about 4TB more space, but then I'd be left with all those perfectly fine 2TB drives sitting around doing nothing. I'm considering buying a card to add more sata ports and adding the 3TB drives as another RaidZ2 array into the pool, thus adding about 12TB of extra space. But I have a few questions. First, will my 430 watt power supply be able to handle the extra 6 drives? Second, are there any recommendations for a good card to add sata ports? I know the IBM M1015 is highly recommended, but I'm having trouble finding a place to buy a new one for a decent price. Are there any other good cards I should be look for, or should I suck it up and grab a used one off ebay?
|
|
#
?
Feb 6, 2013 04:46
|
|
|
If you want up to eight additional drives, the M1015 is definitely your best bet. No reason not to get one used, the only kicker with it is you have to get the correct cable since it doesn't have standard SATA connectors.
|
|
#
?
Feb 6, 2013 04:59
|
|
|
g0del posted:First, will my 430 watt power supply be able to handle the extra 6 drives? Typically a modern 3TB drive will suck up to 1 Amp over the 12V rail on initialization, of which there is plenty of in your 430W PSU. You only have to get a lot of Sata->2xSata or Pata->2xSata power adapters to actually fit them, but those come in very cheap. And ebay is the recommended way to snatch a M1015.
|
|
#
?
Feb 6, 2013 11:41
|
|
|
Today I bought an N40L and added 8GB RAM, an SSD, and a single 3TB WB Red (more to come, but not for RAID). I installed the bios mod and sped up all SATA ports, and I installed ubuntu-server because I'm familiar with it, along with sabnzbd and sickbeard. All seems to be working well, I just have a couple of questions: 1. I get about 100MB/s copying my data from my old machine via samba. That's pretty good, isn't it? I hear people suggesting Intel NICs for them but it seems like that would be overkill. 2. Are there any power options I need to look at in the bios? I'd like the fan to adjust according to temp, the CPU to step according to load, and the HDDs to spin down when not in use. Or are these things I'll need to fix in ubuntu? That's all, thanks!
|
|
#
?
Feb 6, 2013 13:54
|
|
|
deep square leg posted:Today I bought an N40L and added 8GB RAM, an SSD, and a single 3TB WB Red (more to come, but not for RAID). I installed the bios mod and sped up all SATA ports, and I installed ubuntu-server because I'm familiar with it, along with sabnzbd and sickbeard. All seems to be working well, I just have a couple of questions: 2: The technology is called Speedstep for Intel CPUs and either Cool'n'Quiet or PowerNow! for AMD cpus. The PWM fan is already linked to the cpu die temperature monitoring in the BIOS. HDDs powering down can be managed with powerd, all you need to do is configure it. However do be aware that most HDDs don't use much power in idle and using powerd actually causes wear and tear when the harddisk parks its head. BlankSystemDaemon fucked around with this message at 15:15 on Feb 6, 2013 |
|
#
?
Feb 6, 2013 15:11
|
|
|
deep square leg posted:Today I bought an N40L and added 8GB RAM, an SSD, and a single 3TB WB Red (more to come, but not for RAID). I installed the bios mod and sped up all SATA ports, and I installed ubuntu-server because I'm familiar with it, along with sabnzbd and sickbeard. All seems to be working well, I just have a couple of questions: I was getting speeds between 65MBps and 80MBps on the intergrated Realtec 8111F card, but I regularly get 100-120MBps with intel NICs. They can be had for around $20, so it is up to you to decide if that is over kill or not. It really depends on your use case. Speaking of my NAS, I finally got FreeNAS up and running. I started with NAS4Free, and it was working well. But I was having some issues getting SABNZBD set up and managed to break my NAS web interface in the process. I know it would have been easy to fix, but I figured I would take the time to try FreeNAS. I found FreeNAS's web UI to be a little less cluttered, but some of the options were not as intuitive. I honestly think that both products need a little work in the UI, especially with on screen help. I ended up sticking with FreeNAS because of it's jail based plugin system. FreeNAS has a web interface for configuring and managing jail based plug ins, and there are several available on their forums. Most importantly for me, there are premade ones for SAB, CP, Sickbeard, etc. I ran in a couple of small issues getting the jails set up, mostly related to documentation not clarifying best practices for the jail paths. But I was able to get it all sorted out. I could probably write up a short little guide that walks through the steps I took to get it all working and what to avoid if there is any interest.
|
|
#
?
Feb 6, 2013 17:05
|
|
|
Can someone expand on GlusterFS? The site is gibberish to me. Clustered, multi-host file system?
|
|
#
?
Feb 6, 2013 18:01
|
|
|
As you stated it's a cluster file system. It was designed to deal with supercomputing storage issues. It can be scaled up to petabytes and can be distributed over different locations including into cloud storage. The replication settings remind me of the windows home server so you could set it to have only 2 or 3 copies across multiple disks or nodes. From what I've looked at glusterfs is very efficient in relation IO and disk activity. e: Fixed ipad spelling syndrome. Devian666 fucked around with this message at 01:17 on Feb 7, 2013 |
|
#
?
Feb 6, 2013 18:24
|
|
|
g0del posted:Second, are there any recommendations for a good card to add sata ports? I know the IBM M1015 is highly recommended, but I'm having trouble finding a place to buy a new one for a decent price. Are there any other good cards I should be look for, or should I suck it up and grab a used one off ebay?
|
|
#
?
Feb 6, 2013 18:49
|
|
|
adorai posted:How much actual data do you have? Might be worth buying 1 3tb drive and backing your data up to it just in case, then shipping the whole server with drives and all. I only have about 3tb of data, so that's actually a really good idea. Maybe I'll send it ahead, then get someone to confirm that all the data is intact etc before shipping my NAS.
|
|
#
?
Feb 6, 2013 20:05
|
|
|
I have a N40L with FreeNAS installed on an internal USB, and I am getting tired of how slow it takes to load the OS (~4.5 minutes) along with the random large file transfer crashes I get on files over 4-5gb which I am assuming is due to the internal USB being only 4gb. I'm thinking of finally buying a cheap SSD to put under the top optical drive slot (that has my 5th HD) and connecting the SSD to the back eSATA port via a eSATA<->SATA cord that I have. My question is what is the state of software raids on Windows Server? Better than ZFS? I'd like to eventually be able to use this NAS as an output device to my TV, something I can't do on FreeNAS easily, to get rid of the old laptop that I am using for tv output now. Moving to Windows would help the machine to be a good media player, but I don't know anything about how raids are on WinServ machines these days-- especially software raids.
|
|
#
?
Feb 6, 2013 22:29
|
|
|
My brother was complaining that his WD Passport wasn't working. I plugged it into my Macbook and it gave me this: Any thoughts on what's wrong with it?
|
|
#
?
Feb 6, 2013 22:41
|
|
|
The filesystem needs to be fixed and the Mac won't do that, so it is telling you to do it in Windows. If it also doesn't work in Windows, maybe something is wrong with the disk or controller.
|
|
#
?
Feb 6, 2013 22:43
|
|
|
D. Ebdrup posted:1: Short of enabling jumbo frames, you can't get better speeds on a gigabit NIC (1024Mbps/8=128MBps, without overhead - overhead is substantial at around 5-10% of maximum theoretical depending on setup). Something to think about, thanks. I won't access it very often so originally I thought I might just get it to hibernate or shut down for most of the day, then wake at 5pm to do its downloading ready for use that night. But then I thought it would be little more power to keep the system on an SSD and just spin down the HDDs. Mainly I just want to shut the fan up, and it's not, so the CPU must still be hot (assuming PWM is working correctly). Lowen SoDium posted:I was getting speeds between 65MBps and 80MBps on the intergrated Realtec 8111F card, but I regularly get 100-120MBps with intel NICs. They can be had for around $20, so it is up to you to decide if that is over kill or not. It really depends on your use case. I'm already getting around 100MB/s but since they are that cheap I'll have a look, cheers.
|
|
#
?
Feb 6, 2013 23:41
|
|
|
Can I get some tips on how to not suck at ZFS and/or Nexentastor? I'm trying to run a simple 2TB drive with deduplication on for NFS to use with some esxi backups and the write performance is absolutely dreadful. The box has 32G of ram dedicated to it and all the optimizations I could make for NFS and not having a cache or log drive. Is there something I'm missing or is dedup performance on Nexentastor really just bad compared to opendedup without going nuts on hardware? Fake edit: I'm getting around 5-10MB/s average with dedup on compared to 30-40 average without it. That's really drastic. Master Stur fucked around with this message at 03:09 on Feb 7, 2013 |
|
#
?
Feb 7, 2013 03:06
|
|
|
jeeves posted:I have a N40L with FreeNAS installed on an internal USB, and I am getting tired of how slow it takes to load the OS (~4.5 minutes) along with the random large file transfer crashes I get on files over 4-5gb which I am assuming is due to the internal USB being only 4gb. I'm thinking of finally buying a cheap SSD to put under the top optical drive slot (that has my 5th HD) and connecting the SSD to the back eSATA port via a eSATA<->SATA cord that I have. As for software RAID on Windows it's...software RAID on Windows. Performance isn't amazing, but it's not terrible, and you're limited to the normal RAID levels unless you want to look into something funky like Storage Spaces. So the closest thing you get to ZFS is RAID 5, which has a few downsides compared to ZFS. Of course it's a lot easier to get video out to your TV under Windows, but something like the WD TV Live! is cheap and very effective at its job, and will happily pull videos from a N40L with FreeNAS/NAS4Free. DrDork fucked around with this message at 03:30 on Feb 7, 2013 |
|
#
?
Feb 7, 2013 03:26
|
|
|
Master Stur posted:Can I get some tips on how to not suck at ZFS and/or Nexentastor? I'm trying to run a simple 2TB drive with deduplication on for NFS to use with some esxi backups and the write performance is absolutely dreadful. The box has 32G of ram dedicated to it and all the optimizations I could make for NFS and not having a cache or log drive. Is there something I'm missing or is dedup performance on Nexentastor really just bad compared to opendedup without going nuts on hardware? ZFS dedup is a performance killer, but 32GB of RAM versus 2TB stored seems like it should be more than enough even for ZFS.
|
|
#
?
Feb 7, 2013 05:06
|
|
|
Master Stur posted:Can I get some tips on how to not suck at ZFS and/or Nexentastor? I'm trying to run a simple 2TB drive with deduplication on for NFS to use with some esxi backups and the write performance is absolutely dreadful. The box has 32G of ram dedicated to it and all the optimizations I could make for NFS and not having a cache or log drive. Is there something I'm missing or is dedup performance on Nexentastor really just bad compared to opendedup without going nuts on hardware?
|
|
#
?
Feb 7, 2013 05:29
|
|
|
Master Stur posted:Can I get some tips on how to not suck at ZFS and/or Nexentastor? I'm trying to run a simple 2TB drive with deduplication on for NFS to use with some esxi backups and the write performance is absolutely dreadful without going nuts on hardware? If you still insist on using it, change the checksum algorithm to a faster one. Chances for collisions become higher tho, resulting in data errors.
|
|
#
?
Feb 7, 2013 08:57
|
|
|
adorai posted:RAM doesn't really help with writes. VMware on NFS does synch writes, so until the OS tells VMware that is has completed the write, VMware is going to wait. Get an SSD (or two) for ZIL. I thought you could turn that off though by disabling sync on the volume? The various Nexenta forum threads I read had some conflicting information but it does seem like the ram utilization is a giant clusterfuck if you don't have a log and cache drive. Using snapshots might work, but this setup was going to be more of a backup to the primary storage and on opendedup we were getting around a 90% dedup rate. I guess this means I shouldn't waste my time on FreeNAS for deduplication then? There's a few little things about opendedup that make me shy away from it (i.e. a complete idiot needs to be able to use it, not just me) but is there any other free or relatively cheap alternative to get good dedup performance?
|
|
#
?
Feb 7, 2013 13:46
|
|
|
I'm building my first home file server and are going to use 4 WD Red 3 TB disks in raid 5. Also going with Asus P8Z77-M motherboard with an i3 and 8 GB ram. I want to run this under Windows, so should I use the motherboard raid, Windows raid (either Win7 or Server 2012), get a hardware raid controller or just something else?
|
|
#
?
Feb 7, 2013 15:26
|
|
|
With 9TB of usable diskspace, I'd suggest a hardware RAID with battery backup. The last thing you want to deal with is the array rebuilding after a stupid power outage. This'll be dragging your performance down for almost forever. Windows' software-RAID does the same poo poo. At some point I got tired of the disks going on a semi-eternal grind every time the power grid gets a poo poo fit.
|
|
#
?
Feb 7, 2013 16:05
|
|
|
DrDork posted:Unless you're trying to transfer the file to the USB stick itself for some reason (you shouldn't be), if you have FreeNAS set up correctly it shouldn't really be doing much with the USB stick once it finishes loading. It's much more likely that you have some wonky setting, or that your network isn't playing nice with the Realtek NIC. Dropping a SSD into it isn't a bad plan if your complaint is response times and multi-user performance, but it's unlikely to fix file transfer issues. Is there any way I can test to try to really single it down to the NIC? Or should I just buy a new NIC regardless since I've heard from multiple sources over the years that the on board NIC is terrible? DrDork posted:As for software RAID on Windows it's...software RAID on Windows. Performance isn't amazing, but it's not terrible, and you're limited to the normal RAID levels unless you want to look into something funky like Storage Spaces. So the closest thing you get to ZFS is RAID 5, which has a few downsides compared to ZFS. Of course it's a lot easier to get video out to your TV under Windows, but something like the WD TV Live! is cheap and very effective at its job, and will happily pull videos from a N40L with FreeNAS/NAS4Free.
|
|
#
?
Feb 7, 2013 20:25
|
|
|
Master Stur posted:I thought you could turn that off though by disabling sync on the volume?
|
|
#
?
Feb 7, 2013 22:17
|
|
|
adorai posted:You can, if you don't care about data integrity. Those writes are synchronous for a reason. I turned it off to test performance under different scenarios, suffice to say it ultimately didn't matter. To clarify, I would be using synchronous writes in the end, but I turned them off as well as messed with other settings to see if I could get NexentaStor dedup performance anywhere close to acceptable without throwing SSDs at it. I had figured 32gb of ram would be enough, but nope. I blew that away and tried FreeNAS 8.3's implementation of zfs and it ran faster and more consistently, but still not up there with opendedup. Unfortunately iSCSI didn't really improve much over NFS so we went ahead and ordered a cheap SSD for testing purposes. Master Stur fucked around with this message at 22:59 on Feb 7, 2013 |
|
#
?
Feb 7, 2013 22:39
|
|
|
Combat Pretzel posted:With 9TB of usable diskspace, I'd suggest a hardware RAID with battery backup. The last thing you want to deal with is the array rebuilding after a stupid power outage. This'll be dragging your performance down for almost forever. Ignoring the 3rd world power grid you appear to be dealing with, wouldn't one be able to buy like 3 quality UPS units for the price of a hardware RAID card with battery backup? Just plug in the cable and set the OS to shutdown once the battery hits whatever threshold and you shouldn't really have to worry about this particular issue again...
|
|
#
?
Feb 7, 2013 23:18
|
|
|
Yeah, BBU hardware RAID is mostly to deal with the possibility that your UPS doesn't kick in or burns through the available power and your system resets / shuts down abruptly, not as the primary protection against the RAID write hole.
|
|
#
?
Feb 8, 2013 00:07
|
|
|
Fancy_Lad posted:Ignoring the 3rd world power grid you appear to be dealing with, wouldn't one be able to buy like 3 quality UPS units for the price of a hardware RAID card with battery backup? Yes, looking at prices I could get another disk or two + an UPS for the price of a decent raid card with battery support. This brings me back to my first question, what is the recommended software raid option under windows? (From what I see around I should stay away from Intels motherboard raid).
|
|
#
?
Feb 8, 2013 01:07
|
|
|
Zankul posted:what is the recommended software raid option under windows? (From what I see around I should stay away from Intels motherboard raid). Flexraid is what I used for Windows based software Raid. Worked really good for me. http://snapraid.sourceforge.net/compare.html breaks down a bunch of other's.
|
|
#
?
Feb 8, 2013 01:13
|
|
|
|
| # ? May 6, 2024 06:56 |
|
|
kill your idols posted:Flexraid is what I used for Windows based software Raid. Worked really good for me. I currently use FlexRaid on Windows as well, great feature set, no complaints other than it costs money.
|
|
#
?
Feb 8, 2013 13:20
|
|
