Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

mayodreams posted:

Why are our vm's so slow!?!



Someone slap the dumb motherfucker who capitalized IOPs like it's the plural of IOP

Adbot
ADBOT LOVES YOU

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

adorai posted:

AHHAAHAHAHAH. My end users have been known to complain if we 10ms for more than a few seconds.

Well, to be fair 10ms of write latency is very different than 10ms of read latency and is more likely cause noticeable application performance changes.

devmd01
Mar 7, 2006

Elektronik
Supersonik
Can someone point me in the right direction of some decent Netapp 101 resources? All of my storage experience has been with Compellent and a little bit of EMC; and I just threw my hat in the ring for a position that uses UCS/Netapp for their vmware clusters.

I'd like to be able to talk somewhat intelligently about it should I get called. "I haven't used netapp, but <compellent concept> translates to <netapp concept>, etc"

socialsecurity
Aug 30, 2003

Trying to get a general Nimble vs NetApp price comparison but can't find solid NetApp numbers can someone give me a general idea of a FAS2520 with 8ish tb. Our Nimble is 25k but I really want that but boss wants to see how much a NetApp would be.

Potato Salad
Oct 23, 2014

nobody cares


NetApp is priced purely on a "How much can I squeeze from your company" basis. You need an actual quote from a vendor. I could write a number here but it would have no meaning.

Thanks Ants
May 21, 2004

#essereFerrari


I can give you a ballpark list price on a bundle in GBP. I can't share partner purchase pricing.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Yea, there's really no way to give useful pricing to someone else since it's based on partner level, promos, how deep the NetApp AM is willing to go, how deep the partner AM is willing to go, and how deep the competition has gone.

But NetApp can certainly be price competitive with Nimble of they choose.

Nimble has been suffering some from financial ills of late, it will be interesting to see if they are willing to discount deep to get customers or if they start feeling pressure to actually make money at some point.

the spyder
Feb 18, 2011
Has anyone done a onsite demo of Qumulo or very unlikely, running it in production? If so, send me a PM. I have some questions that are probably best answered outside of the forum.

Asimov
Feb 15, 2016

Company is considering putting in a whole lot of security cameras, needs to spec ~300 TB of usable space for video footage. Any recommendations for a good mixture of enterprise support and low performance/low cost? My first thought was a Cisco UCS 3160 or 3260 with a bunch of 7200RPM 6TB drives in a RAID 6, but I don't usually deal with arrays that large. Since this is video footage that will be rarely accessed unless needed, reliability and retention are the main considerations.

Computer Serf
May 14, 2005
Buglord
Seeking opinions on a diy FreeNAS / ZFS // EXT4 RAID 10 of Samsung EVO Pro 850 SSDs versus what vendors with optimized file systems might offer?

Potato Salad
Oct 23, 2014

nobody cares


Vendors selling you managed storage will always be more expensive, if that is what you are asking.

Do you intend to do software mirror-stripe within the zfs pool as opposed to hardware raid10?

Finally, I have a hypervisor at home baked by an 850 EVO for production, an old big hdd for local backup and snapshots, and Google Cloud Nearline for archiving. I intend to have the SSD last the (e: sp) five years needed until the next big storage revolution becomes cheaper (probably going to be Intel's ram-like ssd). I host steam servers, minecaft, music streaming, and a few sites. Even under load, I am not projected to go over the EVO's write volume warranty before then.

Are you dead sure you want the PRO?

Potato Salad fucked around with this message at 13:35 on Mar 2, 2016

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Asimov posted:

Company is considering putting in a whole lot of security cameras, needs to spec ~300 TB of usable space for video footage. Any recommendations for a good mixture of enterprise support and low performance/low cost? My first thought was a Cisco UCS 3160 or 3260 with a bunch of 7200RPM 6TB drives in a RAID 6, but I don't usually deal with arrays that large. Since this is video footage that will be rarely accessed unless needed, reliability and retention are the main considerations.
Can't answer this without the I/O requirements or some basic idea thereof. How many cameras writing concurrently? What framerate, resolution, codec? Do they stream video directly to the disk or do they buffer files locally and burst-dump the whole thing at once?

devmd01
Mar 7, 2006

Elektronik
Supersonik

Vulture Culture posted:

Can't answer this without the I/O requirements or some basic idea thereof. How many cameras writing concurrently? What framerate, resolution, codec? Do they stream video directly to the disk or do they buffer files locally and burst-dump the whole thing at once?

Yeah I was about to say, an installation that large your camera installer/var should be doing the legwork for you, and be able to at least provide you with iops requirements, etc.. If they're not going to/can't provide you with a turn-key system or solid specifications for the archiving portion of the storage, then get another VAR.

Potato Salad
Oct 23, 2014

nobody cares


Panda, for some reason I thought I was in the SSD thread, so I answered as though you were building a home system.

What is your budget like, and what kind of capacity do you need? Is this going to back any systems like hypervisors or heavy-load databases?

Potato Salad fucked around with this message at 23:57 on Mar 2, 2016

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Panda Time posted:

Seeking opinions on a diy FreeNAS / ZFS // EXT4 RAID 10 of Samsung EVO Pro 850 SSDs versus what vendors with optimized file systems might offer?

It will be cheaper and also probably slower, not fully redundant and unsupported, so you will become 24/7 support for a system you probably don't fully understand, at least assuming there is any important data on there.

Asimov
Feb 15, 2016

devmd01 posted:

Yeah I was about to say, an installation that large your camera installer/var should be doing the legwork for you, and be able to at least provide you with iops requirements, etc.. If they're not going to/can't provide you with a turn-key system or solid specifications for the archiving portion of the storage, then get another VAR.

Good points, I'll bring it up with the VAR. It's quite early in the project so we were just spitballing. 200 cameras with a mix of models results in 1500 Mbps network datarate, 1250 Mbps storage datarate when I run it through a few online calculators. I'm sure the reseller has some storage people I can talk to. Thanks guys.

Computer Serf
May 14, 2005
Buglord

Potato Salad posted:

What is your budget like, and what kind of capacity do you need? Is this going to back any systems like hypervisors or heavy-load databases?

This is for 4k video w/ a 10G LAN. The budget is 'can I convince the management this is legit for x price and y value versus our current set up'. (50k max?)
I'm considering a smaller SSD hardware RAID 10 of about 2-10TB, along with a few pools of enterprise HDDs totaling 100TB of usable space, in some mix of RAID 6 or RAID 10. I'm a little uncertain about the performance returns versus cost on SAS drives versus SATA for this purpose.

Turn key vendor hardware and custom file systems look to be upwards of $1000/TB, and that's for HDDs not SSDs.


NippleFloss posted:

It will be cheaper and also probably slower, not fully redundant and unsupported, so you will become 24/7 support for a system you probably don't fully understand, at least assuming there is any important data on there.

Assuming we buy a few extra duplicate RAID cards and drives and do backups outside of this system, I think my main concern is any eventual software/file system/electronic level quagmire fuckaroos that might bite me?
:pwn:

Thanks Ants
May 21, 2004

#essereFerrari


If you can get 100TB usable with a bit of SSD from an actual vendor for 50k then I would be more than surprised.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer

Thanks Ants posted:

If you can get 100TB usable with a bit of SSD from an actual vendor for 50k then I would be more than surprised.
You might be able to get a non-HA oracle zfs appliance for close to that.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Thanks Ants posted:

If you can get 100TB usable with a bit of SSD from an actual vendor for 50k then I would be more than surprised.

SSDs aren't especially useful in high throughput applications like this. Spinning media does fine writing big sequential data streams.

Panda Time posted:

Assuming we buy a few extra duplicate RAID cards and drives and do backups outside of this system, I think my main concern is any eventual software/file system/electronic level quagmire fuckaroos that might bite me?
:pwn:

ZFS is a very mature file system, the likelihood of data loss is going to be from misconfiguration on your part or misbehaving commodity hardware. Part of what you pay for when you buy from a vendor is QA on all of the different hardware and firmware pieces and a comfortable assurance that they will behave as expected. For example, how do you know that the disks you buy or the raid controller (that you won't even be using with ZFS) will actually obey a cache flush request properly?

The other half is that storage performance problems can be really tricky to troubleshoot and you're going to be on the hook for that. A system that is serving data too slowly is exactly as useful as a system that is down. And if it's down long enough that's functionally equivalent to a data loss event.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

NippleFloss posted:

SSDs aren't especially useful in high throughput applications like this. Spinning media does fine writing big sequential data streams.
OTOH, enough sequential data streams writing concurrently and you now have a really big random data stream, so the devil's in the details of exactly what's writing and how

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Vulture Culture posted:

OTOH, enough sequential data streams writing concurrently and you now have a really big random data stream, so the devil's in the details of exactly what's writing and how

Yea, but these days most storage, even if you roll your own with ZFS, will journal that in a very small amount of flash and turn it back into a number of sequential streams. Basically the benefit of anything more than a small amount of SSD as a journal will be completely wasted because there will be no appreciable read caching and he can't buy nearly enough SSD to fit all of the workload on it, and it probably wouldn't help too much anyway.

To the OP I'd probably look at NetApp E-series since it's pretty much build for high ingest rate applications and isn't too expensive, though I doubt anything worth buying can be had for ~$500/TB. Isilon would work too, but would probably be overkill.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

NippleFloss posted:

Yea, but these days most storage, even if you roll your own with ZFS, will journal that in a very small amount of flash and turn it back into a number of sequential streams. Basically the benefit of anything more than a small amount of SSD as a journal will be completely wasted because there will be no appreciable read caching and he can't buy nearly enough SSD to fit all of the workload on it, and it probably wouldn't help too much anyway.

To the OP I'd probably look at NetApp E-series since it's pretty much build for high ingest rate applications and isn't too expensive, though I doubt anything worth buying can be had for ~$500/TB. Isilon would work too, but would probably be overkill.
re: write-back, I'd agree for a smaller number of larger streams, but I'm a little apprehensive about just assuming that on 200 parallel writers

e: I agree that spinning disk should be fine but if possible I'd probably go with RAID-10 over something with parity

Vulture Culture fucked around with this message at 06:03 on Mar 3, 2016

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer

Vulture Culture posted:

e: I agree that spinning disk should be fine but if possible I'd probably go with RAID-10 over something with parity
He's talking about 100TB. If he uses 8TB disks then I agree with you, but if he goes with a pile of 2TB disks, even raid 6 will probably need 10 raid groups, which will almost certainly provide the necessary performance.

thebigcow
Jan 3, 2001

Bully!
Whatever you end up doing, don't forget being able to read files while all that stuff is being written. Having the whole thing fall apart because the video you need isn't in cache anymore and the read requests mess up streaming all those writes is no good.

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


If you're using storage that offers CIFS/SMB access, be sure to poke them about BadLock. This looks like it's a protocol bug and if it is your storage OS is likely vulnerable. I'm going to be bugging my NetApp reps ASAP and you should too.

Amandyke
Nov 27, 2004

A wha?

Number19 posted:

If you're using storage that offers CIFS/SMB access, be sure to poke them about BadLock. This looks like it's a protocol bug and if it is your storage OS is likely vulnerable. I'm going to be bugging my NetApp reps ASAP and you should too.

I poked EMC/Isilon about it last week and they're aware of the bug and are investigating... I suppose we'll know more on the 12th.

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


Amandyke posted:

I poked EMC/Isilon about it last week and they're aware of the bug and are investigating... I suppose we'll know more on the 12th.

I got a similar reply from my account team at NetApp. It doesn't instill a lot of confidence in me that they will have something ready.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer
the illumos guys have indicated that illumos is not vulnerable. That gives me hope for our oracle zfs appliances, and honestly, any other NAS with a proprietary CIFS stack as well.

evil_bunnY
Apr 2, 2003

Our current stuff is a pair of Netapp 2240’s with 5TB of 15k drives for VM datastores and 40TB of nearline.

We need ~200TB of nearline and ~15TB for VM datastores, NAS head(s) for at least SMB (current datastore is on NFS, but I’m not married to that), on 10GBE. Our current solution is mainly bottlenecked at the controllers (WAFL writes/CIFS-SMB CPU usage). We ingest of bunch of raw sequencing data on the regular, so being able to scale out to around a PB before EOL would be cool.

I like how the netapp boxes can just serve all the protocols we need, but I have how CPU bottlenecked we are on WAFL writes. Also I'm a grumpy fart and know nothing of CDOT.

Anyone in particular we should talk to? Netapp will show us their plan, Dell is coming soon.

Tegile could do what we want but I don't know how sustainable they are.
Pure is flash only.
Nimble is iSCSI only.

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


It's NetApp's year end so push them. You can probably get big enough controllers that will give tons of CPU headroom if you squeeze them hard enough.

On another note: still no word from NetApp on Badlock. Sit on your storage vendors for info once the embargo breaks if this poo poo is bad. Anyone who does CIFS/SMB is likely affected and will require immediate patching.

Internet Explorer
Jun 1, 2005





Number19 posted:

It's NetApp's year end so push them. You can probably get big enough controllers that will give tons of CPU headroom if you squeeze them hard enough.

On another note: still no word from NetApp on Badlock. Sit on your storage vendors for info once the embargo breaks if this poo poo is bad. Anyone who does CIFS/SMB is likely affected and will require immediate patching.

Microsoft hasn't released anything either. The Badlock page itself hasn't been updated since 3/31. Whole lot of 0 information going around.

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


That means it's either not a huge deal and this is all hype

Or the world burns in 45 minutes

Get yo popcorn I guess :munch:

Nitr0
Aug 17, 2005

IT'S FREE REAL ESTATE

evil_bunnY posted:

Our current stuff is a pair of Netapp 2240’s with 5TB of 15k drives for VM datastores and 40TB of nearline.

We need ~200TB of nearline and ~15TB for VM datastores, NAS head(s) for at least SMB (current datastore is on NFS, but I’m not married to that), on 10GBE. Our current solution is mainly bottlenecked at the controllers (WAFL writes/CIFS-SMB CPU usage). We ingest of bunch of raw sequencing data on the regular, so being able to scale out to around a PB before EOL would be cool.

I like how the netapp boxes can just serve all the protocols we need, but I have how CPU bottlenecked we are on WAFL writes. Also I'm a grumpy fart and know nothing of CDOT.

Anyone in particular we should talk to? Netapp will show us their plan, Dell is coming soon.

Tegile could do what we want but I don't know how sustainable they are.
Pure is flash only.
Nimble is iSCSI only.

Nimble has fibre channel https://www.nimblestorage.com/blog/introducing-our-fibre-channel-san/

evil_bunnY
Apr 2, 2003

We want 10GBE since that's what we have now.

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


Badlock is a wet fart, but your storage vendors still likely rely on Samba for things and it looks like there are lots of Samba bugs that need to be fixed. This might be worse for them than it is for Microsoft. Time will tell I guess.

Moey
Oct 22, 2010

I LIKE TO MOVE IT

Number19 posted:

Badlock is a wet fart

Wait, you don't have file shares out facing the wide open internet??????

Thanks Ants
May 21, 2004

#essereFerrari


How else are people supposed to get to their documents from out the office?

Number19
May 14, 2003

HOCKEY OWNS
FUCK YEAH


https://kb.netapp.com/support/index?page=content&id=9010080

So NetApp stuff will need patches.

Moey posted:

Wait, you don't have file shares out facing the wide open internet??????

It sounded like a RCE against SMB which would have been super exploitable in awful ways. Even if they're not internet facing, it's easy for a malware author to drop something in your network and do terrible things like have access to these systems to launch ransomware attacks or other data exfiltration. As it is the MITM can be used to change file permissions on Samba servers (which most NAS storage vendors implement) meaning that some very bad things still can happen from this.

For Windows this is boring. For Samba integrators? It might be a lot worse.

Adbot
ADBOT LOVES YOU

Thanks Ants
May 21, 2004

#essereFerrari


Glad my NetApp deployment is happening tomorrow and Thursday and not before this patch. I'm sure it's easy enough to do but I'm getting into this gently.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply