Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Bob Morales
Aug 18, 2006


Just wear the fucking mask, Bob

I don't care how many people I probably infected with COVID-19 while refusing to wear a mask, my comfort is far more important than the health and safety of everyone around me!

bigmandan posted:

What's the main drive for upgrading? Depending on what that is will dictate what solution will work for you. Do you need more performance, capacity, features, etc.. ?

Would like more of everything but it's mainly "this is 3-4 years old and we should get a new one"

Adbot
ADBOT LOVES YOU

bigmandan
Sep 11, 2001

lol internet
College Slice

Bob Morales posted:

Would like more of everything but it's mainly "this is 3-4 years old and we should get a new one"

It's been awhile since I looked at pricing from Nimble, but I think their entry solutions are near that price point. A quote I have from about a year ago was ~20k CDN for a step above entry.

bigmandan fucked around with this message at 16:37 on Sep 21, 2015

Internet Explorer
Jun 1, 2005





Bob Morales posted:

We have (I think) a Dell MD3200 that only has the external SAS connectors, and only 2 of those. We have 2 servers running VMware (just the lowest paid version). Basic Linux and Windows file servers, no big databases or anything. I think we have like 1.5TB worth of stuff.

It's coming up on 3 years old, what are my options? Ideally I would like an all-SSD based solution, is that possible for < $15,000? Is there a good solution that makes good use of SSD-caching?

I'd like to go to something iSCSI-based (there are no network ports in our current PowerVault), but are there really any advantages or disadvantages to doing that? I don't really see adding any more hosts in the near future. We're hopefully getting rid of about half the VM's we run by moving to a cloud-based ERP.

I really like the SAS DAS models for shared storage deployments that are never going to grow beyond 3 hosts. If you are not going to grow I would think long and hard before moving to iSCSI or FC. Unless you just want to gain experience with a "proper" SAN. The SAS DAS solution is super simple, super cheap, and significantly faster than what you can do at entry level prices.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

There's basically nothing you can get from an established vendor for less than 15k. NetApp, Nimble, and Tegile are all going to start above 20k for the lowest end models unless you get some outrageously good discounts. You may want to look at VSAN licensing (probably going to be too expensive) or something like a Dell VRTX.

Bob Morales
Aug 18, 2006


Just wear the fucking mask, Bob

I don't care how many people I probably infected with COVID-19 while refusing to wear a mask, my comfort is far more important than the health and safety of everyone around me!

Internet Explorer posted:

I really like the SAS DAS models for shared storage deployments that are never going to grow beyond 3 hosts. If you are not going to grow I would think long and hard before moving to iSCSI or FC. Unless you just want to gain experience with a "proper" SAN. The SAS DAS solution is super simple, super cheap, and significantly faster than what you can do at entry level prices.

That makes sense. I had never used a DAS unit like that before, we had a couple NetApps at my last gig (and we only had 3 hosts, and migrated to 2) so that's what I know.

Rhymenoserous
May 23, 2008

bigmandan posted:

It's been awhile since I looked at pricing from Nimble, but I think their entry solutions are near that price point. A quote I have from about a year ago was ~20k CDN for a step above entry.

Nimble entry level has about 3-4 times more storage than he needs. At 1.5TB I wouldn't buy anything fancy.

beepsandboops
Jan 28, 2014
Are DAS just traditionally JBOD, or do they ever have more advanced features like dedupe, compression, hybrid flash, etc.?

Gwaihir
Dec 8, 2009
Hair Elf

beepsandboops posted:

Are DAS just traditionally JBOD, or do they ever have more advanced features like dedupe, compression, hybrid flash, etc.?

They're pretty much always just drive enclosures hanging off a typical RAID controller doing raid 0/1/5/6/10/50/60 etc. Nothing more than that and the cache on the controller itself.

Maneki Neko
Oct 27, 2000

beepsandboops posted:

Are DAS just traditionally JBOD, or do they ever have more advanced features like dedupe, compression, hybrid flash, etc.?

You're going to need whatever is connecting to it to do that magic.

Stealthgerbil
Dec 16, 2004


I have been looking at building my own directly attached storage device. From my understanding, I can get a separate case and a device like http://www.newegg.com/Product/Product.aspx?Item=9SIA24G28M7361&cm_re=sas_expander-_-16-117-207-_-Product + a tiny motherboard to provide power and then connect it to an existing HBA in my server?

I was reading this guide http://www.servethehome.com/sas-expanders-diy-cheap-low-cost-jbod-enclosures-raid/ and it seems like an interesting option. this is not for anything mission critical, just for holding backups and stuff.

I have a current setup that uses windows storage spaces with a JBOD array set up in a mirror and it has been great. I have just run out of sata ports and plan on getting an HBA. However I also will need to get a case to hold all of these drives anyway which is what led to me looking at various directly attached storage devices.

I just want to future proof so I can expand even further. The cost of direct attached storage device is crazy and I would love to build my own, especially if I could buy a $250 expander card + a case with 24 hot swap bays instead of a synology box which would cost more then a months rent.

Wicaeed
Feb 8, 2005
What's the opinion on EMC Isilon? Company I started working for has a 400-something TB setup that we just dropped 80k on for software renewals. Only problem is the guy who set the drat thing up is two years gone, nobody has a clue as to how this thing runs.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

Wicaeed posted:

What's the opinion on EMC Isilon? Company I started working for has a 400-something TB setup that we just dropped 80k on for software renewals. Only problem is the guy who set the drat thing up is two years gone, nobody has a clue as to how this thing runs.
If you don't need to change NFS exports, you can probably just leave it plugged in and it will work fine until your support contract runs out.

Rhymenoserous
May 23, 2008
Just send someone off to the EMC certification class. If you have an isilon it's worth doing.

BonoMan
Feb 20, 2002

Jade Ear Joe
Hey guys I have a conceptual question as I'm new to all of this fiber what-nots.

I do motion graphics and visual effects (and sometimes some editing) for an ad agency and our colorist is right next door to me. We're gonna get this QNAP Thunderbolt2/Fiber NAS/DAS combo: https://www.qnap.com/solution/thunderbolt-nas/en-us/index.php

So that we can work on shared storage instead of constantly round-tripping to each other.

Obviously we both need Fiber cards in our systems and a sort of fiber switch (a few more devices may connect in the future... also the thunderbolt 2 ports will be taken up by an LTO backup). But I'm not sure where to go besides that.

Someone at work recommended this 10gig switch: http://www.amazon.com/NETGEAR-ProSA...=Netgear+XS712T

and these cards: http://www.newegg.com/Product/Product.aspx?Item=N82E16833106184

So I'm guessing Fiber goes from the QNAP to the Combo ports on those switches and then the Cat 6A/7 from the switches to the computer cards?

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

BonoMan posted:

Hey guys I have a conceptual question as I'm new to all of this fiber what-nots.

I do motion graphics and visual effects (and sometimes some editing) for an ad agency and our colorist is right next door to me. We're gonna get this QNAP Thunderbolt2/Fiber NAS/DAS combo: https://www.qnap.com/solution/thunderbolt-nas/en-us/index.php

So that we can work on shared storage instead of constantly round-tripping to each other.

Obviously we both need Fiber cards in our systems and a sort of fiber switch (a few more devices may connect in the future... also the thunderbolt 2 ports will be taken up by an LTO backup). But I'm not sure where to go besides that.

Someone at work recommended this 10gig switch: http://www.amazon.com/NETGEAR-ProSA...=Netgear+XS712T

and these cards: http://www.newegg.com/Product/Product.aspx?Item=N82E16833106184

So I'm guessing Fiber goes from the QNAP to the Combo ports on those switches and then the Cat 6A/7 from the switches to the computer cards?

There's no fiber in that config. The QNAP has 10G-BaseT ports, which are normal RJ-45 copper ports.

BonoMan
Feb 20, 2002

Jade Ear Joe

NippleFloss posted:

There's no fiber in that config. The QNAP has 10G-BaseT ports, which are normal RJ-45 copper ports.

Uh, what the hell? I don't know what I was looking at. I swear when I initially researched it it said fiber. As well as having cute little diagrams about how to setup the fiber switch. Now that I go back to it I can't find a single mention of anything like that anywhere on QNAPs site. Did I fall into a loving black hole or something?

Potato Salad
Oct 23, 2014

nobody cares


Speed of 10GBase-T = Speed of 10GBase-SR. Doesn't matter. In truth, optical transceivers add more latency to each jump than copper RJ-45 ports, so if you have copper 10GbE available to you and you aren't spanning distances greater than 100m, the fiber doesn't add any value outside, say, future proofing against future end-to-end fiber upgrades if you see that sort of thing happening in this NAS's operational lifespan in your environment.

If one or both of you can attach to a 10GBase-T switch, you are golden.


Eight drives providing 20Gbit throughput? That's 313MB/s per spindle in non-redundant Raid 0, which sounds like a stretch.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Potato Salad posted:

Speed of 10GBase-T = Speed of 10GBase-SR. Doesn't matter. In truth, optical transceivers add more latency to each jump than copper RJ-45

Base-T latency is an order of magnitude higher than SFP+ owing to the encoding scheme required.

But for high throughout operations running on spinning drives that won't matter much. The other reason to use SFP+ is the host side adapters are cheaper and more plentiful.

Potato Salad
Oct 23, 2014

nobody cares


NippleFloss posted:

Base-T latency is an order of magnitude higher than SFP+ owing to the encoding scheme required.

But for high throughout operations running on spinning drives that won't matter much. The other reason to use SFP+ is the host side adapters are cheaper and more plentiful.

My understanding was previously the other way around for the case of top-end networking copper networking gear. I'm going to go do more reading to make sure. Thanks.

Thanks Ants
May 21, 2004

#essereFerrari


I've never understood 10Gbase-T - if it's going a short distance, use SFP+ direct attach because it's cheaper. If it's going further then you're going to have to replace whatever you have with Cat6a anyway so just put fibre in.

I guess it could make sense if you're doing shortish drops to video workstations and don't want to constantly break fibre terminations. Anyone else got a use case for it?

Potato Salad
Oct 23, 2014

nobody cares


Thanks Ants posted:

Anyone else got a use case for it?

Yeah, environments that are irrationally terrified of the danger presented by solid state optics. Mind, this is a research environment and not all the IT techs have the necessary skills to handle OMG LAZURS safely. On paper, environment safety protocol on some projects does not distinguish between the devices on Optics Bench #482 and the SFP+ interface in the back of Joe's desktop. I and a few others who actually do networking poo poo have degrees and/or training with fiber optics, but...yeah.

My own sphere of influence is going 10GBase-SR as we speak, so some progress is being made.

Potato Salad fucked around with this message at 22:07 on Sep 25, 2015

Minus Pants
Jul 18, 2004

Potato Salad posted:

My understanding was previously the other way around for the case of top-end networking copper networking gear. I'm going to go do more reading to make sure. Thanks.

Yeah 10GBASE-T is around 1-2 usec slower than DAC or fiber depending on the PHY.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Potato Salad posted:

My understanding was previously the other way around for the case of top-end networking copper networking gear. I'm going to go do more reading to make sure. Thanks.

One example: http://www.cisco.com/c/en/us/products/switches/nexus-3000-series-switches/models-comparison.html

Thanks Ants posted:

I've never understood 10Gbase-T - if it's going a short distance, use SFP+ direct attach because it's cheaper. If it's going further then you're going to have to replace whatever you have with Cat6a anyway so just put fibre in.

I guess it could make sense if you're doing shortish drops to video workstations and don't want to constantly break fibre terminations. Anyone else got a use case for it?

The biggest appeal is backwards compatibility and low interconnect cost. If you're not upgrading everything to 10G at the same time the fact that you can plug in plain 1G RJ-45 and it will work is very appealing. Think upgrading your storage to a new 10G compatible array but not having the budget to update all of your ESX hosts.

Also, SFP+ optics are expensive and can add up quickly, and DAC cables aren't always an option due to length restrictions or a need to integrate 1g copper devices.

CrazyLittle
Sep 11, 2001





Clapping Larry
Also DAC cable vendor compatibility, which is still a thing last I checked.

Potato Salad
Oct 23, 2014

nobody cares


CrazyLittle posted:

Also DAC cable vendor compatibility, which is still a thing last I checked.

Huge thing, even with verified twinax pairings. Server/storage vendors and networking vendors will point fingers at each other "it's their fault it's not negotiating 10Gbit" while your direct-attach support tickets rot away unresolved.

Edit: Going 850nm over twinax tacked another 10% on to our most recent system update + convergence project, but at every turn we've been proverbially pulled to the side and told "I wouldn't loving trust it." There's a future unrelated use for fiber anyway.

Potato Salad fucked around with this message at 02:18 on Sep 27, 2015

KennyG
Oct 22, 2002
Here to blow my own horn.
I'm looking for a smb/cifs splitter. Basically I have billions files at //fs01/share and need to move it to //fs02 but can't take the 30 day outage to copy the 100tb off a 1gb link. I know this is a thing with some sans but I want to set up a third party proxy to do it.

If I setup a splitter that would prioritize reads and writes from //fs02 and fail back to //fs01 if the data hasn't yet been written to the new location. I know this is more complicated than it appears but it is really a dead simple concept on its face. Someone has to do it. Anyone know of a solution?

devmd01
Mar 7, 2006

Elektronik
Supersonik
You can't just map the volume to the new server?

KS
Jun 10, 2003
Outrageous Lumpwad
Or cname it.

Or drop a standalone DFS root in front of it.

Without knowing more, what you're describing is possibly overly complex.

adorai
Nov 2, 2002

10/27/04 Never forget
Grimey Drawer

KennyG posted:

I'm looking for a smb/cifs splitter. Basically I have billions files at //fs01/share and need to move it to //fs02 but can't take the 30 day outage to copy the 100tb off a 1gb link. I know this is a thing with some sans but I want to set up a third party proxy to do it.

If I setup a splitter that would prioritize reads and writes from //fs02 and fail back to //fs01 if the data hasn't yet been written to the new location. I know this is more complicated than it appears but it is really a dead simple concept on its face. Someone has to do it. Anyone know of a solution?
why can't you just use a few robocopy threads to do it? Get them close to synced and then schedule a few hours to finalize.

1000101
May 14, 2003

BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY BIRTHDAY FRUITCAKE!

adorai posted:

why can't you just use a few robocopy threads to do it? Get them close to synced and then schedule a few hours to finalize.

This is pretty much what we've done for these large migrations. You probably don't have 100TB of change every day so pre-stage as much as you can then just do a final cutover.

Rhymenoserous
May 23, 2008

Minus Pants posted:

Yeah 10GBASE-T is around 1-2 usec slower than DAC or fiber depending on the PHY.

And DAC cables are cheap as gently caress. Honestly 10g fiber is pretty loving close to commodity pricing these days. I don't even see the point of 10GBASE-T anymore.

Rhymenoserous
May 23, 2008

1000101 posted:

This is pretty much what we've done for these large migrations. You probably don't have 100TB of change every day so pre-stage as much as you can then just do a final cutover.

https://technet.microsoft.com/en-us/magazine/2009.04.utilityspotlight.aspx

Spawns multiple robocopy threads/does everything robocopy does, with a gui. You can even control how many copy threads it fires up at a time. It's a lifesaver for migrations and it's also free.

Amandyke
Nov 27, 2004

A wha?

Wicaeed posted:

What's the opinion on EMC Isilon? Company I started working for has a 400-something TB setup that we just dropped 80k on for software renewals. Only problem is the guy who set the drat thing up is two years gone, nobody has a clue as to how this thing runs.

Isilon is pretty easy. My team manages ~40PB of isilon in primary and replication clusters. If you have any questions I can help out, just pm me.

skipdogg
Nov 29, 2004
Resident SRT-4 Expert

We're an EMC shop and not happy about this potential EMC/Dell acquisition/merger news. Guess we'll have to go back to NetApp if Dell f's up EMC like I know they will.

Vulture Culture
Jul 14, 2003

I was never enjoying it. I only eat it for the nutrients.

skipdogg posted:

We're an EMC shop and not happy about this potential EMC/Dell acquisition/merger news. Guess we'll have to go back to NetApp if Dell f's up EMC like I know they will.
This has serious consequences for VMware and Pivotal as well :smith:

They managed to not really gently caress up Force10 though, so maybe it won't be a colossal wreck, just a regular wreck?

Internet Explorer
Jun 1, 2005





I have serious doubts about a Dell/EMC merger. But I'll take Dell over EMC any day of the week.

I can't imagine Dell getting VMware in any potential merger.

parid
Mar 18, 2004
Anyone going to Insight? Any tips on what not to miss?

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

parid posted:

Anyone going to Insight? Any tips on what not to miss?

I'll be there. The level 3 and 4 breakout sessions are usually pretty good. Also try to do some free cert testing while you're there.

YOLOsubmarine
Oct 19, 2004

When asked which Pokemon he evolved into, Kamara pauses.

"Motherfucking, what's that big dragon shit? That orange motherfucker. Charizard."

Internet Explorer posted:

I have serious doubts about a Dell/EMC merger. But I'll take Dell over EMC any day of the week.

I can't imagine Dell getting VMware in any potential merger.

Well, it just happened. I'd guess Compellent goes away, some EMC product lines get trimmed, and there's a bigger push towards hyperconverged. Also guessing that ScaleIO becomes Dell only.

Adbot
ADBOT LOVES YOU

Internet Explorer
Jun 1, 2005





NippleFloss posted:

Well, it just happened. I'd guess Compellent goes away, some EMC product lines get trimmed, and there's a bigger push towards hyperconverged. Also guessing that ScaleIO becomes Dell only.

Pretty crazy news. Going to be an interesting time once it gets approved.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply