Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Tetramin
Apr 1, 2006

I'ma buck you up.

GnarlyCharlie4u posted:

Hey moving buddy! I'm a similar boat. Moving is stressful. We're moving back to our still-under-renovation building.
Nothing is completed and everything is held up due to construction.
Everyone is freaking the gently caress out that we don't have stuff set up, but we can't do anything because we can't even get into our space to actually populate the server racks.
The building is not networked yet because the low voltage contractors can't finish their work until the main contractors get out of there.
I managed to get Verizon in to install FiOS but we are still working on getting them to transform the rest of our POTS lines.
COX and RCN have scheduled installation dates for their stuff.
The only real service provider hiccough is Windstream not getting on the loving ball and ordering a transformation of their PRI with the last mile provider; Verizon.
We can't do it because we aren't VZ's customer for this circuit. Windstream is loving clueless and doesn't even realize the circuit no longer exists (copper was ripped out of the building) and they just keep sending a tech out to 'repair the circuit.

The real kicker is that the person in charge of the elevators is all pissy because they can't be put into use until they have a phone line for the emergency phone.
I have the service for the phones ready to go, but I have no way of getting it to the elevator because there is no handoff to run a phone line to. And yet the person keeps blaming IT because "there's no phone lines for the elevator" when really they just need to get off their lazy rear end and have the elevator company punch down a jack in the elevator room for me to run a phone line to. I guess they'd rather just complain about it though.

:shepface:
Lol, good lord that sounds like a shitshow.

:blastu: anybody who suddenly decides they need a 'change of scenery' for the office and barely plans or communicates.

Adbot
ADBOT LOVES YOU

Tetramin
Apr 1, 2006

I'ma buck you up.
Got a phone call this morning, cryptolocker infection!!!! Text files demanding 30 btc on all of our exchange and production CMS systems needed by about 40 different locations.

Going to be a long loving day

Tetramin
Apr 1, 2006

I'ma buck you up.

Proteus Jones posted:

That sucks.

Tell me you have backups/deployment images.

We’ve got backups. It seems to be the ryuk ransomware. Already have at least one report of fraudulent bank activity from a user who had their direct deposit info saved on their network home drive. Trying to figure out a way to notify users while email is down without causing a huge panic. Will be interesting to find out how this got in but i have a feeling I’ll be on this call for the next 24 hours straight.

Tetramin
Apr 1, 2006

I'ma buck you up.

Antioch posted:

We got hit by LockerGoga a couple weeks ago. Took us entirely by surprise, had most of our poo poo cryptoed to the nines before we even started getting alerts. Couple days of 12-14 hours, some tense restores and all is mostly well again. Plus a week of uninterrupted downtime was a great opportunity to upgrade almost everything, from server 2016 to the wiring in the switch closet to replacing an old firewall and cleaning up rules.

And get this. We were originally going to be "paid" in time in lieu, but an offhand comment about "also working for money" that was overheard by the CEO fell on sympathetic ears, and we all got actual honest to god cash bonuses, a full week's pay at 1.5x. Actual real money!

I'm going to make "I survived Crypto Crisis 2019" stickers and t-shirts.

We are currently on the 3rd straight day of recovering from ryuk. I’m on the network team so there’s luckily not a whole lot for me to do on this, but yeah day 1 was about 16 hours for me, day 2 was 12, we’ll see about today. Critical services are mostly restored so we’re getting there, but this has been wild. We paid out the rear end to a security contractor to help with this and they’ve been worth every penny to help plan and keep things on track. My manager put in like 36 hours straight from when it started lol

No talk of how we will be compensated for the extra time yet but I’m sure it’ll just be some extra time off

Tetramin
Apr 1, 2006

I'ma buck you up.
Our ticketing system got wiped out by cryptolocker and the data is most likely gone :hellyeah:

Tetramin
Apr 1, 2006

I'ma buck you up.
E: ^^^ are you loving kidding lol? Love sweeping policy changes because a big wig had a stupid rear end question and couldn’t find somebody

I was wondering if you’d even get a link lol

Tetramin
Apr 1, 2006

I'ma buck you up.
55k as a network admin. I was making 62 in support at a software company but had a stretch of unemployment before accepting this offer. At least I’m enjoying the work WAY more, but still feel like I hosed myself by not negotiating at all. My 2nd job in my 4 years in the IT area of work

Tetramin
Apr 1, 2006

I'ma buck you up.
I may have a bad PTO plan, but oh boy do I rack up the comp time! Haven’t had to use any PTO yet! :cenobite:

Tetramin
Apr 1, 2006

I'ma buck you up.
Manager asked me and other networking dude if one of us can start our shift at 7 instead of 830 to improve coverage. To be fair, we do see a fair amount of issues right before we make it into the office. Other guys been here for like 7 years and I feel lovely not doing it because of stupid respect for seniority, but on the other hand, I’m lazy and already have trouble getting there before 830 lol. Moving my shift up an hour and a half would probably seriously affect my relationship with the job and my boss.

Not really sure how to tackle this, we both made it clear that neither of us want this. Might have to team up and just say no to the boss

Tetramin
Apr 1, 2006

I'ma buck you up.

GnarlyCharlie4u posted:

By order of the CTO.
It was not our Network Eng's idea... but I didn't hear any argument from him either.

Lol executives get the most idiotic bugs in their rear end and make outrageous sweeping changes for sure, but this one is a doozy

After spending hundreds of thousands recovering from ransomware I’m impressed that the CIOs only big change was removing admin access and shared domain accounts. Which, you know, is a good idea

Tetramin
Apr 1, 2006

I'ma buck you up.

angry armadillo posted:

I've just had someone in the office who has given me yet another anecdote of their experience of my helpdesk dude getting angry over trivial poo poo. Obviously there are issues.

On the one hand it's tricky to broach the subject because no one is ~actually~ complaining it's a bit more like 'oh hey I said this and helpdesk dude really reacted badly to it you know'

My theory on it was the scope of what we support is rather broad so he is still being exposed to new things and his bad reactions are coming from not know what to do, so in our little kinda monthly management catch up I pointed out people don't ring up IT support to be told you can't help them so I am going to (not literally) ban the words no and can't - the reason I'm doing this is because even if someone says can you fix system X and we don't support it, rather than saying no, why don't you say, sorry but can you give person X a call or submit ticket Y - signposting the person to the right place will get you 10x a better response than just saying no.

Then let's take the example of something you don't know how to do, why don't you just say you'll go over and take a look, then if you don't know you can say 'oh need parts' (etc) the person will be so much happier that someone turned up promptly then getting an answer of 'dunno how to do that bye' - whilst that might technically waste time I think encouraging my dude to work with people will reap the benefit that people will want to reciprocate and work with him which will ultimately keep everything streamlined.

I know we don't go to work to make friends but I need to manage some people skills into this dude before I do actually get a formal complaint. Luckily today's anecdote came from a dude who is really chill but if next time it's someone a little bit more uptight I am getting some kind of grievance sooner or later haha.


This really has very little to do with IT, but I wanted to vent a bit :)

In my software support job I always had a ton of empathy for the customers and would absolutely try to figure out the problem even if it didn’t have much to do with our software, but you do need to be able to say (something nicer than) no sometimes. Like you said there’s a hundred ways to put it without being a huge prick.

Nearly all of the most senior support guys at that job would straight up yell at a customer if they reacted poorly to “we don’t support that call your company IT” it was ridiculous to me how they kept getting promoted and rewarded for that. “But hell they sure do close tickets!” is what my manager would say, until I showed him a spreadsheet of cases that they previously worked and closed that I wound up having to work on and resolve.

Tetramin
Apr 1, 2006

I'ma buck you up.

TheFace posted:

I've been offered a promotion at work that would involve stepping into management on a level I've never managed before. I've been "IT Director" of a small company where really I just managed a single help desk person and I was the main engineer. I later became "Infrastructure Manager" for that companies parent company, but again I didn't actually manage people, it just meant I had decision making power.

This role would involve managing a team of around 15 people, which makes me nervous. Anyone have any advice for someone entirely new to managing people?

I’ve never been in management but drat that’s a big team to manage by yourself. If you’ve got some senior infrastructure people who are trustworthy see about delegating some of the stuff to them.

My manager and director deal with around 10 people total and pretty much all of the tech decisions are made by the team and just brought to them for approval, they have tons of stuff going on and don’t have time for it even with the smaller headcount.

Tetramin
Apr 1, 2006

I'ma buck you up.
Flying out to run my first building move tomorrow. God I hope this goes well, I’ve got a guy from the service desk coming with me and I think we have a solid plan, and are as prepared as we can get at the new building.

Pretty nervous about it though, everything’s gotta be live by Monday morning.

Tetramin
Apr 1, 2006

I'ma buck you up.
Well day one of the building move I coordinated was a fuckin shitshow. The rest of the weekend went really well except for a sysadmin blaming my dhcp config for his iLO not being reachable from vpn or other subsets after we moved his server. I could reach it locally so I screenshared with him and saw that he didn’t check the “receive default gateway from dhcp” checkbox.

Our MPLS provider is taking their drat time to get their circuit up so we are sending voip over vpn for now, absolutely zero other concerns right now.

Plus I got to play some poker in Reno for a few days. I consider it a success.

Tetramin
Apr 1, 2006

I'ma buck you up.
I just found out my company has a habit of shitcanning half of IT every couple years as one of the first steps to save some cash. Just hope the next round comes after I’ve put enough time in to be ready to hop to something better paying.

Tetramin
Apr 1, 2006

I'ma buck you up.
I kinda threw a coworker under the bus on Friday. We have another location moving and he’s been coordinating(the other network dude was kinda involved) and I get on a call to activate their mpls and phone circuit since other network guys out of office. I’m like yeah just bring the existing router config over and put these static routes in. Wind stream tells me that the entire architecture has to change and we haven’t gotten these guys on Cisco yet as they’re a super new acquisition, so the phones are supported by a third party vendor.

Move was supposed to be this weekend but basically windstream marked it as a failed activation because other than the above, the avaya equipment wasn’t on site yet which meant they couldn’t test SIP. I argued with the tech for like 45 minutes before the guy handling the move called the whole thing off.

My CIO called me up to see what’s going on and all I had for him was “I dunno man, (coworker) has been insisting on dealing with all the vendors”. The coworker sent probably 100 emails trying to fix his mistake all day before admitting that the move needed to be delayed. I wish I could’ve helped him but drat

Tetramin
Apr 1, 2006

I'ma buck you up.
We are having a strange reorg here too. Both the infrastructure and applications(content management systems for our locations) directors have been stolen by the CIO supposedly to work on some big acquisition we’re bringing on. They’ve brought on people to take their roles last week. I really liked the infrastructure director, He had a networking background and was overall really easy to have discussions with and he was able to relay concerns to upper management effectively.

The new guy seems nice and respectful, I’ve already sat down with him several times to discuss issues and concerns, but I looked up the company we contracted him from and they’re “efficiency specialists”. Looking forward to my upcoming meeting with the Bobs lol.

I guess I always have major worries when management drastically changes, it takes a long time for new management to reveal their true colors.

Tetramin fucked around with this message at 03:05 on May 21, 2019

Tetramin
Apr 1, 2006

I'ma buck you up.
Do any of y’all use Solarwinds Orion? Our installation is incredibly slow and frustrating. I think they hosted the db on a shared instance, could this be the reason?

Anybody ever been able to make it responsive and not mind numbingly slow? I’m starting to take over administration of it and it’s super frustrating. Too many drat features

Tetramin
Apr 1, 2006

I'ma buck you up.

GnarlyCharlie4u posted:

Yes, we use it.
Yes, ours is also terrible, but we host it ourselves. You have to throw a ridiculous amount of resources at it to make it less terrible.

Yeah we used to have IPMonitor which was excellent and fast, the systems people(who no longer have time to admin Orion after a ransomware attack) pushed to replace it with Orion. Us networking people used ipmonitor successfully for like 8 months until that server got owned by the malware. Now I’m being asked to run the administration of Orion because we aren’t rebuilding ip monitor and it’s loving hell. I can’t even get a sysadmin to look at the resources because they’re so busy.

I’d very much prefer to stand up ip monitor again and just be done with it. This shits not even in my wheelhouse and I have no power to make changes that let it run more efficiently

Tetramin
Apr 1, 2006

I'ma buck you up.

skipdogg posted:

We run the full SolarWinds stack, and it's not terrible, but we throw a ton of resources at it. We have 9 pollers total, plus a very large database server. Each poller is 12 cores/24GB RAM, the main server is 16 cores, 40GB RAM, and DB is 24 cores, 120GB RAM.

We also have 2 full time guys that manage the environment and they're constantly dealing with support.

That is huge lol. I’ll need to look into what kind of resources are allocated in our environment. My feeling is that the DB is bogging things down. I’m pretty sure we are using a shared sql server but it should be on its own. Navigating the web UI is loving awful.

Tetramin
Apr 1, 2006

I'ma buck you up.
I work at a company who uses software by the company I used to work implementations for. We lost our environment from malware and these mfs are now trying to sweet talk me into troubleshooting for them after we paid them 35k to rebuild our environment lol. My days of reading your application logs are over guys, sorry

Tetramin
Apr 1, 2006

I'ma buck you up.

Zero VGS posted:

"Wow, our product manager said that your incredibly simple tweak which takes 5 minutes of coder time would indeed be a huge help to you, and would greatly improve our product as a whole. Please spend 30 minutes writing it up even though we understood it the first time, and submit it to our community suggestion page, where it will do battle royale with all the other basic quality-of-life improvements we should have implemented in the first place. With enough votes and in a few years time, it just might make the cut and be of use to future generations."

I mean yeah, but from a dev perspective isn’t it better to have a PM who pats the customer on their head before politely telling them to gently caress off to the suggestion portal, rather than shoving changes to the front of the line because a customer asked?

Tetramin
Apr 1, 2006

I'ma buck you up.

Internet Explorer posted:

I'm already calling to deal with whatever stupidity your product is doing. Have the service rep note the feature request and stop asking your customers to do your work for you. Bonus points if your suggestion portal requires you to register a completely new account because your regular support credentials don't sync.

I mean I agree with you, I’m on the customer side of things and get the same song and dance all the time, but people at software companies seem to prefer to never do anything at a customers insistence.

The classic “yin and yang” :downs:

Also i have vendor who’s particularly bad that seems to reset my password to their “success center” every week or two, I even stored my past couple pws in keepass wondering if I’m just stupid but no, gotta reset every time I wanna log in.

Tetramin
Apr 1, 2006

I'ma buck you up.
Our director blew the telephony budget on sx10s and sx20s for video conferencing stuff. We set one up in our IT conference room as a test and the other 4-5 are collecting dust in the empty cubicle next to me. Harebrained fuckin ideas that they don’t follow through on

Tetramin
Apr 1, 2006

I'ma buck you up.

GreenNight posted:

That’s some expensive equipment to gather dust.

Indeed. I don’t blame the director though everybody in this company seems to obey every whim from senior management. The C levels want 20k+ of conferencing gear, they get it. At the cost of us not being able to afford phone replacements and stuff without eating up the network equipment budget.

Part of it was also ordering two daisy chainable conference phones(8321? Forget the model) and two mic kits for their executive conference room because people on cell phones have a hard time hearing people in the room. My boss was down at corporate and deployed one phone and mic kit and it sounded perfectly fine when I was testing with him from my cell. we later were told we need to make it so people shuffling papers around while sitting by the mics isn’t so loud..

All of this poo poo gets forgotten about by the time we even get the equipment bought and shipped to us lol

Tetramin
Apr 1, 2006

I'ma buck you up.

CAPS LOCK BROKEN posted:

I did not, but I did mentally file it away into my big pile of red flags and added it to the growing sense of dread and unease.


Custom framing and art supplies. Which made the pressure cooker bullshit even crazier.


Jesus christ

Lol that quote from intuit makes me loving sick wow

Tetramin
Apr 1, 2006

I'ma buck you up.

Dr. Arbitrary posted:

We've gotten really dependent on slack, but the question has come up to how to handle notifications for dire emergencies. After a lot of brainstorming we realized we'd invented the pager.

Lol, we discussed setting Orion up to send emails to everybody’s cell#@everycarrierunderthesun.com for certain things since a lot of us don’t have email notifications turned on

Tetramin
Apr 1, 2006

I'ma buck you up.

Zorak of Michigan posted:

Why spend money when you can make your employees half-rear end a solution for free? It's not like the IT staff have better things to do, right?

Yeah if it ever comes up again I will push for pager duty, seems perfect.

That discussion fizzled out like a lot of things in this organization, it was after our core switch failed(a reboot brought it back up) and we were wondering how to get ahead of it quicker than somebody from service desk calling us.

really on call works fine for us, when there is an all hands on deck situation it’s never been an issue getting in touch.

Tetramin
Apr 1, 2006

I'ma buck you up.
Had the pleasure of going to the datacenter saturday night to swap our 2 ASA's due to a factory defect in every one we bought when we went from sonicwall to asa. cables didnt have enough slack to pull the devices out so i got to reach up and around our core switch to snap pics of the cables, and blindly stick labels on them, and then do the reverse when i got the new ones mounted. lol it took me like 4 hours to swap out two devices and test. to be fair this was my first time going there, but i did not think it was cabled so poorly.

Tetramin
Apr 1, 2006

I'ma buck you up.

22 Eargesplitten posted:

Good boss: the picky guy who knows a lot.

Bad boss: the woman who knows a little but has a job.

Emphasis on woman being the bad part!

Tetramin
Apr 1, 2006

I'ma buck you up.

TerryLennox posted:

Reminds me of my current boss.

You guys are accruing too much OT, my budget!!

Can I opt out of oncall?

No.

Are you going to get additional personnel to distribute the workload and oncall rotation.

Upper management says no.

So...you expect us to do what exactly?

...

Man your boss is a piece of crap with no spine

Tetramin
Apr 1, 2006

I'ma buck you up.

22 Eargesplitten posted:

How would you tell work/life balance in an interview? Work/life balance is the main complaint I’m seeing for this job I have a phone interview for tomorrow, and I have no interest in working a job that makes me do tons of overtime because I’m (actually legally qualified as) exempt.

"When was the last time you took an extended vacation" has usually been a good one for me. You can usually tell whether they're making up a good sounding answer on the fly or are answering honestly.

I had a list of some others that are good for this type of concern too, I'll try to dig them up.

Tetramin
Apr 1, 2006

I'ma buck you up.

Exit Strategy posted:

New Company has a thread in our chat software about "supporting Macs in production" with the first post being just a screencap of a new middle manager asking and a picture of a Fisher-Price logo.

I thought smartphones had their own, separate wifi network here, and didn't need to be on the production net even if they come in a big-boy case like a real computer.

Haha! Epic. My golden man babies to you good sir

Tetramin
Apr 1, 2006

I'ma buck you up.
One of our ATT toll-free numbers isn't working right now, for a location we do not have current billing paperwork or account info for. I have spent 3.5 hours so far today navigating phone menus, being hung up on, transferred to hundreds of departments.

I just can't get a motherfucking tech on the phone to tell me if there's a network issue going on or what. I wonder how long I've been dead and in hell.

Tetramin
Apr 1, 2006

I'ma buck you up.

tango alpha delta posted:

The first time I was laid off, I took it personally. The first time my manager overloaded me with work, it was very hard not to be pissed off.

The trick is to treat your job like a river that flows past your house. Grab as much water as you can and save it for the inevitable rainy day.

Always have a backup plan so that you aren't at your employer's mercy.

With a backup plan in place, the stupid poo poo your company pulls won't be as personal because you will be in a position of strength.

I am wishing i lived this way. I’ve been going hard on my debt since I started my current job. Now my bosses are jumping with joy over $200/mo saved by cancelling some services. It’s looking like end of quarter in sept might be very bad and I’m not in a position to be unemployed comfortably.

If I make it through I’m changing how I do things lol.

Tetramin
Apr 1, 2006

I'ma buck you up.
Well My manager and director have been pushing hard to cut spending by quarter end, and they walked out two people on the service desk today. Have a meeting with all of IT scheduled for this afternoon and I have a feeling it won’t be good. gently caress I’m not ready to be back on the hunt.

Tetramin
Apr 1, 2006

I'ma buck you up.

Sickening posted:

Cutting the budget by 25% and letting people go abruptly isn't a sign that your business is doing well.

Yeah. I feel like I should've been sending resumes out since the start of August but I have only done a couple. The warning signs were definitely there.

Guess I've got an activity to do every evening until I find something else. Not gonna stick around to see how it all shakes out. Honestly I'm lucky to have made it through. Other than the two service desk employees I'm the most recent hire, though I'm in networking.

Found out at the meeting they also let the director of IT at our biggest acquisition go today, and they say that's all the separations IT will experience, but other departments aren't wrapped up yet.

e: How specific should I be about the reason I'm looking after only 9 months when I'm interviewing? Just say budgetary concerns and leave it at that?

Tetramin
Apr 1, 2006

I'ma buck you up.
Anybody know a way to mitigate email bombing? My coworker started getting spammed like crazy the other day, hundreds of emails every few minutes. It worked because they had compromised his account to our corporate Verizon account and bought like 9 iPhone 11s lol.

But what the hell can you do when this sort of thing happens?

Tetramin
Apr 1, 2006

I'ma buck you up.

Lord Dudeguy posted:

Email security gateways (Proofpoint, Sonicwall) will usually have throttling rules that knock that poo poo off, and then it'll send InfoSec/Ops an alarm that something's fishy.

What to do when it happens? Sounds like you did everything right except the throttling.

We have infrascales, i dont know what that does besides report phishing. Otherwise our exchange dude shrugged and said “change your smtp” lmao.

It’s an interesting tactic to me. Just blowing up somebody’s email with legit emails like signing up for newsletters or whatever to cover your massive purchase. I should’ve gotten myself a new phone

How do those tools identify crap versus real communications though? I think my coworker has 500 belly rub points to claim if anybody is interested.

Adbot
ADBOT LOVES YOU

Tetramin
Apr 1, 2006

I'ma buck you up.

kensei posted:

This. Your Exchange guy sucks.

I will be sure to stage a huge speech where i loudly tell him this.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply