Reddit Sysadmin – Telegram
mariadb vs mysql

We run both of these, seemingly at random and we need to pick one and standardize. Which do you run and why?

https://redd.it/1p4bunv
@r_systemadmin
Stepping back

Not even sure why I'm posting this other than I don't have anyone else to rant to.

I've been in IT since 1988. Got my start in the dealer channel back when there was such a thing. Been with a non profit for the last 15 years and I'm just burned out. I've watched things go down the tubes since Covid. Quality of the people being hired has gone down the toilet (talking about "regular" staff, not IT. Shit... I am IT except for the CTO.)

Currently putting out resumes for a lower level desk side support to help desk position. Don't give a shit about pay cuts. Just need to get through the next few years till I can file for SS.

The only reason I don't call it quits tomorrow is because my wife needs health insurance. I can get covered through the VA. She can't and she's not old enough to get medicare yet.

I used to love what I do. Now I'm just disgusted with the level of stupidity, apathy, and lack of respect for our profession that seems to permeate my company.

Thanks for listening to this old jarhead rant.



https://redd.it/1p4d5ev
@r_systemadmin
What makes a good sysadmin?

What do I have to do and need to know to be a sysadmin? I'm currently still new to the IT field, but I know I want to be a sysadmin one day, but I don't think I fully know what it takes.

https://redd.it/1p4dptn
@r_systemadmin
What’s your guys top Christmas wishlist items?

Looking for inspiration for this holiday season.

Looking for something cool/useful for both work and play. I feel like the cool tech of the last couple decades are slow and boring now.

Looking for some cool fun tech! That’s also useful potentially.



https://redd.it/1p4dvb4
@r_systemadmin
IT ops and sysadmins. What would your ideal office include?

A rare chance has come up. I am planning the layout for a brand new space for our IT team of 18 that we will move into next year. What features, amenities, and tools do you wish your office had. I am also toying with a small decompress corner using a modular floor sofa that can switch from quick huddle seating to a short rest between imaging cycles https://adorncroft.com/product/french-daybed-sofa-evan/?utm\_source=reddit&utm\_medium=social&utm\_campaign=product&utm\_content=sysadmin

I am after ideas that are useful for the business and for quality of life.

Context. We image and service about 1,700 rugged field tablets for first responders, so devices cycle through the room often. Suggestions that account for staging, charging, and repair flow are very welcome.

https://redd.it/1p4gh1k
@r_systemadmin
Recovery partition keeps reappearing in File Explorer after removing drive letter - tried everything

I have a 1GB recovery partition on my Windows laptop that keeps getting assigned a drive letter (D:) and showing up in File Explorer every time I restart, even after I remove the drive letter.

**What I've tried so far:**

1. **Removed drive letter via Disk Management** \- comes back after restart
2. **Changed partition type ID via DiskPart:**

​

set id=de94bba4-06d1-4d40-a16a-bfd50179d6ac

1. **Set GPT attributes:**

​

gpt attributes=0x8000000000000001

1. **Both methods combined** \- still reappears after restart

**My setup:**

* Disk 0: 476.92 GB
* Partition 1: 100 MB EFI System
* Partition 2: 16 MB Reserved
* Partition 3: 475 GB Primary (C:)
* Partition 4: 1024 MB Recovery (keeps showing as D:)

Has anyone else dealt with this? What am I missing? I want this recovery partition to stay hidden permanently.

https://redd.it/1p4p8mu
@r_systemadmin
Services Running on Administrator Accounts

Hi,

I found multiple Windows services in production that are running using the DOMAIN\Administrator account. I know this is not recommended, but I want to understand the correct and secure way to fix this issue. What is the proper method to replace these high-privileged accounts with a safer alternative, especially in environments with SQL servers and other critical applications?

Also, how should this be tested properly before applying in production, and what are the common problems or breakages that can happen when changing service accounts from Domain Admin to restricted accounts? If anyone has best practices or real examples from enterprise environments, please share.

Thank you.

https://redd.it/1p4hjj9
@r_systemadmin
The Coverup

Trillion dollar company.

Mid level managers covering up the true cause of major outage that I discovered and fixed.

While these guys are yelling to restore major infra I’m doing packet captures showing the culprit.

I make a change, problem resolved.

The root cause of 3 major outages has now been caused by 1 guy who is careless and protected by mid level managers. No one even remembers that I fixed these outages and how no one else in any team would be capable of finding it. VPs have no idea. I’m simply telling the truth not saying I’m a God of troubleshooting. But these guys I work with are click ops cowboys who can barely type cmd.exe

Mid level managers are not telling the true root cause to anyone. As I said, they have forgotten, as always, that I found the root cause and fixed the mother clucker. They have the memory of a guinea pig.

Now VPs want meetings on how we’re going to have to spend to horizontally scale to fix the fake narrative. So I have to spend the weekend building PowerPoint fake narrative solution.

My conscience and dignity are worth more. But I certainly cannot quit.

Don’t ya’ll just hate the cluster of VPs who are NEVER around until a problem occurs.

I respect these VP guys who we keep in the dark nonetheless but what a dumb reality that they are nowhere near the trench warfare and day to day but will inject themselves into the crisis with sudden urgency.

If I expose the cover-up I am toast. I fantasize about sending a confidential email but that is a nuclear bomb I’m avoiding.

Happy to be employed but god these stupid fucks all around just suck major ass.

Funny seeing young people posting here everyday asking about the road to high paying IT jobs.

Don’t fucking do it. Do everything you can to go to law school. Do not do IT. Stop and turn around. Unless you are an extraordinary high achiever stay the fuck away.

Graybeard in Hell.



https://redd.it/1p4ko0z
@r_systemadmin
How green am I?

I think what I'm looking to learn from this is where my current experience would normally land me on the totem pole in a larger company. I'm not quite 30 and currently work at a hardware startup of about 25 people. I have a degree in physics, started out at this company a few years ago as a mechanical engineer and machinist because of my hobbies, and now for about 6 months I've been the sole IT guy because we needed it and I have experience from my homelab. I have no certs in literally anything. That being said, here's what I've done and currently do:

* Set up and administer microsoft 365 tenant across Teams, Exchange, Entra, Intune, Sharepoint, etc. I recently migrated a bunch of legacy systems using ForensiT profwiz, and set up a process to enroll new devices using Autopilot. Currently rolling out MAM for personal devices and doing the slow grind of getting all devices compliant so I can implement conditional access policies
* Purchased and installed some Supermicro servers for Proxmox and Truenas with replication between our two locations and a cloud storage provider, and put the rest of the rack together (UPS, switches, environmental sensor, etc)
* Set up backups for all the things. i.e. Cubebackup for Sharepoint, Urbackup for certain windows and linux devices. Trying to reduce cloud reliance (lol) and single points of failure
* Gutted our awful Eero routers and set up Unifi networking and protect equipment. Made vlans to segregate staff, servers, local services, and PLCs. Set up our security cams, will probably set up Unifi access equipment soon
* Spin up and administer all of our local services like Grafana, Vaultwarden, aforementioned backups, Nextcloud, Bookstack - in Debian VMs in Proxmox, with scheduled backups to Proxmox Backup Server. Much ansible going on here
* In the process of evaluating traditional vs overlay VPNs like Tailscale/Netbird, evaluating SIEM/XDR like Wazuh, rolling out Admin by Request, working on a presentation to push Knowbe4 phishing prevention training (has been an issue...), and writing company policy for stuff like AI use, remote access, break glass accounts, privilege management, etc

I feel like I've kind of been speed running stuff because we started from zero lol. My only real management experience comes from training and managing a jr CNC mill programmer. Because I've not been "in the industry", If I were to go to a theoretical new employer with this information, I don't even know where I land or what position I'd want to ask for.


EDIT: I should also mention a few more items:

* I have a homelab, a 3-node Proxmox cluster, which runs a lot of my self hosted services like Nextcloud, Immich, Home Assistant, etc. I have high availability set up with ZFS replication, and I've played around with Ceph.
* I've got some Traefik reverse proxies set up for both local DNS and externally exposing certain services with valid certs, and using Crowdsec to ban IPs. I'm keeping any service that doesn't NEED to be external, internal, and certain services like uptime-kuma are on a VPS. I was using Pihole as a dhcp server when we had the Eero router, but have since switched to Unifi.
* I have our backup strategies and dataflows mapped out using draw.io and Bookstack, along with any other information that shouldn't live only in my brain.

https://redd.it/1p4nz9l
@r_systemadmin
What's the next step for you guys?

Just curious. What's next for you guys? Systems engineer, something else, or are you comfortable where you are?

https://redd.it/1p4u3j0
@r_systemadmin
Users receiving Microsoft MFA SMS code when they did not initiate a login

Hi everyone!

I have two users over the past 4 days who have received Microsoft MFA SMS codes that they did not attempt any Microsoft login during the time they came in. The codes also came from the same number as authentic text codes come from. I had the two users change their password the first time it occurred just to be safe if a bad actor had their login credentials and I signed the users out of all sessions though the 365 admin portal just in case the bad actor had the users session tokens, but last night one of the users received another SMS code. I looked all though Entra in sign-in log's, Audit log's, Multifactor Authentication Activity... but can't find nothing during the time the codes came in!

I tested another account to see if a sign-in log appears in Entra if a user gets to the MFA prompt when signing into Microsoft but does not know the code or types in a bad code, but nothing appeared in the log's.

Is there another place I should be looking? could this just be SMS spoofing sending the code to the users?

Thanks!

EDIT: Guys.. I think I found the issue. Entra Admin Center> Authentication Methods > Policy's > SMS > "Use for sign-in" is check marked.... users were probably apart of a Microsoft phone number login spray attack. When logging into Microsoft with a phone number "instead of email" it sends a SMS code to the users phone to sign in.

I am going to confirm with my team on Monday and at least get that check marked off if not get SMS MFA turned off and have Authenticator app be the primary like mentioned in comments below.

Thanks for all your help everyone!

https://redd.it/1p4ryu4
@r_systemadmin
Raid 10 disk failure

I’ve had a disk failure on a dell server running Server 2016

I took the failed disk out and put it back in, the disk has gone from orange to green but now the raid configuration is asking if I want to clear the foreign configuration

I’m guessing it’s not recognising the failed disk as part of the original raid setup.

Windows wouldn’t boot with the failed disk, had auto repair cycle but now the server doesn’t think it has a bootable drive.

How screwed am I?

If I take out the failed disk and put a clean one in will all be restored? 😩

https://redd.it/1p4rkdp
@r_systemadmin
What was your "Dream Sysadmin Job" back in the day vs. Now?

I used to dream of managing a cool server room, but after watching tech events, I realized the new goal is becoming an "AI Architect". So i wanna be ready for this future. And i wanna ask, what was your dream sysadmin job?

https://redd.it/1p4xy3p
@r_systemadmin
Small Business/Church IT setup

I’m looking for recommendations on an IT setup for my church. I have limited experience, but I’m a fast learner. The current setup includes a 24 port managed Cisco Switch on its last legs. We have a solid modem, the router is old and I plan to replace it, I’ll need a good quality managed PoE switch, maybe 24 port, but I’m only using 16 ports now. All the WAPs are failing and will need to be replaced. We have 7, but I can’t get by with 4. We currently have 7 Ethernet connected computers, four laptops that can be connected via WiFi and we run a livestream, so we need a strong VLAN setup to protect that signal. I want at least three separate VLANs that I can isolate (office, media, and guest), and I want good security (firewall?) to protect the network. We have a security camera setup that is separate from this network that is already managed and needs only a single internet port. The camera just needs a PoE port and functions on NDI. We just replaced all the desktop computers with new HP Business profile Windows machines. It is primarily our WiFi that is completely down. My IT guy thinks all the WAPs are just too old and their firmware is out of date and beyond updating. Bottom line, I’m looking for the best recommendation for a high quality, cost effective, router, 24 port managed PoE Switch (with VLANs, QoS, security), and 4 high quality WAPs (or whatever we are calling wireless access points now).

https://redd.it/1p50np7
@r_systemadmin
What's the politically correct/professional wording for calling/wording a company and telling that company, that's aggressively pushing their software to the cloud? They are charging 8x the fee for an on-prem migration compared to their cloud solution which isn't mature. We can't change supplier

And no it's not Broadcom (haha).
They have 5% of their clients on that cloud solution today. They will do major changes to how it works as well for the end-users in the coming months, which means retraining hundreds of users. Our current on-prem server is dying and it's a critical program (thanks to the previous sysadmin who never maintained it).
Edit: We don't mind to pay the on-prem fee, the thing is if we do they still force us to the cloud next year...

https://redd.it/1p5199l
@r_systemadmin
Backhaul Pain + Security Policies… is there a better way?

Been thinking about how companies secure remote users and cloud apps lately. One thing keeps bugging me: all that old school VPN and firewall backhaul. Seriously, forcing traffic through a central datacenter? Latency spikes, weird routing, and making policies stick everywhere feels impossible sometimes.

Some vendors promise “cloud-native secure access” or “unified network and security,” but from what I’ve seen, it’s not always obvious if it really fixes the problem or just slaps a modern label on old tech. And honestly, monitoring PoPs and ensuring consistent enforcement globally? That’s another headache entirely!!!

So I’m wondering, are people actually running setups that merge routing and security at the edge properly, keeping policies consistent and avoiding backhaul pain? Or is it still mostly VPN/firewall patchwork pretending to be SASE?



https://redd.it/1p54u0f
@r_systemadmin
A rather interesting take on “traditional” dataCentre’s vs cloud services.

I apologize if this is not the right place to ask but I thought it best since there would be quite a few varying views. I had an interesting conversation with a group of young learners entering the field of IT that came about from a certification question that went like this “which two of these things separates traditional data Centres from cloud services providers” or something along that line. Now the answers were, automation, load balancing, virtualization and auto-scaling groups. Now when I heard the question I was stumped for a bit, I’ve been in IT for a tad bit too long and from my experiences the only thing that stood out was auto scaling groups and here’s my reasoning. Virtualization, automation, and load balancing is not a cloud-service native feature since these were being done in on premise data Centres since forever though it’s not as easily done as it can be in like aws, azure or whatever. But I was kinda even more stumped when I learned the answers were automation and virtualization. I ask this here to basically see what everyone’s feedback is on that question.

https://redd.it/1p55xlp
@r_systemadmin
Moderating user content is breaking my team’s brain

Running a UGC platform in 2025 is like being a firefighter. One day it’s spam floods, next day coordinated harassment, next day someone tries to get an AI bot to generate borderline illegal stuff to test boundaries.

We can’t keep up manually and our in-house tools feel prehistoric. Is everyone else drowning too or are we just bad at this

https://redd.it/1p59de8
@r_systemadmin
Best office chair for back pain? Is Aeron really that good?

Hey all.. I’ve started dealing with lower-back pain from long hours at the desk, so I’m finally looking to upgrade my chair. I’m a sysadmin, so most days I’m sitting for long stretches with occasional bursts of activity, and my current cheap chair just isn’t cutting it.

What I’m looking for:

* Strong lumbar support (adjustable preferred)
* Mesh back
* Adjustable seat height/tilt
* Something durable that won’t fall apart in a year
* Budget: up to \~$500

I’ve seen a lot of people recommend things like the Aeron or other ergonomic mesh chairs, but I’m hoping to hear what’s actually worked for folks in IT who sit for long hours.

Any chair you’d recommend that genuinely helped with back pain?

https://redd.it/1p5a610
@r_systemadmin
Spark standalone executor failures take forever to recover

Running Spark on a standalone cluster and hitting a big problem. When an executor fails, recovery is painfully slow. Tasks sit there with executor lost errors and nothing moves for minutes. Other jobs on the cluster freeze too.

I tried tweaking spark.deploy.maxExecutorRetries and heartbeat intervals. It helps a little but not enough. One small failure still stalls the pipeline.

Has anyone actually solved this? Do you break jobs into smaller stages, monitor executors differently, or use some trick to speed recovery?

https://redd.it/1p5cb7g
@r_systemadmin