Distributed wan monitoring system.

Our network is currently a star configuration of a core network and a load of remote branch offices connected over fixed vpns. We occasionally have speed or connectivity issues and it would help if we had a non-user machine on site that we could connect to and do testing, and diagnostics etc. as well as something to record historical statistics for various local metrics.

My proposed "solution" at the moment would be getting something like a raspberry pi or similar micro pc running linux to effectively sit as a client on these branch offices. We could then run docker with containers for things like "SmokePing", "MySpeed", "OpenSpeedTest" and similar tools to give us some live and historical statistics on the connections, as well as tailscale so we can still get on to it if/when the WAN vpn drops to aid management and diagnostics of the local devices to avoid sending someone out to the sites.

This is technically a workable solution, but feels a bit klunky. Is there an off the shelf appliance that could give us this functionality? Or possibly a one click install rather than having to setup and maintain multiple monitoring products?

We are predominately a MS/Azure/Windows house, so any linux based options are frowned upon, but not completely ruled out. So anything that simplifies the setup is a benefit.

I have had a look around and couldnt find anything that seems to meet the bill. There are a lot of tools that do middle-out monitoring like solarwinds, cacti, zabbix etc. but I've not seen anything that seems to do edge-in monitoring, and certainly nothing that combines that with remote control to allow ssh/https onto edge-local devices.

We also need something that can be easily secured and maintained to comply with the UK Cyber Essentials+ certification.

Any suggestions?

https://redd.it/1p907o1
@r_systemadmin

Does anybody else have issues magically resolve just by looking at them?

I know it sounds cliche but "magic touch" seems to be true for me. A lot of problems get solved as soon as I watch the user show me what’s happening. That's all i wanted to say.

https://redd.it/1p94d2p
@r_systemadmin

Active Directory remote logoff

Hey sysadmins!

I needed a way to terminate Active Directory sessions on remote PCs, so I decided to create a small GUI program for it. After a bit of research, I built this handy tool that's simple and user-friendly (at least, I hope you’ll find it so).

If you want to check it out, you can find it here <--- here you can access the source code, its a wrapper for quser command and Microsoft AD Object Picker

You have to get the exe or compile it from source, run it and then you can select the AD Computer, serach for sessions using quser in the backend and the you can select the session or logoff all sessions

Feel free to try it and let me know what you think!

https://redd.it/1p9bggc
@r_systemadmin

Help with Blocking External Shares in Google Workspace

Hi, we are planning to disable external sharing in Google Workspace due to recent security concerns, as some users have been accessing publicly shared files outside our domain that may be unsafe.

Our understanding is that disabling external sharing will prevent any new external shares. However, we would like to confirm whether this change will also affect existing externally shared or publicly accessible files that currently appear in users’ “Shared with me” sections in Google Drive.

For reference, we are navigating to: Apps > Google Workspace > Settings for Drive and Docs > Sharing Settings > Sharing Options, and setting external sharing to “OFF,” as well as unchecking “Allow users in our domain to receive files from users or shared drives outside of our domain.”

Our goal is to block both future and past external access. Any confirmation or guidance before we make these changes would be greatly appreciated. Thanks! This was posted before and was for some reason removed.

TLDR; Does anyone know if a user has previously accessed a publicly shared document from outside our domain in the past, will that file automatically disappear from their Drive once we disable external sharing?

EDIT: Using a test OU to check... Simply turning off external sharing for the OU seems to stop future shares as it should. But, it seems that when we uncheck “Allow users in our domain to receive files from users or shared drives outside of our domain” this seems to stop the previous/pre-existing shares with external domains for our test user. I checked Google vault and the files do not appear anymore in the test users drive. I hope someone here can also confirm!!

https://redd.it/1p9gc7z
@r_systemadmin

ADFS token signing and decrypting cert question.

I renewed our token signing and token decrypting certs in ADFS and am going to start distributing the certs sine we have apps that can’t update from metadata. Do relying party trusts ever use the token decrypting certificate, or just the token signing certificate? It’s my understanding that the token decrypting cert would only be used if ADFS is receiving tokens from an upstream IdP. Any “gotchas” that I should be aware of? My assumption is that the new token signing cert that is secondary just needs to be given to any applications that use ADFS a then once all apps are updated we can roll over the certificate.

https://redd.it/1p9fmwa
@r_systemadmin

Recruiting

I'm not currently looking to leave my role, but I've been caught in a few waves in the past 10 years of horrible work environment that I had been looking to leave. I applied for a few jobs but they never really went too far, despite me (I think) being a pretty solid candidate. I've only ever had a helpdesk job at my college and then got an internship in college which led to a FTE where I've been in different internal roles ever since (so I've never really had to seriously go through the process). My company ended up hiring a few good people through a recruiting agency, but how does that work as a job seeker (I'd ask those people who are now my peers but I don't want them to think I'm looking to leave)? All I know is by looking on Indeed or just knowing what the big companies in my area are. I'm honestly just curious how it would work in case I do need to seriously look for a job again.

https://redd.it/1p9mo7i
@r_systemadmin

Okay, but how do you SSH into 1,000 devices??

My company has a few thousand devices in the field (vending machines). And recently my team got report that many machines is having a problem. We figured that those devices are using ‘develop’ branch of our kiosk application, instead of ‘production’ branch.

Th fix is to change git branch to production. But the problem is there's about 700 devices (that we know) that went out with ‘develop’ branch.

For this problem, my team already manual remote SSH into each devices and solve them all. Took us one whole day.

This isn't first time we need to do this. But mostly it wasn't as many devices as this.

I wonder if I can do something like sending same cli command to multiple SSH addresses at once of if there's any tool that let me do that. We use reverse tunnel for SSH endpoint.

Or if your company deals with similar fleet size. How are you dealing with such case?

https://redd.it/1p926bi
@r_systemadmin

Network segment is receiving DHCP address info but not communicating on LAN or internet

Hi all, this problem started late on Thurs and my normal networking consultant is bedridden with the flu and can't help. This one is stumping me.... I'm seeing symptoms that could be something like a network loop and I'm seeing symptoms that might be DNS/DHCP(?)

We have multiple managed switches in the building but this problem is only happening to devices connected to one of them.

SOME of the devices connected to this switch are fine but others can't communicate on the LAN or internet even though they are receiving valid DHCP address info.... no pings, traceroutes die right away.

I rebooted the switch and the devices, it didn't make any difference.

We have an access point plugged into the switch and I can see that access point on the network, it's accepting clients but the clients can't connect anything.

If I plug my laptop into any of the ports connected to that switch it will work normally.

I'm stumped and over my head - if anyone has any recommendations please let me know!


EDIT: Additional Info:

* the DHCP servers (a pair of Windows 2019 servers) are still giving out addresses within the last 24 hours and I have lease expirations of 12/7 (8 days from now)

* I have a DHCP range of (10.0.20.1 - 10.0.21.254) and all devices have addresses witihn that range so I don't think there is a rouge DHCP server on the network.


* Some of the "problem" devices seem to be able to ping the gateway but others cannot.

https://redd.it/1p9tkwa
@r_systemadmin

Intune Shared Device Configuration

Hi everyone

I’m setting up Android Enterprise Fully Managed devices as shared devices for first-line workers. Dedicated (COSU) isn’t an option because we need Microsoft Tunnel, which only works on Fully Managed.

What’s the best practice to make Fully Managed devices behave like shared/dedicated devices?

• ⁠Only specific apps
• ⁠No system settings
• ⁠No personal Play Store
• ⁠Clean sign-in/out between users

Do I need to create a separate “technician/staging account” for the enrollment, or is there another recommended way to handle the initial AAD login?

Thanks for any advice

https://redd.it/1p9tsfy
@r_systemadmin

LPIC-2 Preparation on 4linux

Hello everyone, I'm currently looking for preparation in Portuguese for the LPIC-2 certification and I came across the 4linux website, is their preparation really good for preparing for the exams?

https://redd.it/1p9tj62
@r_systemadmin

Microsoft

I feel like some years ago, there was a lot of messaging from Microsoft about how clean and green their datacenters were, they we trialing underwater DCs, Microsoft would be carbon negative by 2030 you we basically saving the planet by using Azure.

However lately, I don't hear the same narrative.

Has the need to save the planet gone away?
Did something happen in the last couple of years to move away from this messaging? /s



https://redd.it/1p9y58p
@r_systemadmin

Invoice / Monthly Payment tracker

Taking over the role of IT Manager in a couple of weeks - currently the Network Admin. Looking for a good tool to input and track all invoices and bills. A good way to track all monthly / yearly renewals. Current Manager has an Access database to input all invoices and Excel sheet to track monthly payments and yearly. Most of the bills arrive in email or hard copy so those are inputting into the firms invoicing database. I want my own IT db to track everything coming in. Any suggestions?

https://redd.it/1p9zi8w
@r_systemadmin

Which DLP is the better choice for a 10k-endpoint environment?

We’re evaluating three options right now: 1. Forcepoint 2. Trellix 3. Symantec

We have around 10,000 Windows endpoints, and Forcepoint is noticeably more expensive, especially when you include premium support.

If anyone has real-world experience with these tools—stability, policy management, support quality—would love to hear what you recommend.

We’re looking strictly for an on-prem deployment.

https://redd.it/1pa25ij
@r_systemadmin

Are you allowing any AI tools to touch production data at work?

I’m not a sysadmin myself, but I’m an engineer, and I’m trying to understand how this actually works in the real world.

In my previous role, I could use pretty much any AI tool I wanted, but I was working for a startup. I recently moved to a new company where I have a bit more responsibility and influence, and the situation is the complete opposite. We are not allowed to use any AI tool other than Copilot.

When I first raised this with our IT department, the response was basically “everything is a data breach.” But at the same time, I already see people using GPT or Claude anyway and just not talking about it. So there’s this weird gap between policy and reality.

Since I can now at least help influence some of these decisions, I’m trying to understand what’s actually normal out there right now. Are most organisations still in full lockdown mode? Are there environments where AI is formally allowed under strict controls? And do any of those setups actually feel secure in practice?

https://redd.it/1pa5jeg
@r_systemadmin

Do I have the right idea going into a DNS migration?

Hello, never done this before. Currently our domain is hosted on godaddy but the nameservers point to a third party provider. I just got access to a txt file with all the records. So from what I've gathered:

Move the name servers over to godaddy nsXX.domaincontrol.com

nsYY.domaincontrol.com and manually add the records 1 by 1?

Then wait for propogation?

Any help is appreciated, thank you.

https://redd.it/1pa81li
@r_systemadmin

NBNS HELP

Hi,

I am junior system engineer, and need guidance on a task. I have to disable NBNS. I ran Wireshark on one subnet and saw a lot of NBNS from laptops ( DC is broadcasting for laptops

My questions are:

If DNS records exist and work, why is there still NBNS/LLMNR traffic?

How can I tell if anything in the environment actually relies on these protocols before I disable them?
What is the safe way to test this in a production environment?
Are there any common things that usually break (apps, printers, shares) when people turn these off?


Please guide.


Thank you

https://redd.it/1paayg7
@r_systemadmin

Hypervisor Crawling to a stop

Hi everyone,

I just came across one of our hypervisors acting very strange.

We run backups on all the VM's (which have been running fine) via Acronis and these have started failing.

So I tried and connect via our RMM tool but nothing, RDP directly and it takes forever to connect and get a black screen.

So I connect via iLO and I can reach the desktop but its very very slow, windows take forever to open and respond.

I managed to get task manager open but nothing out of the ordinary and event logs shows some potential issues with WMI but not sure.

A reboot has been done but exactly the same issue, VM's are fine but the host seems to be fighting for its life.

Has anyone come across this or would have ideas on what to troubleshoot?

https://redd.it/1pa38u4
@r_systemadmin

How to Change Default SNMP Ports?

I'm setting up a monitoring lab with PRTG as the manager and two agents: a Windows VM and the physical host itself. The project has requirements:

· Must change default SNMP ports (161/162). Only ports 20000 and above are allowed.

The Problem: I can't get the Windows SNMP Service (on both the VM and physical host) to reliably listen on a custom port (e.g., 20000).

What I've Tried on the Windows Agents:

1. Registry Mods: Added TrapListenPort (DWORD) under HKLM\SYSTEM\CurrentControlSet\services\SNMP\Parameters and TrapPort under the snmptrap service path. After restarting the services, netstat -an shows the service is still listening on port 161, not the new port.
2. Service Reconfiguration: Tried using sc config to change the binary path for the SNMP service to include a -p 20000 parameter, but this seems to break the service.

The PRTG side is ready, but I'm stuck at this mandatory port change on the Windows agents. The goal is to have the SNMP service actively listening on, for example, UDP 20000, so PRTG can query it.

Question: What is the definitive, working method to change the listening port for the built-in Windows SNMP Service? Is it even possible without a third-party SNMP agent?

https://redd.it/1pacxhw
@r_systemadmin

What should I add next to my certifications as a Senior IT Infrastructure Engineer?

Hey everyone,

I’ve been in IT for about ten years, currently working as a Senior IT Infrastructure Engineer, and I’m trying to figure out what certifications or skill areas I should pursue next to stay competitive and keep growing.

Current certifications:
• VMware Certified Professional – DCV (VCP-DCV)
• VMware Certified Technical Associate – DCV (VCTA-DCV)
• Microsoft Certified: Azure Administrator Associate
• Microsoft Certified: Azure Fundamentals
• ITIL Foundation (IT Service Management)
• Cisco CCNA Routing & Switching
• CompTIA Security+

Given this background, what would you recommend I add next?

https://redd.it/1padhdt
@r_systemadmin

Switching from LDAP to LDAPS — how bad is the migration?

Our cybersecurity team just told us to disable LDAP and move to LDAPS. Anyone else dealing with this?

https://redd.it/1pagz4t
@r_systemadmin

Event ID 500, Desktop Window Manager uses too much VRAM. (I hope I'm in the right place, forgive me if not)

Have a wonderful day, everyone!

I'll just say this upfront, and I don't mean it disrespectfully, but I really need someone who does system integration or someone who's deeper into this stuff.

I've got result ID 500 in the Event Viewer under Diagnostics Performance:
"Video memory are over utilized and there is trashing happening. Reducing number of running programms and open Windows may help resolve this"
The task category is Desktop Window Manager Monitoring. So, that's where the error must be.

I have the current drivers.
Or rather, the newest one doesn't work because Adrenalin won't start, so I'm using the October version.
I've also tried almost all the settings that are supposed to fix the DWM (Desktop Window Manager) problem, but it's possible I'm missing something.

What's weird is that sometimes I'm not doing anything on the desktop, and my graphics card is using 12-14GB of VRAM even though I'm not doing anything. I've also made a few logs with HW info, and when it's running normally, like with YouTube or Twitch, it uses about 3-4GB of VRAM.

I have the feeling that the graphics card is also being throttled because I often have a pretty weird render distance in games. But when I look at the clock speeds, they're normally up at 3100mhz (9070xt Nitro+)

I've also reinstalled Windows multiple times. Still get event 500 every time.

I really need help, I've spent almost 100 hours on this and can't get rid of it.

https://redd.it/1pai4c9
@r_systemadmin