Reddit DevOps – Telegram
I am currently finishing my college degree in germany. Any advice on future career path?

Next month I will graduate and wanted to hear advice on what kind of field is advancing and preferbly secure and accessible in germany?
I am a decent student. Not the best. But my biggest interests were in theoritcle and math orientated classes. But I am willing to delv my knowledge into any direction.
I don‘t know how much should I fear AI development in terms of job security. But I would like to hear some advice for the future if somebody has anything to give?

https://redd.it/1pjvequ
@r_devops
Do you use Postman to monitor your APIs?

As a developer who recently started using Postman and primarily uses it only to create collections and do some manual testing, I was wondering if is also helpful to monitor API health and performance.

View Poll

https://redd.it/1pjxrbr
@r_devops
We got 30 api access tickets per week, platform team became the bottleneck

Three months ago a PM stood up in standup and said "we can't ship because we're waiting on platform for api keys, this has been 4 days." Everyone went quiet and I felt my face get hot.Checked jira right after and 28 open tickets just for api access. Average close time was 4 days. We're 6 people supporting 14 product teams. Every ticket is the same and takes 2 hours per ticket spread over 3 days because everyone's in meetings. When I tracked it 60 hours of team time just doing manual api access, that's more than one full person.I told management we need to hire, but they said fix the process first. I tried some ideas like confluence docs but nobody reads them. Tried a spreadsheet with all the api keys but got out of date in 2 weeks. My lead engineer said "we need self service, like how stripe does it." I said yeah obviously but we don't have time to build that. He said we don't have time NOT to build it.So I did my research and readme does docs but not key management, we could built custom portal with react but gave up after realizing we would build an entire user management system. Looked at api management platforms but most were insane enterprise pricing, found something that had the developer portal built in. Set it up, connected our apis, took a month to completely set up gravitee, but it was the only thing that wasn't $50k per year and had self service built in. Rolled it out to 2 teams first as beta, they found bugs, we fixed it and rolled out to everyone. Took like a month and half to roll out to everyone, the tickets dropped to about 5 and they're weird stuff like "my team was deleted how do I recover it."If your platform team is drowning in api access tickets you have two options. Hire more people to do manual work or build self service. We're too small to hire so we had to build it, took way longer than I wanted but it worked.

https://redd.it/1pk17a7
@r_devops
A Production Incident Taught Me the Real Difference Between Git Token Types

We hit a strange issue during deployment last month. Our production was pulling code using a developer’s PAT.

That turned into a rabbit hole about which Git tokens are actually meant for humans vs machines.

Wrote down the learning in case others find it useful.

Link : https://medium.com/stackademic/git-authentication-tokens-explained-personal-access-token-vs-deploy-token-vs-other-tokens-f555e92b3918?sk=27b6dab0ff08fcb102c4215823168d7e

https://redd.it/1pk2nc7
@r_devops
I made a tool that lets AI see your screen and fix technical problems step-by-step

I got tired of fixing the same tech issues for people at work again and again.

Demo: **Creating an S3 bucket on Google Cloud**

So, I built Screen Vision. It’s an open source, browser-based app where you share your screen with an AI, and it gives you step-by-step instructions to solve your problem in real-time. It's like having an expert looking at your screen, giving you the exact steps to navigate software, change settings, or debug issues instantly.

Crucially: no user screen data is stored.

See the code: https://github.com/bullmeza/screen.vision

Would love to hear what you think! What frustrating problem would you use Screen Vision to solve first?

https://redd.it/1pk72bu
@r_devops
Manual SBOM validation is killing my team, what base images are you folks using?

Current vendor requires manual SBOM validation for every image update. My team spends 15+ hours weekly cross-referencing CVE feeds against their bloated Ubuntu derivatives. 200+ packages per image, half we don't even use.

Need something with signed SBOMs that work, daily rebuilds, and minimal attack surface. Tired of vendors promising enterprise security then dumping manual processes on us.

Considered Chainguard but it became way too expensive for our scale. Heard of Minimus but my team is sceptical

What's working for you? Skip the marketing pitch please.

https://redd.it/1pk9rgg
@r_devops
Meta replaces SELinux with eBPF

SELinux was too slow for Meta so they replaced it with an eBPF based sandbox to safely run untrusted code.

bpfjailer handles things legacy MACs struggle with, like signed binary enforcement and deep protocol interception, without waiting for upstream kernel patches and without a measurable performance regressions across any workload/host type.

Full presentation here: https://lpc.events/event/19/contributions/2159/attachments/1833/3929/BpfJailer%20LPC%202025.pdf

https://redd.it/1pkhl58
@r_devops
I didn't like that cloud certificate practice exams cost money, so i built some free ones

https://exam-prep-6e334.web.app/

https://redd.it/1pklpt2
@r_devops
Help troubleshooting Skopeo copy to GCP Artifact Registry

I wrote a small noscript that copies a list of public images to a private Artifact Registry account. I used skopeo and everything works on my local machine, but won't when run in the pipeline.

The error I see is reported below, and it seems to be related to the permissions of the service account used for skopeo but it is a artifactRegistry.admin...

time="2025-12-11T17:06:12Z" level=fatal msg="copying system image from manifest list: trying to reuse blob sha256:507427cecf82db8f5dc403dcb4802d090c9044954fae6f3622917a5ff1086238 at destination: checking whether a blob sha256:507427cecf82db8f5dc403dcb4802d090c9044954fae6f3622917a5ff1086238 exists in europe-west8-docker.pkg.dev/myregistry/bitnamilegacy/cert-manager: authentication required"


https://redd.it/1pkmv3j
@r_devops
EKS CI/CD security gates, too many false positives?

We’ve been trying this security gate in our EKS pipelines. It looks solid but its not… Webhook pushes risk scores and critical stuff into PRs. If certain IAM or S3 issues pop up, merges get blocked automatically. The problem is medium severity false positives keep breaking dev PRs. Old dependencies in non-prod namespaces constantly trip the gate. Custom Node.js policies help a bit, but tuning thresholds across prod, stage, and dev for five accounts is a nightmare. Feels like the tool slows devs down more than it protects production. Anyone here running EKS deploy gates? How do you cut the noise? Ideally, you only block criticals for assets that are actually exposed. Scripts or templates for multi-account policy inheritance would be amazing. Right now we poll /api/v1/scans after Helm dry-run It works, but it’s clunky. Feels like we are bending CI/CD pipelines to fit the tool rather than the other way around. Any better approaches or tools that handle EKS pipelines cleanly?

https://redd.it/1pko996
@r_devops
The agents I built are now someone elses problem

Two months since I left and I still get random anxiety about systems I dont own anymore

Did I ever actually document why that endpoint needs a retry with a 3 second sleep? Or did I just leave a comment that says "dont touch this". Pretty sure it was the comment.

Knowledge transfer was two weeks. Guy taking over seemed smart but had never worked with agents. Walked him through everything I could remember but so much context just lives in your head. Why certain prompts are phrased weird. Which integrations fail silently. That one thing that breaks on tuesdays for reasons I never figured out.

He messaged me once the first week asking about a config file and then nothing since. Either everything is fine or hes rebuilt it all or its on fire and nobody told me. I keep checking their status page like a psycho.

I know some of that code is bad. I know the docs have gaps. I know theres at least two hardcoded things I kept meaning to fix. Thats all someone elses problem now and I cant do anything about it.

Does this feeling go away or do you just collect ghosts from every job

https://redd.it/1pkrsm5
@r_devops
Buildstash - Platform to organize, share, and distribute software binaries

We just launched a tool I'm working on called Buildstash. It's a platform for managing and sharing software binaries.

I'd worked across game dev, mobile apps, and agencies - and found every team had no real system for managing their built binaries. Often just dumped in a shared folder (if someone remembered!)
No proper system for versioning, keeping track of who'd signed off what when, or what exact build had gone to a client, etc.

Existing tools out there for managing build artifacts are really more focused on package repository management. But miss all the other types of software not being deployed that way.

That's the gap we'd seen and looked to solve with Buildstash. It's for organizing and distributing software binaries targeting any and all platforms, however they're deployed.

And we've really focused on the UX and making sure it's super easy to get setup - integrating with CI/CD or catching local builds, with a focus on making it accessible to teams of all sizes.

For mobile apps, it'll handle integrated beta distribution. For games, it has no problem with massive binaries targeting PC, consoles, or XR. Embedded teams who are keeping track of binaries across firmware, apps, and tools are also a great fit.

We launched open sign up on the product Monday and then another feature every day this week -
Today we launched Portals - a custom-branded space you can host on your website, and publish releases or entire build streams to your users. Think GitHub Releases but way more powerful. Or even think about any time you've seen some custom-built interface on a developers website for finding past builds by platform, looking through nightlies, viewing releases etc - Buildstash Portals can do all that out the box for you, customizable in a few minutes.

So that's the idea! I'd really love feedback from this community on what we've built so far / what you think we should focus on next?

- Here's a demo video - https://youtu.be/t4Fr6M_vIIc
- landing - https://buildstash.com
- and our GitHub - https://github.com/buildstash

https://redd.it/1pkslis
@r_devops
Is the promise of "AI-driven" incident management just marketing hype for DevOps teams?

We are constantly evaluating new platforms to streamline our on-call workflow and reduce alert fatigue. Tools that promise AI-driven incident management and full automation are everywhere now, like MonsterOps and similar providers.

I’m skeptical about whether these AIOps platforms truly deliver significant value for a team that already has well-defined runbooks and decent observability. Does the cost, complexity, and setup time for full automation really pay off in drastically reducing Mean Time To Resolution compared to simply improving our manual processes?

Did the AI significantly speed up your incident response, or did it mainly just reduce the noise?

https://redd.it/1pku5b6
@r_devops
Serverless BI?

Have people worked with serverless BI yet, or is it still something you’ve only heard mentioned in passing? It has the potential to change how orgs approach analytics operations by removing the entire burden of tuning engines, managing clusters, and worrying about concurrency limits. The model scales automatically, giving data engineers a cleaner pipeline path, analysts fast access to insights, and ops teams far fewer moving parts to maintain. The real win is that sudden traffic bursts or dashboard surges no longer turn into operational fire drills because elasticity happens behind the scenes. Is this direction actually useful in your mind, or does it feel like another buzzword looking for a problem to solve?

https://redd.it/1pktuxa
@r_devops
TRACKING DEPENDENCIES ACROSS A LARGE DEPLOYMENT PIPELINE

We have a large deployment environment where there are multiple custom tenants running different versions of code via release channels.

An issue we've had with these recent npm package vulnerabilities is that, while it's easy to track what is merged into main branch via SBOMs and tooling like socket.dev, snyk, etc., there is no easy way to view all dependencies across all deployed versions.

This is because there's such a large amount of data, there are 10-20 tags for each service, ~100 services, and while each tag generally might not be running different dependencies it becomes a pain to answer "Where across all services, tenants, and release channels is version 15.0.5 of next deployed".

Has anyone dealt with this before? It seems just like a big-data problem, and I'm not an expect at that. I can run custom sboms against those tags but quickly hit the GH API limits.

As I type this out, since not every tag will be a complete refactor (most won't be), they'll likely contain the same dependencies. So maybe for each new tag release, git --diff from the previous commit and only store changes in a DB or something?

https://redd.it/1pkthr3
@r_devops
How do approval flows feel in feature flag tools?

On paper they sound great, check the compliance and accountability boxes, but in practice I've seen them slow things down, turn into bottlenecks or just get ignored.

For anyone using Launchdarkly/ Unleash / Growthbook etc.: do approvals for feature flag changes actually help you? who ends up approving things in real life? do they make things safer or just more annoying?

https://redd.it/1pkt83z
@r_devops
Proxy solution for maven, node.js and oci

We use https://reposilite.com as a proxy for maven artifacts and https://www.verdaccio.org for node.js.

Before we choose another software as a proxy for oci artifacts (images, helm charts) we were thinking about if there's a solution (paid or free) that supports all of the mentioned types.

Anybody got a hint?

https://redd.it/1pl16nk
@r_devops
Self-hosted WandB

We really like using WandB at my company, but we want to deploy it in a CMMC environment, and they have no support for that. Has anyone here self-hosted it using their operator? My experience is that the operator has tons of support but not much flexibility, and given our very specific requirements for data storage and ingress, it doesn't work for us. Does anyone have a working example, using a custom Ingress Controller and maybe Keycloak for user management.

https://redd.it/1pl2uha
@r_devops
how much time should seniors spend on reviews? trying to save time on manual code reviews

our seniors are spending like half their time reviewing prs and everyone's frustrated. Seniors feel like they're not coding anymore, juniors are waiting days for feedback, leadership is asking why everything takes so long.

I know code review is important and seniors should be involved but this seems excessive. We have about 8 seniors and 20 mid/junior engineers, everyone's doing prs constantly. Seniors get tagged on basically everything because they know the systems best.

trying to figure out what's reasonable here. Should seniors be spending 20 hours a week on reviews? 10? Less? And how do you actually reduce it without quality going to shit? We tried having seniors only review certain areas but then knowledge silos got worse.

https://redd.it/1pl6jj7
@r_devops