Fixing Noisy Logs with OpenTelemetry Log Deduplication

Hi all, I wrote an article on reducing log volume using the OpenTelemetry Collector log deduplication processor.

It covers why duplicate logs happen in distributed systems and how to discard identical entries without sacrificing observability.

Article: https://www.dash0.com/guides/opentelemetry-log-deduplication-processor

Would love feedback from anyone using OpenTelemetry in production

https://redd.it/1qwlj2s
@r_devops

I am building Conveyor CI: a lightweight headless CI/CD orchestration engine for building CI/CD platforms.

Hi everyone.

Just released Conveyor CI v0.5.0, a lightweight headless CI/CD orchestration engine for building CI/CD platforms. Its perfect for building Internal developer platforms(IDPs) and custom platforms.

I am applying for the project to join the CNCF Sandbox and would appreciate any support, from a github star, code contributions or even technical feedback(emphasis of the feedback, I want to know if this project is even viable in the broader community)

Checkout the repo at https://github.com/open-ug/conveyor

https://redd.it/1qwnabk
@r_devops

GitHub introduces scaleset module for easier GHA scheduling on self-hosted runners

Written in Go. Available at https://github.com/actions/scaleset. Was extracted from ARC and looks like it can be a great replacement for webhook-based scheduling.

https://redd.it/1qwpd6y
@r_devops

Career Advice For New Grad Platform Engineer Oppourtunity

I’m starting as a Junior New Grad platform engineer at a fast-moving startup this summer. I’ve shipped infra systems before, as I've had a previous internship that allowed me to work on k8s and observability issues, but I care a lot about business and product impact long-term. I like platform work, but I also would like to work on product issues as well.

For folks who started in platform roles:

Did starting off in platform pigeonhole you to being platform only? Is transitioning to product-facing roles in the future harder?
What skills mattered more than raw infra depth?
What would you do in the months before starting to be able to ship quick? Kinda worried that I will need to be told what to do, due to lack of knowing the system and the tools that could help.
How do I make sure that I do not work on just YAML and terraform configs? I know that's a huge part of the job, but in my previous internship, I felt like I did not grow much or learn much when I was working on configs.

Overall, I just feel unsure on whether I can land impact for system as a Junior engineer, and also want to ensure that I can keep growing technically. Will starting off my career on a Platform team still let me achieve these goals?

https://redd.it/1qwpyuu
@r_devops

Why do people from Eastern Europe always seem so smart?

In job interviews, I keep noticing the same thing: people from Eastern Europe (Russia, Ukraine, Belarus, Moldova, etc.) are often extremely knowledgeable and sharp. It happens so often that I’m starting to wonder if there’s a reason behind it or if it’s just my experience.

Has anyone else noticed this?

https://redd.it/1qwt1vh
@r_devops

82% K8s production adoption, 86% of CIOs planning cloud repatriation

Two data points that seem contradictory but probably aren't:


1. CNCF 2025 survey: K8s hits 82% production adoption, 66% use it for AI inference workloads

2. IDC: 86% of CIOs planned to repatriate some workloads in 2025/2026 — highest rate ever



Meanwhile the hyperscalers are spending >$600B in capex this year (36% increase), with 75% of that going to AI infrastructure. But AI services only generated \~$25B in revenue. That's a hell of a bet.



Are we heading toward messy hybrid whether we like it or not.

Are you seeing repatriation actually happening at your org, or is it still just "CIO slide deck" talk?

For those running GPU workloads — cloud, on-prem, or hybrid? What drove the decision?


Reference in case you are interested: https://www.cncf.io/announcements/2026/01/20/kubernetes-established-as-the-de-facto-operating-system-for-ai-as-production-use-hits-82-in-2025-cncf-annual-cloud-native-survey/

https://redd.it/1qwtj8p
@r_devops

Where you guys are looking for jobs nowadays?

I'm on indeed and LinkedIn and trying my luck here too on Reddit but aside that, where do you guys are getting your hits from?

I need to find work and am spreading my effort, can't depend on only two vectors for HA to happen :D

C1 (or 2ish) english level, 6 years of experience in DevOps, 20 years overall experience, based in LATAM (Brazil). Willing to relocate but I don't have a visa to anywhere so I would need sponsorship for that.

Thanks for any ideas I can try!

https://redd.it/1qwuass
@r_devops

Cool write-up about running a small $5M training cluster

Denoscription of comma's on-prem data center including a bunch of technical details: https://blog.comma.ai/datacenter/

https://redd.it/1qwt8yn
@r_devops

How do you handle IaC drift when auto-remediation changes resources?

We use AWS Config/Security Hub with auto-remediation rules, things like enabling S3 default encryption or fixing security group rules. It works, but it creates a headache: Terraform doesn't know about the change, so the next plan either tries to revert it, or you're stuck doing manual state surgery.

Curious how other teams deal with this:

\- Do you accept the drift and fix Terraform manually?

\- Do you avoid auto-remediation entirely and handle findings through your normal IaC pipeline instead?

\- Something else?

Had an interesting conversation in the CloudPosse Slack where the take was that auto-remediation is fundamentally at odds with IaC, and the better approach is to ingest compliance findings and open PRs to fix Terraform directly. Curious if that matches what people are seeing in practice.

https://redd.it/1qwzd1i
@r_devops

YouTube gotcha problem

Working on a project, and I’m wondering if anyone has ever solved this type of problem:

Is there anyway to get YouTube trannoscriptions from urls without getting blocked/gotcha?

I’ve been struggling cause it always only returns empty html cause it’s getting caught by YouTube for being a bot.

Asking for genuine dev tips and not to use some website for this.

https://redd.it/1qx155j
@r_devops

Did I break the server, or was it already broken?

I work at a mid-sized AEC firm (\~150 employees) doing automation and computational design. I'm not a formally trained software developer - I started in a more traditional domain expertise role and gradually moved into writing C# tools, add-ins, and automation noscripts. There's one other person doing similar work, but we're largely self-taught.

Our file infrastructure runs on a Linux Samba server with 100TB+ of data stored serving all 150 + maybe 50 more users. The development workflow that existed when I started was to work directly on the network drives. The other automation developer has always done this with smaller projects for years and it seemed to work fine.

What Happened

I started working on a project to consolidate scattered noscripts and small plugins into a single, cohesive add-in. This meant creating a larger Visual Studio solution with 30+ projects - basically migrating from "loose noscripts on the network" to "proper solution architecture on the network."

Over 7-8 days, the file server experienced complete outages lasting 30-40 minutes daily. Users couldn't access files, work stopped, and IT had to investigate. IT traced the problem to my user account holding approximately 120 simultaneous file handles \- significantly more than any other user (about 30).

The IT persons sent an email to my manager and his boss saying that it should be investigated what I'm doing and why I could be locking so many files basically framing it as if I am the main cause of the outages. The other cause they have stated is that the latest version of the main software used in the AEC field (Autodesk Revit) is designed to create many small files locked by each individual user which even though true, to me sounds like a ridiculous statement as a cause for the server to crash.

Should a production file server serving 200 users be brought down by one user's 120 file handles? I've already moved to local development - that's not the question. I want to understand whether I did something genuinely problematic or the server couldn't handle normal development workload. Even if my workflow was suboptimal, should it be possible for one developer opening Visual Studio to bring down the entire file server for half an hour? This feels like a capacity planning issue.

https://redd.it/1qx1u5r
@r_devops

What is your biggest pain point

Seriously wondering this.

I am a non-technical individual. In fact, I am a recruiter for VC backed early stage tech companies in Ai/Infrastructure/Data. I partner with VCs and build GTM teams for startups.

I am currently working with a cyber vendor who quite literally is a couple of guys who have no founder or cyber experience, but were just recognized by insight partners. They literally just went out and asked CISOs what they struggled with and were able to make something from nothing with the right people.

Not saying that I could ever do that, but I want to find the people doing what solves the common denominator here for you guys.

Are each of these AI tools making life easier? Is there some form of consolidation needed with a conflict of interest between code generation and code review tools? Is AI workflow good or has n8n cornered the market and there is nowhere to improve?

So many questions. Explain it to me like a 5 year old.

https://redd.it/1qx4eh5
@r_devops

We’re testing double enforcement for irreversible ops after restart/retry issues

Post:
We’ve been running into the same operational question:
What actually protects an irreversible external mutation if the service restarts after authorization but before commit?
Most flows authorize once at ingress and then execute later. But between those two points we’ve seen:
pod restarts
retry storms
duplicated webhooks
race conditions across workers
stale grants surviving longer than expected
Ingress validation alone doesn’t protect the commit moment.
So we’re testing a stricter pattern:

Gate A validates the proposed action at ingress (ordering + replay protection).
The system processes normally.

Gate B re-validates the same bound action immediately before the external mutation (idempotency + continuity check).
If either fails, the operation freezes instead of attempting the external call.
We’re specifically testing this against real external side effects (payments, state transitions, etc.) under forced restarts and concurrent retry scenarios.
Curious how others handle this boundary.
Do you rely on idempotent APIs downstream and ingress validation upstream, or do you re-enforce at the commit edge as well?

https://redd.it/1qx5bvm
@r_devops

Unable to get to interview stage after screening

Hi guys, I was recently part of an organization restructure and got laid off. So I’ve been looking for new roles for the past two weeks, and I’ve applied to around 70+ roles. I’ve heard back from about 7–8 for initial screenings, where they said it’s a great match and that they would forward my resume to the hiring manager, but then nothing has happened.

For eg I applied to Deloitte and the recruiter did a phone screening on Tuesday seemed happy with me, but it’s Friday now and still nothing. Another company recruiter yesterday told me he’s really busy and asked me to call him. When I did, he said he’d like to bring me in for an interview and would call me back, but he had to rush to a meeting. Since then, no callback. I tried following up and calling again today but it went to voicemail (he did say he’s on his phone a lot and very busy).

Other companies have sent technical tests or done initial calls, and same thing — nothing since.

Am I being impatient? I haven’t been out in the job market for 4–5 years, so I’m not sure what the normal pace is now, because my previous interview process was all sorted in a week from screening to the offer letter.

https://redd.it/1qx7d1s
@r_devops

Resources to learn CrossPlane

Hi everyone! i want to learn how to set up and use crossplane. Are there any resource online similar to cloudguru/kodekloud for this? or just the crossplane docs?

https://redd.it/1qx8jci
@r_devops

New to AI tools .looking for real world recommendations

Hi I’m pretty new to AI and trying to figure out which tools are actually worth using.
What websites do you rely on for work, studying, or daily tasks?
Would love to hear what’s been useful for you.

https://redd.it/1qx74i2
@r_devops

$225 in prizes - incident diagnosis speed competition this Saturday

Hosting a live incident diagnosis competition this Saturday, 1pm-1:45pm PST on Google Meet.

2 rounds, 2 incidents. You get access to our playground telemetry, GitHub, Confluence docs. First person to find the root cause, present evidence, and propose a fix wins.

Prizes
\- 1st: $100 Amazon gift card
\- 2nd: $75
\- 3rd: $50

At the end, we'll show what our AI found for the same incidents, and how long it took. Humans only for the prizes though.

Think of it as a CTF but for incident response.

DM me to sign up!

https://redd.it/1qxaay5
@r_devops

What should be the next step in DevOps ?

Whenever people talk about DevOps, all I hear is that Terraform is the word of the mouth now, all that IaaC and stuff. But as someone who wants to move into DevOps, what would be the best way to utilise all these different tools and build projects ?

I know for sure that projects in DevOps domain are not same as projects in any other domain. I would build an ML pipeline and post it on GitHub and I would be done. But I know for sure that DevOps projects don't work that way. Any suggestions on how to build DevOps projects ?

https://redd.it/1qxc50o
@r_devops

Do you commit Helm charts to your Git repo or pull them on the fly?

Hi I have question:

When using open-source tools like Prometheus, Grafana, or Ingress-NGINX on production, do you:

Keep the full chart source code in your repo (vendoring)?
Or just keep a Chart.yaml with dependencies (pointing to public repos) and your values.yaml?

I see the benefits of "immutable" infrastructure by having everything locally, but keeping it updated seems like a nightmare. How do you balance security/reliability with maintainability?

I've had situations where the repository became unavailable after a while. On the other hand, downloading everything and pushing it to your own repository is tedious.

Currently using ArgoCD, if that matters. Thanks!

https://redd.it/1qxc9of
@r_devops

Stop writing brittle Python glue code for your security pipelines (Open Source)

In every DevOps role I've had, "security automation" usually meant a folder full of unmaintained Python or Bash noscripts running on a random Jenkins node.

It works until the API changes, or the guy who wrote it leaves.

We wanted a proper orchestration layer for this stuff without paying $50k for enterprise SOAR tools. So we built ShipSec Studio and open-sourced it.

It’s a visual workflow builder that lets you chain tools together.

What it replaces:

Writing a noscript to parse Trufflehog JSON output.
Manually hooking up Nuclei scans to Jira/Slack.
Cron jobs for cloud compliance checks (Prowler).

You can drag-and-drop the logic, handle errors visually, and deploy it via Docker on your own infra.

We just released it under Apache. We’re a small team trying to make security automation accessible, so if you think this is useful, a star on the repo would mean a lot to us.

Repo: github.com/shipsecai/studio

Let me know if you run into any issues deploying the container.

https://redd.it/1qxe2mj
@r_devops

Choosing DevOps instead of SDE?, Is it a Good Choice, More Info on Body

Hello,

I'm a Fresher, Actively applying for jobs from December (Mostly on SDE and Fullstack).


I can clearly see the entry level jobs are slowly vanishing, even if i found something it says 2+ yrs of exp.


It's my personal belief that AI is slowly killing the Junior and entry level roles.


It made me think, like, is there any entry-level role which cannot be affected by AI?



I asked some people on my circle,


One of my friend said DevOps, i don't know is it True or not?


That's why I'm asking you'll guys.

Is DevOps have more job potential than SDE/Fullstack in this current situation.


Is it a good to switch to DevOps or should i continue the SDE Path?


Thanks for reading this far!!!

https://redd.it/1qxeiq3
@r_devops