Raft Protocol Basic Question that trips up EVERYONE!

leader replicates value of current term to a quorum of other servers that accept it, must this value eventually be committed even if leader crashes before committing it?

https://redd.it/1o8fdaw
@r_devops

Are lakehouses/opentable formats viable for low cost observability?

Anyone had success building their o11y with opentable formats?

https://clickhouse.com/blog/lakehouses-path-to-low-cost-scalable-no-lockin-observability

https://redd.it/1o8gn52
@r_devops

Is it possible to combine DevOps with C#?

I am a support specialist in fintech (Asia). As part of an internal training program, I was given the choice between two paths: C# or DevOps.

My knowledge of C# (.net) and DevOps is very limited, but I would like to learn more. A developer friend of mine says that they can be studied together for a narrow field (Azure), which has further increased my doubts.

https://redd.it/1o8ieuc
@r_devops

Local dev for analytics stacks: ClickHouse + Redpanda + OLTP in one command

Created a demo application where the dev server (run with moose dev spins up your entire CDC pipeline's infrastructure: Postgres, Debezium, Redpanda, Stream Sync, ClickHouse, the whole shebang.

Repo: https://github.com/514-labs/debezium-cdc/tree/main
Blog: https://www.fiveonefour.com/blog/cdc-postgres-to-clickhouse-debezium-drizzle


In the application, there's a docker compose override file that allows this (direct link: https://github.com/514-labs/debezium-cdc/blob/main/docker-compose.dev.override.yaml ).


What do y'all think of this approach?

I am thinking of adding file-watcher support to the code relating to the additional infrastructure supported. Are there any local dev experiences like that now?

https://redd.it/1o8jnmr
@r_devops

How can I build a side hustle using my Cloud & DevOps skills?

Hey everyone,
I work full-time as a Cloud/DevOps Engineer mainly focused on Azure, Terraform, Kubernetes, and automation. I’ve tried freelancing on Upwork and Fiverr, but it doesn’t seem worth it the competition is mostly based on price rather than skill or quality.

I’m looking for ideas or examples of how someone with my background can build a side hustle or business outside of traditional freelancing, maybe something like offering specialized services, automation, or creating small SaaS tools.

Has anyone here done something similar or found a good path to monetize their cloud/DevOps expertise on the side?

Would appreciate any guidance or real-world examples!

https://redd.it/1o8ji75
@r_devops

Interesting in giving input on some new helpful tools?

Hey fellow devops geeks & nerds, 

I am part of the team of seasoned engineers with lots of war stories who wanted to help our teams doing devops work.

We finally have enough code checked in to reach our free open beta. We would really appreciate it if anyone is interested in participating to sign up for free here: https://app.ingenimax.ai/auth/login?screen\_hint=signup (no cc req, no sales pressure we promise!) and give us feedback and input on what we are building.

It’s still early days and we know you all will have a ton of practical insight to help us see if we are doing something useful, and shape this into the best tool it can be

Appreciate it!

EDIT: So sorry there was no link to more details, reddit was really giving me grief posting this at all, not sure why. Let's see if this link sticks: https://www.starops.dev

https://redd.it/1o8emz2
@r_devops

What's the most proudest tool you've made at your work?

What's the most proudest custom noscript/tool/system you've developed/implemented at your work?

https://redd.it/1o8pa54
@r_devops

How do you actually think outside the box, remember stuff like tags and elements, and not feel useless seeing AI build websites in seconds?

So I’ve been learning full-stack (basic)— HTML, CSS, a bit of JS — and I’m realizing something. It’s not the syntax that’s hard, it’s actually remembering everything and knowing how to apply it creatively.

Every time I try to make something on my own, I end up stuck thinking “wait, what was that tag again?” or “how did that layout even work?” and it slows me down so much that I lose motivation.

On top of that, I keep seeing reels and videos of AI tools that generate full websites in under a minute. It honestly messes with my head. I start wondering — why am I even learning all this if AI can just do it better and faster? I know those demos probably skip the hard parts, but still, it feels discouraging.

So I wanted to ask people here who’ve been through this — how do you deal with that feeling? How do you stay creative and keep learning when it feels like machines are getting better at what you’re trying to master?

Also, what helped you actually remember HTML/CSS/JS concepts long-term? Like not just understanding them once, but being able to recall and use them naturally later.

I’m not asking for a “study plan” or “10 tricks to learn faster.” I just want honest advice or perspective from someone who’s been where I am right now — stuck between learning and doubting if it’s even worth it.

https://redd.it/1o8pnp4
@r_devops

On the edge server for hls streaming

I'd like to stream hls streams directly to a mobile app from an edge device. I'm thinking about using an nginx web server coupled with jwt authorization on python authentication backend. What do you guys thnk about this architecture? Is it secure ad I will expose the device port to the public?

https://redd.it/1o8tcjm
@r_devops

Stop saying "10x Developer" now that Copilot writes the boilerplate. We need new metrics.

Is anyone else terrified of their codebase right now? My team's "velocity" is up $40\\%$ thanks to LLM copilots, but half the new code feels like highly optimized technical debt. We’re shipping faster, but I spend more time debating if the AI’s solution is correct or just plausible. What metrics do you trust besides commit counts?

https://redd.it/1o8tbgw
@r_devops

Board wants an AI risk assessment but traditional frameworks feel inadequate

Our board is pushing for a comprehensive AI risk assessment seeing the rise in attacks targeting ML models. The usual compliance checklists and generic risk matrices aren't really capturing what we're dealing with here.

We've got ML models in production, AI assisted code review, and customer facing chatbots. The traditional cybersecurity frameworks seem to miss the attack vectors specific to AI systems.

Anyone dealt with this gap between what boards expect and what actually protects against AI threats? Looking for practical approaches that go beyond checkbox exercises.

https://redd.it/1o8x3zw
@r_devops

new experience with deploying azure databricks

i work mostly on AWS and sometimes Azure, the company decided to bring databricks via Azure and i'm the guy who handles data & AI infra, so taking care of this as well.
since i don't like azure much, and have not much idea how databricks works, i tried a new approach with understanding the concepts.
i created an XML-formatted research prompt to search about this topic, used this prompt in Claude research, Gemini deep research, and Perplexity pro search. (i only have claude sub)
then i checked the files and read them and all looks nice and legit. used these 3 output files to feed them to notebookLM. and man this notebooklm got good. created an awesome mind map of how all the things are connected, the podcast is nice, and can reference anything. specially useful for the specific terms and tech that databricks uses, now i created the subnoscription in azure and layed the networking foundation, in a very short time. interesting times, indeed!

https://redd.it/1o91ftq
@r_devops

Looking for DevOps learning partner

Hey Guys

I’ve recently started learning DevOps and also looking for someone who is eager to learn and share knowledge together.

What I intend to learn : Terraform, GitHub Actions, CI/CD pipelines, Kubernetes, Ansible and cloud automation. I've already started learning so have some exposure to these.

My background : I'm a Sysadmin so I currently work with Azure,365, Windows Server, Intune, Jamf

If you’re also learning DevOps or you're working toward similar goals, Let’s connect! I feel it would beneficial to bounce ideas or work on small projects together.

https://redd.it/1o94wdl
@r_devops

Need help with solution for scheduling one time noscripts/processes?

What devops solutions are out there to help run manual one time noscript/process every so often but at a later time?

For example, we have times where we need to make a schema update so we will run a sql command. But it will have to run on a weekend at 10pm when no one wants to work. It would be nice to schedule a command to run at the time and email us the output so we know it worked.

Or let’s say I need to run a bash noscript or a python noscript or something like that. But it’s just every once and awhile and I want to schedule an automation for it to happen. Like I know a process will need to run in 2 weeks at 10pm on Saturday only because there is another downstream application that is making an update.

AFAIK, Gitlab CI is set more to happen on intervals, so we can’t easily schedule a one time process. AWSEventBridge requires a lot of setup for the event and a lambda for it to kick off. I could 100% schedule a bash command locally but that requires that I have my laptop open and a connection on (which wouldn’t work because I need to sign into my auth proxies every 12 hours).

Does anyone else have these kinds of problems? What are your solutions?

https://redd.it/1o96udi
@r_devops

Deploying code with a Bootleg Bastion

Recently made a toy repo for deploying to an EC2 machine with no internet access. It was supposed to be a serious example, but then I realized I’d need to do quite a bit more to make it actually useful/secure.

So I just had fun with it instead. Thought y’all might get a kick out of it: https://github.com/JadenSimon/bootleg-bastion

Side note: how common is zero internet connectivity in prod setups? I figured it’s probably only the norm in regulated industries or big enterprises.

https://redd.it/1o9827r
@r_devops

V2 🏗️ Infrawise - Model your On-Prem vs Cloud Cost

HI guys, after your feedback from last time, I have turned my simple storage cost calculator into a financial cost modeling tool. I have tried my best to add every type of cost involved. Do you think I have missed something? I would love to hear your thoughts on it.

Website: https://infrawise.sagyamthapa.com.np
Github: https://github.com/Sagyam/Infra-Wise

https://preview.redd.it/kknqo9qbypvf1.png?width=1080&format=png&auto=webp&s=52bbdd7ed3d0885dce6996ab647212c3f9303114

https://preview.redd.it/7hdifyzcypvf1.png?width=320&format=png&auto=webp&s=7e5124662bcd4ed9c3721a94b80b18a2652991d6

https://preview.redd.it/2by4i50fypvf1.png?width=640&format=png&auto=webp&s=8be5771b15047609ea91fb6c963cd2e16e8b5d6c

https://preview.redd.it/jpa00ckgypvf1.png?width=1080&format=png&auto=webp&s=5743d6d7accb8679a7778bf019a5a5a9f5a6553a

https://preview.redd.it/p6wqj1yhypvf1.png?width=1080&format=png&auto=webp&s=609828ff77239e85145afa630c34aaaaf7d1708d



\# What's new

\- Presets for various types of businesses (e-commerce, AI/ML, Finance, etc.)

\- Energy, compute, storage, GPU, networking, human resources, software licensing, salary, security, and compliance costs.

\- Sensitivity analysis

\- Full text search

\- Cumulative and detailed cost breakdown

\- TCO vs Amortized analysis

\- CapEx vs OpEx breakdown

https://redd.it/1o99ywr
@r_devops

AKS Ghost pod incident

Hello DevOps experts. Please help me here with this head scratching situation I have faced in my org

So on our Prod AKS cluster on 5th Oct we saw an api gave 502
When the dev team investigated the 502 error they saw that the Request was sent to a pod which didn't exist that's why it returned 502.

Now when this issue got escalated to the DevOps team I was assigned to investigate and fix this issue. It is very rare cannot be reproduced but is happening to few more services where the api request is going to a non existing pod

When i investigated I saw the the Replica set of the pod which was called on 5th Oct was last alive on 26th September.
I can see the logs on elk and even on my grafana dashboard that the pod was last seen on 26th Sept after that new release took over the pods..

But when I tried to check the 5th Oct data on grafana I saw that the pod from the last replica set (Ghost) showed activity and even came up in the dashboard.

Now this shouldn't happen...
The pod was gone by 26th sept to 4th oct but suddenly 1 pod from that replicaset captured activity on 5th Oct and then again disappeared...

I checked the kubeproxy to see if any stale IPs are stored or not but no luck
Tried to check the logs but k8s store only 1 day of logs so again no luck

Cannot access etcd cause Azure managed

Please help me here what could be the reason for this
How can I fix this
And also share your experiences if you faced a similar case

https://redd.it/1o9af25
@r_devops

GCP Usecases

As A Jobs hunter in Devops Iam sicked of following this Linkedin, Naukri. Tried with outreaching startups cold emails got one internship. Now its time to get a full time job. So I just want to know where is mostly gchacloud is used and core cheaper and effective services of it. I want to get a grip over that I have an upcoming cert exam for gcp associate solutions architect and also iam skilled in aws also. So just want to know how I can get a devops job as gcp cloud engineer and architect. I have tried search stacks of startups in yc, more. But mostly startups tech is hidden. Just want to get a job with skills I have .
I have 2 internship experience of 3-6 months.

And one suggestion need I worked in a startup where my work was so small with 2 devops mentor. So even a company if they want to hire me they expect me to architect solutions independent ly and give job or consider me as a novice and assign a mentor to me and take as an intern again

https://redd.it/1o9a39v
@r_devops

Got any SAS ideas for stuff on top of Hetzner?

Got together with a few mates, to try and build some tools for people migrating to Hetzner from other platforms, but since neither of us did such a migration we have no idea where the pain points are and what other teams would be willing to trust a service automating. We figured reaching out to the wider community might be helpful for a bit of brainstorming. So anyone got a whish list for stuff that you'd want in Hetzner but can't be bothered to do yourself, it's the season to be jolly friend, plus if you're somewhere in the bad parts of EU (ahem, ahem, central eastern) we might be able to provide a colossal amount of alcohol to imbue.

https://redd.it/1o96ol5
@r_devops

Fellow Developers : What's one system optimization at work you're quietly proud of?

We all have that one optimization we're quietly proud of. The one that didn't make it into a blog post or company all-hands, but genuinely improved things. What's your version? Could be:

Infrastructure/cloud cost optimizations
Performance improvements that actually mattered
Architecture decisions that paid off
Even monitoring/alerting setups that caught issues early



https://redd.it/1o9fzl1
@r_devops

I'm working with devops team. Want to know career aspect

So, last July 25 I got job in devops team right after college. Some senior told me devops is very high growth in career. Like 35LPA after 3 years. Is it true or just some or one companu pays well other just nothing

https://redd.it/1o9ngbq
@r_devops