I Battled Google's Inconsistent Docs to Set Up Custom Error Pages with Cloud Armor + Load Balancer, Here's the Workaround That Saved the Day

As a cloud consultant and staff cloud engineer, I’ve seen my fair share of GCP quirks, but setting up a custom error page for Cloud Armor–blocked traffic was a real nightmare! 😫

Setup: HTTP(S) Load Balancer, Cloud Run backend, and a GCS-hosted error page. Google’s docs made it sound possible, but contradictory info and Terraform errors told a different story, no love for serverless NEGs.

I dug through this subreddit for answers (no luck), then turned to GitHub issues and a lot of trial and error. Eventually, I figured out a slick workaround: using Cloud Armor redirects to a branded GCS page instead of the ugly generic 403s. Client’s happy, and I’m not stuck explaining why GCP docs feel like a maze.

Full story and Terraform code here: Setting up a Custom Error Page with Cloud Armor and Load Balancer (on Medium).

TL;DR: GCP docs are messy, custom_error_response_policy doesn’t work for Cloud Armor + serverless. Used Cloud Armor redirects to GCS instead. Code’s in the article!

So what’s your worst GCP doc struggle? Anyone got Cloud Armor hacks or workarounds? Spill the beans.

==========================
Documentation Contradiction:

One part of the documentation states that custom error pages work for errors generated by Cloud Armor: [https://cloud.google.com/load-balancing/docs/https/custom-error-response?utm\_source=chatgpt.com](https://cloud.google.com/load-balancing/docs/https/custom-error-response?utm_source=chatgpt.com)
However, another part of the same documentation says the policy only applies to responses that come from the backend, not the Google Front End (GFE). Since Cloud Armor operates at the GFE level, it seems this feature is not applicable to our setup: https://cloud.google.com/load-balancing/docs/https/custom-error-response?utm\_source=chatgpt.com#limitations

https://redd.it/1nh3ae8
@r_devops

Small teams adapting faster to AI-driven changes in software delivery?

Interesting early signal from the first two weeks live of Warestack.

While we expected mid-size engineering organizations to jump in first, it’s the smaller, fast-moving teams that are setting up modern processes and context-aware rules to keep AI-driven changes safe.

They already sense how quickly the ground is shifting:

- AI code editors are writing production code and developers don’t always own every change
- Autonomous agents may soon manage pull requests end-to-end

That means unmanaged changes can reach production in seconds. Some of these smaller teams are already moving beyond static GitHub settings toward more agentic, adaptive guardrails, like:

- Enforce smart review thresholds (e.g. large PRs require extra reviewers) with the flexibility to bypass only when an urgent hotfix is created by a senior team member
- Apply critical-path ownership and secret / config change controls
- Block risky deployments outside approved windows
- Align every PR with its project ticket to keep scope transparent


Curious if others here have seen similar patterns - are small teams actually quicker at adapting to this shift than larger organizations?

https://redd.it/1nh5dcn
@r_devops

Wanna build a production ready fullstack website

I’ve only done like student projects never deployed or done something scalable. If anyone’s willing to coach/manage/guide me through the process would be greatly appreciated. Having trouble figuring out the apis and tools ill need to calculate like a cost analysis and have an accurate full picture.
I have an initial functional and non functional requirements list but I need experienced advice and reviews theres alot i dont know about im in way over my head

https://redd.it/1nh7h12
@r_devops

Need Help in Learning Devops

I'll be joining Cognizant as a Fresher and I'm planning to learn Devops during this and in 1-1.5 years after cognizant,get a Devops job.
How can I do that?
What all resources should I follow??
How can I manage work along with Devops learning coz I will be doing a non Devops work in cognizant most probably..

https://redd.it/1nhddcv
@r_devops

Looking for minimal containers with built in audit trails and signed metadata

Our environment demands high transparency like every deployed container image must be traceable and verifiable. We are talking signed provenance, tamper proof SBOMs, and easy audit exports for regulatory reviews.
The usual workflow of building images locally and then generating SBOMs feels brittle. manual, inconsistent, and prone to oversight. Ideally i would use ready made, minimal container images that include signed SBOMs and provenance data. Even better if they integrate with our CI/CD pipeline and help speed up compliance audits. Any recommendations?



https://redd.it/1nhf3bs
@r_devops

Feeling unfulfilled in tech

Hey ,

I’m currently a Software Engineer with 2.4 years of experience at a major MNC, and I’m finding myself at a professional crossroads. While I've been doing decent in my career so far, I’m feeling a deep sense of unfulfillment. I've always been good in the of my peer group because of my ability to learn quickly and solve complex problems, but the tech itself just doesn’t excite me anymore. I'm ready for something more.

I'm not looking for just another job or a promotion. I'm looking for something worthwhile. I believe my intelligence and drive can be applied to much more than optimizing pipelines. I want to use my skills to solve a real-world problem and build something that truly matters.

I’m not interested in the stereotypical path of an MBA or upskilling in a field that no longer resonates with me. Instead, my biggest goal is to work with and learn from highly influential people—founders, visionaries, and leaders who have already succeeded. I want to be in an environment where I can absorb their wisdom and contribute .

I'm open to almost any field. I'm a fast learner and adaptable. I’m a tech professional on paper, but at my core, I'm a problem-solver who just happens to be getting paid for it. If you're a leader who is tackling a real-world challenge, and you're looking for someone with an intense will to build something worthwhile, let’s talk.

I’m ready to put my all into a new challenge. If you’re a founder or visionary who can offer a role with fantastic environment, I’d love to connect.

Feel free to comment or send me a DM.

https://redd.it/1nhg46l
@r_devops

Steps to move to DevSecOps

Hello, i am wondering what would be the ideal steps to add Sec on top of DevOps poisition. Where to even begin?

There is quite push to start somewhere in my small company and position opened for anyone interested in the team. Where should i begin?

https://redd.it/1nhgjfh
@r_devops

[Hiring] [Remote] [Competitive Pay] Technical Project Manager

FP Block is a blockchain consulting firm (formerly FP Complete, founded 2012) delivering high-performance applications across EVM, Cosmos, Solana, and Near. We are hiring a Technical Project Manager to oversee timelines, communication, and project deliveries.

What you will do:

* Manage 1–3 projects in GameFi, DeFi, high-frequency trading, dapps, and audits
* Coordinate between clients and engineers in a fully remote setup
* Ensure smooth execution using agile practices

What we are looking for:

* 4+ years project management in software, DevOps, finance, or blockchain
* Strong English and async communication skills
* Proven track record with stakeholders and deliverables

Big pluses:

* Experience across multiple areas (development, DevOps, finance, blockchain)
* Smart contract or dapp project management
* Cloud or distributed systems knowledge

Apply by sending your CV and a short cover letter to [jobs@fpcomplete.com](mailto:jobs@fpcomplete.com).
More info: [www.fpblock.com/jobs](http://www.fpblock.com/jobs)
Reddit: [https://www.reddit.com/r/FPBlock/](https://www.reddit.com/r/FPBlock/)

https://redd.it/1nhfjs1
@r_devops

Is support in the same time zone important to you?

Have you ever dropped (or avoided) a tool because the vendor was on the ‘wrong’ side of the world for your team?

I‘ve had a quite interesting discussion with my buddy working as a CTO (based in Germany), who said he prefers to work with European Vendors due to their customer support being in the same time zone. Of course AI Bots are reducing this friction, but still.

Would you chose a US-based vendor over an Australian or European? Or does time zone difference not have any impact at all?

https://redd.it/1nhk60j
@r_devops

Feeling stuck in DevOps career after 2 years, not sure how to prepare for interviews

Hey folks,

I have been working as the DevOps Engineer with 2 yrs of experience, so my current company is completely uncertain and don't know what will happen at what time, so I am applying for job switch , I have did good accomplishments like scaling Kubernetes workloads, automating mobile build pipeline from scratch but the thing is, I am not mastered any of the things, I kept my footprints in the all the tech stacks and worked on demand by researching it.

Recently i gave an interview with ZETA for SRE 2 role, they asked me below questions
1. Jenkinsfile stages , like checkout,build, push and deploy so I wrote the skeleton


2 - python question (two sum problem), i solved it, but u was asked for the time complexity of the 5 line python problem 🙂, why do DevOps Engineers need Time complexity, since we use python most of the time to automatic the tasks


3 - python noscript for archiving 10 days older file and push to s3, I created a pseudocode noscript with the flow



4 - among 3 replica , 1 pod is giving crashloopback, I answered , possibilities, OOMkilled, PvC in different regions node is in different

But they expected the bookish answers I think, Nothing they have asked about my work which i mentioned in resume, just came up with the questions and share it with Google docs

Pls can anyone guide me how can I prepare for the interview and become interview-ready

Thank you in advance

https://redd.it/1nhlgn0
@r_devops

Our AWS bill is getting insane (>95k/mo), I'm going insane, how do we even start to lower it?

Our company's AWS bill has been steadily climbing for the past few months and it's starting to get out of control.



We don't even fully understand why. We have all the usual monitoring tools and dashboards, which tell us what services are costing the most (EC2, RDS, S3, of course), and when usage spikes. But things are still unpredictable.



It feels like we're constantly reacting. We see a spike, we investigate, maybe we find an obvious runaway process or an unoptimized query, we fix it, and then another cost center pops up somewhere else. It's getting rly fkn annoying.



We don't know which teams are contributing most to the increases in a meaningful way. We can see service usage, but translating that into "Team A's new feature" or "Team B's analytics pipeline" is a manual, time-consuming nightmare involving cross-referencing dashboards and asking around.



We don't know why specific architectural decisions or code deployments are leading to cost increases before they become a problem.



Our internal discussions about cost optimization often go in circles because everyone has anecdotal evidence, but we lack a clear, synthesized understanding of the underlying drivers. Is it dev environments? Is it staging? Is it that new batch job? Is it just general growth?. No way to validate these.



We're trying to implement FinOps principles, but without a clear way to attribute costs and understand the why behind usage patterns, it's incredibly difficult to foster a culture of cost awareness and ownership among our engineering teams. We need something that can connect the dots between our technical metrics and the actual human decisions and activities driving them.



Any advice or tips would be greatly appreciated. Also open to third party tools as long as they won't take over our account or billing.

https://redd.it/1nhlsz5
@r_devops

P50 vs P95 vs P99 Latency: What These Percentiles Actually Mean

A practical guide to understanding P50, P95, and P99 latency percentiles—why averages lie, what each percentile tells you about user experience, how to set SLOs around them, and how to collect them correctly with histograms.



https://oneuptime.com/blog/post/2025-09-15-p50-vs-p95-vs-p99-latency-percentiles/view

https://redd.it/1nhlknf
@r_devops

How often do you actually use scalability models (like the Universal Scalability Law) in DevOps practice?

I’ve been studying the Universal Scalability Law (USL) introduced by Neil. J. Gunther, which models throughput with factors for resource contention (σ) and coordination overhead (κ).

On paper it feels like a great way to reason about when adding servers stops giving you linear gains. But in real SRE/DevOps practice, I rarely see people talk about it explicitly.

For example: do you ever use USL (or similar models) to guide capacity planning, cluster sizing, or cost/performance trade-offs? Or is it more common to rely purely on load testing and dashboards?

Curious to hear how much theory like this actually makes it into day-to-day operations, and if you’ve seen cases where it helped (or failed) in real-world systems.

Reference for USL: https://cran.r-project.org/web/packages/usl/vignettes/usl.pdf?

https://redd.it/1nhltik
@r_devops

Migrating GKE Dataplane V1 → V2 (PVC Backup + Terraform state questions)

Hi everyone,

I’m currently testing a migration from GKE Dataplane V1 to V2 and decided to use GKE Backup for the process. I’ve run into two issues and would love some advice from people with more experience:


1. PVC Backup stuck in Pending
• Whenever I try to back up PVCs, the restore ends up stuck in Pending.
• I also noticed that the StorageClass changes automatically (from standard-rwo → gce-pd-gkebackup-de).
• Is this expected? Do I need to adjust snapshot config or handle StorageClass mapping differently?



2. Terraform state management after upgrade
• My cluster and resources are managed with Terraform (state stored in GCS).
• After upgrading, I thought about running terraform import on existing resources to re-sync them with state.
• Is that the right approach, or would you recommend another strategy (e.g. terraform state mv, or letting Terraform recreate)?


I’m still learning, so I’d really appreciate best practices or lessons learned from anyone who’s been through a Dataplane V1 → V2 migration 🙏

https://redd.it/1nhry7f
@r_devops

DNS server on Macos

Hey,

I am a devops engineer and the company for some reason gave me a Mac (not my initial choice btw)
I want some DNS server tool, where I can manage dns server and Microsoft AD, anyone?

https://redd.it/1nhoz4p
@r_devops

How to get DevOps job

Hello everyone i am a relitavely new DevOps person. I just graduated from college and i am looking into DevOps jobs but I cant seem to find any jobs that fits my requirements. They are looking for 5+ years experience in this field and there arent many entry level roles in this field.
Can you tell me how to get started i am applying non stop to the jobs with chatgpt premium by modifying my resume to the targeted jobs and even lying in some areas but i am still getting rejection mails.
I have a very good understanding of my field i have certifications of AWS, RHCSA (almost finishing RHCE now), and terraform and i have done multiple projects (Terraform, ansible, ec2,Kubernetes ,Eks) self projects since i have no prior DevOps working experience i just have 1 year software development experience in my Home country not here
any leads or idea on how to get a job would be appreciated
thank you
this is my resume https://docs.google.com/document/d/1db9Q4XpLDRNKhTeN0RUa4Ff9rhNBuT3nVlyyHbCjekA/edit?usp=sharing
If anyone wants to see it

https://redd.it/1nhyall
@r_devops

Is it good to upgrade in macOS Tahoe 26 now?

Are there any bugs or issues that you have encountered or know so far while doing Flutter dev?

https://redd.it/1ni50oy
@r_devops

Same docker image behaving differently

I have docker container running in kubernetes cluster, its a java app that does video processing using ffmpeg and ffprobe, i ran into weird problem here, it was running fine till last week but recently dev pushed something and it stopped working at ffprobe command. I did git hard reset to the old commit and built a image, still no luck. So i used old image and it works.. also same docker image works in one cluster but not in diff cluster.. please help i am running out of ideas to check

https://redd.it/1ni9dym
@r_devops

I NEED A MOBILE PAGER

I’ve been banging my head against this for a while and can’t quite land on the best solution, so hoping someone here can point me in the right direction.

I’ve got CloudWatch + SSM set up on my EC2 instances to monitor CPU, memory, and disk. The alerting part works fine, but the way I receive them is the problem.SMS is too costly in the long run while Emails end up buried and don’t really grab my attention.


What I’d really like is some kind of free pager-style app for Android that AWS can push notifications to (via HTTP/HTTPS API) — something loud and impossible to ignore, like a siren on my phone.

Does anyone have a solid recommendation for this kind of setup? Ideally free, reliable, and works well with AWS alarms.

Appreciate any tips or personal experiences


gpt enhanced for clarity

https://redd.it/1niaqhe
@r_devops

AWS ECS ( CI / CD )

which CI/CD you guys are using and which is better ??

note : needs to self hosted

https://redd.it/1niapty
@r_devops

DevOps team set up 15 different clusters 'for testing.' That was 8 months ago and we're still paying $87K/month for abandoned resources.

Our Devs team spun up a bunch of AWS infra for what was supposed to be a two-week performance testing sprint. We had EKS clusters, RDS instances (provisioned with GP3/IOPS), ELBs, EBS volumes, and a handful of supporting EC2s.

The ticket was closed, everyone moved on. Fast forward eight and a half months… yesterday I was doing some cost exploration in the dev account and almost had a heart attack. We were paying $87k/month for environments with no application traffic, near-zero CloudWatch metrics, and no recent console/API activity for eight and a half months. No owner tags, no lifecycle TTLs, lots of orphaned snapshots and unattached volumes.

Governance tooling exists, but the process to enforce it doesn’t. This is less about tooling gaps and more about failing to require ownership, automated teardown, and cost gates at provision time. Anyone have a similar story to make me feel better? What guardrails do you have to prevent this?

https://redd.it/1nieqfn
@r_devops