Scaling through crisis: how infrastructure handled 1B messages in a single day
https://www.reddit.com/r/programming/comments/1nodab9/scaling_through_crisis_how_infrastructure_handled/
<!-- SC_OFF -->We recently published a piece on ShiftMag (a project by Infobip) that I think might interest folks here. It’s a candid breakdown of how Infobip’s infrastructure team scaled to handling 10 billion messages in a single day — not just the technical wins, but also the painful outages, bad regexes, and hard lessons learned along the way. <!-- SC_ON --> submitted by /u/shift_devs (https://www.reddit.com/user/shift_devs)
[link] (https://shiftmag.dev/how-infobips-infrastructure-handled-10-billion-messages-in-a-day-6162/) [comments] (https://www.reddit.com/r/programming/comments/1nodab9/scaling_through_crisis_how_infrastructure_handled/)
https://www.reddit.com/r/programming/comments/1nodab9/scaling_through_crisis_how_infrastructure_handled/
<!-- SC_OFF -->We recently published a piece on ShiftMag (a project by Infobip) that I think might interest folks here. It’s a candid breakdown of how Infobip’s infrastructure team scaled to handling 10 billion messages in a single day — not just the technical wins, but also the painful outages, bad regexes, and hard lessons learned along the way. <!-- SC_ON --> submitted by /u/shift_devs (https://www.reddit.com/user/shift_devs)
[link] (https://shiftmag.dev/how-infobips-infrastructure-handled-10-billion-messages-in-a-day-6162/) [comments] (https://www.reddit.com/r/programming/comments/1nodab9/scaling_through_crisis_how_infrastructure_handled/)
SQL Is for Data, Not for Logic
https://www.reddit.com/r/programming/comments/1nodhc9/sql_is_for_data_not_for_logic/
submitted by /u/ewaldbenes (https://www.reddit.com/user/ewaldbenes)
[link] (https://ewaldbenes.com/en/blog/why-i-keep-business-logic-out-of-sql) [comments] (https://www.reddit.com/r/programming/comments/1nodhc9/sql_is_for_data_not_for_logic/)
https://www.reddit.com/r/programming/comments/1nodhc9/sql_is_for_data_not_for_logic/
submitted by /u/ewaldbenes (https://www.reddit.com/user/ewaldbenes)
[link] (https://ewaldbenes.com/en/blog/why-i-keep-business-logic-out-of-sql) [comments] (https://www.reddit.com/r/programming/comments/1nodhc9/sql_is_for_data_not_for_logic/)
A Tour of eBPF in the Linux Kernel: Observability, Security and Networking
https://www.reddit.com/r/programming/comments/1noezi3/a_tour_of_ebpf_in_the_linux_kernel_observability/
<!-- SC_OFF -->I published a new blog post: "A Tour of eBPF in the Linux Kernel: Observability, Security and Networking". I recently read the book "Learning eBPF" by Liz Rice and condensed my notes into this article. Great for a quick overview before you decide to dive deeper! <!-- SC_ON --> submitted by /u/lucavallin (https://www.reddit.com/user/lucavallin)
[link] (https://www.lucavall.in/blog/a-tour-of-ebpf-in-the-linux-kernel-observability-security-and-networking) [comments] (https://www.reddit.com/r/programming/comments/1noezi3/a_tour_of_ebpf_in_the_linux_kernel_observability/)
https://www.reddit.com/r/programming/comments/1noezi3/a_tour_of_ebpf_in_the_linux_kernel_observability/
<!-- SC_OFF -->I published a new blog post: "A Tour of eBPF in the Linux Kernel: Observability, Security and Networking". I recently read the book "Learning eBPF" by Liz Rice and condensed my notes into this article. Great for a quick overview before you decide to dive deeper! <!-- SC_ON --> submitted by /u/lucavallin (https://www.reddit.com/user/lucavallin)
[link] (https://www.lucavall.in/blog/a-tour-of-ebpf-in-the-linux-kernel-observability-security-and-networking) [comments] (https://www.reddit.com/r/programming/comments/1noezi3/a_tour_of_ebpf_in_the_linux_kernel_observability/)
Your Images Are (Probably) Oversized
https://www.reddit.com/r/programming/comments/1nogdup/your_images_are_probably_oversized/
submitted by /u/HenriqueInonhe (https://www.reddit.com/user/HenriqueInonhe)
[link] (https://reasonunderpressure.com/blog/posts/your-images-are-probably-oversized) [comments] (https://www.reddit.com/r/programming/comments/1nogdup/your_images_are_probably_oversized/)
https://www.reddit.com/r/programming/comments/1nogdup/your_images_are_probably_oversized/
submitted by /u/HenriqueInonhe (https://www.reddit.com/user/HenriqueInonhe)
[link] (https://reasonunderpressure.com/blog/posts/your-images-are-probably-oversized) [comments] (https://www.reddit.com/r/programming/comments/1nogdup/your_images_are_probably_oversized/)
CodeRabbit Commits 1 Million to Open Source Software Sponsorships.
https://www.reddit.com/r/programming/comments/1nohta2/coderabbit_commits_1_million_to_open_source/
submitted by /u/rag1987 (https://www.reddit.com/user/rag1987)
[link] (https://www.coderabbit.ai/blog/coderabbit-commits-1-million-to-open-source) [comments] (https://www.reddit.com/r/programming/comments/1nohta2/coderabbit_commits_1_million_to_open_source/)
https://www.reddit.com/r/programming/comments/1nohta2/coderabbit_commits_1_million_to_open_source/
submitted by /u/rag1987 (https://www.reddit.com/user/rag1987)
[link] (https://www.coderabbit.ai/blog/coderabbit-commits-1-million-to-open-source) [comments] (https://www.reddit.com/r/programming/comments/1nohta2/coderabbit_commits_1_million_to_open_source/)
Go has added Valgrind support
https://www.reddit.com/r/programming/comments/1nominv/go_has_added_valgrind_support/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://go-review.googlesource.com/c/go/+/674077) [comments] (https://www.reddit.com/r/programming/comments/1nominv/go_has_added_valgrind_support/)
https://www.reddit.com/r/programming/comments/1nominv/go_has_added_valgrind_support/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://go-review.googlesource.com/c/go/+/674077) [comments] (https://www.reddit.com/r/programming/comments/1nominv/go_has_added_valgrind_support/)
The YAML Document from Hell
https://www.reddit.com/r/programming/comments/1nompmr/the_yaml_document_from_hell/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://ruudvanasseldonk.com/2023/01/11/the-yaml-document-from-hell) [comments] (https://www.reddit.com/r/programming/comments/1nompmr/the_yaml_document_from_hell/)
https://www.reddit.com/r/programming/comments/1nompmr/the_yaml_document_from_hell/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://ruudvanasseldonk.com/2023/01/11/the-yaml-document-from-hell) [comments] (https://www.reddit.com/r/programming/comments/1nompmr/the_yaml_document_from_hell/)
I've built a Swiss Tables interactive simulator so you can understand how they work internally and how they offer superior performance compared to Buckets
https://www.reddit.com/r/programming/comments/1nomqrc/ive_built_a_swiss_tables_interactive_simulator_so/
<!-- SC_OFF -->As you may know, this year Go switched its hashmap implementation from Buckets to Swiss tables looking for a boost in performance, how much? A lot according to Datadog (https://www.reddit.com/r/programming/comments/1m3di7x/how_go_124s_swiss_tables_saved_hundreds_of/): Go 1.24's Swiss Tables cut our map memory usage by up to 70% in high traffic workloads So I made a visual version of Swiss Tables and a tutorial so you can have an overall view of them and understand why they're so fast <!-- SC_ON --> submitted by /u/prox_sea (https://www.reddit.com/user/prox_sea)
[link] (https://coffeebytes.dev/en/software-architecture/swiss-tables-the-superior-performance-hashmap/) [comments] (https://www.reddit.com/r/programming/comments/1nomqrc/ive_built_a_swiss_tables_interactive_simulator_so/)
https://www.reddit.com/r/programming/comments/1nomqrc/ive_built_a_swiss_tables_interactive_simulator_so/
<!-- SC_OFF -->As you may know, this year Go switched its hashmap implementation from Buckets to Swiss tables looking for a boost in performance, how much? A lot according to Datadog (https://www.reddit.com/r/programming/comments/1m3di7x/how_go_124s_swiss_tables_saved_hundreds_of/): Go 1.24's Swiss Tables cut our map memory usage by up to 70% in high traffic workloads So I made a visual version of Swiss Tables and a tutorial so you can have an overall view of them and understand why they're so fast <!-- SC_ON --> submitted by /u/prox_sea (https://www.reddit.com/user/prox_sea)
[link] (https://coffeebytes.dev/en/software-architecture/swiss-tables-the-superior-performance-hashmap/) [comments] (https://www.reddit.com/r/programming/comments/1nomqrc/ive_built_a_swiss_tables_interactive_simulator_so/)
Awash in revisionist histories about Apple's web efforts, a look at the evidence
https://www.reddit.com/r/programming/comments/1nomsqf/awash_in_revisionist_histories_about_apples_web/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://infrequently.org/2025/09/cupertinos-comforting-myths/) [comments] (https://www.reddit.com/r/programming/comments/1nomsqf/awash_in_revisionist_histories_about_apples_web/)
https://www.reddit.com/r/programming/comments/1nomsqf/awash_in_revisionist_histories_about_apples_web/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://infrequently.org/2025/09/cupertinos-comforting-myths/) [comments] (https://www.reddit.com/r/programming/comments/1nomsqf/awash_in_revisionist_histories_about_apples_web/)
Exploring GrapheneOS secure allocator: Hardened Malloc
https://www.reddit.com/r/programming/comments/1nomtel/exploring_grapheneos_secure_allocator_hardened/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://www.synacktiv.com/en/publications/exploring-grapheneos-secure-allocator-hardened-malloc) [comments] (https://www.reddit.com/r/programming/comments/1nomtel/exploring_grapheneos_secure_allocator_hardened/)
https://www.reddit.com/r/programming/comments/1nomtel/exploring_grapheneos_secure_allocator_hardened/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://www.synacktiv.com/en/publications/exploring-grapheneos-secure-allocator-hardened-malloc) [comments] (https://www.reddit.com/r/programming/comments/1nomtel/exploring_grapheneos_secure_allocator_hardened/)
Postgres’ Original Project Goals: The Creators Totally Nailed It
https://www.reddit.com/r/programming/comments/1nonal1/postgres_original_project_goals_the_creators/
submitted by /u/craigkerstiens (https://www.reddit.com/user/craigkerstiens)
[link] (https://www.crunchydata.com/blog/the-postgres-project-original-goals-and-how-the-creators-totally-nailed-it) [comments] (https://www.reddit.com/r/programming/comments/1nonal1/postgres_original_project_goals_the_creators/)
https://www.reddit.com/r/programming/comments/1nonal1/postgres_original_project_goals_the_creators/
submitted by /u/craigkerstiens (https://www.reddit.com/user/craigkerstiens)
[link] (https://www.crunchydata.com/blog/the-postgres-project-original-goals-and-how-the-creators-totally-nailed-it) [comments] (https://www.reddit.com/r/programming/comments/1nonal1/postgres_original_project_goals_the_creators/)
Fifty Years of Open Source Software Supply-Chain Security
https://www.reddit.com/r/programming/comments/1nop0qq/fifty_years_of_open_source_software_supplychain/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://cacm.acm.org/practice/fifty-years-of-open-source-software-supply-chain-security/) [comments] (https://www.reddit.com/r/programming/comments/1nop0qq/fifty_years_of_open_source_software_supplychain/)
https://www.reddit.com/r/programming/comments/1nop0qq/fifty_years_of_open_source_software_supplychain/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://cacm.acm.org/practice/fifty-years-of-open-source-software-supply-chain-security/) [comments] (https://www.reddit.com/r/programming/comments/1nop0qq/fifty_years_of_open_source_software_supplychain/)
Compiling a Functional Language to LLVM
https://www.reddit.com/r/programming/comments/1nop1aw/compiling_a_functional_language_to_llvm/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://danieljharvey.github.io/posts/2023-02-08-llvm-compiler-part-1.html) [comments] (https://www.reddit.com/r/programming/comments/1nop1aw/compiling_a_functional_language_to_llvm/)
https://www.reddit.com/r/programming/comments/1nop1aw/compiling_a_functional_language_to_llvm/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://danieljharvey.github.io/posts/2023-02-08-llvm-compiler-part-1.html) [comments] (https://www.reddit.com/r/programming/comments/1nop1aw/compiling_a_functional_language_to_llvm/)
Targetting specific characters with CSS rules
https://www.reddit.com/r/programming/comments/1nop1cw/targetting_specific_characters_with_css_rules/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://shkspr.mobi/blog/2025/09/targetting-specific-characters-with-css-rules/) [comments] (https://www.reddit.com/r/programming/comments/1nop1cw/targetting_specific_characters_with_css_rules/)
https://www.reddit.com/r/programming/comments/1nop1cw/targetting_specific_characters_with_css_rules/
submitted by /u/ketralnis (https://www.reddit.com/user/ketralnis)
[link] (https://shkspr.mobi/blog/2025/09/targetting-specific-characters-with-css-rules/) [comments] (https://www.reddit.com/r/programming/comments/1nop1cw/targetting_specific_characters_with_css_rules/)
Building my own web session recorder
https://www.reddit.com/r/programming/comments/1noqaud/building_my_own_web_session_recorder/
submitted by /u/takkatakka (https://www.reddit.com/user/takkatakka)
[link] (https://www.scryspell.com/blog/2025-09-21-building-my-own-session-recorder-how-i-built-scry-analytics) [comments] (https://www.reddit.com/r/programming/comments/1noqaud/building_my_own_web_session_recorder/)
https://www.reddit.com/r/programming/comments/1noqaud/building_my_own_web_session_recorder/
submitted by /u/takkatakka (https://www.reddit.com/user/takkatakka)
[link] (https://www.scryspell.com/blog/2025-09-21-building-my-own-session-recorder-how-i-built-scry-analytics) [comments] (https://www.reddit.com/r/programming/comments/1noqaud/building_my_own_web_session_recorder/)
Just Let Me Select Text
https://www.reddit.com/r/programming/comments/1nostrl/just_let_me_select_text/
submitted by /u/aartaka (https://www.reddit.com/user/aartaka)
[link] (https://aartaka.me/select-text.html) [comments] (https://www.reddit.com/r/programming/comments/1nostrl/just_let_me_select_text/)
https://www.reddit.com/r/programming/comments/1nostrl/just_let_me_select_text/
submitted by /u/aartaka (https://www.reddit.com/user/aartaka)
[link] (https://aartaka.me/select-text.html) [comments] (https://www.reddit.com/r/programming/comments/1nostrl/just_let_me_select_text/)
defer and errdefer in Rust
https://www.reddit.com/r/programming/comments/1nowrn3/defer_and_errdefer_in_rust/
submitted by /u/phaazon_ (https://www.reddit.com/user/phaazon_)
[link] (https://strongly-typed-thoughts.net/blog/rust-defer-errdefer.md) [comments] (https://www.reddit.com/r/programming/comments/1nowrn3/defer_and_errdefer_in_rust/)
https://www.reddit.com/r/programming/comments/1nowrn3/defer_and_errdefer_in_rust/
submitted by /u/phaazon_ (https://www.reddit.com/user/phaazon_)
[link] (https://strongly-typed-thoughts.net/blog/rust-defer-errdefer.md) [comments] (https://www.reddit.com/r/programming/comments/1nowrn3/defer_and_errdefer_in_rust/)
The Hardware Knowledge that Every programmer should know
https://www.reddit.com/r/programming/comments/1np1irj/the_hardware_knowledge_that_every_programmer/
submitted by /u/stackoverflooooooow (https://www.reddit.com/user/stackoverflooooooow)
[link] (https://needoneapp.medium.com/the-hardware-knowledge-that-every-programmer-should-know-f62cf4ba8bdc) [comments] (https://www.reddit.com/r/programming/comments/1np1irj/the_hardware_knowledge_that_every_programmer/)
https://www.reddit.com/r/programming/comments/1np1irj/the_hardware_knowledge_that_every_programmer/
submitted by /u/stackoverflooooooow (https://www.reddit.com/user/stackoverflooooooow)
[link] (https://needoneapp.medium.com/the-hardware-knowledge-that-every-programmer-should-know-f62cf4ba8bdc) [comments] (https://www.reddit.com/r/programming/comments/1np1irj/the_hardware_knowledge_that_every_programmer/)
How We Unified API Tests, SDKs, and Docs Into One Workflow
https://www.reddit.com/r/programming/comments/1np1vwb/how_we_unified_api_tests_sdks_and_docs_into_one/
submitted by /u/ndbroadbent (https://www.reddit.com/user/ndbroadbent)
[link] (https://docspring.com/blog/posts/how-we-unified-api-tests-sdks-and-docs-into-one-workflow/) [comments] (https://www.reddit.com/r/programming/comments/1np1vwb/how_we_unified_api_tests_sdks_and_docs_into_one/)
https://www.reddit.com/r/programming/comments/1np1vwb/how_we_unified_api_tests_sdks_and_docs_into_one/
submitted by /u/ndbroadbent (https://www.reddit.com/user/ndbroadbent)
[link] (https://docspring.com/blog/posts/how-we-unified-api-tests-sdks-and-docs-into-one-workflow/) [comments] (https://www.reddit.com/r/programming/comments/1np1vwb/how_we_unified_api_tests_sdks_and_docs_into_one/)
Beginner Friendly Java Guide Part 1 Looking for Feedback!
https://www.reddit.com/r/programming/comments/1np2yza/beginner_friendly_java_guide_part_1_looking_for/
submitted by /u/Connect-Opening-5475 (https://www.reddit.com/user/Connect-Opening-5475)
[link] (https://mirajmaroni.wixsite.com/mimicoding) [comments] (https://www.reddit.com/r/programming/comments/1np2yza/beginner_friendly_java_guide_part_1_looking_for/)
https://www.reddit.com/r/programming/comments/1np2yza/beginner_friendly_java_guide_part_1_looking_for/
submitted by /u/Connect-Opening-5475 (https://www.reddit.com/user/Connect-Opening-5475)
[link] (https://mirajmaroni.wixsite.com/mimicoding) [comments] (https://www.reddit.com/r/programming/comments/1np2yza/beginner_friendly_java_guide_part_1_looking_for/)
From Batch to Insights: How to Automate Data Validation Workflows
https://www.reddit.com/r/programming/comments/1np5m74/from_batch_to_insights_how_to_automate_data/
<!-- SC_OFF -->Hey r/programming (https://www.reddit.com/r/programming), I've been thinking a lot about the common pain points of dealing with unvalidated or "dirty" data, especially when working with large datasets. Manual cleaning is incredibly time-consuming and often a huge bottleneck for getting projects off the ground or maintaining data pipelines. It feels like a constant battle against inaccurate reports, compliance risks, and just generally wasted effort. Specifically, I'm looking into approaches for automating validation across different data types—like email addresses, mobile numbers, IP addresses, and even browser user-agents—for batch processing. Has anyone here implemented solutions using external APIs for this kind of batch data validation? What were your experiences? What are your thoughts on: * The challenges of integrating such third-party validation services? * Best practices for handling asynchronous batch processing (submission, polling, retrieval)? * The ROI you've seen from automating these processes versus maintaining manual checks or in-house solutions? * Any particular types of validation (e.g., email deliverability, mobile line type, IP threat detection) that have given you significant headaches or major wins with automation? Would love to hear about your experiences, cautionary tales, or success stories in building robust, automated data validation workflows! Cheers! <!-- SC_ON --> submitted by /u/Available-Floor9213 (https://www.reddit.com/user/Available-Floor9213)
[link] (https://www.onboardingbuddy.co/blog/from-batch-to-insights-data-validation) [comments] (https://www.reddit.com/r/programming/comments/1np5m74/from_batch_to_insights_how_to_automate_data/)
https://www.reddit.com/r/programming/comments/1np5m74/from_batch_to_insights_how_to_automate_data/
<!-- SC_OFF -->Hey r/programming (https://www.reddit.com/r/programming), I've been thinking a lot about the common pain points of dealing with unvalidated or "dirty" data, especially when working with large datasets. Manual cleaning is incredibly time-consuming and often a huge bottleneck for getting projects off the ground or maintaining data pipelines. It feels like a constant battle against inaccurate reports, compliance risks, and just generally wasted effort. Specifically, I'm looking into approaches for automating validation across different data types—like email addresses, mobile numbers, IP addresses, and even browser user-agents—for batch processing. Has anyone here implemented solutions using external APIs for this kind of batch data validation? What were your experiences? What are your thoughts on: * The challenges of integrating such third-party validation services? * Best practices for handling asynchronous batch processing (submission, polling, retrieval)? * The ROI you've seen from automating these processes versus maintaining manual checks or in-house solutions? * Any particular types of validation (e.g., email deliverability, mobile line type, IP threat detection) that have given you significant headaches or major wins with automation? Would love to hear about your experiences, cautionary tales, or success stories in building robust, automated data validation workflows! Cheers! <!-- SC_ON --> submitted by /u/Available-Floor9213 (https://www.reddit.com/user/Available-Floor9213)
[link] (https://www.onboardingbuddy.co/blog/from-batch-to-insights-data-validation) [comments] (https://www.reddit.com/r/programming/comments/1np5m74/from_batch_to_insights_how_to_automate_data/)