Network mapping could help you with debug problems and understand real network interaction between your microservices. So this implementation with Grafana https://betterprogramming.pub/improve-cluster-monitoring-with-network-mapping-in-grafana-fa8bb479fd47
Medium
Improve Cluster Monitoring With Network Mapping in Grafana
A deep dive into obtaining network maps and correlating IP with cluster workloads to speed up debugging
Good article about Cgroups in Linux https://towardsdatascience.com/the-power-of-linux-cgroups-how-containers-take-control-of-their-resources-ba564fef13b0
All we know that "at least privileges model" one of the most important parts the security. But why people still struggle with it? https://sysdig.com/blog/identity-access-management-difficult-cloud/
Sysdig
Why Companies Still Struggle with Least Privilege in the Cloud | Sysdig
According to the Sysdig 2023 Cloud-Native Usage Report, misconfigurations are still the biggest player in security incidents and, therefore, should be one of the greatest causes for concern in organizations.
Guy share the company experience about building Infrastructure platform with k8s https://betterprogramming.pub/how-we-built-an-infrastructure-platform-on-top-of-kubernetes-a39e67d85680
Medium
How We Built an Infrastructure Platform on Top of Kubernetes
How and why we used kubernetes for our infrastructure platform and some lessons learned along the way
Linkedin engineering team's article about autoscaling builds https://engineering.linkedin.com/blog/2023/scaling-autobuild--our-journey-towards-delivering-an-enhanced-cu
Linkedin
Scaling AutoBuild: Our Journey Towards Delivering An Enhanced Customer Experience
Never forget about security in your cluster https://medium.com/@badawekoo/harden-kubernetes-cluster-with-pod-and-container-security-contexts-119639dbb6ce
Medium
Harden Kubernetes cluster with Pod and container security contexts
When it comes to security in Kubernetes, It is very vital to secure the individual resources of the cluster. Pods and containers are…
Continuous profiling for Python applications https://medium.com/@martin.heinz/boost-your-python-application-performance-using-continuous-profiling-7eb993e68d23
Medium
Boost Your Python Application Performance Using Continuous Profiling
Learn how to use Grafana Phlare and continuous profiling to discover bottlenecks in you code and boost the performance of your Python apps
Good article about scaning vulnerabilities
https://semaphoreci.com/blog/govulncheck
https://semaphoreci.com/blog/govulncheck
The article discusses how to use eBPF (extended Berkeley Packet Filter) to collect telemetry data from a service without code changes and without requesting engineering efforts. eBPF provides the ability to execute programs on the Operational System Kernel, extending the OS capabilities and leveraging the kernel's privileged ability to control the system. The author explains how to use Pixie, an open-source observability solution for Kubernetes applications that uses eBPF to collect telemetry data automatically. Pixie offers features such as network monitoring, database query profiling, continuous application profiling, and Kafka monitoring. However, Pixie has two drawbacks, long-term data retention, and a lack of support for ARM architectures. The article concludes by suggesting other tools that offer similar features to Pixie, such as Cilium Hubble.
https://itnext.io/observability-strategies-to-not-overload-engineering-teams-ebpf-b034b26d7f1d
https://itnext.io/observability-strategies-to-not-overload-engineering-teams-ebpf-b034b26d7f1d
Medium
Observability strategies to not overload engineering teams – eBPF
eBPF is a powerful technology since it allows you to inject custom user-definition programs in the kernel without having to install…
kubectl foreach is a command-line tool that enables running kubectl commands on one or more contexts (clusters) in parallel. Users can match context names from kubeconfig using patterns such as exact names and regular expressions. The tool offers options for limiting parallel executions, disabling confirmation prompts, and replacing values in kubectl arguments with context names. kubectl foreach can be installed using Krew kubectl plugin manager and used to query pods and run commands on multiple contexts at the same time. The tool is not intended for deploying workloads to clusters or using programmatically yet.
https://github.com/ahmetb/kubectl-foreach
https://github.com/ahmetb/kubectl-foreach
GitHub
GitHub - ahmetb/kubectl-foreach: Run kubectl commands in all/some contexts in parallel (similar to GNU xargs+parallel)
Run kubectl commands in all/some contexts in parallel (similar to GNU xargs+parallel) - ahmetb/kubectl-foreach
This article provides a deep dive into container file systems, specifically the use of OverlayFS in containers. It explains the need for container file systems to reduce data redundancy and save disk space, as well as how UnionFS mounts multiple directories together in one directory. The article also provides sample commands to illustrate how OverlayFS works and how Docker container uses it to divide container image files into multiple layers. Overall, this article is useful for those who want to understand the technical details of container file systems and how they work in containers.
https://medium.com/geekculture/k8s-container-file-system-ec26eda8b3ea
https://medium.com/geekculture/k8s-container-file-system-ec26eda8b3ea
Medium
K8s — Container File System
Container file system deep dive
The article explains how to enable communication between microservices in a Kubernetes cluster, using various methods. The author starts by deploying a simple setup that simulates two pods communicating with each other. They then explore different methods to achieve communication between these pods, including using pod IPs directly, creating and using services, and communicating between services across namespaces. The author also explains how to use environment variables and fully-qualified DNS names to address services. The article is a useful reference for anyone working with Kubernetes microservices. https://dev.to/narasimha1997/communication-between-microservices-in-a-kubernetes-cluster-1n41
DEV Community
Communication between Microservices in a Kubernetes cluster
Kubernetes is a popular, open source container orchestrator which takes care of creating, running and...
👌1
The article discusses the differences between Red Hat OpenShift and Kubernetes, two popular container orchestration management systems. While Kubernetes is an open-source container orchestration system developed by Google, OpenShift is a cloud-based Kubernetes container platform that offers consistent security, built-in monitoring, centralized policy management, and compatibility with Kubernetes container workloads. OpenShift contains all the native Kubernetes and Podman features and adds value through its own management functionality and DevOps tooling features. OpenShift offers stronger security features than native Kubernetes, but its stricter policies can make it harder to administer initially. While Kubernetes is more flexible, OpenShift is cheaper and offers enterprise-level support, making it more valuable to large organizations. The article provides details on deployment options, support, cost, releases and updates, networking, templates, image registry management, and integrated CI/CD for both systems.
https://itnext.io/openshift-vs-kubernetes-what-is-the-difference-cadee96497b7
https://itnext.io/openshift-vs-kubernetes-what-is-the-difference-cadee96497b7
Medium
OpenShift vs. Kubernetes: What is the Difference?
In this article, we will examine and point out some of the differences between 2 popular container orchestration management systems, Red…
ClusterWatch is an open-source product that offers a comprehensive solution for monitoring the health and performance of Kubernetes clusters. It provides real-time monitoring of the different architectural layers of a cluster, including nodes, pods, services, and other components. It also offers an automated configuration process for Prometheus and Grafana, allowing users to set up custom alerts for the metrics they want to track. With its interactive and responsive dashboard, ClusterWatch provides a single view point for users to access all the information they need about their cluster's health and performance. ClusterWatch is available on Github and is an ideal solution for organizations that want to ensure the health and performance of their Kubernetes-based applications.
https://medium.com/@shengli356/clusterwatch-official-launch-8c77885de58b
https://medium.com/@shengli356/clusterwatch-official-launch-8c77885de58b
Medium
ClusterWatch Official Launch
Introduction
The publication is a comprehensive guide to learning about MLOps, including key concepts and skills to master. It outlines a step-by-step roadmap to follow to become an expert in MLOps and provides a selection of the best free learning resources available online. The roadmap includes the following steps: (1) Machine Learning Fundamentals, (2) Version Control for Machine Learning, (3) Continuous Integration & Continuous Delivery (CI/CD) Tools, (4) Infrastructure & Resource Management for Machine Learning, (5) Machine Learning Monitoring & Observability Tools, (6) Managing Machine Learning Projects & Pipelines, and (7) Machine Learning Security & Compliance Tools. The publication also includes links to various learning resources for each step.
https://pub.towardsai.net/ultimate-mlops-learning-roadmap-with-free-learning-resources-in-2023-3ba7664cb1e9
https://pub.towardsai.net/ultimate-mlops-learning-roadmap-with-free-learning-resources-in-2023-3ba7664cb1e9
Medium
Ultimate MLOps Learning Roadmap with Free Learning Resources In 2025
In today’s hype of Machine learning where many organizations have integrated or are trying to integrate ML systems into their products and…
❤1
In this article, the author shares their experience of testing AWS Serverless Microservices and emphasizes the importance of quality assurance in software development. The author discusses various testing strategies such as pyramid testing, ice-cream cone testing, honeycomb testing, black box testing, and white box testing. The need for writing tests is illustrated with a story about a fast-paced development project that eventually faced issues due to insufficient testing.
https://dev.to/epilot/how-to-test-aws-serverless-microservices-the-proper-way-1f05
https://dev.to/epilot/how-to-test-aws-serverless-microservices-the-proper-way-1f05
DEV Community
How to test AWS Serverless Microservices - the proper way?
Table of Contents Testing strategies out there Why should you write tests? Story...
Criteo switched from monolithic applications to microservices, which introduced the challenge of monitoring hundreds of interacting applications. To address this, the "Central Monitoring" tool was created during a Hackathon. Central Monitoring is a web application that visualizes interactions between applications hosted in different data centers, providing an up-to-date view of the services architecture. It displays a graph of services and their statuses, along with quick access to documentation for further investigation.
https://medium.com/criteo-engineering/monitoring-microservices-central-monitoring-a-tool-for-a-global-view-of-things-80e46a810fd5
https://medium.com/criteo-engineering/monitoring-microservices-central-monitoring-a-tool-for-a-global-view-of-things-80e46a810fd5
Medium
Monitoring microservices — Central Monitoring: A tool for a global view of things
Introducing Central Monitoring: a web application for visualizing the interactions between applications hosted in different data centers.
DevOps and cloud engineers do not necessarily need coding skills to excel in their roles. However, having coding skills can significantly enhance their capabilities and make them more competitive in the job market. DevOps engineers bridge the gap between developers and operations teams, while cloud engineers design, deploy, and maintain cloud-based infrastructure and services. Coding can help these professionals collaborate effectively with developers, communicate technical requirements, troubleshoot issues, and create custom workflows. Python and Go are two recommended programming languages for those looking to learn coding for DevOps and cloud engineering, with Python offering versatility and Go being popular for DevOps tools like Docker and Kubernetes.
https://kodekloud.com/blog/devops-cloud-coding/
https://kodekloud.com/blog/devops-cloud-coding/
DevOps Blog
Does DevOps or Cloud Engineer Need Coding?
Are you wondering if coding is required for a DevOps or cloud engineer? Find out the answer in this blog post.