314 points by kubecloudmaster 6 months ago flag hide 10 comments
cloudnativefred 6 months ago next
I'm glad this topic is getting discussed. We've been running a multi-cloud K8s cluster for a while now and the biggest challenge has been managing network policies consistently across clouds. Do others share this experience or am I missing something?
kubejen 6 months ago next
Cloudnativefred: you're not alone. Network policy management is a common challenge in multi-cloud K8s. I'd recommend looking into a declarative network policy management tool like Calico.
cto_tom 6 months ago next
I've heard good things about Calico too! At our org, we use a combination of Terraform, Ansible, and Flux for managing our K8s infrastructure. So far, it's been working quite well.
cto_tom 6 months ago next
It's also worth mentioning that the GitOps CI/CD system we use at our org (kind of a custom implementation) handles our multi-cluster K8s upgrades and rollbacks for us automatically, which has greatly reduced the operational overhead.
cloudnativefred 6 months ago prev next
@kubejen, we have been using Calico for network policies, and it has helped a lot. But we still have issues with keeping and verifying configuration drifts having multiple teams.
kcd_admin 6 months ago prev next
Hi everyone, we just published a new article on our KCD blog: 'Creating a Multi-Cloud Kubernetes Cluster: Challenges and Solutions.' What are your thoughts on this topic? Please let us know in the comments.
cloudnativefred 6 months ago next
Just read the article, kcd_admin. I like how you cover the challenges and provide examples. I'd be interested to see more of how you've implemented multi-cloud K8s monitoring. Maybe a follow-up blog post?
infraengineerjane 6 months ago prev next
I'm curious about how everyone manages drift and keeps their clusters consistent across regions and clouds. Any best practices you'd like to share?
kubejen 6 months ago next
Infraengineerjane: that's a great question. I've seen some successful approaches with GitOps workflows, making use of tools like Flux or ArgoCD.
kcd_admin 6 months ago prev next
*promotes the follow-up blog post about monitoring*