-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Coder pods running out of memory #14881
Copy link
Copy link
Labels
bug riskProne to bugsProne to bugsobservabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)Issues related to observability (metrics, dashboards, alerts, opentelemetry)s2Broken use cases or features (with a workaround). Only humans may set this.Broken use cases or features (with a workaround). Only humans may set this.
Metadata
Metadata
Assignees
Labels
bug riskProne to bugsProne to bugsobservabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)Issues related to observability (metrics, dashboards, alerts, opentelemetry)s2Broken use cases or features (with a workaround). Only humans may set this.Broken use cases or features (with a workaround). Only humans may set this.
Type
Fields
Give feedbackNo fields configured for Bug.
We've noticed over the past several months the coder pods gradually run out of memory over time. Typically around 30 day mark but can't really say for sure. Here is our memory allocation for a 5 replica set in k8s.
and here is a datadog screenshot of the memory usage around 30 day mark
Coder V2.13.4
We don't keep the k8s logs so not able to share those.