{"id":10799,"date":"2023-08-07T02:30:44","date_gmt":"2023-08-07T02:30:44","guid":{"rendered":"https:\/\/www.scmgalaxy.com\/tutorials\/?p=10799"},"modified":"2023-08-07T02:30:46","modified_gmt":"2023-08-07T02:30:46","slug":"knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled","status":"publish","type":"post","link":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/","title":{"rendered":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Root Cause<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">what would happen with this amount of traffic is the service would scale up, which would remove the activator from the data path (i.e. SKS in serve mode) and send traffic directly to the pod. But because you&#8217;ve set max replicas to one, the service can&#8217;t scale up and alleviate the pressure.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Potential solution:<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">There&#8217;s a couple of things you can try in this situation:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Increasing the limits in the net-istio-controller pod does fix the problem but this is not satisfying enough as size can be unpredictable and may not be acceptable.<\/li>\n\n\n\n<li>set &#8220;target burst capacity&#8221; to 0 so that the activator is only on the path when the app is scaled to zero<\/li>\n\n\n\n<li>look into scaling the data plane and\/or tweaking the activator cacapity<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">target burst capacity &#8211; https:\/\/knative.dev\/docs\/serving\/load-balancing\/target-burst-capacity\/#setting-the-target-burst-capacity<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Commands:\r\n\r\nkubectl describe pod -n knative-serving activator-774d4ff4b8-4l5vp | grep Reason\r\n      Reason:       OOMKilled\r\n\r\nCheck net-istio-controller pod:\r\n$ kubectl get pods -n knative-serving\r\n\r\n$ kubectl logs net-istio-controller-8d456687b-hq95g -n knative-serving\r\n\r\n$ kubectl get secrets -A | wc -l<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">Reference<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>https:\/\/github.com\/knative\/serving\/issues\/13583#issuecomment-1377339654<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Root Cause what would happen with this amount of traffic is the service would scale up, which would remove the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_joinchat":[],"footnotes":""},"categories":[1],"tags":[],"class_list":["post-10799","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy\" \/>\n<meta property=\"og:description\" content=\"Root Cause what would happen with this amount of traffic is the service would scale up, which would remove the [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/\" \/>\n<meta property=\"og:site_name\" content=\"scmGalaxy\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-07T02:30:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-07T02:30:46+00:00\" \/>\n<meta name=\"author\" content=\"rajeshkumar\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"rajeshkumar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/\"},\"author\":{\"name\":\"rajeshkumar\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/#\\\/schema\\\/person\\\/a40e0dd38feee7c2779460a804d49361\"},\"headline\":\"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled\",\"datePublished\":\"2023-08-07T02:30:44+00:00\",\"dateModified\":\"2023-08-07T02:30:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/\"},\"wordCount\":162,\"commentCount\":0,\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/\",\"url\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/\",\"name\":\"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/#website\"},\"datePublished\":\"2023-08-07T02:30:44+00:00\",\"dateModified\":\"2023-08-07T02:30:46+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/#\\\/schema\\\/person\\\/a40e0dd38feee7c2779460a804d49361\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/#website\",\"url\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/\",\"name\":\"scmGalaxy\",\"description\":\"A Platform for Software Engineers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/#\\\/schema\\\/person\\\/a40e0dd38feee7c2779460a804d49361\",\"name\":\"rajeshkumar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g\",\"caption\":\"rajeshkumar\"},\"url\":\"https:\\\/\\\/www.scmgalaxy.com\\\/tutorials\\\/author\\\/rajeshkumar\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/","og_locale":"en_US","og_type":"article","og_title":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy","og_description":"Root Cause what would happen with this amount of traffic is the service would scale up, which would remove the [&hellip;]","og_url":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/","og_site_name":"scmGalaxy","article_published_time":"2023-08-07T02:30:44+00:00","article_modified_time":"2023-08-07T02:30:46+00:00","author":"rajeshkumar","twitter_card":"summary_large_image","twitter_misc":{"Written by":"rajeshkumar","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/#article","isPartOf":{"@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/"},"author":{"name":"rajeshkumar","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/#\/schema\/person\/a40e0dd38feee7c2779460a804d49361"},"headline":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled","datePublished":"2023-08-07T02:30:44+00:00","dateModified":"2023-08-07T02:30:46+00:00","mainEntityOfPage":{"@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/"},"wordCount":162,"commentCount":0,"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/","url":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/","name":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled - scmGalaxy","isPartOf":{"@id":"https:\/\/www.scmgalaxy.com\/tutorials\/#website"},"datePublished":"2023-08-07T02:30:44+00:00","dateModified":"2023-08-07T02:30:46+00:00","author":{"@id":"https:\/\/www.scmgalaxy.com\/tutorials\/#\/schema\/person\/a40e0dd38feee7c2779460a804d49361"},"breadcrumb":{"@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/knative-error-knative-serving-with-istio-fails-net-istio-controller-is-oomkilled\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.scmgalaxy.com\/tutorials\/"},{"@type":"ListItem","position":2,"name":"Knative Error: Knative Serving with istio fails, net-istio controller is OOMkilled"}]},{"@type":"WebSite","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/#website","url":"https:\/\/www.scmgalaxy.com\/tutorials\/","name":"scmGalaxy","description":"A Platform for Software Engineers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.scmgalaxy.com\/tutorials\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.scmgalaxy.com\/tutorials\/#\/schema\/person\/a40e0dd38feee7c2779460a804d49361","name":"rajeshkumar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/82337e1fc8642c7f36795aa0775af055a4f38882994004b593efd31758d4434e?s=96&d=mm&r=g","caption":"rajeshkumar"},"url":"https:\/\/www.scmgalaxy.com\/tutorials\/author\/rajeshkumar\/"}]}},"_links":{"self":[{"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/posts\/10799","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/comments?post=10799"}],"version-history":[{"count":1,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/posts\/10799\/revisions"}],"predecessor-version":[{"id":10800,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/posts\/10799\/revisions\/10800"}],"wp:attachment":[{"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/media?parent=10799"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/categories?post=10799"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.scmgalaxy.com\/tutorials\/wp-json\/wp\/v2\/tags?post=10799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}