The Wayback Machine - https://web.archive.org/web/20200927084659/https://github.com/fission/fission/issues/1619
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port Forward failure if evicted controller pod exists #1619

Open
vishal-biyani opened this issue May 21, 2020 · 2 comments
Open

Port Forward failure if evicted controller pod exists #1619

vishal-biyani opened this issue May 21, 2020 · 2 comments

Comments

@vishal-biyani
Copy link
Member

@vishal-biyani vishal-biyani commented May 21, 2020

Fission commands fail with an error such as this:

./fission-cli fn list
Error forwarding to port 60083: error upgrading connection: the server does not allow this method on the requested resource%

When there is an evicted controller pod - most likely the Kubectl/client-go port forward tries to port-forward to evicted pod

$ kubectl get pods -l=application=fission-api
NAME                          READY   STATUS    RESTARTS   AGE
controller-5b959bd9df-pzmb5   1/1     Running   0          21h
controller-5b959bd9df-wjsqj   0/1     Evicted   0          3d21h

After removing the pod, things start working normally

$ kubectl rm po controller-5b959bd9df-wjsqj
pod "controller-5b959bd9df-wjsqj" deleted


$fission fn list
NAME           ENV    EXECUTORTYPE MINSCALE MAXSCALE MINCPU MAXCPU MINMEMORY MAXMEMORY TARGETCPU SECRETS CONFIGMAPS
count          java   newdeploy    1        2        0      0      0         0         80

@vishal-biyani
Copy link
Member Author

@vishal-biyani vishal-biyani commented May 23, 2020

A similar thing happens if there is an evicted router pod and someone tries to test a function:

$ fission fn test --name kp
Error forwarding to port 64988: error upgrading connection: the server does not allow this method on the requested resource%
@rahulchheda
Copy link
Collaborator

@rahulchheda rahulchheda commented Jun 8, 2020

@vishal-biyani PTAL: txn2/kubefwd#125
I got some insights from this, might want to take a look.
Would take up this issue, seems like we add filtering for fission-cli

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.