The Wayback Machine - https://web.archive.org/web/20201129150508/https://github.com/apache/openwhisk/issues/4932
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KubernetesClient cannot fetch action logs correctly #4932

Closed
jiangpengcheng opened this issue Jul 20, 2020 · 2 comments
Closed

KubernetesClient cannot fetch action logs correctly #4932

jiangpengcheng opened this issue Jul 20, 2020 · 2 comments

Comments

@jiangpengcheng
Copy link
Contributor

@jiangpengcheng jiangpengcheng commented Jul 20, 2020

when action pod's log prints like below cases:

  • some timestamp return 8 digit nanoseconds
2020-07-17T07:28:01.911401988Z log start
2020-07-17T07:28:01.911428485Z undefined
2020-07-17T07:28:01.91164149Z XXX_THE_END_OF_A_WHISK_ACTIVATION_XXX
2020-07-17T07:28:01.911659266Z XXX_THE_END_OF_A_WHISK_ACTIVATION_XXX

in this case, the 2020-07-17T07:28:01.91164149Z would be parsed to 2020-07-17T07:28:01.091164149Z and will be filtered out as it's older than last timestamp, but actually it should be parsed to 2020-07-17T07:28:01.911641490Z

  • the logs can be unordered
2020-07-17T07:28:02.387244404Z log start
2020-07-17T07:28:02.387326085Z undefined
2020-07-17T07:28:02.387331028Z XXX_THE_END_OF_A_WHISK_ACTIVATION_XXX
2020-07-17T07:28:02.387293122Z XXX_THE_END_OF_A_WHISK_ACTIVATION_XXX

in this case the last log's timestamp is older than the third line, and so it will also be filtered out


In both cases, the KubernetesClient will try to fetch log again and again to get enough log sentinels but always got empty lines returned until timeout(2 seconds)

We can do a benchmark to reproduce this error

@jiangpengcheng jiangpengcheng mentioned this issue Jul 20, 2020
5 of 21 tasks complete
@rabbah
Copy link
Member

@rabbah rabbah commented Aug 6, 2020

@jiangpengcheng is this now fixed?

@jiangpengcheng
Copy link
Contributor Author

@jiangpengcheng jiangpengcheng commented Aug 7, 2020

yes, I will close this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
2 participants
You can’t perform that action at this time.