2019-10-24 10:01:44 UTC - Bill Zong: Haven’t updated my local `openwhisk-deploy-kube` repo since commit `e09f810215f4010310f0d85698d86feeb13e7f56`, which I tested OK locally. And the related repos’ tag I used is `0.10.0-incubating` or sth close in time. Hope those settings could bring you back to normal.
@Dave Grove David, any idea about this issue? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571911304045100?thread_ts=1571812737.038300&cid=C3TPCAQG1 ---- 2019-10-24 11:36:43 UTC - Nikolai Starodubtcev: I have the question that might be easy to answer, but I don't see an explanation, and can't find configuration choices. I use `KubernatesContainerFactory`, and I wonder that only 10 invokers are supported concurrrently: ``` wskwsk-invoker-00-1-prewarm-nodejs10 1/1 Running 0 111m wskwsk-invoker-00-2-prewarm-nodejs10 1/1 Running 0 111m wskwsk-invoker-00-63-guest-api-test001 1/1 Running 0 13m wskwsk-invoker-00-64-guest-api-test001 1/1 Running 0 13m wskwsk-invoker-00-67-guest-api-test002 1/1 Running 0 13m wskwsk-invoker-00-68-guest-api-test003 1/1 Running 0 13m wskwsk-invoker-00-70-guest-api-test003 1/1 Running 0 13m wskwsk-invoker-00-72-guest-api-test002 1/1 Running 0 11m wskwsk-invoker-00-73-guest-api-test003 1/1 Running 0 10m wskwsk-invoker-00-75-guest-api-test001 1/1 Running 0 9m49s ``` Where I can change this value? In reality I want much more invokers to be running. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571917003047300?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 11:53:21 UTC - Bill Zong: set `whisk.containerPool.userMemory` bigger than default `2048m`. You could get the info [here](<https://github.com/apache/openwhisk-deploy-kube/blob/master/docs/configurationChoices.md#invoker-container-factory>) https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571918001047900?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 12:06:07 UTC - Nikolai Starodubtcev: I found this document. So, it's limit of RAM, right? I don't think that it's connected :smiley: Thanks https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571918767048100?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 13:14:58 UTC - Nikolai Starodubtcev: ``` whisk: ingress: type: NodePort apiHostName: 10.0.0.1 apiHostPort: 31001 containerPool: userMemory: "39000m" ``` it should look like this, right? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571922898048400?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 13:16:27 UTC - Nikolai Starodubtcev: still has only 10 invokers, even with extended memory. am I miss something? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571922987048700?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 15:14:50 UTC - Narasimha Murthy: How do I install wskadmin? is there any exe for windows? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571930090049500?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 15:26:24 UTC - Narasimha Murthy: Did you try invoker.kubernetes.replicaCount? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571930784049600?thread_ts=1571917003.047300&cid=C3TPCAQG1 ---- 2019-10-24 15:46:58 UTC - Rodric Rabbah: It’s a python script. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932018050000?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 15:47:15 UTC - Rodric Rabbah: There is wskadmin-next which exists as a java app. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932035050700?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 15:47:23 UTC - Rodric Rabbah: Look at the docs in tools/admin https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932043051200?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 15:54:26 UTC - Adrian Schuepbach: I think, I have an idea what might have happened: Earlier I run Kubernetes 1.15.3 and an OpenWhisk version from February 2019. After it sopped working last week, I reinstalled the cluster completely (Linux and software) and got Kubernetes 1.16.2 and still the OpenWhisk from February. This did not work. Also, several other services (microservices) I implemented did not work with Kubernetes 1.16.2, since some definition files for APIs and services changed. Then I went back to Kubernetes 1.15.3 and my services started work again. OpenWhisk did not work, so I upgraded it. However I assume that the newest OpenWhisk does not work with Kubernetes 1.15.3, since the older Kubernetes uses an older API/definition files. Finally, I reinstalled Kubernetes 1.16, newest OpenWhisk and upgraded all my definitions and service files to use the new format for Kubernetes 1.16 and it worked again. The only thing, which is still a bit strange is that OpenWhisk's official python2action image with Alpine Linux sometimes shows an error state in the activation and sometimes works, while if I use my custom Ubuntu-based python2action container (with actionProxy and pythonruner copied), it works always. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932466051400?thread_ts=1571812737.038300&cid=C3TPCAQG1 ---- 2019-10-24 15:54:48 UTC - Adrian Schuepbach: Thanks for you help and your hints! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932488051600?thread_ts=1571812737.038300&cid=C3TPCAQG1 ---- 2019-10-24 15:55:38 UTC - Adrian Schuepbach: To completely understand everything, I will look more deepely into this and try to recreate everything. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932538051800?thread_ts=1571812737.038300&cid=C3TPCAQG1 ---- 2019-10-24 15:55:43 UTC - Adrian Schuepbach: Thanks again! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571932543052000?thread_ts=1571812737.038300&cid=C3TPCAQG1 ---- 2019-10-24 16:59:48 UTC - Pepi Paraskevoulakou: anyone who knows this kind of log? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571936388057100?thread_ts=1571936388.057100&cid=C3TPCAQG1 ---- 2019-10-24 17:01:28 UTC - Ali Tariq: Hi everyone, i joined this channel sometime back and now, i want to potentially contribute to the openwhisk community but since it my first time becoming part of an open-source project ... i would appreciate if someone can guide me through where can i start from - preferably some easy-low effort issues such as Documentation, to start with (it would help gain confidence). A little about me - i am a graduate student (2nd-year computer-science), currently pursuing Phd at University of Colorado Boulder. Looking forward to start right away! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571936488058200 ---- 2019-10-24 17:17:21 UTC - Rodric Rabbah: That’s wonderful Ali. We’ve tried to label some issues as good first issues. I’ll go through open issues and label more as I don’t remember the last time we’ve done that. +1 : Ali Tariq https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571937441059700 ---- 2019-10-24 17:19:20 UTC - Rodric Rabbah: Means your function didn’t return a python dictionary. You can get a clue by perhaps logging the result before returning. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571937560060600?thread_ts=1571936388.057100&cid=C3TPCAQG1 ---- 2019-10-24 18:01:14 UTC - Pepi Paraskevoulakou: i found that it has 2 logs due to the fact that i have constructed a sequence of two functions so it has 2 logs https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571940074060900?thread_ts=1571936388.057100&cid=C3TPCAQG1 ---- 2019-10-24 18:18:03 UTC - Pepi Paraskevoulakou: Also i want to ask something specific, if i have the first and the last functions in a sequence as web actions do i have any problem? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571941083061900 ---- 2019-10-24 18:21:13 UTC - Rodric Rabbah: No. Sequence execute as normal actions regardless of web enablement. If you want the sequence available as a web action then you need to also turn —web true on for that https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571941273063900 ---- 2019-10-24 18:24:14 UTC - Rodric Rabbah: The sequence logs are the activation ids of the individual actions. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571941454064400?thread_ts=1571936388.057100&cid=C3TPCAQG1 ---- 2019-10-24 18:24:33 UTC - Rodric Rabbah: Look at the result of the second activation in that case. https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571941473065100?thread_ts=1571936388.057100&cid=C3TPCAQG1 ---- 2019-10-24 19:09:42 UTC - Narasimha Murthy: @Rodric Rabbah, I have downloaded <https://github.com/apache/openwhisk/tree/master/tools/admin> but how do I execute this on my windows? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944182065400?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:10:26 UTC - Narasimha Murthy: I have python 3.7 installed and when I typed "wskadmin" from the folder /tools/admin i get error message that there is no such command https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944226065600?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:10:38 UTC - Rodric Rabbah: You need python then run python wskadmin https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944238066100?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:11:14 UTC - Narasimha Murthy: Got it. Thanks! https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944274066900?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:11:37 UTC - Rodric Rabbah: you will need to set some environment variables if you don’t have whisk.properties in your openwhisk directory https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944297067800?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:11:44 UTC - Narasimha Murthy: I was thinking if there is anyway i can turn it as windows command https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944304068200?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:11:49 UTC - Narasimha Murthy: like wsk command https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944309068400?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:12:31 UTC - Rodric Rabbah: wsk is compiled time native windows Exec wskadmin is implemented differently. You might want to use wskadmin-next instead as a java app https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944351069700?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:14:33 UTC - Narasimha Murthy: where can i find java app? https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571944473070000?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:25:09 UTC - Rodric Rabbah: <https://github.com/apache/openwhisk/blob/master/tools/admin/README-NEXT.md> https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571945109070300?thread_ts=1571930090.049500&cid=C3TPCAQG1 ---- 2019-10-24 19:56:18 UTC - Mayank Jha: ```[2019-10-24T19:54:38.032Z] [INFO] Slf4jLogger started [2019-10-24T19:54:39.993Z] [INFO] Started the Kamon StatsD reporter [2019-10-24T19:54:40.009Z] [INFO] Loaded metric reporter [kamon.statsd.StatsDReporter] [2019-10-24T19:54:41.803Z] [INFO] [#tid_sid_unknown] [Config] environment set value for limits.triggers.fires.perMinute [2019-10-24T19:54:41.807Z] [INFO] [#tid_sid_unknown] [Config] environment set value for limits.actions.sequence.maxLength [2019-10-24T19:54:41.811Z] [INFO] [#tid_sid_unknown] [Config] environment set value for limits.actions.invokes.concurrent [2019-10-24T19:54:41.814Z] [INFO] [#tid_sid_unknown] [Config] environment set value for limits.actions.invokes.perMinute [2019-10-24T19:54:41.817Z] [INFO] [#tid_sid_unknown] [Config] environment set value for runtimes.manifest [2019-10-24T19:54:41.821Z] [INFO] [#tid_sid_unknown] [Config] environment set value for kafka.hosts [2019-10-24T19:54:41.828Z] [INFO] [#tid_sid_unknown] [Config] environment set value for port [2019-10-24T19:54:44.989Z] [INFO] [#tid_sid_unknown] [KafkaMessagingProvider] topic completed0 already existed [2019-10-24T19:54:45.985Z] [INFO] [#tid_sid_unknown] [KafkaMessagingProvider] topic health already existed [2019-10-24T19:54:46.949Z] [INFO] [#tid_sid_unknown] [KafkaMessagingProvider] topic cacheInvalidation already existed [2019-10-24T19:54:47.823Z] [INFO] [#tid_sid_unknown] [KafkaMessagingProvider] topic events already existed [2019-10-24T19:54:49.335Z] [INFO] [#tid_sid_controller] [Controller] starting controller instance 0 [marker:controller_startup0_counter:7547] [2019-10-24T19:54:54.648Z] [INFO] [#tid_sid_dispatcher] [MessageFeed] handler capacity = 128, pipeline fill at = 128, pipeline depth = 256 [2019-10-24T19:54:55.838Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] managedFraction = 0.9, blackboxFraction = 0.1 [2019-10-24T19:54:56.306Z] [INFO] [#tid_sid_unknown] [Controller] Shutting down Kamon with coordinated shutdown [2019-10-24T19:54:56.395Z] [INFO] [#tid_sid_dispatcher] [MessageFeed] handler capacity = 128, pipeline fill at = 128, pipeline depth = 256 [2019-10-24T19:54:56.434Z] [INFO] Message [org.apache.openwhisk.core.connector.MessageFeed$Ready$] from Actor[<akka://controller-actor-system/user/$c#329230135>] to Actor[<akka://controller-actor-system/user/$c#329230135>] was not delivered. [1] dead letters encountered. If this is not an expected behavior, then [Actor[<akka://controller-actor-system/user/$c#329230135>]] may have terminated unexpectedly, This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'. [ERROR] [10/24/2019 19:54:56.668] [controller-actor-system-dispatchers.kafka-dispatcher-7] [Controller$(<akka://controller-actor-system>)] [#tid_sid_unknown] [KafkaConsumerConnector] poll timeout occurred. Retrying 3 more times.``` I am facing this repeatedly on my controller. Any clues ? This <https://pastebin.com/MRChZYCv> are my kafka logs https://openwhisk-team.slack.com/archives/C3TPCAQG1/p1571946978070900 ----
