[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192:
URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1561105011
Let's make a step back, so we can understand with a simpler reproducer what
could be going on. I've tested a generic openapi route [1] which we can use as
a benchmark. This one is running in my local cluster like:
```
[1] 2023-05-24 12:53:49,106 INFO [org.apa.cam.k.Runtime] (main) Apache
Camel K Runtime 1.17.0
[1] 2023-05-24 12:53:49,124 INFO
[org.apa.cam.qua.cor.CamelBootstrapRecorder] (main) Bootstrap runtime:
org.apache.camel.quarkus.main.CamelMainRuntime
[1] 2023-05-24 12:53:49,126 INFO [org.apa.cam.mai.MainSupport] (main)
Apache Camel (Main) 3.20.1 is starting
[1] 2023-05-24 12:53:49,170 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='greetings',
language='groovy', type='source',
location='file:/etc/camel/sources/greetings.groovy', }
[1] 2023-05-24 12:53:49,284 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='greetings-api',
language='xml', type='source',
location='file:/etc/camel/sources/greetings-api.xml', }
[1] 2023-05-24 12:53:50,639 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) is starting
[1] 2023-05-24 12:53:50,653 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Routes startup (started:2)
[1] 2023-05-24 12:53:50,654 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started route1 (direct://greeting-api)
[1] 2023-05-24 12:53:50,654 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started greeting-api (rest://get:/camel/:/greetings/%7Bname%7D)
[1] 2023-05-24 12:53:50,654 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) started in 116ms (build:0ms init:102ms
start:14ms)
[1] 2023-05-24 12:53:50,761 INFO [io.quarkus] (main) camel-k-integration
1.12.0 on JVM (powered by Quarkus 2.16.0.Final) started in 3.266s. Listening
on: http://0.0.0.0:8080
[1] 2023-05-24 12:53:50,762 INFO [io.quarkus] (main) Profile prod
activated.
[1] 2023-05-24 12:53:50,762 INFO [io.quarkus] (main) Installed features:
[camel-attachments, camel-bean, camel-core, camel-direct, camel-groovy-dsl,
camel-k-core, camel-k-runtime, camel-kubernetes, camel-log,
camel-platform-http, camel-rest, camel-xml-io-dsl, cdi, kubernetes-client,
security, smallrye-context-propagation, vertx]
```
We should not look at the elapsed time shown in the trace log, but to the
trace log instead. So, the application starts at `2023-05-24 12:53:49,106` and
finishes at `2023-05-24 12:53:50,762`, around. 1.5 seconds in JVM mode.
@mertdotcc could you please run this very same example in your cluster so we
can look at performance differences? according to the first information of this
issue, the problem was about some delay when loading routes.
[1]
https://github.com/apache/camel-k-examples/tree/main/generic-examples/openapi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1560947069 I don't have any update about this one, sorry. I can suggest you try on different clusters to figure it out if the problem is related somehow to the cluster/hardware used. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1521285609 The strange thing is that I managed somehow to replicate the issue when running in native mode, but, running it straight it did not. I will have a further look to understand it better. In the while, you may have a look at the IO operation on the disk used in the cluster, as, it seems to me, that this slowness happens when doing some disk operation. You may also retry to reset all kits and start it from scratch. However, I think that the situation where I managed to reproduce the problem is the real root cause, although I cannot understand yet why it is happening. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1520375255 I start having the feeling that the problem is that we do not include the openapi generated route in the sources required at build time. Wdyt @essobedo ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192:
URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1520344271
I am testing this locally and I cannot see any deviation from what we expect
when we run it in JVM mode:
```
[2] 2023-04-24 14:41:25,734 INFO [org.apa.cam.k.Runtime] (main) Apache
Camel K Runtime 1.17.0
[2] 2023-04-24 14:41:25,753 INFO
[org.apa.cam.qua.cor.CamelBootstrapRecorder] (main) Bootstrap runtime:
org.apache.camel.quarkus.main.CamelMainRuntime
[2] 2023-04-24 14:41:25,756 INFO [org.apa.cam.mai.MainSupport] (main)
Apache Camel (Main) 3.20.1 is starting
[2] 2023-04-24 14:41:25,798 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='TestOne', language='java',
type='source', location='file:/etc/camel/sources/TestOne.java', }
[2] 2023-04-24 14:41:26,698 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='test-one-openapi',
language='xml', type='source',
location='file:/etc/camel/sources/test-one-openapi.xml', }
[2] 2023-04-24 14:41:27,006 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) is starting
[2] 2023-04-24 14:41:27,023 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Routes startup (started:4)
[2] 2023-04-24 14:41:27,023 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started mertGet (direct://mertGet)
[2] 2023-04-24 14:41:27,023 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started mertPost (direct://mertPost)
[2] 2023-04-24 14:41:27,024 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started route1 (rest://get:/mert)
[2] 2023-04-24 14:41:27,024 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started route2 (rest://post:/mert)
[2] 2023-04-24 14:41:27,024 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) started in 140ms (build:0ms init:123ms
start:17ms)
[2] 2023-04-24 14:41:27,117 INFO [io.quarkus] (main) camel-k-integration
1.12.0 on JVM (powered by Quarkus 2.16.0.Final) started in 3.159s. Listening
on: http://0.0.0.0:8080
[2] 2023-04-24 14:41:27,118 INFO [io.quarkus] (main) Profile prod
activated.
[2] 2023-04-24 14:41:27,118 INFO [io.quarkus] (main) Installed features:
[camel-attachments, camel-bean, camel-core, camel-direct, camel-java-joor-dsl,
camel-k-core, camel-k-runtime, camel-kubernetes, camel-platform-http,
camel-rest, camel-xml-io-dsl, cdi, kubernetes-client, security,
smallrye-context-propagation, vertx]
```
However, something strange happens when I am running in native mode (which
is what you may be experiencing):
```
[2] 2023-04-24 14:43:36,452 INFO [org.apa.cam.k.Runtime] (main) Apache
Camel K Runtime 1.17.0
[2] 2023-04-24 14:43:36,966 INFO
[org.apa.cam.qua.cor.CamelBootstrapRecorder] (main) Bootstrap runtime:
org.apache.camel.quarkus.main.CamelMainRuntime
[2] 2023-04-24 14:43:37,056 INFO [org.apa.cam.mai.MainSupport] (main)
Apache Camel (Main) 3.20.1 is starting
[2] 2023-04-24 14:43:37,356 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='TestOne', language='java',
type='source', location='file:/etc/camel/sources/TestOne.java', }
[2] 2023-04-24 14:43:50,771 INFO [org.apa.cam.k.lis.SourcesConfigurer]
(main) Loading routes from: SourceDefinition{name='test-one-openapi',
language='xml', type='source',
location='file:/etc/camel/sources/test-one-openapi.xml', }
[2] 2023-04-24 14:43:53,956 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) is starting
[2] 2023-04-24 14:43:54,052 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Routes startup (started:4)
[2] 2023-04-24 14:43:54,053 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started mertGet (direct://mertGet)
[2] 2023-04-24 14:43:54,053 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started mertPost (direct://mertPost)
[2] 2023-04-24 14:43:54,054 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started route1 (rest://get:/mert)
[2] 2023-04-24 14:43:54,055 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Started route2 (rest://post:/mert)
[2] 2023-04-24 14:43:54,056 INFO [org.apa.cam.imp.eng.AbstractCamelContext]
(main) Apache Camel 3.20.1 (camel-1) started in 1s396ms (build:0ms init:1s297ms
start:99ms)
[2] 2023-04-24 14:43:54,858 INFO [io.quarkus] (main) camel-k-integration
1.12.0 on JVM (powered by Quarkus 2.16.0.Final) started in 42.794s. Listening
on: http://0.0.0.0:8080
[2] 2023-04-24 14:43:54,858 INFO [io.quarkus] (main) Profile prod
activated.
[2] 2023-04-24 14:43:54,859 INFO [io.quarkus] (main) Installed features:
[camel-attachments, camel-bean, camel-core, camel-direct, camel-java-joor-dsl,
camel-k-core, camel-k-runtime, camel-kubernetes, camel-microprofile-health,
camel-platform-http, camel-rest, camel-xm
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1491428055 ``` 2023-03-30 20:59:58,998 DEBUG [org.apa.cam.dsl.jav.joo.MultiCompile] (main) Java JooR Compile -classpath: ./resources:/etc/camel/application.properties:/etc/camel/conf.d/_resources:/etc/camel/resources:/etc/camel/resources/sample-error-response.json:/etc/camel/resources/simple-body.json:/etc/camel/sources/TestOne.java:/etc/camel/sources/test-one-openapi.xml:dependencies/app/camel-k-integration-1.12.0.jar:dependencies/lib/boot/io.github.crac.org-crac-0.1.3.jar:dependencies/lib/boot/io.quarkus.quarkus-bootstrap-runner-2.16.0.Final.jar:dependencies/lib/boot/io.quarkus.quarkus-development-mode-spi-2.16.0.Final.jar:dependencies/lib/boot/io.quarkus.quarkus-vertx-latebound-mdc-provider-2.16.0.Final.jar:dependencies/lib/boot/io.smallrye.common.smallrye-common-io-1.13.2.jar:dependencies/lib/boot/org.glassfish.jakarta.json-1.1.6.jar:dependencies/lib/boot/org.graalvm.sdk.graal-sdk-22.3.0.jar:dependencies/lib/boot/org.jboss.logging.jboss-logging-3.5.0.Final.jar:dependencies/lib/boot/org.jboss .logmanager.jboss-logmanager-embedded-1.0.11.jar:dependencies/lib/boot/org.wildfly.common.wildfly-common-1.5.4.Final-format-001.jar:dependencies/lib/main/com.aayushatharva.brotli4j.brotli4j-1.8.0.jar:dependencies/lib/main/com.aayushatharva.brotli4j.native-linux-x86_64-1.8.0.jar:dependencies/lib/main/com.fasterxml.jackson.core.jackson-annotations-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.core.jackson-core-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.core.jackson-databind-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.dataformat.jackson-dataformat-yaml-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.14.1.jar:dependencies/lib/main/com.fasterxml.jackson.module.jackson-module-parameter-names-2.14.1.jar:dependencies/lib/main/com.github.mifmif.generex-1.0.2.jar:dependencies/lib/main/com.squareup.okhttp3.logging-interceptor-3.14.9.jar :dependencies/lib/main/com.squareup.okhttp3.okhttp-3.14.9.jar:dependencies/lib/main/com.squareup.okio.okio-1.17.2.jar:dependencies/lib/main/com.sun.activation.jakarta.activation-1.2.1.jar:dependencies/lib/main/dk.brics.automaton.automaton-1.11-8.jar:dependencies/lib/main/io.fabric8.kubernetes-client-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-client-api-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-httpclient-okhttp-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-admissionregistration-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-apiextensions-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-apps-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-autoscaling-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-batch-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-certificates-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-common-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model- coordination-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-core-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-discovery-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-events-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-extensions-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-flowcontrol-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-gatewayapi-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-metrics-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-networking-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-node-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-policy-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-rbac-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-scheduling-6.3.1.jar:dependencies/lib/main/io.fabric8.kubernetes-model-storageclass-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-client-6.3.1.jar:dependencies/lib/m ain/io.fabric8.openshift-client-api-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-clusterautoscaling-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-config-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-console-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-hive-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-installer-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-machine-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-machineconfig-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-miscellaneous-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-monitoring-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-operator-6.3.1.jar:dependencies/lib/main/io.fabric8.openshift-model-operatorhub-6.3.1.jar:depend
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1489828392 > @squakez Will do that! Do we have any readily-available examples somewhere? Sure, you can use any of the examples in Camel Quarkus: https://github.com/apache/camel-quarkus-examples About directly deploying bypassing Camel K, I think it can get a bit trickier and here is some reference: https://quarkus.io/guides/deploying-to-kubernetes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-k] squakez commented on issue #4192: Startup times take way longer than advertised numbers
squakez commented on issue #4192: URL: https://github.com/apache/camel-k/issues/4192#issuecomment-1489819460 I think a good way to troubleshoot this is to try running a simple Camel Quarkus application directly on the cluster and verify if it takes the same amount of time. At this stage, it seems to me more a runtime (hence Camel Quarkus) problem, than a build/deploy time problem (where Camel K comes in play). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
