[
https://issues.apache.org/jira/browse/KYLIN-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922308#comment-17922308
]
Alexander commented on KYLIN-5985:
----------------------------------
Exception is:
{code:java}
2025-01-30T00:19:31,491 WARN [logger-thread-0] transaction.UnitOfWork :
UnitOfWork 2a001b44-b789-0795-3f1a-90d99b153a3b takes too long time 1554824ms
to complete
2025-01-30T00:19:31,492 WARN [logger-thread-0] transaction.UnitOfWork :
current stack:
java.lang.Throwable: null
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.logIfLongTransaction(UnitOfWork.java:184)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doTransaction(UnitOfWork.java:153)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doInTransactionWithRetry(UnitOfWork.java:115)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doInTransactionWithRetry(UnitOfWork.java:85)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doInTransactionWithRetry(UnitOfWork.java:81)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.builder.DFBuilderHelper$.checkPointSegment(DFBuilderHelper.scala:119)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.build.FlatTableAndDictBase.tryPersistFTDS(FlatTableAndDictBase.scala:356)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.build.FlatTableAndDictBase.generateFlatTable(FlatTableAndDictBase.scala:196)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.build.GenerateFlatTable.execute(GenerateFlatTable.scala:38)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.StageExec.toWork0(StageExec.scala:83)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.StageExec.toWork0$(StageExec.scala:75)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.build.BuildStage.toWork0(BuildStage.scala:47)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.StageExec.toWork(StageExec.scala:68)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.StageExec.toWork$(StageExec.scala:67)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.stage.build.BuildStage.toWork(BuildStage.scala:47)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.exec.BuildExec.$anonfun$buildSegment$1(BuildExec.scala:41)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.exec.BuildExec.$anonfun$buildSegment$1$adapted(BuildExec.scala:39)
~[newten-job.jar:5.0.0-r5]
at scala.collection.Iterator.foreach(Iterator.scala:943)
~[scala-library-2.12.15.jar:?]
at scala.collection.Iterator.foreach$(Iterator.scala:943)
~[scala-library-2.12.15.jar:?]
at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
~[scala-library-2.12.15.jar:?]
at scala.collection.IterableLike.foreach(IterableLike.scala:74)
~[scala-library-2.12.15.jar:?]
at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
~[scala-library-2.12.15.jar:?]
at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
~[scala-library-2.12.15.jar:?]
at
org.apache.kylin.engine.spark.job.exec.BuildExec.buildSegment(BuildExec.scala:39)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.SegmentBuildJob.buildSegment(SegmentBuildJob.java:184)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.SegmentBuildJob.lambda$build$1(SegmentBuildJob.java:172)
~[newten-job.jar:5.0.0-r5]
at java.util.Iterator.forEachRemaining(Iterator.java:116) ~[?:1.8.0_211]
at
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
~[?:1.8.0_211]
at
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
~[?:1.8.0_211]
at
org.apache.kylin.engine.spark.job.SegmentBuildJob.build(SegmentBuildJob.java:143)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.job.SegmentBuildJob.doExecute(SegmentBuildJob.java:111)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:354)
~[newten-job.jar:5.0.0-r5]
at
org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:153)
~[newten-job.jar:5.0.0-r5]
at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:57)
~[newten-job.jar:5.0.0-r5]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_211]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_211]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_211] {code}
Looks like new metadata implementation have bottlenecks...
In kylin.metadata.log i see some similar entries when project update on UI.
{code:java}
traceId: 65d01e72-9570-9752-2f0b-45fe414bc365 2025-01-29T18:50:22,537 WARN
[learn_kylin] [Transaction-Thread-2341] transaction.UnitOfWork : UnitOfWork
2c82caf1-c668-c647-4cac-3ec022c012aa takes too long time 37716ms to complete
traceId: 65d01e72-9570-9752-2f0b-45fe414bc365 2025-01-29T18:50:22,538 WARN
[learn_kylin] [Transaction-Thread-2341] transaction.UnitOfWork : current stack:
java.lang.Throwable: null
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.logIfLongTransaction(UnitOfWork.java:184)
~[kylin-core-common-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doTransaction(UnitOfWork.java:153)
~[kylin-core-common-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.common.persistence.transaction.UnitOfWork.doInTransactionWithRetry(UnitOfWork.java:115)
~[kylin-core-common-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.metadata.project.EnhancedUnitOfWork.doInTransactionWithCheckAndRetry(EnhancedUnitOfWork.java:49)
~[kylin-core-metadata-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.metadata.project.EnhancedUnitOfWork.doInTransactionWithCheckAndRetry(EnhancedUnitOfWork.java:44)
~[kylin-core-metadata-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.metadata.project.EnhancedUnitOfWork.doInTransactionWithCheckAndRetry(EnhancedUnitOfWork.java:39)
~[kylin-core-metadata-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.metadata.project.EnhancedUnitOfWork.doInTransactionWithCheckAndRetry(EnhancedUnitOfWork.java:30)
~[kylin-core-metadata-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.metadata.project.EnhancedUnitOfWork.doInTransactionWithCheckAndRetry(EnhancedUnitOfWork.java:26)
~[kylin-core-metadata-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.rest.service.ModelBuildService.fullBuildSegmentsManually(ModelBuildService.java:170)
~[kylin-modeling-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.rest.service.ModelBuildService.buildSegmentsManually(ModelBuildService.java:141)
~[kylin-modeling-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.rest.service.ModelBuildService$$FastClassBySpringCGLIB$$8da3defe.invoke(<generated>)
~[kylin-modeling-service-5.0.0-r5.jar:5.0.0-r5]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
~[spring-core-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.apache.kylin.rest.service.ModelBuildService$$EnhancerBySpringCGLIB$$ea6cb106.buildSegmentsManually(<generated>)
~[kylin-modeling-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.rest.controller.SegmentController.buildSegmentsManually(SegmentController.java:287)
~[kylin-metadata-server-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.kylin.rest.controller.SegmentController$$FastClassBySpringCGLIB$$f2f2d3f6.invoke(<generated>)
~[kylin-metadata-server-5.0.0-r5.jar:5.0.0-r5]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
~[spring-core-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:102)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.apache.kylin.rest.aspect.InsensitiveNameAspect.around(InsensitiveNameAspect.java:70)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at sun.reflect.GeneratedMethodAccessor301.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_211]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_211]
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
~[spring-aop-5.3.31.jar:5.3.31]
at
org.apache.kylin.rest.controller.SegmentController$$EnhancerBySpringCGLIB$$6c839fd6.buildSegmentsManually(<generated>)
~[kylin-metadata-server-5.0.0-r5.jar:5.0.0-r5]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_211]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_211]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_211]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_211]
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
~[spring-webmvc-5.3.31.jar:5.3.31]
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909)
~[spring-webmvc-5.3.31.jar:5.3.31]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:517)
~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
~[spring-webmvc-5.3.31.jar:5.3.31]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
~[tomcat-embed-websocket-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:106)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:106)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:87)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.apache.kylin.rest.security.FillEmptyAuthorizationFilter.doFilter(FillEmptyAuthorizationFilter.java:46)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:237)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:223)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:89)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:111)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:181)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.filter.SegmentsRequestFilter.doFilter(SegmentsRequestFilter.java:97)
~[kylin-data-loading-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.security.FillEmptyAuthorizationFilter.doFilter(FillEmptyAuthorizationFilter.java:46)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.interceptor.ResourceGroupCheckerFilter.doFilter(ResourceGroupCheckerFilter.java:69)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.interceptor.RepeatableRequestBodyFilter.doFilter(RepeatableRequestBodyFilter.java:67)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:164)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.apache.kylin.rest.security.FillEmptyAuthorizationFilter.doFilter(FillEmptyAuthorizationFilter.java:46)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.ui.DefaultLogoutPageGeneratingFilter.doFilterInternal(DefaultLogoutPageGeneratingFilter.java:58)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:237)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:223)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186)
~[spring-security-web-5.7.11.jar:5.7.11]
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.interceptor.V2ApiFilter.doFilter(V2ApiFilter.java:82)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:155)
~[spring-session-core-2.6.1-kylin-r4.jar:2.6.1-kylin-r4]
at
org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82)
~[spring-session-core-2.6.1-kylin-r4.jar:2.6.1-kylin-r4]
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.MultiTenantModeFilter.doFilter(MultiTenantModeFilter.java:120)
~[classes!/:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.QueryNodeFilter.checkServer(QueryNodeFilter.java:234)
~[classes!/:5.0.0-r5]
at org.apache.kylin.rest.QueryNodeFilter.doFilter(QueryNodeFilter.java:211)
~[classes!/:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at org.apache.kylin.rest.JobNodeFilter.doFilter(JobNodeFilter.java:79)
~[classes!/:5.0.0-r5]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.security.LoginLogFilter.doFilterInternal(LoginLogFilter.java:50)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)
~[spring-boot-actuator-2.7.18.jar:2.7.18]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
~[spring-web-5.3.33.jar:5.3.33]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.kylin.rest.interceptor.KEFilter.doFilterInternal(KEFilter.java:72)
~[kylin-common-service-5.0.0-r5.jar:5.0.0-r5]
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
~[spring-web-5.3.33.jar:5.3.33]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:168)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:670)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:346)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:390)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:928)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1786)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
~[tomcat-embed-core-9.0.87.jar:9.0.87]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_211] {code}
> Spark build indexes persormance issue. Many pauses/freezes in spark UI.
> -----------------------------------------------------------------------
>
> Key: KYLIN-5985
> URL: https://issues.apache.org/jira/browse/KYLIN-5985
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: 5.0.0
> Environment: Rocky linux 8.
> Hadoop - Bigtop 3.3.0 distribution.
> Reporter: Alexander
> Priority: Blocker
> Attachments: SparkUI.jpeg,
> eventLogs-application_1738068922293_0056.zip,
> image-2025-01-29-12-40-18-326.png, image-2025-01-29-12-40-58-725.png,
> image-2025-01-29-12-46-03-795.png, image-2025-01-29-12-46-50-561.png,
> image-2025-01-29-12-52-20-907.png, image-2025-01-29-12-53-01-478.png,
> ns3246587.ip-57-128-229.eu_7070_job_2025_01_29_09_27_19_862C85.zip
>
>
> Spark build job freezes and a lot of time spend.
> Build job works 88,94 minutes.
> !image-2025-01-29-12-40-18-326.png!
> Loads a model with only 71,734 rows and 97 indexes.
> !image-2025-01-29-12-52-20-907.png!
>
> Builded segment size 1.46mb
> !image-2025-01-29-12-53-01-478.png!
> With next parameters
> |spark.driver.memory|6G|
> |spark.driver.memoryOverhead|2G|
> |spark.executor.instances|6|
> |spark.executor.memory|6G|
> |spark.executor.memoryOverhead|2G|
>
> in spark UI we have a lot of pauses/freezes. It looks like nothing happend at
> this pauses. No any tasks on executors.
> !image-2025-01-29-12-46-50-561.png!
> Full screen of a spark job - SparkUI.jpeg.
> Diagnostic information in attachment.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
