Re: Kylin Cluster Mode Issue Overwriting conflict /user/ADMIN
You are welcome, enjoy Kylin :). Shrikant Bang 于2018年11月11日周日 上午2:35写道： > Thanks JiaTao for response. I have upgraded Kylin to v2.5.1-hbase1.x and > issue resolved. > > Regards, > Shrikant Bang. > > On Sat, Nov 10, 2018 at 7:22 AM JiaTao Tao wrote: > >> Seems the same with this JIRA: >> https://issues.apache.org/jira/browse/KYLIN-3562. >> >> Shrikant Bang 于2018年11月10日周六 上午2:28写道： >> >> > Hi Team, >> > >> > I have 3 node Kylin (v2.5.0-hbase1.x) Cluster (1all+2query). I am >> > seeing HTTP response codes for QUERY REST APIs giving error code 500. I >> see >> > these exception when I try with concurrent requests. >> > >> > Did anyone faced this issue? Am I missing any configuration in >> cluster >> > mode? >> > >> >Here is exception trace on tomcat logs. >> > >> > Nov 10, 2018 2:20:08 AM org.apache.catalina.core.StandardWrapperValve >> > invoke >> > SEVERE: Servlet.service() for servlet [kylin] in context with path >> > [/kylin] threw exception >> > *org.apache.kylin.common.persistence.WriteConflictException: Overwriting >> > conflict /user/ADMIN, expect old TS 1541787608396, but it is >> 1541787608402* >> > at >> > >> org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325) >> > at >> > >> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323) >> > at >> > >> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308) >> > at >> > >> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287) >> > at >> > >> org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192) >> > at >> > >> org.apache.kylin.rest.security.KylinUserManager.update(KylinUserManager.java:122) >> > at >> > >> org.apache.kylin.rest.service.KylinUserService.updateUser(KylinUserService.java:85) >> > at >> > >> org.apache.kylin.rest.security.KylinAuthenticationProvider.authenticate(KylinAuthenticationProvider.java:117) >> > at >> > >> org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:174) >> > at >> > >> org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199) >> > at >> > >> org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:180) >> > at >> > >> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) >> > at >> > >> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) >> > at >> > >> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) >> > at >> > >> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) >> > at >> > >> org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) >> > at >> > >> org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) >> > at >> > >> org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) >> > at >> > >> org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) >> > at >> > >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> > at >> > >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> > at >> com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) >> > at >> com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) >> > at >> > >>
Re: Kylin Cluster Mode Issue Overwriting conflict /user/ADMIN
Thanks JiaTao for response. I have upgraded Kylin to v2.5.1-hbase1.x and issue resolved. Regards, Shrikant Bang. On Sat, Nov 10, 2018 at 7:22 AM JiaTao Tao wrote: > Seems the same with this JIRA: > https://issues.apache.org/jira/browse/KYLIN-3562. > > Shrikant Bang 于2018年11月10日周六 上午2:28写道： > > > Hi Team, > > > > I have 3 node Kylin (v2.5.0-hbase1.x) Cluster (1all+2query). I am > > seeing HTTP response codes for QUERY REST APIs giving error code 500. I > see > > these exception when I try with concurrent requests. > > > > Did anyone faced this issue? Am I missing any configuration in > cluster > > mode? > > > >Here is exception trace on tomcat logs. > > > > Nov 10, 2018 2:20:08 AM org.apache.catalina.core.StandardWrapperValve > > invoke > > SEVERE: Servlet.service() for servlet [kylin] in context with path > > [/kylin] threw exception > > *org.apache.kylin.common.persistence.WriteConflictException: Overwriting > > conflict /user/ADMIN, expect old TS 1541787608396, but it is > 1541787608402* > > at > > > org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325) > > at > > > org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323) > > at > > > org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308) > > at > > > org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287) > > at > > > org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192) > > at > > > org.apache.kylin.rest.security.KylinUserManager.update(KylinUserManager.java:122) > > at > > > org.apache.kylin.rest.service.KylinUserService.updateUser(KylinUserService.java:85) > > at > > > org.apache.kylin.rest.security.KylinAuthenticationProvider.authenticate(KylinAuthenticationProvider.java:117) > > at > > > org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:174) > > at > > > org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199) > > at > > > org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:180) > > at > > > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) > > at > > > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) > > at > > > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) > > at > > > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > > at > > > org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) > > at > > > org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) > > at > > > org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) > > at > > > org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) > > at > > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > > at > > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > > at > com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) > > at > com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) > > at > > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > > at > > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > > at > > >
Re: Kylin Cluster Mode Issue Overwriting conflict /user/ADMIN
Seems the same with this JIRA: https://issues.apache.org/jira/browse/KYLIN-3562. Shrikant Bang 于2018年11月10日周六 上午2:28写道： > Hi Team, > > I have 3 node Kylin (v2.5.0-hbase1.x) Cluster (1all+2query). I am > seeing HTTP response codes for QUERY REST APIs giving error code 500. I see > these exception when I try with concurrent requests. > > Did anyone faced this issue? Am I missing any configuration in cluster > mode? > >Here is exception trace on tomcat logs. > > Nov 10, 2018 2:20:08 AM org.apache.catalina.core.StandardWrapperValve > invoke > SEVERE: Servlet.service() for servlet [kylin] in context with path > [/kylin] threw exception > *org.apache.kylin.common.persistence.WriteConflictException: Overwriting > conflict /user/ADMIN, expect old TS 1541787608396, but it is 1541787608402* > at > org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325) > at > org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323) > at > org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308) > at > org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287) > at > org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192) > at > org.apache.kylin.rest.security.KylinUserManager.update(KylinUserManager.java:122) > at > org.apache.kylin.rest.service.KylinUserService.updateUser(KylinUserService.java:85) > at > org.apache.kylin.rest.security.KylinAuthenticationProvider.authenticate(KylinAuthenticationProvider.java:117) > at > org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:174) > at > org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199) > at > org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:180) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) > at > org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at > org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) > at > org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) > at > org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) > at > org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) > at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110) > at > org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:494) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104) > at >
Kylin Cluster Mode Issue Overwriting conflict /user/ADMIN
Hi Team, I have 3 node Kylin (v2.5.0-hbase1.x) Cluster (1all+2query). I am seeing HTTP response codes for QUERY REST APIs giving error code 500. I see these exception when I try with concurrent requests. Did anyone faced this issue? Am I missing any configuration in cluster mode? Here is exception trace on tomcat logs. Nov 10, 2018 2:20:08 AM org.apache.catalina.core.StandardWrapperValve invoke SEVERE: Servlet.service() for servlet [kylin] in context with path [/kylin] threw exception *org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /user/ADMIN, expect old TS 1541787608396, but it is 1541787608402* at org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325) at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:323) at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:308) at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:287) at org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192) at org.apache.kylin.rest.security.KylinUserManager.update(KylinUserManager.java:122) at org.apache.kylin.rest.service.KylinUserService.updateUser(KylinUserService.java:85) at org.apache.kylin.rest.security.KylinAuthenticationProvider.authenticate(KylinAuthenticationProvider.java:117) at org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:174) at org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:180) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:494) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445) at
