[jira] [Resolved] (KYLIN-1271) Create streaming table layer will disappear if click on outside
[ https://issues.apache.org/jira/browse/KYLIN-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason resolved KYLIN-1271. Resolution: Fixed Fix Version/s: 2.0 > Create streaming table layer will disappear if click on outside > --- > > Key: KYLIN-1271 > URL: https://issues.apache.org/jira/browse/KYLIN-1271 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0 >Reporter: Lola Liu >Assignee: Zhong,Jason > Fix For: 2.0 > > > STEPS: > 1. Sign in, go to models > 2. Click "adding streaming table" > 3. "Create Streaming Table Schema" layer showed up > 4. Edit on layer, create streaming table schema > 5. Click outside of this layer > RESULT: > The layer disappeared without saving anything -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-1273) remove suffix "_ts" of timestamps
[ https://issues.apache.org/jira/browse/KYLIN-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason closed KYLIN-1273. -- > remove suffix "_ts" of timestamps > - > > Key: KYLIN-1273 > URL: https://issues.apache.org/jira/browse/KYLIN-1273 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0 >Reporter: Lola Liu >Assignee: Zhong,Jason > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1272) Add explanation for auto appended field of streaming table
[ https://issues.apache.org/jira/browse/KYLIN-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason resolved KYLIN-1272. Resolution: Fixed > Add explanation for auto appended field of streaming table > -- > > Key: KYLIN-1272 > URL: https://issues.apache.org/jira/browse/KYLIN-1272 > Project: Kylin > Issue Type: Bug >Reporter: Lola Liu >Assignee: Zhong,Jason >Priority: Minor > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-1272) Add explanation for auto appended field of streaming table
[ https://issues.apache.org/jira/browse/KYLIN-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason closed KYLIN-1272. -- > Add explanation for auto appended field of streaming table > -- > > Key: KYLIN-1272 > URL: https://issues.apache.org/jira/browse/KYLIN-1272 > Project: Kylin > Issue Type: Bug >Reporter: Lola Liu >Assignee: Zhong,Jason >Priority: Minor > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1273) remove suffix "_ts" of timestamps
[ https://issues.apache.org/jira/browse/KYLIN-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason resolved KYLIN-1273. Resolution: Fixed > remove suffix "_ts" of timestamps > - > > Key: KYLIN-1273 > URL: https://issues.apache.org/jira/browse/KYLIN-1273 > Project: Kylin > Issue Type: Bug > Components: Web >Affects Versions: v2.0 >Reporter: Lola Liu >Assignee: Zhong,Jason > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (KYLIN-1287) UI update for streaming build action
[ https://issues.apache.org/jira/browse/KYLIN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong,Jason resolved KYLIN-1287. Resolution: Fixed > UI update for streaming build action > > > Key: KYLIN-1287 > URL: https://issues.apache.org/jira/browse/KYLIN-1287 > Project: Kylin > Issue Type: Improvement > Components: Web >Affects Versions: v2.0 >Reporter: Zhong,Jason >Assignee: Zhong,Jason > Fix For: 2.0 > > > for streaming cube, it's not build from GUI, each user can schedule it in > their own environment,when user click build on GUI,need a tip guide user to > know how to schedule streaming cube build. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1287) UI update for streaming build action
Zhong,Jason created KYLIN-1287: -- Summary: UI update for streaming build action Key: KYLIN-1287 URL: https://issues.apache.org/jira/browse/KYLIN-1287 Project: Kylin Issue Type: Improvement Components: Web Affects Versions: v2.0 Reporter: Zhong,Jason Assignee: Zhong,Jason Fix For: 2.0 for streaming cube, it's not build from GUI, each user can schedule it in their own environment,when user click build on GUI,need a tip guide user to know how to schedule streaming cube build. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1278) Query engine optimization: skip the condition checking on partition column if a segment's time is totaly included in the query range
[ https://issues.apache.org/jira/browse/KYLIN-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-1278: Description: See an example: a cube (which is partitioned by date column "CAL_DT") has three segments: S1, S2, S3; Now a query like "select from fact_table where CAL_DT > '-mm-dd' group by dimA, dimB..." comes, and the "CAL_DT" is only used for filtering, not in group by; By checking the startTime/endTime, Kylin found S2 and S3 need be scanned, and S3 is totally match the condition "CAL_DT > -mm-dd". Then when scan S3, Kylin can ignore the condition on "CAL_DT", selecting a smaller cuboid, this should gain better performance. Further more, this can be generalized to all filtering condition columns: if all values of a dimension matches with user's filtering condition, and it isn't in "group by", Kylin can ignore that column when selecting the cuboid. was: See an example: a cube (which is partitioned by date column "CAL_DT") has three segments: S1, S2, S3; Now a query like "select from fact_table where CAL_DT > '-mm-dd' group by dimA, dimB..." comes, and the "CAL_DT" is only used for filtering, not in group by; By checking the startTime/endTime, Kylin found S2 and S3 need be scanned, and S3 is totally match the condition "CAL_DT > -mm-dd". Then when scan S3, Kylin can ignore the condition on "CAL_DT", selecting a smaller cuboid, this should gain better performance. > Query engine optimization: skip the condition checking on partition column if > a segment's time is totaly included in the query range > > > Key: KYLIN-1278 > URL: https://issues.apache.org/jira/browse/KYLIN-1278 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Reporter: Shaofeng SHI >Assignee: liyang > Fix For: Backlog > > > See an example: a cube (which is partitioned by date column "CAL_DT") has > three segments: > S1, S2, S3; > Now a query like "select from fact_table where CAL_DT > '-mm-dd' > group by dimA, dimB..." comes, and the "CAL_DT" is only used for filtering, > not in group by; > By checking the startTime/endTime, Kylin found S2 and S3 need be scanned, and > S3 is totally match the condition "CAL_DT > -mm-dd". Then when scan S3, > Kylin can ignore the condition on "CAL_DT", selecting a smaller cuboid, this > should gain better performance. > Further more, this can be generalized to all filtering condition columns: if > all values of a dimension matches with user's filtering condition, and it > isn't in "group by", Kylin can ignore that column when selecting the cuboid. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1082) Hive dependencies should be add to tmpjars
[ https://issues.apache.org/jira/browse/KYLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082501#comment-15082501 ] wangxianbin commented on KYLIN-1082: hi, liyang, can you assign this task to me? > Hive dependencies should be add to tmpjars > -- > > Key: KYLIN-1082 > URL: https://issues.apache.org/jira/browse/KYLIN-1082 > Project: Kylin > Issue Type: Bug >Reporter: liyang >Assignee: liyang > Labels: newbie > > Currently kylin assume all data nodes have hive deployment at exact same FS > location. However, a better position is to think hive as a client side app. > Then we need to ship hive jar with MR job every time. > This make deploy kylin a lot easier in cluster that does not have hive on all > data nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1104) Long dimension value casue ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/KYLIN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082353#comment-15082353 ] fengYu commented on KYLIN-1104: --- OK, I will do it based on kylin 2.0-rc. > Long dimension value casue ArrayIndexOutOfBoundsException > - > > Key: KYLIN-1104 > URL: https://issues.apache.org/jira/browse/KYLIN-1104 > Project: Kylin > Issue Type: Bug >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v1.3 > > Attachments: 0001-.patch, 0001-bug.patch > > > I get ArrayIndexOutOfBoundsException while building cube, and the error is > caused by one dimension(I think measure can not be so long) value is longer > than 4096 bytes. > I check source code and find the reason: > 1、it specify max split length is 4096 when create BytesSplitter object in > setup. > 2、in BytesSplitter.split function which split all items in one row with > delimiter, and using System.arraycopy(bytes, offset, split.value, 0, length); > copy every item to a SplittedBytes object named split. and before this line , > it execute split.length = length; to set the split length. > 3、while executing the copy code, it throw ArrayIndexOutOfBoundsException > because the real item length is bigger than 4096! > 4、in mapper function, the exception will catched and execute > handleErrorRecord function to handle it, However, in this function it will > call use splits again(in toString function), ArrayIndexOutOfBoundsException > will throw again. > 5、There is not one catch this exception, which casue the mapper execute > failed. > That is all my situation and analysis, I will modify source code to continue > my job building and I will upload my patch later. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1104) Long dimension value casue ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/KYLIN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082352#comment-15082352 ] fengYu commented on KYLIN-1104: --- OK, I will do it based on kylin 2.0-rc. > Long dimension value casue ArrayIndexOutOfBoundsException > - > > Key: KYLIN-1104 > URL: https://issues.apache.org/jira/browse/KYLIN-1104 > Project: Kylin > Issue Type: Bug >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v1.3 > > Attachments: 0001-.patch, 0001-bug.patch > > > I get ArrayIndexOutOfBoundsException while building cube, and the error is > caused by one dimension(I think measure can not be so long) value is longer > than 4096 bytes. > I check source code and find the reason: > 1、it specify max split length is 4096 when create BytesSplitter object in > setup. > 2、in BytesSplitter.split function which split all items in one row with > delimiter, and using System.arraycopy(bytes, offset, split.value, 0, length); > copy every item to a SplittedBytes object named split. and before this line , > it execute split.length = length; to set the split length. > 3、while executing the copy code, it throw ArrayIndexOutOfBoundsException > because the real item length is bigger than 4096! > 4、in mapper function, the exception will catched and execute > handleErrorRecord function to handle it, However, in this function it will > call use splits again(in toString function), ArrayIndexOutOfBoundsException > will throw again. > 5、There is not one catch this exception, which casue the mapper execute > failed. > That is all my situation and analysis, I will modify source code to continue > my job building and I will upload my patch later. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (KYLIN-1104) Long dimension value casue ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/KYLIN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengYu updated KYLIN-1104: -- Comment: was deleted (was: OK, I will do it based on kylin 2.0-rc.) > Long dimension value casue ArrayIndexOutOfBoundsException > - > > Key: KYLIN-1104 > URL: https://issues.apache.org/jira/browse/KYLIN-1104 > Project: Kylin > Issue Type: Bug >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v1.3 > > Attachments: 0001-.patch, 0001-bug.patch > > > I get ArrayIndexOutOfBoundsException while building cube, and the error is > caused by one dimension(I think measure can not be so long) value is longer > than 4096 bytes. > I check source code and find the reason: > 1、it specify max split length is 4096 when create BytesSplitter object in > setup. > 2、in BytesSplitter.split function which split all items in one row with > delimiter, and using System.arraycopy(bytes, offset, split.value, 0, length); > copy every item to a SplittedBytes object named split. and before this line , > it execute split.length = length; to set the split length. > 3、while executing the copy code, it throw ArrayIndexOutOfBoundsException > because the real item length is bigger than 4096! > 4、in mapper function, the exception will catched and execute > handleErrorRecord function to handle it, However, in this function it will > call use splits again(in toString function), ArrayIndexOutOfBoundsException > will throw again. > 5、There is not one catch this exception, which casue the mapper execute > failed. > That is all my situation and analysis, I will modify source code to continue > my job building and I will upload my patch later. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1279) protobuf jar file conflict with other
[ https://issues.apache.org/jira/browse/KYLIN-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082348#comment-15082348 ] fengYu commented on KYLIN-1279: --- actually I am run kylin-2.0-rc now, there is protobuf-java-2.5.0.jar in WEB-INF/lib > protobuf jar file conflict with other > - > > Key: KYLIN-1279 > URL: https://issues.apache.org/jira/browse/KYLIN-1279 > Project: Kylin > Issue Type: Bug >Affects Versions: 2.0 >Reporter: fengYu > > I query a sql in kylin-2.0, and error happen, here is the log : > [http-bio-17070-exec-1]:[2016-01-04 > 13:30:13,488][ERROR][org.apache.kylin.rest.controller.BasicController.handleError(BasicController.java:44)] > - > org.apache.kylin.rest.exception.InternalErrorException: loader constraint > violation: loader (instance of org/apache/catalina/loader/WebappClassLoader) > previously initiated loading for a different type with name > "com/google/protobuf/Message" > at > org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:212) > at > org.apache.kylin.rest.controller.QueryController.query(QueryController.java:95) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > I delete protobuf-java-2.5.0.jar file in WEB-INF/lib and restart, it works > fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1186) Support precise Count Distinct using bitmap
[ https://issues.apache.org/jira/browse/KYLIN-1186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yerui Sun updated KYLIN-1186: - Attachment: KYLIN-1186-1.x-staging.2.patch New version patch for 1.x-staging branch. There's still one issue: the IICube seems using hllc(10) for count distinct by hardcode, so I skipped the PreciselyCountDistinctQueryTest in IIQueryTest. > Support precise Count Distinct using bitmap > --- > > Key: KYLIN-1186 > URL: https://issues.apache.org/jira/browse/KYLIN-1186 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v1.1 >Reporter: Yerui Sun >Assignee: Yerui Sun > Fix For: v2.0, v1.3 > > Attachments: KYLIN-1186-1.x-staging.2.patch, > KYLIN-1186-1.x-staging.patch > > Original Estimate: 168h > Remaining Estimate: 168h > > For now, kylin only support non-precise count distinct by hyperloglog. > In our production scenario, there're strongly requirements for precise count > distinct, mainly for the column of type int or bigint, such as user-id, > product-id, etc. > Implementing of precise count distinct for all types is difficult and not > efficiency. However, only supporting int or bigint make this much easier. The > values can be projected into a bitmap, which is easy to be compressed and > stored, and easy to count. > I've created a POC based on RoaringBitmap, proving that worked. There's some > more work to be done: > * RoaringBitmap only support int, there need a solution to support bigint; > * Add a new measure and codec, like HyperLogLogPlusCounter, make it easy to > use; > * Add new measure on web ui, and check that whether the column type is int > or bigint; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1285) Release 2.0-rc
liyang created KYLIN-1285: - Summary: Release 2.0-rc Key: KYLIN-1285 URL: https://issues.apache.org/jira/browse/KYLIN-1285 Project: Kylin Issue Type: Task Reporter: liyang Assignee: liyang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1286) Clean up license issues on 2.0 branch
liyang created KYLIN-1286: - Summary: Clean up license issues on 2.0 branch Key: KYLIN-1286 URL: https://issues.apache.org/jira/browse/KYLIN-1286 Project: Kylin Issue Type: Sub-task Reporter: liyang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1279) protobuf jar file conflict with other
[ https://issues.apache.org/jira/browse/KYLIN-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082304#comment-15082304 ] Shaofeng SHI commented on KYLIN-1279: - Do you mean Kylin embeded a protobf jar in WEB-INF/lib? I checked the v1.1.1 and v1.2 package, there isn't this jar. > protobuf jar file conflict with other > - > > Key: KYLIN-1279 > URL: https://issues.apache.org/jira/browse/KYLIN-1279 > Project: Kylin > Issue Type: Bug >Affects Versions: 2.0 >Reporter: fengYu > > I query a sql in kylin-2.0, and error happen, here is the log : > [http-bio-17070-exec-1]:[2016-01-04 > 13:30:13,488][ERROR][org.apache.kylin.rest.controller.BasicController.handleError(BasicController.java:44)] > - > org.apache.kylin.rest.exception.InternalErrorException: loader constraint > violation: loader (instance of org/apache/catalina/loader/WebappClassLoader) > previously initiated loading for a different type with name > "com/google/protobuf/Message" > at > org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:212) > at > org.apache.kylin.rest.controller.QueryController.query(QueryController.java:95) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > I delete protobuf-java-2.5.0.jar file in WEB-INF/lib and restart, it works > fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1285) Release 2.0-rc
[ https://issues.apache.org/jira/browse/KYLIN-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-1285: -- Description: Deliver a official apache release of 2.0-rc > Release 2.0-rc > -- > > Key: KYLIN-1285 > URL: https://issues.apache.org/jira/browse/KYLIN-1285 > Project: Kylin > Issue Type: Task >Reporter: liyang >Assignee: liyang > > Deliver a official apache release of 2.0-rc -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-579) Unload Hive table from Kylin
[ https://issues.apache.org/jira/browse/KYLIN-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-579: --- Assignee: (was: Shaofeng SHI) > Unload Hive table from Kylin > > > Key: KYLIN-579 > URL: https://issues.apache.org/jira/browse/KYLIN-579 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Reporter: Luke Han >Priority: Minor > Labels: newbie > Fix For: Backlog > > > Unload Hive table from Kylin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1014) Support kerberos authentication while getting status from RM
[ https://issues.apache.org/jira/browse/KYLIN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-1014: Fix Version/s: v2.0 v2.1 > Support kerberos authentication while getting status from RM > > > Key: KYLIN-1014 > URL: https://issues.apache.org/jira/browse/KYLIN-1014 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v1.0, v0.7.2, v0.7.1 >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v2.1, v2.0, v1.3 > > Attachments: > 0001-hadoop-status-checker-support-rm-with-kerberos.patch, > patch-for-2.0-rc.patch > > > I have used kylin-0.7.2 build cube and do some query, and I am trying > kylin-1.0 in another hadoop cluster. I get this problem below in kylin-0.7.2 > and kylin-1.0 : > Our hadoop cluster deals with authentication with kerberos, However, We find > after submit a mapreduce job(the second step in building cube), kylin will > send a http request to RM server and get the job status at regular intervals, > But we always get errors here because kylin do nothing about kerberos. > Finally , we do some change on source code and make it support kerberos > authentication . attachment is my patch file.. > I add a property named "kylin.job.status.with.kerberos" which means if we > need do authentication with kerberos when getting status from RM, the default > value is false. > It will be highly appreciated if you have some good idea or some suggestion. > Thanks... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1014) Support kerberos authentication while getting status from RM
[ https://issues.apache.org/jira/browse/KYLIN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082299#comment-15082299 ] Shaofeng SHI commented on KYLIN-1014: - Patch applied in 2.0-rc and 2.x-staging branches; Thanks Yu! > Support kerberos authentication while getting status from RM > > > Key: KYLIN-1014 > URL: https://issues.apache.org/jira/browse/KYLIN-1014 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: v1.0, v0.7.2, v0.7.1 >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v1.3 > > Attachments: > 0001-hadoop-status-checker-support-rm-with-kerberos.patch, > patch-for-2.0-rc.patch > > > I have used kylin-0.7.2 build cube and do some query, and I am trying > kylin-1.0 in another hadoop cluster. I get this problem below in kylin-0.7.2 > and kylin-1.0 : > Our hadoop cluster deals with authentication with kerberos, However, We find > after submit a mapreduce job(the second step in building cube), kylin will > send a http request to RM server and get the job status at regular intervals, > But we always get errors here because kylin do nothing about kerberos. > Finally , we do some change on source code and make it support kerberos > authentication . attachment is my patch file.. > I add a property named "kylin.job.status.with.kerberos" which means if we > need do authentication with kerberos when getting status from RM, the default > value is false. > It will be highly appreciated if you have some good idea or some suggestion. > Thanks... -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1281) Add "partition_date_end", and move "partition_date_start" into cube descriptor
[ https://issues.apache.org/jira/browse/KYLIN-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-1281: Assignee: Zhong,Jason (was: Shaofeng SHI) The backend and the cube migration tool has been updated; Now we need update the UI to allow user enter the start date at cube level. The "end date" can be hidden to avoid confusion. > Add "partition_date_end", and move "partition_date_start" into cube descriptor > -- > > Key: KYLIN-1281 > URL: https://issues.apache.org/jira/browse/KYLIN-1281 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Affects Versions: v2.0 >Reporter: Shaofeng SHI >Assignee: Zhong,Jason > Fix For: v2.0 > > > For some legacy cube, we expect set an "partition_date_end" for it and don't > allow building beyond that date, so we can create new cube from that date. > And also, move the existing "partition_date_start" from DataModelDesc to > CubeDesc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1104) Long dimension value casue ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/KYLIN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082274#comment-15082274 ] Shaofeng SHI commented on KYLIN-1104: - [~feng_xiao_yu] Yu, the patch is applied in 1.x-staging branch, you can see it in https://github.com/apache/kylin/commit/307e13ccfea507290a1fdd4e72447fac69ecc63b ; Could you please make another patch for 2.x-staging? Thanks for your contribution. > Long dimension value casue ArrayIndexOutOfBoundsException > - > > Key: KYLIN-1104 > URL: https://issues.apache.org/jira/browse/KYLIN-1104 > Project: Kylin > Issue Type: Bug >Reporter: fengYu >Assignee: Shaofeng SHI > Fix For: v1.3 > > Attachments: 0001-.patch, 0001-bug.patch > > > I get ArrayIndexOutOfBoundsException while building cube, and the error is > caused by one dimension(I think measure can not be so long) value is longer > than 4096 bytes. > I check source code and find the reason: > 1、it specify max split length is 4096 when create BytesSplitter object in > setup. > 2、in BytesSplitter.split function which split all items in one row with > delimiter, and using System.arraycopy(bytes, offset, split.value, 0, length); > copy every item to a SplittedBytes object named split. and before this line , > it execute split.length = length; to set the split length. > 3、while executing the copy code, it throw ArrayIndexOutOfBoundsException > because the real item length is bigger than 4096! > 4、in mapper function, the exception will catched and execute > handleErrorRecord function to handle it, However, in this function it will > call use splits again(in toString function), ArrayIndexOutOfBoundsException > will throw again. > 5、There is not one catch this exception, which casue the mapper execute > failed. > That is all my situation and analysis, I will modify source code to continue > my job building and I will upload my patch later. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-1284) Restful API Get hive SQL of the cube "cubes/{cubeName}/segs/{segmentName}/sql" returns xml
[
https://issues.apache.org/jira/browse/KYLIN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lola Liu closed KYLIN-1284.
---
Resolution: Not A Problem
False alert. Miss api in request
> Restful API Get hive SQL of the cube
> "cubes/{cubeName}/segs/{segmentName}/sql" returns xml
> --
>
> Key: KYLIN-1284
> URL: https://issues.apache.org/jira/browse/KYLIN-1284
> Project: Kylin
> Issue Type: Bug
> Components: REST Service
>Affects Versions: v2.0
>Reporter: Lola Liu
>Assignee: Zhong,Jason
>Priority: Minor
>
> STEPS:
> Send get request:
> http://kylin-qa2-host:port/kylin/cubes/airline_test_vic/segs/1970010100_2922789940817071255/sql
> (Cube name and segment name are from /cubes API response)
> RESULT:
> Response:
>
>
>
>
>
>
>
>
>
> Kylin
>
>
>
>
>
> ng-include="'partials/header.html'">
>
>
>
>
>
> ng-include="'partials/footer.html'">
>
>
>
>
>
> Error Message
> {{text}}
>
>
> Cube Schema
> {{schema}}
>
>
>
>
> {{text}}
>
>
>
>
>
>
> Error Message
> {{text}}
>
>
> Model Schema
> {{schema}}
>
>
>
>
> {{text}}
>
>
>
>
>
> Error Message
> {{text}}
>
>
> Streaming Schema
> {{streamingSchema}}
>
>
> Kafka Schema
> {{kfkSchema}}
>
>
>
[jira] [Created] (KYLIN-1284) Restful API Get hive SQL of the cube "cubes/{cubeName}/segs/{segmentName}/sql" returns xml
Lola Liu created KYLIN-1284:
---
Summary: Restful API Get hive SQL of the cube
"cubes/{cubeName}/segs/{segmentName}/sql" returns xml
Key: KYLIN-1284
URL: https://issues.apache.org/jira/browse/KYLIN-1284
Project: Kylin
Issue Type: Bug
Components: REST Service
Affects Versions: v2.0
Reporter: Lola Liu
Assignee: Zhong,Jason
Priority: Minor
STEPS:
Send get request:
http://kylin-qa2-host:port/kylin/cubes/airline_test_vic/segs/1970010100_2922789940817071255/sql
(Cube name and segment name are from /cubes API response)
RESULT:
Response:
Kylin
Error Message
{{text}}
Cube Schema
{{schema}}
{{text}}
Error Message
{{text}}
Model Schema
{{schema}}
{{text}}
Error Message
{{text}}
Streaming Schema
{{streamingSchema}}
Kafka Schema
{{kfkSchema}}
[jira] [Created] (KYLIN-1283) Replace GTScanRequest's SerDer form Kryo to manual
hongbin ma created KYLIN-1283: - Summary: Replace GTScanRequest's SerDer form Kryo to manual Key: KYLIN-1283 URL: https://issues.apache.org/jira/browse/KYLIN-1283 Project: Kylin Issue Type: Improvement Reporter: hongbin ma Assignee: hongbin ma Kryo greatly simplifies bject SerDer at the cost of performance. When there're tens of segments, such cost accumulates too big to accept. Going to serialize GTScanRequest's with manual serialization. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1281) Add "partition_date_end", and move "partition_date_start" into cube descriptor
[ https://issues.apache.org/jira/browse/KYLIN-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-1281: Description: For some legacy cube, we expect set an "partition_date_end" for it and don't allow building beyond that date, so we can create new cube from that date. And also, move the existing "partition_date_start" from DataModelDesc to CubeDesc. (was: For some legacy cube, we expect set an "endDate" for it and don't allow building beyond that date. So we can create new cube from that date.) > Add "partition_date_end", and move "partition_date_start" into cube descriptor > -- > > Key: KYLIN-1281 > URL: https://issues.apache.org/jira/browse/KYLIN-1281 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Affects Versions: v2.0 >Reporter: Shaofeng SHI >Assignee: Shaofeng SHI > Fix For: v2.0 > > > For some legacy cube, we expect set an "partition_date_end" for it and don't > allow building beyond that date, so we can create new cube from that date. > And also, move the existing "partition_date_start" from DataModelDesc to > CubeDesc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1281) Add "partition_date_end", and move "partition_date_start" into cube descriptor
[ https://issues.apache.org/jira/browse/KYLIN-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-1281: Summary: Add "partition_date_end", and move "partition_date_start" into cube descriptor (was: Add "endDate" for cube descriptor) > Add "partition_date_end", and move "partition_date_start" into cube descriptor > -- > > Key: KYLIN-1281 > URL: https://issues.apache.org/jira/browse/KYLIN-1281 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Affects Versions: v2.0 >Reporter: Shaofeng SHI >Assignee: Shaofeng SHI > Fix For: v2.0 > > > For some legacy cube, we expect set an "endDate" for it and don't allow > building beyond that date. So we can create new cube from that date. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1282) Comparison filter on Date/Time column not work for query
Dong Li created KYLIN-1282: -- Summary: Comparison filter on Date/Time column not work for query Key: KYLIN-1282 URL: https://issues.apache.org/jira/browse/KYLIN-1282 Project: Kylin Issue Type: Bug Components: Query Engine Affects Versions: v2.0 Reporter: Dong Li Assignee: Dong Li Suppose test_table has column A whose type is 'date', following query will get error: select * from test_table where A > '2012-01-01' But this query works on 1.x -- This message was sent by Atlassian JIRA (v6.3.4#6332)
