[GitHub] carbondata pull request #1394: [RELEASE] Updated new version number 1.3.0-SN...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1394 ---
[GitHub] carbondata issue #1361: [CARBONDATA-1481] Compaction support global sort
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1361 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/961/ ---
[GitHub] carbondata issue #1394: [RELEASE] Updated new version number 1.3.0-SNAPSHOT ...
Github user lionelcao commented on the issue: https://github.com/apache/carbondata/pull/1394 LGTM ---
[GitHub] carbondata issue #1397: Change pom version to 1.3.0 for new release developm...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1397 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/960/ ---
[GitHub] carbondata issue #1361: [CARBONDATA-1481] Compaction support global sort
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1361 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/333/ ---
[GitHub] carbondata issue #1361: [CARBONDATA-1481] Compaction support global sort
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1361 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/209/ ---
[GitHub] carbondata issue #1397: Change pom version to 1.3.0 for new release developm...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1397 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/332/ ---
[GitHub] carbondata issue #1394: [RELEASE] Updated new version number 1.3.0-SNAPSHOT ...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1394 LGTM ---
[GitHub] carbondata issue #1397: Change pom version to 1.3.0 for new release developm...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1397 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/208/ ---
[GitHub] carbondata issue #1397: Change pom version to 1.3.0 for new release developm...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1397 duplicated pull request, close it. ---
[GitHub] carbondata pull request #1397: Change pom version to 1.3.0 for new release d...
Github user chenliang613 closed the pull request at: https://github.com/apache/carbondata/pull/1397 ---
[GitHub] carbondata pull request #1397: Change pom version to 1.3.0 for new release d...
GitHub user chenliang613 opened a pull request: https://github.com/apache/carbondata/pull/1397 Change pom version to 1.3.0 for new release development You can merge this pull request into a Git repository by running: $ git pull https://github.com/chenliang613/carbondata upgrade_1.3.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1397.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1397 commit 8094d8e8e089140adedef87aae95370581f7abb6 Author: chenliang613 Date: 2017-09-29T02:51:54Z change pom version to 1.3.0 ---
[jira] [Commented] (CARBONDATA-1534) Update CarbonData 1.2.0 Release details in the website
[ https://issues.apache.org/jira/browse/CARBONDATA-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185255#comment-16185255 ] ASF GitHub Bot commented on CARBONDATA-1534: Github user asfgit closed the pull request at: https://github.com/apache/carbondata-site/pull/51 > Update CarbonData 1.2.0 Release details in the website > -- > > Key: CARBONDATA-1534 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1534 > Project: CarbonData > Issue Type: New Feature > Components: website >Affects Versions: 1.2.0 >Reporter: Pallavi Singh >Assignee: Pallavi Singh > Fix For: 1.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (CARBONDATA-1532) Add Link for Partition Table Guide in Website
[ https://issues.apache.org/jira/browse/CARBONDATA-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185247#comment-16185247 ] ASF GitHub Bot commented on CARBONDATA-1532: Github user asfgit closed the pull request at: https://github.com/apache/carbondata-site/pull/50 > Add Link for Partition Table Guide in Website > - > > Key: CARBONDATA-1532 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1532 > Project: CarbonData > Issue Type: Bug > Components: website >Affects Versions: 1.2.0 >Reporter: Pallavi Singh >Assignee: Pallavi Singh > Fix For: 1.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1362 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/959/ ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1396 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/958/ ---
[GitHub] carbondata issue #1352: [CARBONDATA-1174] Streaming Ingestion - schema valid...
Github user aniketadnaik commented on the issue: https://github.com/apache/carbondata/pull/1352 All review comments have been addressed in previous commit. Please review and merge. mvn -T 4C -Pspark-2.1 -Dspark.version=2.1.0 clean verify - Successful mvn clean verify - Successful ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1396 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/330/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/331/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/207/ ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1396 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/206/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/329/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1362 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/957/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/205/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1362 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/956/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/204/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/328/ ---
[GitHub] carbondata issue #1359: [CARBONDATA-1480]Min Max Index Example for DataMap
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1359 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/955/ ---
[GitHub] carbondata issue #1359: [CARBONDATA-1480]Min Max Index Example for DataMap
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1359 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/954/ ---
[GitHub] carbondata issue #1359: [CARBONDATA-1480]Min Max Index Example for DataMap
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1359 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/203/ ---
[GitHub] carbondata issue #1359: [CARBONDATA-1480]Min Max Index Example for DataMap
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1359 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/327/ ---
[GitHub] carbondata issue #1359: [CARBONDATA-1480]Min Max Index Example for DataMap
Github user sounakr commented on the issue: https://github.com/apache/carbondata/pull/1359 Retest this please ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1362 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/953/ ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1396 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/952/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/201/ ---
[GitHub] carbondata issue #1362: [CARBONDATA-1444] Support boolean
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1362 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/325/ ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1396 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/200/ ---
[GitHub] carbondata issue #1396: [CARBONDATA-1536] Default value of carbon.bad.record...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1396 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/324/ ---
[jira] [Resolved] (CARBONDATA-1531) Format module should support BOOLEAN
[ https://issues.apache.org/jira/browse/CARBONDATA-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-1531. -- Resolution: Fixed Fix Version/s: 1.3.0 > Format module should support BOOLEAN > > > Key: CARBONDATA-1531 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1531 > Project: CarbonData > Issue Type: Improvement > Components: file-format >Reporter: xubo245 >Assignee: xubo245 >Priority: Minor > Fix For: 1.3.0 > > Time Spent: 2h 20m > Remaining Estimate: 0h > > format module support Boolean data type when I was developing Boolean > function, and there are some error in CI after push request into github. So > fromat module should support Boolean. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/1392 LGTM ---
[GitHub] carbondata pull request #1392: [CARBONDATA-1531] Format module should suppor...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1392 ---
[jira] [Created] (CARBONDATA-1536) Default value of carbon.bad.records.action is FORCE
xubo245 created CARBONDATA-1536: --- Summary: Default value of carbon.bad.records.action is FORCE Key: CARBONDATA-1536 URL: https://issues.apache.org/jira/browse/CARBONDATA-1536 Project: CarbonData Issue Type: Bug Components: docs Reporter: xubo245 Assignee: xubo245 Priority: Minor Default value of carbon.bad.records.action is FORCE in source code, but the value is fail in documentation -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata pull request #1396: [CARBONDATA-1536] Default value of carbon.bad...
GitHub user xubo245 opened a pull request: https://github.com/apache/carbondata/pull/1396 [CARBONDATA-1536] Default value of carbon.bad.records.action is FORCE Default value of carbon.bad.records.action is FORCE in source code, but the value is fail in documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/xubo245/carbondata badRecordDoc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1396.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1396 commit 9553c73674c809a3a627311d4ec34aee8cce60db Author: xubo245 <601450...@qq.com> Date: 2017-09-28T15:15:21Z [CARBONDATA-1536] Default value of carbon.bad.records.action is FORCE ---
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/1392 I have changed indentation @jackylk ---
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1392 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/951/ ---
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1392 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/323/ ---
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1392 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/199/ ---
[GitHub] carbondata issue #1395: [CARBONDATA-1533] Fixed decimal data load fail issue...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1395 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/950/ ---
[jira] [Updated] (CARBONDATA-1535) Complex data type ARRAY does not support auto merge/compaction
[
https://issues.apache.org/jira/browse/CARBONDATA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-1535:
Summary: Complex data type ARRAY does not support auto
merge/compaction (was: Complex data type ARRAY do not support auto
merge/compaction)
> Complex data type ARRAY does not support auto merge/compaction
> ---
>
> Key: CARBONDATA-1535
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1535
> Project: CarbonData
> Issue Type: Bug
>Reporter: xubo245
> Original Estimate: 720h
> Remaining Estimate: 720h
>
> When carbon.enable.auto.load.merge was set as true, the table that has
> complex data type ARRAY will happen error when compaction(auto
> merge).
>
> Complex data type ARRAY doesn't support some operations as follow:
> # auto merge
> # sql("alter table array_table compact 'major'")
> # sql("alter table array_table compact 'minor'")
> {code:java}
> java.lang.IndexOutOfBoundsException: 1
> at
> scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
> at scala.collection.immutable.List.apply(List.scala:84)
> at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
> at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (CARBONDATA-1535) Complex data type ARRAY do not support auto merge/compaction
[
https://issues.apache.org/jira/browse/CARBONDATA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-1535:
Description:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
as follow:
# auto merge
# sql("alter table array_table compact 'major'")
# sql("alter table array_table compact 'minor'")
{code:java}
java.lang.IndexOutOfBoundsException: 1
at
scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
at scala.collection.immutable.List.apply(List.scala:84)
at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
{code}
was:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
{code:java}
java.lang.IndexOutOfBoundsException: 1
at
scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
at scala.collection.immutable.List.apply(List.scala:84)
at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
{code}
> Complex data type ARRAY do not support auto merge/compaction
> -
>
> Key: CARBONDATA-1535
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1535
> Project: CarbonData
> Issue Type: Bug
>Reporter: xubo245
> Original Estimate: 720h
> Remaining Estimate: 720h
>
> When carbon.enable.auto.load.merge was set as true, the table that has
> complex data type ARRAY will happen error when compaction(auto
> merge).
>
> as follow:
> # auto merge
> # sql("alter table array_table compact 'major'")
> # sql("alter table array_table compact 'minor'")
> {code:java}
> java.lang.IndexOutOfBoundsException: 1
> at
> scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
> at scala.collection.immutable.List.apply(List.scala:84)
> at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
> at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (CARBONDATA-1535) Complex data type ARRAY do not support auto merge/compaction
[
https://issues.apache.org/jira/browse/CARBONDATA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-1535:
Description:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
Complex data type ARRAY doesn't support some operations as follow:
# auto merge
# sql("alter table array_table compact 'major'")
# sql("alter table array_table compact 'minor'")
{code:java}
java.lang.IndexOutOfBoundsException: 1
at
scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
at scala.collection.immutable.List.apply(List.scala:84)
at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
{code}
was:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
as follow:
# auto merge
# sql("alter table array_table compact 'major'")
# sql("alter table array_table compact 'minor'")
{code:java}
java.lang.IndexOutOfBoundsException: 1
at
scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
at scala.collection.immutable.List.apply(List.scala:84)
at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
{code}
> Complex data type ARRAY do not support auto merge/compaction
> -
>
> Key: CARBONDATA-1535
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1535
> Project: CarbonData
> Issue Type: Bug
>Reporter: xubo245
> Original Estimate: 720h
> Remaining Estimate: 720h
>
> When carbon.enable.auto.load.merge was set as true, the table that has
> complex data type ARRAY will happen error when compaction(auto
> merge).
>
> Complex data type ARRAY doesn't support some operations as follow:
> # auto merge
> # sql("alter table array_table compact 'major'")
> # sql("alter table array_table compact 'minor'")
> {code:java}
> java.lang.IndexOutOfBoundsException: 1
> at
> scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
> at scala.collection.immutable.List.apply(List.scala:84)
> at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
> at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (CARBONDATA-1535) Complex data type ARRAY do not support auto merge/compaction
[
https://issues.apache.org/jira/browse/CARBONDATA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-1535:
Description:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
{code:java}
java.lang.IndexOutOfBoundsException: 1
at
scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
at scala.collection.immutable.List.apply(List.scala:84)
at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
at
org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
{code}
was:
When carbon.enable.auto.load.merge was set as true, the table that has complex
data type ARRAY will happen error when compaction(auto merge).
> Complex data type ARRAY do not support auto merge/compaction
> -
>
> Key: CARBONDATA-1535
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1535
> Project: CarbonData
> Issue Type: Bug
>Reporter: xubo245
> Original Estimate: 720h
> Remaining Estimate: 720h
>
> When carbon.enable.auto.load.merge was set as true, the table that has
> complex data type ARRAY will happen error when compaction(auto
> merge).
> {code:java}
> java.lang.IndexOutOfBoundsException: 1
> at
> scala.collection.LinearSeqOptimized$class.apply(LinearSeqOptimized.scala:65)
> at scala.collection.immutable.List.apply(List.scala:84)
> at scala.collection.convert.Wrappers$SeqWrapper.get(Wrappers.scala:66)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.readAllComplexTypeChildren(SegmentProperties.java:445)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.fillDimensionAndMeasureDetails(SegmentProperties.java:390)
> at
> org.apache.carbondata.core.datastore.block.SegmentProperties.(SegmentProperties.java:173)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.(CarbonMergerRDD.scala:161)
> at
> org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:79)
> at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:62)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (CARBONDATA-1534) Update CarbonData 1.2.0 Release details in the website
[ https://issues.apache.org/jira/browse/CARBONDATA-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184089#comment-16184089 ] ASF GitHub Bot commented on CARBONDATA-1534: GitHub user PallaviSingh1992 opened a pull request: https://github.com/apache/carbondata-site/pull/51 [CARBONDATA-1534] Updated Website to CarbonData Release 1.2.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/PallaviSingh1992/carbondata-site CARBONDATA-1534 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata-site/pull/51.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #51 commit f4f90faca72efe3270fe1ba69bbe2add469bff65 Author: PallaviSingh1992 Date: 2017-09-28T12:32:33Z Updated Website to CarbonData Release 1.2.0 > Update CarbonData 1.2.0 Release details in the website > -- > > Key: CARBONDATA-1534 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1534 > Project: CarbonData > Issue Type: New Feature > Components: website >Affects Versions: 1.2.0 >Reporter: Pallavi Singh >Assignee: Pallavi Singh > Fix For: 1.2.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1535) Complex data type ARRAY do not support auto merge/compaction
xubo245 created CARBONDATA-1535: --- Summary: Complex data type ARRAY do not support auto merge/compaction Key: CARBONDATA-1535 URL: https://issues.apache.org/jira/browse/CARBONDATA-1535 Project: CarbonData Issue Type: Bug Reporter: xubo245 When carbon.enable.auto.load.merge was set as true, the table that has complex data type ARRAY will happen error when compaction(auto merge). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1388: [CARBONDATA-1512] Fixed bug for failing of concurren...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1388 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/949/ ---
[GitHub] carbondata issue #1395: [CARBONDATA-1533] Fixed decimal data load fail issue...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1395 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/198/ ---
[GitHub] carbondata issue #1395: [CARBONDATA-1533] Fixed decimal data load fail issue...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1395 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/322/ ---
[jira] [Created] (CARBONDATA-1534) Update CarbonData 1.2.0 Release details in the website
Pallavi Singh created CARBONDATA-1534: - Summary: Update CarbonData 1.2.0 Release details in the website Key: CARBONDATA-1534 URL: https://issues.apache.org/jira/browse/CARBONDATA-1534 Project: CarbonData Issue Type: New Feature Components: website Affects Versions: 1.2.0 Reporter: Pallavi Singh Assignee: Pallavi Singh Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1388: [CARBONDATA-1512] Fixed bug for failing of concurren...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1388 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/197/ ---
[GitHub] carbondata issue #1388: [CARBONDATA-1512] Fixed bug for failing of concurren...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1388 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/321/ ---
[GitHub] carbondata pull request #1395: [CARBONDATA-1533] Fixed decimal data load fai...
GitHub user manishgupta88 opened a pull request: https://github.com/apache/carbondata/pull/1395 [CARBONDATA-1533] Fixed decimal data load fail issue and restricted max characters per column 1. Fixed data load failure when both precision and data falls in integer range for decimal data type Analysis: When precision is <=9 for decimal data type then by default integer type is selected for storing decimal data. Data is further compressed by checking min and max value range of data. If data is such that it falls in the Integer range only then exception is thrown during data load as encode method is not handling integer data type data during data load. 2. Restricted max characters per column to 32000 as we use short to store the length of each column Analysis: Short data type is used to store length of each column in unsafe carbon row while writing data to off heap. If length is more than Short value then values goes into negative and while reading the same data negative array size exception is thrown. You can merge this pull request into a Git repository by running: $ git pull https://github.com/manishgupta88/carbondata decimal_int_range_issue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1395.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1395 commit 5066935dc5cd6f9873cda794b2e71d9431983996 Author: manishgupta88 Date: 2017-09-28T11:33:46Z 1. Fixed data load bug failure when both precision and data fal in integer range for decimal data type 2. Restricted max characters per column to 32000 as we use short to store the length of each column ---
[jira] [Created] (CARBONDATA-1533) Fixed decimal data load fail issue and restricted max characters per column
Manish Gupta created CARBONDATA-1533: Summary: Fixed decimal data load fail issue and restricted max characters per column Key: CARBONDATA-1533 URL: https://issues.apache.org/jira/browse/CARBONDATA-1533 Project: CarbonData Issue Type: Bug Reporter: Manish Gupta Assignee: Manish Gupta Priority: Minor 1. Data load fails when both precision and data falls in integer range for decimal data type with exception as below: 17/09/28 16:36:28 ERROR CarbonFactDataHandlerColumnar: pool-20-thread-1 Error in producer java.lang.RuntimeException: internal error: org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec[src type: DECIMAL, target type: INT, stats(org.apache.carbondata.core.datastore.page.statistics.PrimitivePageStatsCollector@2afaa54e)] at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$3.encode(AdaptiveIntegralCodec.java:142) at org.apache.carbondata.core.datastore.page.SafeDecimalColumnPage.convertValue(SafeDecimalColumnPage.java:209) at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$1.encodeData(AdaptiveIntegralCodec.java:67) at org.apache.carbondata.core.datastore.page.encoding.ColumnPageEncoder.encode(ColumnPageEncoder.java:57) at org.apache.carbondata.processing.store.TablePage.encodeAndCompressMeasures(TablePage.java:284) at org.apache.carbondata.processing.store.TablePage.encode(TablePage.java:269) at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processDataRows(CarbonFactDataHandlerColumnar.java:350) at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.access$500(CarbonFactDataHandlerColumnar.java:62) at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:724) at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:701) 2. Negative Array size exception is thrown when max characters per column is greater than Short max value during data load. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1391: [CARBONDATA-1530] Clean up carbon-processing module
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1391 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/948/ ---
[GitHub] carbondata issue #1392: [CARBONDATA-1531] Format module should support BOOLE...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1392 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/947/ ---
[GitHub] carbondata issue #1391: [CARBONDATA-1530] Clean up carbon-processing module
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1391 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/320/ ---
[GitHub] carbondata issue #1391: [CARBONDATA-1530] Clean up carbon-processing module
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1391 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/196/ ---
[GitHub] carbondata pull request #1388: [CARBONDATA-1512] Fixed bug for failing of co...
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1388#discussion_r141581555
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonTableReader.java
---
@@ -224,15 +225,16 @@ public CarbonTable getTable(SchemaTableName
schemaTableName) {
* is called, it clears this.tableList and populate the list by reading
the files.
*/
private void updateSchemaTables() {
-// update logic determine later
+// update logic determine later
--- End diff --
incorrect indentation
---
[GitHub] carbondata pull request #1392: [CARBONDATA-1531] Format module should suppor...
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1392#discussion_r141580376
--- Diff: format/src/main/thrift/schema.thrift ---
@@ -52,7 +53,8 @@ enum Encoding{
ADAPTIVE_DELTA_INTEGRAL = 8; // Identifies that a column is encoded
using AdaptiveDeltaIntegralCodec
RLE_INTEGRAL = 9; // Identifies that a column is encoded using
RLECodec
DIRECT_STRING = 10; // Stores string value and string length
separately in page data
- ADAPTIVE_FLOATING = 11; // Identifies that a column is encoded using
AdaptiveFloatingCodec
+ADAPTIVE_FLOATING = 11; // Identifies that a column is encoded using
AdaptiveFloatingCodec
--- End diff --
correct the indentation
---
[jira] [Resolved] (CARBONDATA-1505) Get the detailed blocklet information using default BlockletDataMap for other datamaps
[ https://issues.apache.org/jira/browse/CARBONDATA-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-1505. -- Resolution: Fixed Fix Version/s: 1.3.0 > Get the detailed blocklet information using default BlockletDataMap for other > datamaps > -- > > Key: CARBONDATA-1505 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1505 > Project: CarbonData > Issue Type: Improvement >Reporter: Ravindra Pesala > Fix For: 1.3.0 > > Time Spent: 4h > Remaining Estimate: 0h > > All the detail information of blocklet which is need for exceuting query is > present only BlockletDataMap. It is actually default datamap. > So if new datamap is added then it gives only information of blocklet and > blockid, it is insuffucient information to exceute query. > Please add the functionality to retrieve detailed blocklet information from > the BlockletDataMap based on block and blocklet id -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata pull request #1376: [CARBONDATA-1505] Get the detailed blocklet i...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1376 ---
[GitHub] carbondata issue #1376: [CARBONDATA-1505] Get the detailed blocklet informat...
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/1376 LGTM ---
[GitHub] carbondata issue #1391: [CARBONDATA-1530] Clean up carbon-processing module
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/1391 retest this please ---
[GitHub] carbondata issue #1376: [CARBONDATA-1505] Get the detailed blocklet informat...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1376 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/946/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1393 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/319/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1393 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/195/ ---
[GitHub] carbondata issue #1394: [RELEASE] Updated new version number 1.3.0-SNAPSHOT ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1394 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/318/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1393 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/945/ ---
[GitHub] carbondata issue #1394: [RELEASE] Updated new version number 1.3.0-SNAPSHOT ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1394 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/194/ ---
[GitHub] carbondata pull request #1394: [RELEASE] Updated new version number 1.3.0-SN...
GitHub user ravipesala opened a pull request: https://github.com/apache/carbondata/pull/1394 [RELEASE] Updated new version number 1.3.0-SNAPSHOT in master branch pom files You can merge this pull request into a Git repository by running: $ git pull https://github.com/ravipesala/incubator-carbondata new-version Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1394.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1394 commit 87e45a4c592472a32efa3de559fb0ad69c245581 Author: Ravindra Pesala Date: 2017-09-28T09:01:13Z Updated new version number 1.3.0-SNAPSHOT in pom files ---
[GitHub] carbondata issue #1377: [CARBONDATA-1504] Fixed refresh of segments in datam...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1377 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/944/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1393 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/193/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1393 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/317/ ---
[GitHub] carbondata issue #1393: [WIP] Added Support for S3 Storage
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1393 Build Failed with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/192/ ---
[GitHub] carbondata issue #1391: [CARBONDATA-1530] Clean up carbon-processing module
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1391 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/943/ ---
[GitHub] carbondata issue #1376: [CARBONDATA-1505] Get the detailed blocklet informat...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1376 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/316/ ---
[GitHub] carbondata issue #1376: [CARBONDATA-1505] Get the detailed blocklet informat...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1376 Build Success with Spark 1.6, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/191/ ---
