[GitHub] carbondata pull request #3070: [CARBONDATA-3246]Fix sdk reader issue if batc...

2019-01-11 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3070#discussion_r247292846 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/iterator/AbstractDetailQueryResultIterator.java --- @@ -94,6 +94,9

[GitHub] carbondata issue #3068: [HOTFIX] Fixed NPE during query with Local Dictionar...

2019-01-11 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3068 @ravipesala I remember if the local dictionary value count reach threshold, it will go back to original value, right? Does some nodes's local dictionary reach the threshold, bug

[GitHub] carbondata issue #3068: [HOTFIX] Fixed NPE during query with Local Dictionar...

2019-01-11 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3068 why does one segment have some blocklet encoded with local dictionary and some without local dictionary ? ---

[GitHub] carbondata pull request #3065: [HOTFIX] Optimize presto-guide

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3065#discussion_r246997808 --- Diff: docs/presto-guide.md --- @@ -220,7 +220,8 @@ Now you can use the Presto CLI on the coordinator to query data sources in the c

[GitHub] carbondata pull request #3066: [CARBONDATA-3244] Add benchmark for Change Da...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3066#discussion_r246995496 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/benchmark/CDCBenchmark.scala --- @@ -0,0 +1,256 @@ +/* + * Licensed

[GitHub] carbondata issue #3066: [CARBONDATA-3244] Add benchmark for Change Data Capt...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3066 i think the query performance of carbon_solution is lower than hive_solution's, because carbon_solution has more segment (insert generates a segment and update generates more segment

[GitHub] carbondata pull request #3066: [CARBONDATA-3244] Add benchmark for Change Da...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3066#discussion_r246977629 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/benchmark/CDCBenchmark.scala --- @@ -0,0 +1,256 @@ +/* + * Licensed

[GitHub] carbondata pull request #3064: [CARBONDATA-3243] Updated DOC for No-Sort Com...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3064#discussion_r246975368 --- Diff: docs/dml-of-carbondata.md --- @@ -106,6 +107,13 @@ CarbonData DML statements are documented here,which includes: OPTIONS

[GitHub] carbondata pull request #3064: [CARBONDATA-3243] Updated DOC for No-Sort Com...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3064#discussion_r246975324 --- Diff: docs/dml-of-carbondata.md --- @@ -49,6 +49,7 @@ CarbonData DML statements are documented here,which includes: | [COMMENTCHAR

[GitHub] carbondata pull request #3064: [CARBONDATA-3243] Updated DOC for No-Sort Com...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3064#discussion_r246975024 --- Diff: docs/configuration-parameters.md --- @@ -208,6 +208,7 @@ RESET | carbon.options.date.format | Specifies the data

[GitHub] carbondata pull request #3063: [CARBONDATA-3242] Move Range_Column into the ...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3063#discussion_r246973842 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java --- @@ -1364,6 +1365,29 @@ public int

[GitHub] carbondata pull request #3063: [CARBONDATA-3242] Move Range_Column into the ...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3063#discussion_r246973727 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java --- @@ -1364,6 +1365,29 @@ public int

[GitHub] carbondata pull request #3063: [CARBONDATA-3242] Move Range_Column into the ...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3063#discussion_r246973311 --- Diff: core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java --- @@ -947,6 +947,16 @@ public int

[GitHub] carbondata pull request #3065: Optimize presto-guide

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3065#discussion_r246972785 --- Diff: docs/presto-guide.md --- @@ -220,7 +220,8 @@ Now you can use the Presto CLI on the coordinator to query data sources in the c

[GitHub] carbondata pull request #3062: [WIP][CARBONDATA-3241] Refactor the requested...

2019-01-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3062#discussion_r246715623 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala --- @@ -449,9 +455,10

[GitHub] carbondata issue #3060: [HOTFIX] Exclude filter doesn't work in presto carbo...

2019-01-09 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3060 Is there test case to test this scene (use 'exclude filter' in presto carbon ), if not, better to add test case, so that other's changes will not affect this feature. ---

[GitHub] carbondata pull request #3059: [HOTFIX][DataLoad]fix task assignment issue u...

2019-01-09 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3059#discussion_r246352937 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonLoaderUtil.java --- @@ -609,6 +609,14 @@ public static Dictionary

[GitHub] carbondata pull request #3058: [CARBONDATA-3238] Solve StackOverflowError us...

2019-01-08 Thread qiuchenjian
GitHub user qiuchenjian opened a pull request: https://github.com/apache/carbondata/pull/3058 [CARBONDATA-3238] Solve StackOverflowError using MV datamap 【Problem】 An exception or error caused a run to abort. (Using MV) java.lang.StackOverflowError

[GitHub] carbondata pull request #3057: [Test][CARBONDATA-3238] Solve StackOverflowEr...

2019-01-08 Thread qiuchenjian
Github user qiuchenjian closed the pull request at: https://github.com/apache/carbondata/pull/3057 ---

[GitHub] carbondata issue #3057: [Test][CARBONDATA-3238] Solve StackOverflowError usi...

2019-01-08 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3057 retest please ---

[GitHub] carbondata pull request #3057: [Test][CARBONDATA-3238] Solve StackOverflowEr...

2019-01-08 Thread qiuchenjian
GitHub user qiuchenjian reopened a pull request: https://github.com/apache/carbondata/pull/3057 [Test][CARBONDATA-3238] Solve StackOverflowError using MV datamap Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily

[GitHub] carbondata pull request #3057: [Test][CARBONDATA-3238] Solve StackOverflowEr...

2019-01-08 Thread qiuchenjian
Github user qiuchenjian closed the pull request at: https://github.com/apache/carbondata/pull/3057 ---

[GitHub] carbondata pull request #3057: [CARBONDATA-3238] Solve StackOverflowError us...

2019-01-08 Thread qiuchenjian
GitHub user qiuchenjian opened a pull request: https://github.com/apache/carbondata/pull/3057 [CARBONDATA-3238] Solve StackOverflowError using MV datamap 【Problem】 An exception or error caused a run to abort. (Using MV) java.lang.StackOverflowError

[GitHub] carbondata pull request #3053: [CARBONDATA-3233]Fix JVM crash issue in snapp...

2019-01-08 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3053#discussion_r245982727 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/UnsafeFixLengthColumnPage.java --- @@ -369,7 +367,7 @@ public BigDecimal

[GitHub] carbondata issue #3053: [CARBONDATA-3233]Fix JVM crash issue in snappy compr...

2019-01-07 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3053 i think the performance of rawCompress is better than compressLong,compressInt, can we find the root cause of JVM crash? ---

[GitHub] carbondata pull request #3053: [CARBONDATA-3233]Fix JVM crash issue in snapp...

2019-01-07 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3053#discussion_r245848950 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/UnsafeFixLengthColumnPage.java --- @@ -369,7 +367,7 @@ public BigDecimal

[GitHub] carbondata pull request #3054: [CARBONDATA-3232] Optimize carbonData using a...

2019-01-07 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3054#discussion_r245661158 --- Diff: docs/Integration/alluxio-guide.md --- @@ -0,0 +1,44 @@ + + + +# Presto guide +This tutorial provides a quick

[GitHub] carbondata pull request #3052: [CARBONDATA-3227] There are some spell errors...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3052#discussion_r245505788 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -837,9 +837,9 @@ abstract class

[GitHub] carbondata pull request #3052: [CARBONDATA-3227] There are some spell errors...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3052#discussion_r245505775 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -821,10 +821,10 @@ abstract class

[GitHub] carbondata pull request #3052: [CARBONDATA-3227] There are some spell errors...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3052#discussion_r245505760 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -796,10 +796,10 @@ abstract class

[GitHub] carbondata pull request #3052: [CARBONDATA-3227] There are some spell errors...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3052#discussion_r245505699 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -697,9 +697,9 @@ abstract class

[GitHub] carbondata pull request #3052: [CARBONDATA-3227] There are some spell errors...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3052#discussion_r245505691 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -668,9 +668,9 @@ abstract class

[GitHub] carbondata issue #3052: [CARBONDATA-3227] There are some spell errors in the...

2019-01-06 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3052 add to whitelist ---

[GitHub] carbondata pull request #3050: 【CARBONDATA-3211】 Optimize the documentat...

2019-01-04 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3050#discussion_r245244853 --- Diff: datamap/lucene/src/main/java/org/apache/carbondata/datamap/lucene/LuceneFineGrainDataMapFactory.java --- @@ -57,7 +57,7 @@ public

[GitHub] carbondata pull request #3047: [CARBONDATA-3223] Fixed Wrong Datasize and In...

2019-01-02 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3047#discussion_r244895354 --- Diff: integration/spark-common/src/main/scala/org/apache/carbondata/api/CarbonStore.scala --- @@ -101,14 +102,21 @@ object CarbonStore

[GitHub] carbondata pull request #3046: [WIP] Added check to start fallback based on ...

2019-01-02 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3046#discussion_r244708339 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java --- @@ -205,8 +205,10 @@ public

[GitHub] carbondata pull request #3045: [CARBONDATA-3222]Fix dataload failure after c...

2019-01-02 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3045#discussion_r244706639 --- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/longstring/VarcharDataTypesBasicTestCase.scala

[GitHub] carbondata pull request #3044: [CARBONDATA-3202]Documentation for alter tabl...

2019-01-02 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3044#discussion_r244677596 --- Diff: docs/ddl-of-carbondata.md --- @@ -681,24 +682,28 @@ Users can specify which columns to include and exclude for local dictionary gene

[GitHub] carbondata pull request #3044: [CARBONDATA-3202]Documentation for alter tabl...

2019-01-02 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3044#discussion_r244676690 --- Diff: docs/ddl-of-carbondata.md --- @@ -681,24 +682,28 @@ Users can specify which columns to include and exclude for local dictionary gene

[GitHub] carbondata pull request #3041: [CARBONDATA-3218] Fix schema refresh and wron...

2019-01-01 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3041#discussion_r244655257 --- Diff: integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonTableReader.java --- @@ -234,30 +219,26 @@ public TBase create

[GitHub] carbondata pull request #3039: [CARBONDATA-3217] Optimize implicit filter ex...

2019-01-01 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3039#discussion_r244654748 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/expression/conditional/ImplicitExpression.java --- @@ -0,0 +1,109

[GitHub] carbondata pull request #3039: [CARBONDATA-3217] Optimize implicit filter ex...

2019-01-01 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3039#discussion_r244654723 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/expression/conditional/ImplicitExpression.java --- @@ -0,0 +1,109

[GitHub] carbondata issue #3036: [CARBONDATA-3208]Remove unused parameters and import...

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3036 @xubo245 OK, i'll try ---

[GitHub] carbondata issue #3036: [CARBONDATA-3208]Remove unused parameters and import...

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3036 @xuchuanyin @xubo245 @QiangCai @jackylk Can we enable checkstyle rule of avoiding unused imports,i think it's necessary to keep good code style and reduce the dependency of a class

[GitHub] carbondata pull request #3033: [CARBONDATA-3215] Optimize the documentation

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3033#discussion_r21456 --- Diff: docs/datamap-developer-guide.md --- @@ -3,15 +3,15 @@ ### Introduction DataMap is a data structure that can be used

[GitHub] carbondata pull request #3032: [CARBONDATA-3210] merge getKeyOnPrefix into C...

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3032#discussion_r244295612 --- Diff: integration/spark2/src/main/scala/org/apache/carbondata/spark/util/CarbonSparkUtil.scala --- @@ -117,4 +116,18 @@ object CarbonSparkUtil

[GitHub] carbondata pull request #3032: [CARBONDATA-3210] merge getKeyOnPrefix into C...

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3032#discussion_r244291200 --- Diff: README.md --- @@ -84,3 +85,6 @@ To get involved in CarbonData: ## About Apache CarbonData is an open source project

[GitHub] carbondata issue #3032: [CARBONDATA-3210] merge getKeyOnPrefix into CarbonSp...

2018-12-28 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3032 Please describe the change of this PR ---

[GitHub] carbondata pull request #3031: [CARBONDATA-3212] Fixed NegativeArraySizeExce...

2018-12-27 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3031#discussion_r244269580 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/LocalDictColumnPage.java --- @@ -140,6 +140,7 @@ public boolean

[GitHub] carbondata issue #3029: [CARBONDATA-3200] No-Sort compaction

2018-12-27 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3029 Need it add a param to control whether to sort when no_sort? Maybe user only want to merge small segments to a big segment, slow data merging may be unaccepted ---

[GitHub] carbondata pull request #3029: [CARBONDATA-3200] No-Sort compaction

2018-12-27 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3029#discussion_r244252283 --- Diff: processing/src/main/java/org/apache/carbondata/processing/merger/CarbonCompactionExecutor.java --- @@ -105,10 +107,10 @@ public

[GitHub] carbondata pull request #3028: [CARBONDATA-3205]Fix Get Local Dictionary for...

2018-12-27 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3028#discussion_r244142318 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/DimensionRawColumnChunk.java --- @@ -197,6 +197,10 @@ public static

[GitHub] carbondata pull request #3026: [WIP] Added support to compile carbon CDH spa...

2018-12-27 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3026#discussion_r244137998 --- Diff: integration/spark-datasource/src/main/spark2.1andspark2.2/org/apache/spark/sql/CarbonDictionaryReflectionUtil.java --- @@ -0,0 +1,118

[GitHub] carbondata issue #3026: [WIP] Added support to compile carbon CDH spark dist...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3026 @ravipesala sorry,i didn't notice it, now i know the purpose ---

[GitHub] carbondata issue #3025: [WIP][CARBONDATA-3199]"show datamap" represents prea...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3025 > @qiuchenjian currently pre-aggregate datamap is not following the datamap interfaces as it was implemented before datamap framework. That is why not all datamap DDL works with

[GitHub] carbondata pull request #3025: [WIP][CARBONDATA-3199]"show datamap" represen...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian closed the pull request at: https://github.com/apache/carbondata/pull/3025 ---

[GitHub] carbondata issue #3026: [WIP] Added support to compile carbon CDH spark dist...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3026 Does carbon not support Cdh using -Pspark-2.2 ? Does CDH change the spark interface ,so that carbon can't run succesfully ? ---

[GitHub] carbondata pull request #2970: [CARBONDATA-3142]Add timestamp with thread na...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2970#discussion_r244065663 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonThreadFactory.java --- @@ -34,14 +34,26 @@ */ private String name

[GitHub] carbondata pull request #2970: [CARBONDATA-3142]Add timestamp with thread na...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2970#discussion_r244013967 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactDataHandlerColumnar.java --- @@ -144,14 +144,14 @@ private

[GitHub] carbondata pull request #2970: [CARBONDATA-3142]Add timestamp with thread na...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2970#discussion_r244013978 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactDataHandlerColumnar.java --- @@ -144,14 +144,14 @@ private

[GitHub] carbondata pull request #2970: [CARBONDATA-3142]Add timestamp with thread na...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2970#discussion_r244013962 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonThreadFactory.java --- @@ -34,14 +34,26 @@ */ private String name

[GitHub] carbondata issue #3025: [CARBONDATA-3199]"show datamap" represents preaggreg...

2018-12-26 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3025 retest this please ---

[GitHub] carbondata pull request #3025: [CARBONDATA-3199]"show datamap" represents pr...

2018-12-26 Thread qiuchenjian
GitHub user qiuchenjian opened a pull request: https://github.com/apache/carbondata/pull/3025 [CARBONDATA-3199]"show datamap" represents preaggregate datamap [Problem] "show datamap" command doesn't represents preaggregate datamap, it only represents

[GitHub] carbondata pull request #3023: [CARBONDATA-3197][BloomDataMap] Merge bloom i...

2018-12-25 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3023#discussion_r243927801 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/events/MergeBloomIndexEventListener.scala --- @@ -24,59 +24,88 @@ import

[GitHub] carbondata pull request #3023: [CARBONDATA-3197][BloomDataMap] Merge bloom i...

2018-12-25 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3023#discussion_r243904016 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/events/MergeBloomIndexEventListener.scala --- @@ -24,59 +24,88 @@ import

[GitHub] carbondata pull request #3023: [CARBONDATA-3197][BloomDataMap] Merge bloom i...

2018-12-25 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3023#discussion_r243901940 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/events/MergeBloomIndexEventListener.scala --- @@ -24,59 +24,88 @@ import

[GitHub] carbondata pull request #3023: [CARBONDATA-3197][BloomDataMap] Merge bloom i...

2018-12-25 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3023#discussion_r243902213 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/events/MergeBloomIndexEventListener.scala --- @@ -24,59 +24,88 @@ import

[GitHub] carbondata pull request #3019: [CARBONDATA-3194] Integrating Carbon with Pre...

2018-12-24 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3019#discussion_r243822523 --- Diff: integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataPageSourceProvider.java --- @@ -113,7 +132,7 @@ private

[GitHub] carbondata pull request #3019: [CARBONDATA-3194] Integrating Carbon with Pre...

2018-12-24 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3019#discussion_r243821704 --- Diff: integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataPageSourceProvider.java --- @@ -43,63 +44,81

[GitHub] carbondata issue #3021: [CARBONDATA-3193] Cdh5.14.2 spark2.2.0 support

2018-12-24 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3021 Does carbon not support Cdh5.14.2 spark2.2.0 using -Pspark-2.2 ? Did CDH change the spark interface ,so that carbon can't run succesfully ? ---

[GitHub] carbondata issue #3020: [CARBONDATA-3195]Added validation for Inverted Index...

2018-12-24 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3020 I think you need describe this validation in the ddl-of-carbondata.md of Inverted Index Configuration part ---

[GitHub] carbondata pull request #3017: [HOTFIX] remove this useless assignment

2018-12-23 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3017#discussion_r243780410 --- Diff: core/src/main/java/org/apache/carbondata/core/locks/LocalFileLock.java --- @@ -112,7 +112,7 @@ public LocalFileLock(String

[GitHub] carbondata issue #3010: [CARBONDATA-3189] Fix PreAggregate Datamap Issue

2018-12-20 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3010 Can you show up the error message when load and query failing ---

[GitHub] carbondata issue #3008: Carbonfile

2018-12-20 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3008 i think your branch of carbonfile is confused ---

[GitHub] carbondata issue #3007: Carbondata 3173

2018-12-19 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/3007 Please add describe to the title like other PRS ---

[GitHub] carbondata pull request #3006: [CARBONDATA-3187] Supported Global Dictionary...

2018-12-19 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3006#discussion_r243177823 --- Diff: integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -182,7 +182,7 @@ object

[GitHub] carbondata pull request #3000: [CARBONDATA-3181][BloomDataMap] Fix access fi...

2018-12-19 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3000#discussion_r243132507 --- Diff: datamap/bloom/src/main/java/org/apache/hadoop/util/bloom/CarbonBloomFilter.java --- @@ -49,27 +49,23 @@ public CarbonBloomFilter(int

[GitHub] carbondata pull request #3000: [CARBONDATA-3181][BloomDataMap] Fix access fi...

2018-12-19 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/3000#discussion_r242851840 --- Diff: datamap/bloom/src/main/java/org/apache/hadoop/util/bloom/CarbonBloomFilter.java --- @@ -49,27 +49,23 @@ public CarbonBloomFilter(int

[GitHub] carbondata pull request #2996: [WIP] Fix Rename-Fail & Datamap-creation-Fail

2018-12-19 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2996#discussion_r242847958 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonAlterTableRenameCommand.scala --- @@ -165,15

[GitHub] carbondata pull request #2993: [CARBONDATA-3179] Map data load failure

2018-12-18 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2993#discussion_r242436603 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/parser/FieldConverter.scala --- @@ -66,30 +65,57 @@ object FieldConverter

[GitHub] carbondata pull request #2993: [CARBONDATA-3179] Map data load failure

2018-12-17 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2993#discussion_r242435030 --- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/createTable/TestCreateDDLForComplexMapType.scala

[GitHub] carbondata pull request #2713: [WIP][CARBONDATA-2931][BloomDataMap] Optimize...

2018-12-17 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2713#discussion_r242430992 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMapFactory.java --- @@ -218,56 +218,46 @@ public

[GitHub] carbondata pull request #2713: [WIP][CARBONDATA-2931][BloomDataMap] Optimize...

2018-12-17 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2713#discussion_r242393730 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java --- @@ -178,15 +178,9 @@ private String

[GitHub] carbondata pull request #2713: [WIP][CARBONDATA-2931][BloomDataMap] Optimize...

2018-12-17 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2713#discussion_r242387613 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMapFactory.java --- @@ -218,56 +218,46 @@ public

[GitHub] carbondata pull request #2990: [CARBONDATA-3149]Support alter table column r...

2018-12-16 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2990#discussion_r242010744 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonAlterTableColRenameDataTypeChangeCommand.scala

[GitHub] carbondata pull request #2990: [CARBONDATA-3149]Support alter table column r...

2018-12-16 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2990#discussion_r242010398 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonAlterTableColRenameDataTypeChangeCommand.scala

[GitHub] carbondata pull request #2990: [CARBONDATA-3149]Support alter table column r...

2018-12-16 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2990#discussion_r242007987 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/schema/CarbonAlterTableColRenameDataTypeChangeCommand.scala

[GitHub] carbondata pull request #2984: [CARBONDATA-3165]Protection of Bloom Null Exc...

2018-12-15 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2984#discussion_r241950006 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java --- @@ -227,6 +231,12 @@ private String

[GitHub] carbondata pull request #2990: [CARBONDATA-3149]Support alter table column r...

2018-12-14 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2990#discussion_r241935317 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/hive/CarbonFileMetastore.scala --- @@ -286,12 +286,16 @@ class

[GitHub] carbondata pull request #2990: [CARBONDATA-3149]Support alter table column r...

2018-12-14 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2990#discussion_r241935024 --- Diff: integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala --- @@ -1464,31 +1464,46 @@ abstract

[GitHub] carbondata pull request #2988: [CARBONDATA-3174] Fix trailing space issue wi...

2018-12-14 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2988#discussion_r241934868 --- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/createTable/TestNonTransactionalCarbonTable.scala

[GitHub] carbondata pull request #2987: [CARBONDATA-3167] Add a example for DataFrame...

2018-12-13 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2987#discussion_r241619136 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DataFrameSDKS3Example.scala --- @@ -0,0 +1,184 @@ +/* + * Licensed

[GitHub] carbondata pull request #2987: [CARBONDATA-3167] Add a example for DataFrame...

2018-12-13 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2987#discussion_r241619313 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DataFrameSDKS3Example.scala --- @@ -0,0 +1,184 @@ +/* + * Licensed

[GitHub] carbondata pull request #2984: [CARBONDATA-3165]Protection of Bloom Null Exc...

2018-12-13 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2984#discussion_r241617708 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java --- @@ -227,6 +231,12 @@ private String

[GitHub] carbondata pull request #2984: [CARBONDATA-3165]Protection of Bloom Null Exc...

2018-12-12 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2984#discussion_r241298414 --- Diff: datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java --- @@ -227,6 +231,12 @@ private String

[GitHub] carbondata pull request #2985: [HOTFIX] Fixed Query performance issue

2018-12-12 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2985#discussion_r241285610 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/BlockletScannedResult.java --- @@ -663,6 +663,12 @@ public boolean hasNext

[GitHub] carbondata pull request #2984: [CARBONDATA-3165]Protection of Bloom Null Exc...

2018-12-12 Thread qiuchenjian
GitHub user qiuchenjian opened a pull request: https://github.com/apache/carbondata/pull/2984 [CARBONDATA-3165]Protection of Bloom Null Exception Problem: 24274.0 (TID 664711) | org.apache.spark.internal.Logging$class.logError(Logging.scala:91

[GitHub] carbondata pull request #2963: [CARBONDATA-3139] Fix bugs in MinMaxDataMap e...

2018-12-11 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2963#discussion_r240581131 --- Diff: datamap/example/src/main/java/org/apache/carbondata/datamap/minmax/AbstractMinMaxDataMapWriter.java --- @@ -0,0 +1,248

[GitHub] carbondata pull request #2970: [CARBONDATA-3142]Add timestamp with thread na...

2018-12-10 Thread qiuchenjian
Github user qiuchenjian commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2970#discussion_r240447425 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonThreadFactory.java --- @@ -34,14 +34,26 @@ */ private String name

[GitHub] carbondata issue #2970: [CARBONDATA-3142]Add timestamp with thread name whic...

2018-12-10 Thread qiuchenjian
Github user qiuchenjian commented on the issue: https://github.com/apache/carbondata/pull/2970 > @qiuchenjian the checklist should be select correctly, you can refer #2981 or other PR done ---

  1   2   >