carbondata git commit: Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading"

Repository: carbondata Updated Branches: refs/heads/carbonstore 6dd8b038f -> e5c32ac96 Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading" This reverts commit 6dd8b038fc898dbf48ad30adfc870c19eb38e3d0. Project:

[24/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/ExcludeColGroupFilterExecuterImpl.java -- diff --git

[33/36] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

http://git-wip-us.apache.org/repos/asf/carbondata/blob/dc43a46a/datamap/examples/src/minmaxdatamap/main/java/org/apache/carbondata/datamap/examples/MinMaxDataWriter.java -- diff --git

[36/36] carbondata git commit: [HotFix][CheckStyle] Fix import related checkstyle

[HotFix][CheckStyle] Fix import related checkstyle This closes #1952 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/7adb295b Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/7adb295b Diff:

[32/36] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row Pick up the no-sort fields in the row and pack them as bytes array and skip parsing them during merge sort to reduce CPU consumption This closes #1792 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo

[15/36] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

http://git-wip-us.apache.org/repos/asf/carbondata/blob/bfa9a2c2/core/src/test/java/org/apache/carbondata/core/cache/dictionary/ForwardDictionaryCacheTest.java -- diff --git

[25/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/scan/executor/impl/AbstractQueryExecutor.java -- diff --git

[17/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/processing/src/main/java/org/apache/carbondata/processing/merger/CarbonCompactionExecutor.java -- diff --git

[34/36] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

[CARBONDATA-1544][Datamap] Datamap FineGrain implementation Implemented interfaces for FG datamap and integrated to filterscanner to use the pruned bitset from FG datamap. FG Query flow as follows. 1.The user can add FG datamap to any table and implement there interfaces. 2. Any filter query

[18/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java -- diff --git a/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java

[12/36] carbondata git commit: [CARBONDATA-1480]Min Max Index Example for DataMap

[CARBONDATA-1480]Min Max Index Example for DataMap Datamap Example. Implementation of Min Max Index through Datamap. And Using the Index while prunning. This closes #1359 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[22/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanFiterExecuterImpl.java -- diff --git

[21/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java -- diff --git

[11/36] carbondata git commit: [CARBONDATA-2080] [S3-Implementation] Propagated hadoopConf from driver to executor for s3 implementation in cluster mode.

[CARBONDATA-2080] [S3-Implementation] Propagated hadoopConf from driver to executor for s3 implementation in cluster mode. Problem : hadoopconf was not getting propagated from driver to the executor that's why load was failing to the distributed environment. Solution: Setting the Hadoop conf in

[09/36] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

[CARBONDATA-1992] Remove partitionId in CarbonTablePath In CarbonTablePath, there is a deprecated partition id which is always 0, it should be removed to avoid confusion. This closes #1765 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[26/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/metadata/blocklet/SegmentInfo.java -- diff --git

[27/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/unsafe/UnsafeFixedLengthDimensionDataChunkStore.java -- diff --git

[29/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

[CARBONDATA-2099] Refactor query scan process to improve readability Unified concepts in scan process flow: 1.QueryModel contains all parameter for scan, it is created by API in CarbonTable. (In future, CarbonTable will be the entry point for various table operations) 2.Use term ColumnChunk to

[31/36] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

http://git-wip-us.apache.org/repos/asf/carbondata/blob/1acc4e18/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[05/36] carbondata git commit: [CARBONDATA-2150] Unwanted updatetable status files are being generated for the delete operation where no records are deleted

[CARBONDATA-2150] Unwanted updatetable status files are being generated for the delete operation where no records are deleted Problem: Unwanted updatetable status files are being generated for the delete operation where no records are deleted Analysis: when the filter value for delete

[08/36] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

http://git-wip-us.apache.org/repos/asf/carbondata/blob/d3cbb026/processing/src/main/java/org/apache/carbondata/processing/loading/steps/CarbonRowDataWriterProcessorStepImpl.java -- diff --git

[23/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java -- diff --git

[10/36] carbondata git commit: [CARBONDATA-1827] S3 Carbon Implementation

[CARBONDATA-1827] S3 Carbon Implementation 1.Provide support for s3 in carbondata. 2.Added S3Example to create carbon table on s3. 3.Added S3CSVExample to load carbon table using csv from s3. This closes #1805 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[01/36] carbondata git commit: [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 [Forced Update!]

Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase 132fbd4d8 -> 3d055c187 (forced update) [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 Upgrade pom version from 1.3.0 to 1.4.0 This closes #1961 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[28/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionDataChunk.java -- diff --git

[06/36] carbondata git commit: [REBASE] Solve conflict after rebasing master

[REBASE] Solve conflict after rebasing master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/3ee9351a Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/3ee9351a Diff:

[02/36] carbondata git commit: [CARBONDATA-1763] Dropped table if exception thrown while creation

[CARBONDATA-1763] Dropped table if exception thrown while creation Preaggregate table is not getting dropped when creation fails because Exceptions from undo metadata is not handled If preaggregate table is not registered with main table(main table updation fails) then it is not dropped from

[04/36] carbondata git commit: [HOTFIX] Fix documentation errors

[HOTFIX] Fix documentation errors Fix documentation errors This closes #1955 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/420cc35d Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/420cc35d Diff:

[19/36] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/7b79ff18/core/src/main/java/org/apache/carbondata/core/util/AbstractDataFileFooterConverter.java -- diff --git

[35/36] carbondata git commit: [REBASE] Solve conflict after rebasing master

[REBASE] Solve conflict after rebasing master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/b93f9542 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/b93f9542 Diff:

Jenkins build became unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #89

See

Jenkins build became unstable: carbondata-master-spark-2.2 #89

See

carbondata git commit: [CARBONDATA-2150] Unwanted updatetable status files are being generated for the delete operation where no records are deleted

Repository: carbondata Updated Branches: refs/heads/master 420cc35d5 -> da549c2b7 [CARBONDATA-2150] Unwanted updatetable status files are being generated for the delete operation where no records are deleted Problem: Unwanted updatetable status files are being generated for the delete

carbondata git commit: [CARBONDATA-2023][DataLoad] Add size base block allocation in data loading [Forced Update!]

Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase 5c55dfe19 -> 132fbd4d8 (forced update) [CARBONDATA-2023][DataLoad] Add size base block allocation in data loading Carbondata assign blocks to nodes at the beginning of data loading. Previous block allocation strategy is

carbondata git commit: [HOTFIX] Fix documentation errors

Repository: carbondata Updated Branches: refs/heads/master 7c05f5f18 -> 420cc35d5 [HOTFIX] Fix documentation errors Fix documentation errors This closes #1955 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

Jenkins build is back to normal : carbondata-master-spark-2.1 #2049

See

Jenkins build is back to normal : carbondata-master-spark-2.1 » Apache CarbonData :: Hadoop #2049

See

Jenkins build is back to normal : carbondata-master-spark-2.2 #85

See

Jenkins build is back to normal : carbondata-master-spark-2.2 » Apache CarbonData :: Hadoop #85

See

carbondata git commit: [CARBONDATA-2137] Delete query performance improved

Repository: carbondata Updated Branches: refs/heads/branch-1.3 1137c285f -> 6e435de5e [CARBONDATA-2137] Delete query performance improved Following is the configuration used : SPARK_EXECUTOR_MEMORY : 200G SPARK_DRIVER_MEMORY : 20G SPARK_EXECUTOR_CORES : 32 SPARK_EXECUTOR_INSTANCEs : 3

carbondata git commit: [CARBONDATA-1763] Dropped table if exception thrown while creation

Repository: carbondata Updated Branches: refs/heads/master 957a51fef -> 1be27b085 [CARBONDATA-1763] Dropped table if exception thrown while creation Preaggregate table is not getting dropped when creation fails because Exceptions from undo metadata is not handled If preaggregate table is not

Build failed in Jenkins: carbondata-master-spark-2.2 » Apache CarbonData :: Hadoop #84

See -- [INFO] [INFO]

Build failed in Jenkins: carbondata-master-spark-2.2 #84

See -- [...truncated 60.31 KB...] [INFO] --- jacoco-maven-plugin:0.7.9:check (default-check) @ carbondata-core --- [INFO] Loading execution data file

Build failed in Jenkins: carbondata-master-spark-2.1 » Apache CarbonData :: Hadoop #2048

See -- [INFO] [INFO]

Jenkins build is back to stable : carbondata-master-spark-2.1 #2046

See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2046

See

Build failed in Jenkins: carbondata-master-spark-2.1 #2047

See Changes: [chenliang613] [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 -- [...truncated 61.50 KB...] [INFO] Building Apache CarbonData :: Processing

Build failed in Jenkins: carbondata-master-spark-2.1 » Apache CarbonData :: Hadoop #2047

See Changes: [chenliang613] [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 -- [INFO]

Build failed in Jenkins: carbondata-master-spark-2.2 #83

See Changes: [chenliang613] [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 -- [...truncated 62.07 KB...] [INFO] Downloading:

Build failed in Jenkins: carbondata-master-spark-2.2 » Apache CarbonData :: Hadoop #83

See Changes: [chenliang613] [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 -- [INFO]

Jenkins build is back to stable : carbondata-master-spark-2.2 #82

See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #82

See

carbondata git commit: [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0

Repository: carbondata Updated Branches: refs/heads/master 11a795cec -> 957a51fef [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 Upgrade pom version from 1.3.0 to 1.4.0 This closes #1961 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[18/35] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/4749ca29/core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java -- diff --git

[17/35] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/4749ca29/core/src/main/java/org/apache/carbondata/core/scan/result/iterator/PartitionSpliterRawResultIterator.java -- diff --git

[15/35] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

http://git-wip-us.apache.org/repos/asf/carbondata/blob/4749ca29/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java -- diff --git a/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java