[40/50] [abbrv] carbondata git commit: [CARBONDATA-2420][32K] Support string longer than 32000 characters

http://git-wip-us.apache.org/repos/asf/carbondata/blob/dc53dee2/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/longstring/VarcharDataTypesBasicTestCase.scala -- diff --git

[48/50] [abbrv] carbondata git commit: [CARBONDATA-2509][CARBONDATA-2510][CARBONDATA-2511][32K] Add validate for long string columns

[CARBONDATA-2509][CARBONDATA-2510][CARBONDATA-2511][32K] Add validate for long string columns Add validate for long string columns 1. long string columns cannot be sort_columns 2. long string columns cannot be dictionary include 3. long string columns cannot be dictionary exclude 4. long string

[36/50] [abbrv] carbondata git commit: Support adding local dictionary configuration in create table statement and show the configs in describe formatted table

Support adding local dictionary configuration in create table statement and show the configs in describe formatted table What changes were proposed in this pull request? In this PR, in order to support local dictionary, create table changes are made to support local dictionary configurations as

[24/50] [abbrv] carbondata git commit: [CARBONDATA-2604] Getting ArrayIndexOutOfBoundException during compaction after IUD in cluster is fixed

[CARBONDATA-2604] Getting ArrayIndexOutOfBoundException during compaction after IUD in cluster is fixed Issue: if some records are deleted then during filling the measure and dimension data no of valid rows count and actual rows may be different if some records are deleted . and during filling

[47/50] [abbrv] carbondata git commit: [CARBONDATA-2615][32K] Support page size less than 32000 in CarbondataV3

[CARBONDATA-2615][32K] Support page size less than 32000 in CarbondataV3 Since we support super long string, if it is long enough, a column page with 32000 rows will exceed 2GB, so we support a page less than 32000 rows. This closes #2383 Project:

[30/50] [abbrv] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

[CARBONDATA-2428] Support flat folder for managed carbon table Currently carbondata writing happens in fixed path tablepath/Fact/Part0/Segment_NUM folder and it is not same as hive/parquet folder structure. This PR makes all files written will be inside tablepath, it does not maintain any

[13/50] [abbrv] carbondata git commit: [CARBONDATA-2577] [CARBONDATA-2579] Fixed issue in Avro logical type for nested Array and document update

[CARBONDATA-2577] [CARBONDATA-2579] Fixed issue in Avro logical type for nested Array and document update Problem: Nested Array logical type of date, timestamp-millis, timestamp-micros is not working. Root cause: During the preparation of carbon schema from avro schema. For array nested type

[32/50] [abbrv] carbondata git commit: [CARBONDATA-2553] support ZSTD compression for sort temp file

[CARBONDATA-2553] support ZSTD compression for sort temp file This closes #2350 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ece06729 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/ece06729 Diff:

[49/50] [abbrv] carbondata git commit: [CARBONDATA-2513][32K] Support write long string from dataframe

[CARBONDATA-2513][32K] Support write long string from dataframe support write long string from dataframe This closes #2382 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/55f4bc6c Tree:

[37/50] [abbrv] carbondata git commit: [CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand

http://git-wip-us.apache.org/repos/asf/carbondata/blob/c5a4ec07/integration/spark-common/src/main/scala/org/apache/spark/sql/catalyst/CarbonDDLSqlParser.scala -- diff --git

[18/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

[CARBONDATA-2573] integrate carbonstore mv branch Fixes bugs related to MV and added tests This closes #2335 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/0ef7e55c Tree:

[45/50] [abbrv] carbondata git commit: [CARBONDATA-2504][STREAM] Support StreamSQL for streaming job

http://git-wip-us.apache.org/repos/asf/carbondata/blob/2ea3b2dc/store/sdk/src/main/java/org/apache/carbondata/store/LocalCarbonStore.java -- diff --git a/store/sdk/src/main/java/org/apache/carbondata/store/LocalCarbonStore.java

[50/50] [abbrv] carbondata git commit: [CARBONDATA-2623][DataMap] Add DataMap Pre and Pevent listener

[CARBONDATA-2623][DataMap] Add DataMap Pre and Pevent listener Added Pre and Post Execution Events for index datamap This closes #2389 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/b3f78206 Tree:

[33/50] [abbrv] carbondata git commit: [CARBONDATA-2610] Fix for datamap creation failed on table having loaded data with null value on string datatype

[CARBONDATA-2610] Fix for datamap creation failed on table having loaded data with null value on string datatype Problem: Datamap creation having null values already loaded in string datatype of table fails. Solution: Check for null before converting data to the string. This closes #2376

[43/50] [abbrv] carbondata git commit: [HOTFIX] Added Performance Optimization for Presto by using MultiBlockSplit

[HOTFIX] Added Performance Optimization for Presto by using MultiBlockSplit Added Performance Optimization for Presto by using MultiBlockSplit This closes #2265 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[46/50] [abbrv] carbondata git commit: [CARBONDATA-2504][STREAM] Support StreamSQL for streaming job

[CARBONDATA-2504][STREAM] Support StreamSQL for streaming job Currently, user need to write Spark Streaming APP to use carbon streaming ingest feature, which is not so easy for some users. By providing StreamSQL, user can manage the streaming job more easily. This closes #2328 Project:

[27/50] [abbrv] carbondata git commit: [CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'=

[CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'='true' When insert into data with 'carbon.insert.persist.enable'='true', the storage level of dataset is 'MEMORY_AND_DISK', it should

[41/50] [abbrv] carbondata git commit: [CARBONDATA-2420][32K] Support string longer than 32000 characters

[CARBONDATA-2420][32K] Support string longer than 32000 characters Add a property in creating table 'long_string_columns' to support string columns that will contains more than 32000 characters. Inside carbondata, it use an integer instead of short to store the length of bytes content.

[38/50] [abbrv] carbondata git commit: [CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand

http://git-wip-us.apache.org/repos/asf/carbondata/blob/c5a4ec07/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/localdictionary/LocalDictionarySupportCreateTableTest.scala -- diff --git

[06/50] [abbrv] carbondata git commit: [CARBONDATA-2566] Optimize CarbonReaderExample

[CARBONDATA-2566] Optimize CarbonReaderExample Optimize CarbonReaderExample 1.Add different data type, including date and timestamp 2. update the doc 3.invoke the Schema schema = CarbonSchemaReader .readSchemaInSchemaFile(dataFiles[0].getAbsolutePath()) .asOriginOrder(); This closes #2356

[01/50] [abbrv] carbondata git commit: [CARBONDATA-2521] Support create carbonReader without tableName

Repository: carbondata Updated Branches: refs/heads/carbonstore 638ed1fa7 -> b3f782062 [CARBONDATA-2521] Support create carbonReader without tableName Add new method for creating carbonReader without tableName 1.add new interface: public static CarbonReaderBuilder builder(String tablePath)

[19/50] [abbrv] carbondata git commit: [HOTFIX][CARBONDATA-2591] Fix SDK CarbonReader filter issue

[HOTFIX][CARBONDATA-2591] Fix SDK CarbonReader filter issue There are some issue in SDK CarbonReader filter function, please check the lira. This closes #2363 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[29/50] [abbrv] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/datacompaction/CarbonIndexFileMergeTestCase.scala -- diff --git

[23/50] [abbrv] carbondata git commit: [HOTFIX] fix java style errors

[HOTFIX] fix java style errors This closes #2371 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ff036459 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/ff036459 Diff:

[12/50] [abbrv] carbondata git commit: [CARBONDATA-2575] Add document to explain DataMap Management

[CARBONDATA-2575] Add document to explain DataMap Management Add document to explain DataMap Management This closes #2360 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/d401e060 Tree:

[08/50] [abbrv] carbondata git commit: [CARONDATA-2559]task id set for each carbonReader in threadlocal

[CARONDATA-2559]task id set for each carbonReader in threadlocal 1. Task Id set for CarbonReader because for each CarbonReader object it should be separate Thread Local variable . 2. If sort-Column is not given to CarbonWriter Describe formatted showing default sort_cols is fixed 3. Issue :

[20/50] [abbrv] carbondata git commit: [CARBONDATA-2578] fixed memory leak inside CarbonReader and handled failure case for creation of multi reader for non-transactional table

[CARBONDATA-2578] fixed memory leak inside CarbonReader and handled failure case for creation of multi reader for non-transactional table Issue : CarbonIterator inside CarbonRecordReader was keeping reference of RowBatch and it is not being closed inside CarbonRecordReader. sort_column with

[31/50] [abbrv] carbondata git commit: [CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none

[CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none the prune result is none, and can not set datamapWritePath, which will not generate bitSegGroup in

[21/50] [abbrv] carbondata git commit: [CARBONDATA-2603] Fix: error handling during reader build failure

[CARBONDATA-2603] Fix: error handling during reader build failure problem : When the CarbonReaderBuilder.build() is failed due to some problems like invalid projection that leads to query model creation failure. Blocklet datamap is not cleared for that table.So, the next reader instance uses old

[04/50] [abbrv] carbondata git commit: [CARBONDATA-2529] Fixed S3 Issue for Hadoop 2.8.3

[CARBONDATA-2529] Fixed S3 Issue for Hadoop 2.8.3 This issue fixes the issue while loading the data with S3 as backend This closes #2340 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/4d22ddc9 Tree:

[14/50] [abbrv] carbondata git commit: [CARBONDATA-2569] Change the strategy of Search mode throw exception and run sparkSQL

[CARBONDATA-2569] Change the strategy of Search mode throw exception and run sparkSQL Search mode throw exception but test case pass, please check the jira. This closes #2357 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[17/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/matching/TestTPCDS_1_4_Batch.scala -- diff --git

[03/50] [abbrv] carbondata git commit: [Documentation] Editorial Review comment fixed

[Documentation] Editorial Review comment fixed Editorial Review comment fixed This closes #2320 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/5ad70095 Tree:

[26/50] [abbrv] carbondata git commit: [CARBONDATA-2592][Integration] Getting NoSuchMethod error due to aws sdk multple version jar conflicts

[CARBONDATA-2592][Integration] Getting NoSuchMethod error due to aws sdk multple version jar conflicts ## What changes were proposed in this pull request? Currently in Carbon Spark2 project multiple dependency for the aws-sdk jar has been defined,this will create issue when we build

[15/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/test/scala/org/apache/carbondata/mv/testutil/TestSQLBatch2.scala -- diff --git

[05/50] [abbrv] carbondata git commit: [CARBONDATA-2355] Support run SQL on carbondata files directly

[CARBONDATA-2355] Support run SQL on carbondata files directly Support run SQL on carbondata files directly This closes #2181 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/9469e6bd Tree:

[09/50] [abbrv] carbondata git commit: [CARBONDATA-2571] Calculating the carbonindex and carbondata file size of a table is wrong

[CARBONDATA-2571] Calculating the carbonindex and carbondata file size of a table is wrong Problem: While calculating the carbonindex files size, we are checking either index file or merge file. But in PR#2333, implementation is changed to fill both the file name and the merge file name. So, we

[02/50] [abbrv] carbondata git commit: [CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice

[CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice This closes #2355 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/6aadfe70 Tree:

[28/50] [abbrv] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java -- diff --git

[07/50] [abbrv] carbondata git commit: [Hoxfix] Upgrade dev version to 1.5.0-SNAPSHOT and fix some small issues

[Hoxfix] Upgrade dev version to 1.5.0-SNAPSHOT and fix some small issues 1.Upgrade dev version to 1.5.0-SNAPSHOT 2.Fix carbon-spark-sql issue 3.Remove hadoop 2.2 profile This closes #2359 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[34/50] [abbrv] carbondata git commit: [CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3

[CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3 This closes #2287 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/dc4f87ba Tree:

[16/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala

[10/50] [abbrv] carbondata git commit: [CARBONDATA-2554] Added support for logical type

[CARBONDATA-2554] Added support for logical type Added support for date and timestamp logical types in AvroCarbonWriter. This closes #2347 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2f234869 Tree:

[35/50] [abbrv] carbondata git commit: [CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS

[CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS This closes #1668 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ca466d9f Tree:

[11/50] [abbrv] carbondata git commit: [CARBONDATA-2557] [CARBONDATA-2472] [CARBONDATA-2570] Improve Carbon Reader performance on S3 and fixed datamap clear issue in reader

[CARBONDATA-2557] [CARBONDATA-2472] [CARBONDATA-2570] Improve Carbon Reader performance on S3 and fixed datamap clear issue in reader [CARBONDATA-2557] [CARBONDATA-2472] Problem : CarbonReaderBuilder.build() is slower in s3. It takes around 8 seconds to finish build() Solution: S3 is slow in

[44/50] [abbrv] carbondata git commit: [CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns

[CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns During pruning in bloomfilter datamap, the same blocklets has been added to result more than once, thus causing explaining and querying returning incorrect result. This closes #2386 Project:

[42/50] [abbrv] carbondata git commit: [CARBONDATA-2617] Invalid tuple-id and block id getting formed for Non partition table

[CARBONDATA-2617] Invalid tuple-id and block id getting formed for Non partition table Problem Invalid tuple and block id getting formed for non partition table Analysis While creating a partition table a segment file was written in the Metadata folder under table structure. This was

[22/50] [abbrv] carbondata git commit: [CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data

[CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data This closes #2314 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/685087ed Tree:

[39/50] [abbrv] carbondata git commit: [CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand

[CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand What changes were proposed in this pull request? In this PR, UTs and SDV test cases are added for local dictionary support for create table command and describe formatted command. changed the error message

Jenkins build is back to stable : carbondata-master-spark-2.1 #2526

See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2526

See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Store SDK #567

See

Jenkins build is back to normal : carbondata-master-spark-2.2 #567

See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #567

See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Spark2 #567

See

Jenkins build is back to normal : carbondata-master-spark-2.2 » Apache CarbonData :: Parent #567

See

carbondata git commit: [CARBONDATA-2623][DataMap] Add DataMap Pre and Pevent listener

Repository: carbondata Updated Branches: refs/heads/master 55f4bc6c8 -> b3f782062 [CARBONDATA-2623][DataMap] Add DataMap Pre and Pevent listener Added Pre and Post Execution Events for index datamap This closes #2389 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

Build failed in Jenkins: carbondata-master-spark-2.2 #566

See Changes: [kumarvishal09] [CARBONDATA-2513][32K] Support write long string from dataframe -- [...truncated 62.39 MB...] ++ ++ |count(1)|

Jenkins build became unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Store SDK #566

See

Jenkins build became unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Spark2 #566

See

Jenkins build is still unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #566

See

Build failed in Jenkins: carbondata-master-spark-2.2 » Apache CarbonData :: Parent #566

See -- Established TCP socket on 35591 maven33-agent.jar already up to date maven33-interceptor.jar already up to date

Jenkins build is unstable: carbondata-master-spark-2.2 #565

See

Jenkins build is back to normal : carbondata-master-spark-2.2 » Apache CarbonData :: Parent #565

See

Jenkins build became unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #565

See

Jenkins build is still unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2525

See

Jenkins build is still unstable: carbondata-master-spark-2.1 #2525

See

Jenkins build is unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2524

See

Jenkins build is unstable: carbondata-master-spark-2.1 #2524

See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Store SDK #2523

See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #564

See

Build failed in Jenkins: carbondata-master-spark-2.2 #564

See Changes: [kumarvishal09] [CARBONDATA-2615][32K] Support page size less than 32000 in CarbondataV3 -- [...truncated 55.64 MB...] |which test1 good5|who and

Build failed in Jenkins: carbondata-master-spark-2.2 » Apache CarbonData :: Parent #564

See -- Established TCP socket on 40673 maven33-agent.jar already up to date maven33-interceptor.jar already up to date

carbondata git commit: [CARBONDATA-2513][32K] Support write long string from dataframe

Repository: carbondata Updated Branches: refs/heads/master 218a8deb6 -> 55f4bc6c8 [CARBONDATA-2513][32K] Support write long string from dataframe support write long string from dataframe This closes #2382 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2509][CARBONDATA-2510][CARBONDATA-2511][32K] Add validate for long string columns

Repository: carbondata Updated Branches: refs/heads/master 091a28bf8 -> 218a8deb6 [CARBONDATA-2509][CARBONDATA-2510][CARBONDATA-2511][32K] Add validate for long string columns Add validate for long string columns 1. long string columns cannot be sort_columns 2. long string columns cannot be

Build failed in Jenkins: carbondata-master-spark-2.2 #562

See Changes: [jacky.likun] [CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with -- [...truncated 63.07 MB...] time for query on table

Build failed in Jenkins: carbondata-master-spark-2.2 » Apache CarbonData :: Parent #562

See -- Established TCP socket on 45958 maven33-agent.jar already up to date maven33-interceptor.jar already up to date

Jenkins build is still unstable: carbondata-master-spark-2.1 #2522

See

Jenkins build is still unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2522

See

Jenkins build became unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Store SDK #2522

See