carbondata git commit: [CARBONDATA-3047] Added fallback mechanism when offheap memory is not available in UnsafeMemoryManager

2018-10-26 Thread ravipesala
02:01:11 2018 +0530 Committer: ravipesala Committed: Sat Oct 27 07:37:36 2018 +0530 -- .../core/memory/UnsafeMemoryManager.java| 94 +++- 1 file changed, 34 insertions(+), 60 deleti

carbondata git commit: [CARBONDATA-3039] Fix Custom Deterministic Expression for rand() UDF

2018-10-26 Thread ravipesala
45e Author: Indhumathi27 Authored: Tue Oct 23 11:29:51 2018 +0530 Committer: ravipesala Committed: Sat Oct 27 07:30:06 2018 +0530 -- .../spark/sql/CustomDeterministicExpression.scala | 12 +++- 1 file changed

carbondata git commit: [CARBONDATA-3048] Added Lazy Loading For 2.2/2.1

2018-10-26 Thread ravipesala
ter: ravipesala Committed: Sat Oct 27 07:10:00 2018 +0530 -- .../impl/LocalDictDimensionDataChunkStore.java | 20 +- .../safe/AbstractNonDictionaryVectorFiller.java | 221 +++ .../SafeFixedLengthDimensionDataChunkStore.java |

svn commit: r30128 - /release/carbondata/1.5.0/

2018-10-18 Thread ravipesala
Author: ravipesala Date: Thu Oct 18 08:03:42 2018 New Revision: 30128 Log: Uploading 1.5.0 binaries Added: release/carbondata/1.5.0/apache-carbondata-1.5.0-bin-spark2.1.0-hadoop2.7.2.jar (with props) release/carbondata/1.5.0/apache-carbondata-1.5.0-bin-spark2.1.0-hadoop2.7.2.jar.asc

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.3.0 [created] dade91bde

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.3.0-rc2 [deleted] dade91bde

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.3.1 [created] a1f6cc4c5

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.3.1-rc1 [deleted] a1f6cc4c5

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.4.0 [created] daa260242

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.4.0-rc2 [deleted] daa260242

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.5.0 [created] d47ed1634

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.5.0-rc2 [deleted] d47ed1634

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.4.1 [created] d3e58359c

[carbondata] Git Push Summary

2018-10-17 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.4.1-rc2 [deleted] d3e58359c

svn commit: r30072 - /release/carbondata/1.5.0/

2018-10-15 Thread ravipesala
Author: ravipesala Date: Mon Oct 15 14:22:37 2018 New Revision: 30072 Log: Upload 1.5.0 Added: release/carbondata/1.5.0/ release/carbondata/1.5.0/apache-carbondata-1.5.0-bin-spark2.2.1-hadoop2.7.2.jar (with props) release/carbondata/1.5.0/apache-carbondata-1.5.0-bin-spark2.2.1

carbondata git commit: [DOC] Add document for TABLE_BLOCKLET_SIZE

2018-10-09 Thread ravipesala
ter: ravipesala Committed: Wed Oct 10 11:27:29 2018 +0530 -- docs/ddl-of-carbondata.md | 59 +- 1 file changed, 35 insertions(+), 24 deleti

svn commit: r29976 - in /dev/carbondata/1.5.0-rc2: ./ apache-carbondata-1.5.0-source-release.zip apache-carbondata-1.5.0-source-release.zip.asc apache-carbondata-1.5.0-source-release.zip.md5 apache-ca

2018-10-09 Thread ravipesala
Author: ravipesala Date: Tue Oct 9 19:12:44 2018 New Revision: 29976 Log: Upload 1.5.0 RC2 Added: dev/carbondata/1.5.0-rc2/ dev/carbondata/1.5.0-rc2/apache-carbondata-1.5.0-source-release.zip (with props) dev/carbondata/1.5.0-rc2/apache-carbondata-1.5.0-source-release.zip.asc

[carbondata] Git Push Summary

2018-10-09 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.5.0-rc2 [created] d47ed1634

carbondata git commit: [maven-release-plugin] prepare release apache-carbondata-1.5.0-rc2

2018-10-09 Thread ravipesala
3a5 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/935cf3a5 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/935cf3a5 Branch: refs/heads/branch-1.5 Commit: 935cf3a5291a12a39f8c68b32157e26b8b1ef92b Parents: 3c7b339 Author: ravipesala Authored: Tue Oct 9 22:42:22 2018 +0

[18/45] carbondata git commit: [HOTFIX][Streaming] Avoid throwing NPE during deleting the streaming lock file

2018-10-09 Thread ravipesala
[HOTFIX][Streaming] Avoid throwing NPE during deleting the streaming lock file We should check whether the lock file is exists or not before deleting it. If the lock file is exists, need to delete it. If the lock file is not exists, no need to do anything. This closes #2775 Project:

[21/45] carbondata git commit: [CARBONDATA-2989] Upgrade spark integration version to 2.3.2

2018-10-09 Thread ravipesala
[CARBONDATA-2989] Upgrade spark integration version to 2.3.2 1.According to SPARK-PR#22346, change the parameter type from 'outputColumns: Seq[Attribute]' to 'outputColumnNames: Seq[String]' when call 'writeAndRead' method; 2.According to SPARK-PR#21815, there are some parameters added 'lazy',

[17/45] carbondata git commit: [CARBONDATA-2974] Fixed multiple expressions issue on datamap chooser and bloom datamap

2018-10-09 Thread ravipesala
Branch: refs/heads/branch-1.5 Commit: 8284d9ed1fe60d8881788656b7f78c055f76e453 Parents: 8427771 Author: ravipesala Authored: Wed Sep 26 16:56:03 2018 +0530 Committer: xuchuanyin Committed: Fri Sep 28 16:46:49 2018 +0800

[10/45] carbondata git commit: [CARBONDATA-2971] Add shard info of blocklet for debugging

2018-10-09 Thread ravipesala
[CARBONDATA-2971] Add shard info of blocklet for debugging add toString method to print both shard name and blocklet id for debugging. This closes #2765 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/5c0da31a

[23/45] carbondata git commit: [CARBONDATA-2982] CarbonSchemaReader support array

2018-10-09 Thread ravipesala
[CARBONDATA-2982] CarbonSchemaReader support array This PR fix the issue and change : org.apache.carbondata.sdk.file.CarbonSchemaReader#readSchemaInDataFile org.apache.carbondata.sdk.file.CarbonSchemaReader#readSchemaInIndexFile This PR remove child schema This closes #2780 Project:

[32/45] carbondata git commit: [CARBONDATA-2990] Fixed JVM crash when rebuilding bloom datamap

2018-10-09 Thread ravipesala
Author: ravipesala Authored: Sun Sep 30 11:27:57 2018 +0530 Committer: manishgupta88 Committed: Thu Oct 4 14:39:25 2018 +0530 -- .../core/indexstore/UnsafeMemoryDMStore.java| 14 +++ .../core/memory

[37/45] carbondata git commit: [CARBONDATA-2983][BloomDataMap] Change bloom query model to proceed multiple filter values

2018-10-09 Thread ravipesala
: 396c26f531192e3da8a233ca14024dd8899da52a Parents: 3edea12 Author: Manhua Authored: Fri Sep 28 11:39:39 2018 +0800 Committer: ravipesala Committed: Thu Oct 4 18:13:12 2018 +0530 -- .../datamap/bloom/BloomCoarseGrainDataMap.java | 98

[41/45] carbondata git commit: [Documentation] Readme updated with latest topics and new TOC

2018-10-09 Thread ravipesala
http://git-wip-us.apache.org/repos/asf/carbondata/blob/ca30ad97/docs/configuration-parameters.md -- diff --git a/docs/configuration-parameters.md b/docs/configuration-parameters.md index 9dd8164..0a4565a 100644 ---

[31/45] carbondata git commit: [HOTFIX] Changes to align printing of information in explain command based on enable.query.statistics flag

2018-10-09 Thread ravipesala
: c3a8704494d8d4cffbe8f35c43101ce248913965 Parents: d8003a3 Author: manishgupta88 Authored: Wed Oct 3 18:13:45 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:23:12 2018 +0530 -- .../apache/carbondata/core/profiler

[25/45] carbondata git commit: [CARBONDATA-2979] select count fails when carbondata file is written through SDK and read through sparkfileformat for complex datatype map(struct->array->map)

2018-10-09 Thread ravipesala
a/tree/682160fa Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/682160fa Branch: refs/heads/branch-1.5 Commit: 682160fa1bbde5f13c8a28e0114d3f18e5ffaf79 Parents: e9a198a Author: manishgupta88 Authored: Thu Sep 27 18:02:34 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 19:57:5

[20/45] carbondata git commit: [CARBONDATA-2980][BloomDataMap] Fix bug in clearing bloomindex cache when recreating table and datamap

2018-10-09 Thread ravipesala
[CARBONDATA-2980][BloomDataMap] Fix bug in clearing bloomindex cache when recreating table and datamap We use shard path as a part of key for bloomindex cache. However the path separator in windows is different from that in linux, which causes the cache not being cleaned when we clear the cache.

[16/45] carbondata git commit: [CARBONDATA-2818] Upgrade presto integration version to 0.210

2018-10-09 Thread ravipesala
[CARBONDATA-2818] Upgrade presto integration version to 0.210 Upgrade presto integration version to 0.210 This closes #2733 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/8427771f Tree:

[44/45] carbondata git commit: [CARBONDATA-2994] unify badrecordpath property name for create and load

2018-10-09 Thread ravipesala
/19097f27 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/19097f27 Branch: refs/heads/branch-1.5 Commit: 19097f272fe3227c71c86338bb8bf788e87cd4aa Parents: fa08825 Author: kunal642 Authored: Fri Oct 5 14:57:26 2018 +0530 Committer: ravipesala Committed: Mon Oct 8 14:29:59 2018 +0530

[22/45] carbondata git commit: [HOTFIX] Fixed S3 metrics issue.

2018-10-09 Thread ravipesala
/7d1fcb30 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/7d1fcb30 Branch: refs/heads/branch-1.5 Commit: 7d1fcb3092a1e9da6c49f17c63c6217892e9e531 Parents: 2081bc8 Author: ravipesala Authored: Fri Sep 28 18:29:08 2018 +0530 Committer: kumarvishal09 Committed: Wed Oct 3 16:08:49 2018

[15/45] carbondata git commit: [DOC] Add kafka example in StreamSQL doc

2018-10-09 Thread ravipesala
[DOC] Add kafka example in StreamSQL doc This closes #2769 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/629d6254 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/629d6254 Diff:

[36/45] carbondata git commit: [CARBONDATA-2986] Table Properties are lost when multiple driver concurrently

2018-10-09 Thread ravipesala
/carbondata/diff/3edea12a Branch: refs/heads/branch-1.5 Commit: 3edea12a83e70dddb1eca271bf5660f73de272f5 Parents: 11bd0ad Author: BJangir Authored: Fri Sep 28 17:17:30 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 18:05:06 2018 +0530

[19/45] carbondata git commit: [CARBONDATA-2978] Fixed JVM crash issue when insert into carbon table from other carbon table

2018-10-09 Thread ravipesala
: 9ae91cc5a9d683ef54550cfe7e65c4d63d5e5a24 Parents: c016361 Author: ravipesala Authored: Wed Sep 26 23:04:59 2018 +0530 Committer: kumarvishal09 Committed: Fri Sep 28 19:51:06 2018 +0530 -- .../hadoop/api/CarbonTableOutputFormat.java | 35

[14/45] carbondata git commit: [CARBONDATA-2972] Debug Logs and function added for Adaptive Encoding

2018-10-09 Thread ravipesala
[CARBONDATA-2972] Debug Logs and function added for Adaptive Encoding Added a function to get the type of encoding used. Added the debug log for checking which type of encoding is used This closes #2758 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[28/45] carbondata git commit: [CARBONDATA-2987] Data mismatch after compaction with measure sort columns

2018-10-09 Thread ravipesala
Author: ajantha-bhat Authored: Fri Sep 28 16:27:55 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:09:13 2018 +0530 -- .../chunk/store/ColumnPageWrapper.java | 52 +++ .../compaction

[26/45] carbondata git commit: Problem: Preaggregate select queries require table path of parent table to access dictionary files. Therefore in executor CarbonMetadata class was used to get parent tab

2018-10-09 Thread ravipesala
: 9ca985f0d96380d96dae6fdab2d4ee014d5ac345 Parents: 682160f Author: kunal642 Authored: Fri Sep 28 17:41:32 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:02:49 2018 +0530 -- .../core/metadata/schema/table

[43/45] carbondata git commit: [CARBONDATA-2993] fix random NPE while concurrent loading

2018-10-09 Thread ravipesala
://git-wip-us.apache.org/repos/asf/carbondata/diff/fa088256 Branch: refs/heads/branch-1.5 Commit: fa0882569872d3280807a5a57f36c4c43f48cc99 Parents: ca30ad9 Author: kunal642 Authored: Fri Oct 5 10:13:05 2018 +0530 Committer: ravipesala Committed: Fri Oct 5 15:31:33 2018 +0530

[33/45] carbondata git commit: [CARBONDATA-2594] Do not add InvertedIndex in Encoding list for non-sort dimension column #2768

2018-10-09 Thread ravipesala
[CARBONDATA-2594] Do not add InvertedIndex in Encoding list for non-sort dimension column #2768 Not add InvertedIndex in Encoding list for non-sort dimension column This closes #2768 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[38/45] carbondata git commit: [CARBONDATA-2985]Fix issues in Table level compaction and TableProperties

2018-10-09 Thread ravipesala
-us.apache.org/repos/asf/carbondata/diff/30adaa8c Branch: refs/heads/branch-1.5 Commit: 30adaa8c15e430b94bd1448969f50cb2451e1746 Parents: 396c26f Author: BJangir Authored: Tue Oct 2 00:17:29 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 18:58:49 2018 +0530

[39/45] carbondata git commit: [CARBONDATA-2991]NegativeArraySizeException during query execution

2018-10-09 Thread ravipesala
2018 +0530 Committer: ravipesala Committed: Thu Oct 4 21:11:09 2018 +0530 -- .../unsafe/UnsafeAbstractDimensionDataChunkStore.java | 2 +- .../core/datastore/page/UnsafeFixLengthColumnPage.java | 2 +- .../core/datastore/page

[01/45] carbondata git commit: [CARBONDATA-2969]local dictioanry query fix for spark-2.3 [Forced Update!]

2018-10-09 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/branch-1.5 ef1068cad -> 3c7b33992 (forced update) [CARBONDATA-2969]local dictioanry query fix for spark-2.3 This closes #2761 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[03/45] carbondata git commit: [CARBONDATA-2965] support Benchmark command in CarbonCli

2018-10-09 Thread ravipesala
[CARBONDATA-2965] support Benchmark command in CarbonCli A new command called "benchmark" is added in CarbonCli tool to output the scan performance of the specified file and column. Example usage: ```bash shell>java -jar carbondata-cli.jar org.apache.carbondata.CarbonCli -cmd benchmark -p

[09/45] carbondata git commit: [CARBONDATA-2973] Added documentation for fallback condition for complex columns in local Dictionary

2018-10-09 Thread ravipesala
[CARBONDATA-2973] Added documentation for fallback condition for complex columns in local Dictionary 1. Added documentation for fallback condition for complex columns in local Dictionary 2. Added documentation for system level property" carbon.local.dictionary.decoder.fallback" This closes

[04/45] carbondata git commit: [CARBONDATA-2968] Single pass load fails 2nd time in Spark submit execution due to port binding error

2018-10-09 Thread ravipesala
[CARBONDATA-2968] Single pass load fails 2nd time in Spark submit execution due to port binding error Problem : In secure cluster setup, single pass load is failing in spark-submit after using the beeline. Solution: It was happening because port was not getting updated and was not looking for

[35/45] carbondata git commit: [CARBONDATA-2992] Fixed Between Query Data Mismatch issue for timestamp data type

2018-10-09 Thread ravipesala
Author: kumarvishal09 Authored: Fri Sep 28 18:33:29 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 18:02:08 2018 +0530 -- .../src/test/resources/datedatafile.csv | 7 ++ .../src/test/resources/timestampdatafile.csv

[30/45] carbondata git commit: [CARBONDATA-2976] Support dumping column chunk metadata in CarbonCli

2018-10-09 Thread ravipesala
: Wed Sep 26 23:51:34 2018 +0800 Committer: ravipesala Committed: Wed Oct 3 20:17:04 2018 +0530 -- .../org/apache/carbondata/tool/CarbonCli.java | 2 + .../org/apache/carbondata/tool/DataFile.java| 8 +++- .../org/apache

[02/45] carbondata git commit: [CARBONDATA-2962]Even after carbon file is copied to targetfolder(local/hdfs), carbon files is not deleted from temp directory

2018-10-09 Thread ravipesala
[CARBONDATA-2962]Even after carbon file is copied to targetfolder(local/hdfs), carbon files is not deleted from temp directory Problem: Even after carbon file is copied to targetfolder(local/hdfs), carbon files is not deleted from temp directory. Solution: After copying Carbon data and index

[12/45] carbondata git commit: [HOTFIX] support "carbon.load.directWriteHdfs.enabled" for S3

2018-10-09 Thread ravipesala
[HOTFIX] support "carbon.load.directWriteHdfs.enabled" for S3 problem : Currently for s3, when the above carbon property is set. index file will not be written in the s3 store path due to bug in folder path. Solution: file separator used is wrong. Need to fix it. Also rename a carbon peroperty

[27/45] carbondata git commit: [HOTFIX] carbon reader support open another reader without closing previous reader

2018-10-09 Thread ravipesala
: Fri Sep 28 20:24:39 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:06:05 2018 +0530 -- .../hadoop/api/CarbonInputFormat.java | 26 .../sdk/file/CarbonReaderBuilder.java | 7

[42/45] carbondata git commit: [Documentation] Readme updated with latest topics and new TOC

2018-10-09 Thread ravipesala
[Documentation] Readme updated with latest topics and new TOC Readme updated with the new structure Formatting issue fixed Review comments fixed This closes #2788 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[13/45] carbondata git commit: [CARBONDATA-2970]lock object creation fix for viewFS

2018-10-09 Thread ravipesala
[CARBONDATA-2970]lock object creation fix for viewFS Problem when default fs is set to ViewFS then the drop table and load fails with exception saying failed to get lock like meta.lock, tablestatus.lock. This is because when getting locktypeObject we wre not checking for viewfs and we are

[29/45] carbondata git commit: [CARBONDATA-2984][Streaming] Fix NPE when there is no data in the task of a batch

2018-10-09 Thread ravipesala
/repos/asf/carbondata/diff/fa9c8323 Branch: refs/heads/branch-1.5 Commit: fa9c8323c11c083452d75886cbbdad1f23d6dfb7 Parents: 0b16816 Author: QiangCai Authored: Fri Sep 28 14:48:39 2018 +0800 Committer: ravipesala Committed: Wed Oct 3 20:13:50 2018 +0530

[06/45] carbondata git commit: [CARBONDATA-2966]Update Documentation For Avro DataType conversion

2018-10-09 Thread ravipesala
[CARBONDATA-2966]Update Documentation For Avro DataType conversion Updated document for the following features: 1. Avro DataType conversion to carbon 2. Remove min, max for varchar columns 3. LRU enhancements for driver cache This closes #2756 Project:

[07/45] carbondata git commit: [HOTFIX] fix compile error after merging PR-2749

2018-10-09 Thread ravipesala
[HOTFIX] fix compile error after merging PR-2749 fix compile error after merging PR-2749 This closes #2763 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/a9ddfbd7 Tree:

[40/45] carbondata git commit: [Documentation] Readme updated with latest topics and new TOC

2018-10-09 Thread ravipesala
http://git-wip-us.apache.org/repos/asf/carbondata/blob/ca30ad97/docs/datamap-developer-guide.md -- diff --git a/docs/datamap-developer-guide.md b/docs/datamap-developer-guide.md index 6bac9b5..60f93df 100644 ---

[08/45] carbondata git commit: [CARBONDATA-2957][DOC] update doc for supporting compressor in table property

2018-10-09 Thread ravipesala
[CARBONDATA-2957][DOC] update doc for supporting compressor in table property add doc for supporting compressor in table property This closes #2744 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/3cd8b947 Tree:

[11/45] carbondata git commit: [HOTFIX] Fix NPE in LRU cache when entry from the same table is getting evicted to load another entry from same table

2018-10-09 Thread ravipesala
/repos/asf/carbondata/tree/2a4f5300 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/2a4f5300 Branch: refs/heads/branch-1.5 Commit: 2a4f53001058346843e0248c60fee2943087efc9 Parents: 5c0da31 Author: manishgupta88 Authored: Tue Sep 25 19:21:08 2018 +0530 Committer: ravipesala Committed: Thu

[34/45] carbondata git commit: [CARBONDATA-2975] DefaultValue choosing and removeNullValues on rangefilters is incorrect

2018-10-09 Thread ravipesala
/carbondata/tree/6aa2a90b Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/6aa2a90b Branch: refs/heads/branch-1.5 Commit: 6aa2a90bf113132880694e305a264cdccc4c5693 Parents: 18fbdfc Author: dhatchayani Authored: Wed Sep 26 20:49:06 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 17:22

[24/45] carbondata git commit: [CARBONDATA-2952] Provide CarbonReader C++ interface for SDK

2018-10-09 Thread ravipesala
[CARBONDATA-2952] Provide CarbonReader C++ interface for SDK 1.init carbonreader,config data path and tablename 2.config ak sk endpoing for S3 3.configure projection 4.build carbon reader 5.hasNext 6.readNextRow 7.close This closes #2738 Project:

[45/45] carbondata git commit: [CARBONDATA-2990] Queries slow down after some time due to broadcast issue

2018-10-09 Thread ravipesala
/carbondata/diff/3c7b3399 Branch: refs/heads/branch-1.5 Commit: 3c7b33992e06d81fb47d81bf8ccf7884f845b3ff Parents: 19097f2 Author: manishgupta88 Authored: Mon Oct 8 19:38:54 2018 +0530 Committer: ravipesala Committed: Tue Oct 9 13:38:51 2018 +0530

[05/45] carbondata git commit: [DOC] Add spark carbon file format documentation

2018-10-09 Thread ravipesala
/carbondata/tree/d84cd817 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/d84cd817 Branch: refs/heads/branch-1.5 Commit: d84cd817a8ed90e79c12dcee7334b6e52d030982 Parents: 13ecc9e Author: ravipesala Authored: Tue Sep 25 16:19:16 2018 +0530 Committer: kunal642 Committed: Wed Sep 26 16:11

carbondata git commit: [CARBONDATA-2990] Queries slow down after some time due to broadcast issue

2018-10-09 Thread ravipesala
wip-us.apache.org/repos/asf/carbondata/tree/3c7b3399 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/3c7b3399 Branch: refs/heads/master Commit: 3c7b33992e06d81fb47d81bf8ccf7884f845b3ff Parents: 19097f2 Author: manishgupta88 Authored: Mon Oct 8 19:38:54 2018 +0530 Committer: ravipesala Committed:

carbondata git commit: [CARBONDATA-2994] unify badrecordpath property name for create and load

2018-10-08 Thread ravipesala
:26 2018 +0530 Committer: ravipesala Committed: Mon Oct 8 14:29:59 2018 +0530 -- docs/ddl-of-carbondata.md| 11 +++ docs/dml-of-carbondata.md|

carbondata git commit: [CARBONDATA-2993] fix random NPE while concurrent loading

2018-10-05 Thread ravipesala
530 Committer: ravipesala Committed: Fri Oct 5 15:31:33 2018 +0530 -- .../scala/org/apache/carbondata/spark/rdd/CarbonRDD.scala | 9 + .../org/apache/carbondata/sdk/file/AvroCarbonWriter.java| 2 +- 2 files changed

carbondata git commit: [CARBONDATA-2991]NegativeArraySizeException during query execution

2018-10-04 Thread ravipesala
mit: d3927172f19b2251e77b840e53d8678cba2a38bd Parents: 30adaa8 Author: BJangir Authored: Wed Oct 3 23:05:42 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 21:11:09 2018 +0530 -- .../unsafe/UnsafeAbstractDimensionDataChunkStore.java |

carbondata git commit: [CARBONDATA-2985]Fix issues in Table level compaction and TableProperties

2018-10-04 Thread ravipesala
ttp://git-wip-us.apache.org/repos/asf/carbondata/tree/30adaa8c Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/30adaa8c Branch: refs/heads/master Commit: 30adaa8c15e430b94bd1448969f50cb2451e1746 Parents: 396c26f Author: BJangir Authored: Tue Oct 2 00:17:29 2018 +0530 Committer: ravipes

carbondata git commit: [CARBONDATA-2983][BloomDataMap] Change bloom query model to proceed multiple filter values

2018-10-04 Thread ravipesala
pos/asf/carbondata/diff/396c26f5 Branch: refs/heads/master Commit: 396c26f531192e3da8a233ca14024dd8899da52a Parents: 3edea12 Author: Manhua Authored: Fri Sep 28 11:39:39 2018 +0800 Committer: ravipesala Committed: Thu Oct 4 18:13:12 2018 +0

carbondata git commit: [CARBONDATA-2986] Table Properties are lost when multiple driver concurrently

2018-10-04 Thread ravipesala
wip-us.apache.org/repos/asf/carbondata/tree/3edea12a Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/3edea12a Branch: refs/heads/master Commit: 3edea12a83e70dddb1eca271bf5660f73de272f5 Parents: 11bd0ad Author: BJangir Authored: Fri Sep 28 17:17:30 2018 +0530 Committer: ravipesala Committed: Thu

carbondata git commit: [CARBONDATA-2992] Fixed Between Query Data Mismatch issue for timestamp data type

2018-10-04 Thread ravipesala
efs/heads/master Commit: 11bd0ade93a3ac72b42068c3b57ed8bb1203ab47 Parents: 6aa2a90 Author: kumarvishal09 Authored: Fri Sep 28 18:33:29 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 18:02:08 2018 +0530 -- .../src/t

carbondata git commit: [CARBONDATA-2975] DefaultValue choosing and removeNullValues on rangefilters is incorrect

2018-10-04 Thread ravipesala
red: Wed Sep 26 20:49:06 2018 +0530 Committer: ravipesala Committed: Thu Oct 4 17:22:14 2018 +0530 -- .../apache/carbondata/core/scan/filter/FilterUtil.java | 11 ++- .../filter/executer/RangeValueFilterExecuterImpl.j

carbondata git commit: [HOTFIX] Changes to align printing of information in explain command based on enable.query.statistics flag

2018-10-03 Thread ravipesala
org/repos/asf/carbondata/diff/c3a87044 Branch: refs/heads/master Commit: c3a8704494d8d4cffbe8f35c43101ce248913965 Parents: d8003a3 Author: manishgupta88 Authored: Wed Oct 3 18:13:45 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:23:12 2018 +0

carbondata git commit: [CARBONDATA-2976] Support dumping column chunk metadata in CarbonCli

2018-10-03 Thread ravipesala
mit: d8003a31c602807f00d438d8be392992cb0955ac Parents: fa9c832 Author: Jacky Li Authored: Wed Sep 26 23:51:34 2018 +0800 Committer: ravipesala Committed: Wed Oct 3 20:17:04 2018 +0530 -- .../org/apache/carbondata/tool/CarbonCli.j

carbondata git commit: [CARBONDATA-2984][Streaming] Fix NPE when there is no data in the task of a batch

2018-10-03 Thread ravipesala
git-wip-us.apache.org/repos/asf/carbondata/tree/fa9c8323 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/fa9c8323 Branch: refs/heads/master Commit: fa9c8323c11c083452d75886cbbdad1f23d6dfb7 Parents: 0b16816 Author: QiangCai Authored: Fri Sep 28 14:48:39 2018 +0800 Committer: ravipes

carbondata git commit: [CARBONDATA-2987] Data mismatch after compaction with measure sort columns

2018-10-03 Thread ravipesala
efs/heads/master Commit: 0b16816da7b401318929bfe973dad4bf397e90d9 Parents: 6ef4e46 Author: ajantha-bhat Authored: Fri Sep 28 16:27:55 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:09:13 2018 +0530 -- .../chunk/st

carbondata git commit: [HOTFIX] carbon reader support open another reader without closing previous reader

2018-10-03 Thread ravipesala
mit: 6ef4e46b0df2d3954788222943df09bf07fdb120 Parents: 9ca985f Author: ajantha-bhat Authored: Fri Sep 28 20:24:39 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:06:05 2018 +0530 -- .../hadoop/api/CarbonInputFormat.j

carbondata git commit: Problem: Preaggregate select queries require table path of parent table to access dictionary files. Therefore in executor CarbonMetadata class was used to get parent table objec

2018-10-03 Thread ravipesala
wip-us.apache.org/repos/asf/carbondata/diff/9ca985f0 Branch: refs/heads/master Commit: 9ca985f0d96380d96dae6fdab2d4ee014d5ac345 Parents: 682160f Author: kunal642 Authored: Fri Sep 28 17:41:32 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 20:02:49 2018 +0

carbondata git commit: [CARBONDATA-2979] select count fails when carbondata file is written through SDK and read through sparkfileformat for complex datatype map(struct->array->map)

2018-10-03 Thread ravipesala
hu Sep 27 18:02:34 2018 +0530 Committer: ravipesala Committed: Wed Oct 3 19:57:50 2018 +0530 -- .../datasource/SparkCarbonDataSourceTest.scala | 63 +++- .../sql/carbondata/datasource/TestUtil.scal

carbondata git commit: [HOTFIX] Fix NPE in LRU cache when entry from the same table is getting evicted to load another entry from same table

2018-09-27 Thread ravipesala
hor: manishgupta88 Authored: Tue Sep 25 19:21:08 2018 +0530 Committer: ravipesala Committed: Thu Sep 27 12:08:28 2018 +0530 -- .../indexstore/BlockletDataMapIndexWrapper.java | 1 - .../core/indexstore/SafeMemoryDMStore.java |

svn commit: r29698 - in /dev/carbondata/1.5.0-rc1: ./ apache-carbondata-1.5.0-source-release.zip apache-carbondata-1.5.0-source-release.zip.asc apache-carbondata-1.5.0-source-release.zip.md5 apache-ca

2018-09-25 Thread ravipesala
Author: ravipesala Date: Wed Sep 26 05:50:47 2018 New Revision: 29698 Log: Upload 1.5.0 rc1 Added: dev/carbondata/1.5.0-rc1/ dev/carbondata/1.5.0-rc1/apache-carbondata-1.5.0-source-release.zip (with props) dev/carbondata/1.5.0-rc1/apache-carbondata-1.5.0-source-release.zip.asc

carbondata git commit: [maven-release-plugin] prepare for next development iteration

2018-09-25 Thread ravipesala
ree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/ef1068ca Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/ef1068ca Branch: refs/heads/branch-1.5 Commit: ef1068cadf007cc0fe853a6f8c2ed7e86fb78b0a Parents: 2157741 Author: ravipesala Authored: Wed Sep 26 09:18:35 2018 +0

[carbondata] Git Push Summary

2018-09-25 Thread ravipesala
Repository: carbondata Updated Tags: refs/tags/apache-carbondata-1.5.0-rc1 [created] 04f399158

carbondata git commit: [maven-release-plugin] prepare release apache-carbondata-1.5.0-rc1

2018-09-25 Thread ravipesala
41f Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/2157741f Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/2157741f Branch: refs/heads/branch-1.5 Commit: 2157741f1d8cf3f0418ab37e1755a8d4167141a5 Parents: f239894 Author: ravipesala Authored: Wed Sep 26 09:15:06 2018 +0

[2/2] carbondata git commit: [HOTFIX] Remove MV test from example module as release prepare fails with default profile.

2018-09-25 Thread ravipesala
/carbondata/tree/f2398948 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/f2398948 Branch: refs/heads/branch-1.5 Commit: f2398948c992d22174e5e41514785dfa91074d65 Parents: d7913b1 Author: ravipesala Authored: Wed Sep 26 07:46:03 2018 +0530 Committer: ravipesala Committed: Wed Sep 26 07

[1/2] carbondata git commit: [HOTFIX] Fixed data loading failure

2018-09-25 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/branch-1.5 6a2a94d05 -> f2398948c [HOTFIX] Fixed data loading failure Problem: 1.Data loading is failing with ArrayIndexOutOfBoundException when all columns are not considered in sort columns. this is because while filling the sort

carbondata git commit: [HOTFIX] Remove MV test from example module as release prepare fails with default profile.

2018-09-25 Thread ravipesala
wip-us.apache.org/repos/asf/carbondata/commit/f2398948 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/f2398948 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/f2398948 Branch: refs/heads/master Commit: f2398948c992d22174e5e41514785dfa91074d65 Parents: d7913b1 Author: ravipesala Autho

[carbondata] Git Push Summary

2018-09-25 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/branch-1.5 [created] 6a2a94d05

[2/3] carbondata git commit: [CARBONDATA-2961] Simplify SDK API interfaces

2018-09-25 Thread ravipesala
http://git-wip-us.apache.org/repos/asf/carbondata/blob/6a2a94d0/integration/spark-datasource/src/test/scala/org/apache/spark/sql/carbondata/datasource/TestCreateTableUsingSparkCarbonFileFormat.scala -- diff --git

[1/3] carbondata git commit: [CARBONDATA-2961] Simplify SDK API interfaces

2018-09-25 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/master 1d4d24044 -> 6a2a94d05 http://git-wip-us.apache.org/repos/asf/carbondata/blob/6a2a94d0/store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java --

[3/3] carbondata git commit: [CARBONDATA-2961] Simplify SDK API interfaces

2018-09-25 Thread ravipesala
: 6a2a94d057d33435c16405d1da2e682cb748a77d Parents: 1d4d240 Author: ajantha-bhat Authored: Fri Sep 21 16:32:56 2018 +0530 Committer: ravipesala Committed: Tue Sep 25 20:59:50 2018 +0530 -- docs/sdk-guide.md

carbondata git commit: [CARBONDATA-2964] Fix for unsupported float data type bug

2018-09-25 Thread ravipesala
b22 Author: kunal642 Authored: Fri Sep 21 18:36:58 2018 +0530 Committer: ravipesala Committed: Tue Sep 25 16:17:12 2018 +0530 -- .../impl/AbstractScannedResultCollector.java| 2 ++ .../core/util/CarbonMetadataUtil.j

carbondata git commit: [CARBONDATA-2947] Adaptive encoding support for timestamp no dictionary and Refactor ColumnPageWrapper

2018-09-25 Thread ravipesala
ads/master Commit: 5443b227b806eecc81299f3c50d54d0b66fb00bb Parents: 786db21 Author: dhatchayani Authored: Wed Sep 19 19:09:04 2018 +0530 Committer: ravipesala Committed: Tue Sep 25 16:08:39 2018 +0530 -- .../datastore/ch

carbondata git commit: [Compatibility] fix legacy store compatibility issue

2018-09-24 Thread ravipesala
asf/carbondata/diff/0ad90820 Branch: refs/heads/master Commit: 0ad90820acd78b8158edb4025e559df363af6800 Parents: 23bd6e9 Author: kunal642 Authored: Fri Sep 21 18:43:22 2018 +0530 Committer: ravipesala Committed: Mon Sep 24 16:53:35 2018 +0

[2/2] carbondata git commit: [CARBONDATA-2948] Float and Byte DataType support

2018-09-21 Thread ravipesala
: ravipesala Committed: Fri Sep 21 17:54:10 2018 +0530 -- .../chunk/store/ColumnPageWrapper.java | 16 +- .../core/datastore/page/ColumnPage.java | 10 + .../core/datastore/page/DecimalColumnPage.java | 5

[1/2] carbondata git commit: [CARBONDATA-2948] Float and Byte DataType support

2018-09-21 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/master b04269b2b -> edfcdca0a http://git-wip-us.apache.org/repos/asf/carbondata/blob/edfcdca0/integration/spark-datasource/src/test/scala/org/apache/spark/sql/carbondata/datasource/TestUtil.scala

carbondata git commit: [CARBONDATA-2927] multiple issue fixes for varchar column and complex columns, row that grows more than 2MB

2018-09-19 Thread ravipesala
018 +0530 Committer: ravipesala Committed: Wed Sep 19 18:02:41 2018 +0530 -- .../core/indexstore/UnsafeMemoryDMStore.java| 20 ++-- .../core/memory/UnsafeMemoryManager.java| 3 +- .../u

carbondata git commit: [CARBONDATA-2935] Write is_sorter in footer for compaction

2018-09-18 Thread ravipesala
asf/carbondata/diff/05033f71 Branch: refs/heads/master Commit: 05033f71e028d708f1a7d23b0d01775134be3078 Parents: 077dd58 Author: Jacky Li Authored: Fri Sep 14 18:28:25 2018 +0800 Committer: ravipesala Committed: Tue Sep 18 22:13:12 2018 +0

carbondata git commit: [CARBONDATA-2932] FIx CarbonReader Projection cann't be empty exception

2018-09-18 Thread ravipesala
wip-us.apache.org/repos/asf/carbondata/tree/02a89a9c Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/02a89a9c Branch: refs/heads/master Commit: 02a89a9c6c0426243668653f8dfa20bb70536273 Parents: 04084c7 Author: xubo245 Authored: Thu Sep 13 19:09:30 2018 +0800 Committer: ravipesala Committed:

<    1   2   3   4   5   6   7   8   9   10   >