[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 @watermen Thanks for your contribution, everything looks good. Only one comment, in AbstractFactDataWriter.java, there are two parameters(fileName, carbonDataFileName)

[GitHub] incubator-carbondata issue #697: [CARBONDATA-708] Fixed Between and Logical ...

2017-03-27 Thread bhavya411
Github user bhavya411 commented on the issue: https://github.com/apache/incubator-carbondata/pull/697 Fixed the coding styles issues as well as the spacing issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] incubator-carbondata issue #697: [CARBONDATA-708] Fixed Between and Logical ...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/697 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1349/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread watermen
Github user watermen commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 @chenliang613 `fileName` is like below, used on executor as temp dir. Actual it is a path. ``` /tmp/6937581525189542/0/default/carbon_v3/Fact/Part0/Segment_0/0/part-0-0_bat

[GitHub] incubator-carbondata pull request #659: [CARBONDATA-781] Store one SegmentPr...

2017-03-27 Thread watermen
Github user watermen commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/659#discussion_r108113194 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/block/SegmentTaskIndex.java --- @@ -16,30 +16,52 @@ */ package

[GitHub] incubator-carbondata issue #695: [CARBONDATA-696] Fixed Null Pointer Excepti...

2017-03-27 Thread kumarvishal09
Github user kumarvishal09 commented on the issue: https://github.com/apache/incubator-carbondata/pull/695 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 @watermen You are right, the fileName actually is a path parameter. Agree to change fileName to carbonDataFileTempPath, please modify it in your PR. --- If your pr

[GitHub] incubator-carbondata pull request #703: [CARBONDATA-780] Alter table support...

2017-03-27 Thread manishgupta88
GitHub user manishgupta88 opened a pull request: https://github.com/apache/incubator-carbondata/pull/703 [CARBONDATA-780] Alter table support for compaction through sort step Alter table need to support compaction process where complete data need to be sorted again and then written

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/703 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1350/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1351/ --- If your project is set up for it, you can reply to this email and

[jira] [Created] (CARBONDATA-825) upload or delete problem

2017-03-27 Thread sehriff (JIRA)
sehriff created CARBONDATA-825: -- Summary: upload or delete problem Key: CARBONDATA-825 URL: https://issues.apache.org/jira/browse/CARBONDATA-825 Project: CarbonData Issue Type: Bug R

[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1352/ --- If your project is set up for it, you can reply to this email and

[jira] [Created] (CARBONDATA-826) Create carbondata-connector of presto for supporting presto query carbon data

2017-03-27 Thread Liang Chen (JIRA)
Liang Chen created CARBONDATA-826: - Summary: Create carbondata-connector of presto for supporting presto query carbon data Key: CARBONDATA-826 URL: https://issues.apache.org/jira/browse/CARBONDATA-826

[jira] [Updated] (CARBONDATA-826) Create carbondata-connector for query carbon data in presto

2017-03-27 Thread Liang Chen (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen updated CARBONDATA-826: -- Summary: Create carbondata-connector for query carbon data in presto (was: Create carbondat

[GitHub] incubator-carbondata pull request #704: [CARBONDATA-826] Create carbondata-c...

2017-03-27 Thread chenliang613
GitHub user chenliang613 opened a pull request: https://github.com/apache/incubator-carbondata/pull/704 [CARBONDATA-826] Create carbondata-connector of presto Create carbondata-connector for query carbon data in presto 1.In CarbonData project, generate carbondata-connector of pre

[GitHub] incubator-carbondata issue #704: [CARBONDATA-826] Create carbondata-connecto...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/704 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1353/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata pull request #659: [CARBONDATA-781] Store one SegmentPr...

2017-03-27 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/659#discussion_r108146058 --- Diff: core/src/test/java/org/apache/carbondata/core/datastore/block/SegmentTaskIndexTest.java --- @@ -58,7 +58,9 @@ @Mock pub

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread kumarvishal09
Github user kumarvishal09 commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 @watermen Attached heap dump is of executor side btree or driver side? 1. Because in driver side btree is loaded based on segment and one segment will have only one segment pr

[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1354/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #656: [CARBONDATA-773] Fixed multiple DictionaryS...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/656 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1355/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread watermen
Github user watermen commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 @kumarvishal09 1. In the driver side, one segment has n(the number of nodes) SegmentProperties objects. You can see the `SegmentTaskIndexStore.loadBlocks` or ask @QiangCai for det

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1356/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #656: [CARBONDATA-773] Fixed multiple DictionaryS...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/656 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1357/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata pull request #698: [CARBONDATA-820] Remove redundant Bi...

2017-03-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[jira] [Resolved] (CARBONDATA-820) Redundant BitSet created in data load

2017-03-27 Thread Jacky Li (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-820. - Resolution: Fixed Assignee: Jacky Li > Redundant BitSet created in data load > -

[GitHub] incubator-carbondata issue #696: [CARBONDATA-818] Make the file_name in carb...

2017-03-27 Thread jackylk
Github user jackylk commented on the issue: https://github.com/apache/incubator-carbondata/pull/696 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[jira] [Resolved] (CARBONDATA-818) The file_name stored in carbonindex is wrong

2017-03-27 Thread Jacky Li (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-818. - Resolution: Fixed Fix Version/s: 1.1.0-incubating > The file_name stored in carbonindex

[jira] [Resolved] (CARBONDATA-696) NPE when select query run on measure having double data type without fraction.

2017-03-27 Thread Jacky Li (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-696. - Resolution: Fixed Fix Version/s: 1.1.0-incubating > NPE when select query run on measu

[GitHub] incubator-carbondata issue #695: [CARBONDATA-696] Fixed Null Pointer Excepti...

2017-03-27 Thread jackylk
Github user jackylk commented on the issue: https://github.com/apache/incubator-carbondata/pull/695 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] incubator-carbondata pull request #695: [CARBONDATA-696] Fixed Null Pointer ...

2017-03-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/695 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] incubator-carbondata pull request #696: [CARBONDATA-818] Make the file_name ...

2017-03-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[jira] [Created] (CARBONDATA-827) Query statistics log format is incorrect

2017-03-27 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-827: --- Summary: Query statistics log format is incorrect Key: CARBONDATA-827 URL: https://issues.apache.org/jira/browse/CARBONDATA-827 Project: CarbonData Issue Type:

[GitHub] incubator-carbondata pull request #705: [CARBONDATA-827] Fix query stats for...

2017-03-27 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/705 [CARBONDATA-827] Fix query stats format error Fix format of output query statistics log: ``` +--++++

[GitHub] incubator-carbondata issue #705: [CARBONDATA-827] Fix query stats format err...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/705 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1358/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1359/ --- If your project is set up for it, you can reply to this email and

[jira] [Assigned] (CARBONDATA-781) Some SegmentProperties objects occupy too much memory in driver

2017-03-27 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi reassigned CARBONDATA-781: Assignee: Yadong Qi > Some SegmentProperties objects occupy too much memory in driver >

[GitHub] incubator-carbondata issue #659: [CARBONDATA-781] Store one SegmentPropertie...

2017-03-27 Thread QiangCai
Github user QiangCai commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 @kumarvishal09 dump picture is driver tree. @watermen this pr only implement to reuse segment properties in driver side. can you try to do it in executor side? About the building o

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/703 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1360/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/703 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1361/ --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-carbondata issue #635: [CARBONDATA-782]support SORT_COLUMNS

2017-03-27 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/635 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1362/ --- If your project is set up for it, you can reply to this email and

[jira] [Created] (CARBONDATA-828) CarbonGlobalDictionaryGenerateRDD

2017-03-27 Thread tianli (JIRA)
tianli created CARBONDATA-828: - Summary: CarbonGlobalDictionaryGenerateRDD Key: CARBONDATA-828 URL: https://issues.apache.org/jira/browse/CARBONDATA-828 Project: CarbonData Issue Type: Bug

[jira] [Updated] (CARBONDATA-828) CarbonGlobalDictionaryGenerateRDD

2017-03-27 Thread tianli (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tianli updated CARBONDATA-828: -- Request participants: (was: ) Description: org.apache.carbondata.spark.rdd.CarbonGlob

[jira] [Created] (CARBONDATA-829) DICTIONARY_EXCLUDE is not working when using Spark Datasource DDL

2017-03-27 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-829: --- Summary: DICTIONARY_EXCLUDE is not working when using Spark Datasource DDL Key: CARBONDATA-829 URL: https://issues.apache.org/jira/browse/CARBONDATA-829 Project: Carbon