[jira] [Commented] (CARBONDATA-1421) Auto Compaction Failing in CarbonData Loading
[ https://issues.apache.org/jira/browse/CARBONDATA-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144817#comment-16144817 ] Zhichao Zhang commented on CARBONDATA-1421: Hi, Pallavi Singh, you can try to use this pr(https://github.com/apache/carbondata/pull/1266) to resolve this issue, and please let me know whether it works. > Auto Compaction Failing in CarbonData Loading > - > > Key: CARBONDATA-1421 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1421 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.2.0 >Reporter: Pallavi Singh > Fix For: 1.2.0 > > > I ran the create query followed by multiple load queries and the > auto-compaction is failing. > 0: jdbc:hive2://localhost:1> LOAD DATA inpath > 'hdfs://localhost:54310/data/4000_UniqData.csv' INTO table uniqdata > options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, > ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, > DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, > INTEGER_COLUMN1'); > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (1.183 seconds) > 0: jdbc:hive2://localhost:1> LOAD DATA inpath > 'hdfs://localhost:54310/data/5000_UniqData.csv' INTO table uniqdata > options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, > ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, > DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, > INTEGER_COLUMN1'); > Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. > Please check logs. (state=,code=0) > 0: jdbc:hive2://localhost:1> LOAD DATA inpath > 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata > options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, > ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, > DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, > INTEGER_COLUMN1'); > Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. > Please check logs. (state=,code=0) > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> > 0: jdbc:hive2://localhost:1> show segments for table uniqdata; > ++--+--+--+--+ > | SegmentSequenceId | Status | Load Start Time | Load End > Time | > ++--+--+--+--+ > | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 > 10:37:13.888 | > | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 > 10:36:59.08 | > | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 > 10:36:50.373 | > | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 > 10:36:38.768 | > | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 > 10:36:26.1| > ++--+--+--+--+ > 5 rows selected (0.099 seconds) > 0: jdbc:hive2://localhost:1> LOAD DATA inpath > 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata > options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, > ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, > DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, > INTEGER_COLUMN1'); > Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. > Please check logs. (state=,code=0) > 0: jdbc:hive2://localhost:1> show segments for table uniqdata; > ++--+--+--+--+ > | SegmentSequenceId | Status | Load Start Time | Load End > Time | > ++--+--+--+--+ > | 5 | Success | 2017-08-29 10:38:15.727 | 2017-08-29 > 10:38:16.548 | > | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 > 10:37:13.888 | > | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 > 10:36:59.08 | > | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 > 10:36:50.373 | > | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 > 10:36:38.768 | > | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 > 10:36:26.1| > ++--+--+--+--+ -- This message was sent by Atlassian JIRA (v6.4.
[GitHub] carbondata issue #1295: [CARBONDATA-1419] Support adaptive encoding for Doub...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1295 SDV Build Failed with Spark 2.1, Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/303/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1423) Add Integration Test Cases For Presto
anubhav tarar created CARBONDATA-1423: - Summary: Add Integration Test Cases For Presto Key: CARBONDATA-1423 URL: https://issues.apache.org/jira/browse/CARBONDATA-1423 Project: CarbonData Issue Type: Task Components: presto-integration Reporter: anubhav tarar Assignee: anubhav tarar Priority: Minor -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1422) Major and Minor Compaction Failing
Pallavi Singh created CARBONDATA-1422: - Summary: Major and Minor Compaction Failing Key: CARBONDATA-1422 URL: https://issues.apache.org/jira/browse/CARBONDATA-1422 Project: CarbonData Issue Type: Bug Affects Versions: 1.2.0 Reporter: Pallavi Singh Fix For: 1.2.0 The major and minor compaction is failing. Please find the error logs below : 0: jdbc:hive2://localhost:1> show segments for table uniqdata; ++--+--+--+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | ++--+--+--+--+ | 9 | Success | 2017-08-29 11:17:29.927 | 2017-08-29 11:17:30.555 | | 8 | Success | 2017-08-29 11:17:27.572 | 2017-08-29 11:17:28.363 | | 7 | Success | 2017-08-29 11:17:23.583 | 2017-08-29 11:17:25.112 | | 6 | Success | 2017-08-29 11:17:07.966 | 2017-08-29 11:17:09.322 | | 5 | Success | 2017-08-29 10:38:15.727 | 2017-08-29 10:38:16.548 | | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 10:37:13.888 | | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 10:36:59.08 | | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 10:36:50.373 | | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 10:36:38.768 | | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 10:36:26.1| ++--+--+--+--+ 10 rows selected (0.081 seconds) 0: jdbc:hive2://localhost:1> ALTER TABLE uniqdata COMPACT 'MINOR'; Error: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction Failure in Merger Rdd. (state=,code=0) 0: jdbc:hive2://localhost:1> ALTER TABLE uniqdata COMPACT 'MAJOR'; Error: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction Failure in Merger Rdd. (state=,code=0) 0: jdbc:hive2://localhost:1> -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1421) Auto Compaction Failing in CarbonData Loading
Pallavi Singh created CARBONDATA-1421: - Summary: Auto Compaction Failing in CarbonData Loading Key: CARBONDATA-1421 URL: https://issues.apache.org/jira/browse/CARBONDATA-1421 Project: CarbonData Issue Type: Bug Components: data-load Affects Versions: 1.2.0 Reporter: Pallavi Singh Fix For: 1.2.0 I ran the create query followed by multiple load queries and the auto-compaction is failing. 0: jdbc:hive2://localhost:1> LOAD DATA inpath 'hdfs://localhost:54310/data/4000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1'); +-+--+ | Result | +-+--+ +-+--+ No rows selected (1.183 seconds) 0: jdbc:hive2://localhost:1> LOAD DATA inpath 'hdfs://localhost:54310/data/5000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1'); Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0) 0: jdbc:hive2://localhost:1> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1'); Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0) 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> 0: jdbc:hive2://localhost:1> show segments for table uniqdata; ++--+--+--+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | ++--+--+--+--+ | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 10:37:13.888 | | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 10:36:59.08 | | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 10:36:50.373 | | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 10:36:38.768 | | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 10:36:26.1| ++--+--+--+--+ 5 rows selected (0.099 seconds) 0: jdbc:hive2://localhost:1> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1'); Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0) 0: jdbc:hive2://localhost:1> show segments for table uniqdata; ++--+--+--+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | ++--+--+--+--+ | 5 | Success | 2017-08-29 10:38:15.727 | 2017-08-29 10:38:16.548 | | 4 | Success | 2017-08-29 10:37:13.053 | 2017-08-29 10:37:13.888 | | 3 | Success | 2017-08-29 10:36:57.851 | 2017-08-29 10:36:59.08 | | 2 | Success | 2017-08-29 10:36:49.439 | 2017-08-29 10:36:50.373 | | 1 | Success | 2017-08-29 10:36:37.365 | 2017-08-29 10:36:38.768 | | 0 | Success | 2017-08-29 10:36:21.011 | 2017-08-29 10:36:26.1| ++--+--+--+--+ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1420) Partition Feature doesn't support a Partition Column of Date Type.
Neha Bhardwaj created CARBONDATA-1420: - Summary: Partition Feature doesn't support a Partition Column of Date Type. Key: CARBONDATA-1420 URL: https://issues.apache.org/jira/browse/CARBONDATA-1420 Project: CarbonData Issue Type: Bug Environment: spark 2.1 Reporter: Neha Bhardwaj *Create Table : DROP TABLE IF EXISTS list_partition_table_date; CREATE TABLE list_partition_table_date(shortField SHORT, intField INT, bigintField LONG, doubleField DOUBLE, stringField STRING, timestampField TIMESTAMP, decimalField DECIMAL(18,2), charField CHAR(5), floatField FLOAT, complexData ARRAY ) PARTITIONED BY (dateField DATE) STORED BY 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='2010/7/23 , 2011/7/23, 2012/7/23'); *Output : Error: java.lang.RuntimeException: BaseSqlParser null CarbonSqlParser [1.1] failure: identifier matching regex (?i)ALTER expected CREATE TABLE list_partition_table_date(shortField SHORT, intField INT, bigintField LONG, doubleField DOUBLE, stringField STRING, timestampField TIMESTAMP, decimalField DECIMAL(18,2), charField CHAR(5), floatField FLOAT, complexData ARRAY ) PARTITIONED BY (dateField DATE) STORED BY 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='2010/7/23 , 2011/7/23, 2012/7/23') ^ (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1286: [CARBONDATA-1404] Added Unit test cases for Hive Int...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1286 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-1419) Add adaptive encoding for Double data type
[ https://issues.apache.org/jira/browse/CARBONDATA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li updated CARBONDATA-1419: - Description: Add two new encoding for Double data type: 1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, decimalCount) and do type cast from double to target data type like byte, short, int 2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column value and maximum value and multiple by Math.pow(10, decimalCount) and do type cast from double to target data type like byte, short, int > Add adaptive encoding for Double data type > -- > > Key: CARBONDATA-1419 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1419 > Project: CarbonData > Issue Type: New Feature >Reporter: Jacky Li > Time Spent: 10m > Remaining Estimate: 0h > > Add two new encoding for Double data type: > 1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, > decimalCount) and do type cast from double to target data type like byte, > short, int > 2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column > value and maximum value and multiple by Math.pow(10, decimalCount) and do > type cast from double to target data type like byte, short, int -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata pull request #1295: [CARBONDATA-1419] Support adaptive encoding f...
GitHub user jackylk opened a pull request: https://github.com/apache/carbondata/pull/1295 [CARBONDATA-1419] Support adaptive encoding for Double data type Add two new encoding for Double data type: 1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, decimalCount) and do type cast from double to target data type like byte, short, int 2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column value and maximum value and multiple by Math.pow(10, decimalCount) and do type cast from double to target data type like byte, short, int You can merge this pull request into a Git repository by running: $ git pull https://github.com/jackylk/incubator-carbondata upscale Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1295.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1295 commit 56548813f015b919f0304d45c117c6f93b1fadc0 Author: Jacky Li Date: 2017-08-29T04:09:47Z support adaptive encoding for double --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1419) Add adaptive encoding for Double data type
Jacky Li created CARBONDATA-1419: Summary: Add adaptive encoding for Double data type Key: CARBONDATA-1419 URL: https://issues.apache.org/jira/browse/CARBONDATA-1419 Project: CarbonData Issue Type: New Feature Reporter: Jacky Li -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1230: [WIP]corrected sdv test cases
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1230 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/3428/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1284: [CARBONDATA-1330] Not able to drop temporary table b...
Github user PannerselvamVelmyl commented on the issue: https://github.com/apache/carbondata/pull/1284 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Resolved] (CARBONDATA-1418) Use CarbonTableInputFormat in Presto Integration
[ https://issues.apache.org/jira/browse/CARBONDATA-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen resolved CARBONDATA-1418. Resolution: Fixed > Use CarbonTableInputFormat in Presto Integration > > > Key: CARBONDATA-1418 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1418 > Project: CarbonData > Issue Type: Improvement > Components: presto-integration >Affects Versions: 1.2.0 > Environment: All >Reporter: Bhavya Aggarwal >Assignee: Bhavya Aggarwal >Priority: Minor > Fix For: 1.2.0 > > Time Spent: 50m > Remaining Estimate: 0h > > Use CarbonTableInputFormat in Presto Integration -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (CARBONDATA-1418) Use CarbonTableInputFormat in Presto Integration
[ https://issues.apache.org/jira/browse/CARBONDATA-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen updated CARBONDATA-1418: --- Priority: Minor (was: Major) > Use CarbonTableInputFormat in Presto Integration > > > Key: CARBONDATA-1418 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1418 > Project: CarbonData > Issue Type: Improvement > Components: presto-integration >Affects Versions: 1.2.0 > Environment: All >Reporter: Bhavya Aggarwal >Assignee: Bhavya Aggarwal >Priority: Minor > Fix For: 1.2.0 > > Time Spent: 50m > Remaining Estimate: 0h > > Use CarbonTableInputFormat in Presto Integration -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata pull request #1294: [CARBONDATA-1418] Use CarbonTableInputFormat ...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1294 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1294 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1294 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1292#discussion_r135672191 --- Diff: integration/spark-common-test/src/test/resources/IUD/2000_UniqData_2.csv --- @@ -0,0 +1,5 @@ +CUST_ID,CUST_NAME,DECIMAL_COLUMN1 --- End diff -- can you simulate the data for test, don't suggest adding many csv files to repo. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1292#discussion_r135672102 --- Diff: examples/spark2/src/main/resources/2000_UniqData_2.csv --- @@ -0,0 +1,4 @@ +9000,CUST_NAME_1,12345678901.1234 +9001,1CUST_NAME_0,12345678901.1234 --- End diff -- Why added test file to example module ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1294 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1266 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1266 retest it please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1294: [CARBONDATA-1418] Use CarbonTableInputFormat ...
GitHub user bhavya411 opened a pull request: https://github.com/apache/carbondata/pull/1294 [CARBONDATA-1418] Use CarbonTableInputFormat for creating the Splits and QueryModel Refactored Code to use CarbonTableInputFormat for creating splits Build Successful All Test Cases executing successfully Manually verified the changes You can merge this pull request into a Git repository by running: $ git pull https://github.com/bhavya411/incubator-carbondata prestoImprovement Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1294.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1294 commit 86c7d2240555b2579726a9f6378f51af93ab2677 Author: Bhavya Date: 2017-08-28T17:51:58Z Used CarbonTableInputFormat for creating the Splits and QueryModel --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1293 SDV Build Failed with Spark 2.1, Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/302/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1293 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/3427/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1418) Use CarbonTableInputFormat in Presto Integration
Bhavya Aggarwal created CARBONDATA-1418: --- Summary: Use CarbonTableInputFormat in Presto Integration Key: CARBONDATA-1418 URL: https://issues.apache.org/jira/browse/CARBONDATA-1418 Project: CarbonData Issue Type: Improvement Components: presto-integration Affects Versions: 1.2.0 Environment: All Reporter: Bhavya Aggarwal Assignee: Bhavya Aggarwal Fix For: 1.2.0 Use CarbonTableInputFormat in Presto Integration -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...
Github user sraghunandan commented on the issue: https://github.com/apache/carbondata/pull/1293 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...
Github user sraghunandan commented on the issue: https://github.com/apache/carbondata/pull/1293 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1293: [CARBONDATA-1417]Added cluster tests for IUD,...
GitHub user sraghunandan opened a pull request: https://github.com/apache/carbondata/pull/1293 [CARBONDATA-1417]Added cluster tests for IUD, batch sort and global sort features 1.IUD 2.batch sort 3.global sort You can merge this pull request into a Git repository by running: $ git pull https://github.com/sraghunandan/carbondata-1 missing_sdv_tests Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1293.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1293 commit e67de0bd6c99d7199104ddaeb21e52e028bf58a1 Author: Raghunandan S Date: 2017-08-28T16:27:20Z Added cluster tests for 1.IUD 2.batch sort 3.global sort --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1417) Add Cluster tests for IUD, batch sort and Global sort features
Raghunandan created CARBONDATA-1417: --- Summary: Add Cluster tests for IUD, batch sort and Global sort features Key: CARBONDATA-1417 URL: https://issues.apache.org/jira/browse/CARBONDATA-1417 Project: CarbonData Issue Type: Bug Reporter: Raghunandan -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand
Github user ashwini-krishnakumar commented on the issue: https://github.com/apache/carbondata/pull/1292 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-1416) Show Segments raises exception for a Partition Table after Updation.
[ https://issues.apache.org/jira/browse/CARBONDATA-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Bhardwaj updated CARBONDATA-1416: -- Attachment: list_partition_table.csv > Show Segments raises exception for a Partition Table after Updation. > > > Key: CARBONDATA-1416 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1416 > Project: CarbonData > Issue Type: Bug > Components: data-query > Environment: spark 2.1 >Reporter: Neha Bhardwaj > Attachments: list_partition_table.csv > > > 1. Create Partition Table : > DROP TABLE IF EXISTS list_partition_table_string; > CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, > bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField > DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, > complexData ARRAY ) PARTITIONED BY (stringField STRING) STORED BY > 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, > America, Europe', 'DICTIONARY_EXCLUDE'='stringfield'); > 2. Load Data : > load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into > table list_partition_table_string > options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata', > 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', > 'SINGLE_PASS'='TRUE'); > 3. Update Data : > update list_partition_table_string set (stringfield)=('China') where > stringfield = 'Japan' ; > update list_partition_table_string set (stringfield)=('Japan') where > stringfield > 'Europe' ; > update list_partition_table_string set (stringfield)=('Asia') where > stringfield < 'Europe' ; > 4. Compaction : > ALTER TABLE list_partition_table_string COMPACT 'Minor'; > Show segments for table list_partition_table_string; > Expected Output: Segments Must be Displayed. > Actual Output : Error: java.lang.NullPointerException (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1291: [CARBONDATA-1343] Hive can't query data when the car...
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/1291 @cenyuhai i think, CarbonInputFormat should extend CarbonTableInputFormat now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1291: [CARBONDATA-1343] Hive can't query data when ...
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1291#discussion_r135560774 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -133,7 +133,7 @@ public static void setTableInfo(Configuration configuration, TableInfo tableInfo /** * Get TableInfo object from `configuration` */ - private TableInfo getTableInfo(Configuration configuration) throws IOException { + public TableInfo getTableInfo(Configuration configuration) throws IOException { --- End diff -- In the future, carbondata will use CarbonTableInputFormat to replace CarbonInputFormat, so please use CarbonTableInputFormat. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1416) Show Segments raises exception for a Partition Table after Updation.
Neha Bhardwaj created CARBONDATA-1416: - Summary: Show Segments raises exception for a Partition Table after Updation. Key: CARBONDATA-1416 URL: https://issues.apache.org/jira/browse/CARBONDATA-1416 Project: CarbonData Issue Type: Bug Components: data-query Environment: spark 2.1 Reporter: Neha Bhardwaj 1. Create Partition Table : DROP TABLE IF EXISTS list_partition_table_string; CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 'DICTIONARY_EXCLUDE'='stringfield'); 2. Load Data : load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into table list_partition_table_string options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata', 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 'SINGLE_PASS'='TRUE'); 3. Update Data : update list_partition_table_string set (stringfield)=('China') where stringfield = 'Japan' ; update list_partition_table_string set (stringfield)=('Japan') where stringfield > 'Europe' ; update list_partition_table_string set (stringfield)=('Asia') where stringfield < 'Europe' ; 4. Compaction : ALTER TABLE list_partition_table_string COMPACT 'Minor'; Show segments for table list_partition_table_string; Expected Output: Segments Must be Displayed. Actual Output : Error: java.lang.NullPointerException (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1415) Show Segments raises exception for a Partition Table after Updation.
Neha Bhardwaj created CARBONDATA-1415: - Summary: Show Segments raises exception for a Partition Table after Updation. Key: CARBONDATA-1415 URL: https://issues.apache.org/jira/browse/CARBONDATA-1415 Project: CarbonData Issue Type: Bug Components: data-query Environment: spark 2.1 Reporter: Neha Bhardwaj 1. Create Partition Table : DROP TABLE IF EXISTS list_partition_table_string; CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 'DICTIONARY_EXCLUDE'='stringfield'); 2. Load Data : load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into table list_partition_table_string options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata', 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 'SINGLE_PASS'='TRUE'); 3. Update Data : update list_partition_table_string set (stringfield)=('China') where stringfield = 'Japan' ; update list_partition_table_string set (stringfield)=('Japan') where stringfield > 'Europe' ; update list_partition_table_string set (stringfield)=('Asia') where stringfield < 'Europe' ; 4. Compaction : ALTER TABLE list_partition_table_string COMPACT 'Minor'; Show segments for table list_partition_table_string; Expected Output: Segments Must be Displayed. Actual Output : Error: java.lang.NullPointerException (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1414) Show Segments raises exception for a Partition Table after Updation.
Neha Bhardwaj created CARBONDATA-1414: - Summary: Show Segments raises exception for a Partition Table after Updation. Key: CARBONDATA-1414 URL: https://issues.apache.org/jira/browse/CARBONDATA-1414 Project: CarbonData Issue Type: Bug Components: data-query Environment: spark 2.1 Reporter: Neha Bhardwaj Attachments: list_partition_table.csv 1. Create Partition Table : DROP TABLE IF EXISTS list_partition_table_string; CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 'DICTIONARY_EXCLUDE'='stringfield'); 2. Load Data : load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into table list_partition_table_string options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata', 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 'SINGLE_PASS'='TRUE'); 3. Update Data : update list_partition_table_string set (stringfield)=('China') where stringfield = 'Japan' ; update list_partition_table_string set (stringfield)=('Japan') where stringfield > 'Europe' ; update list_partition_table_string set (stringfield)=('Asia') where stringfield < 'Europe' ; 4. Compaction : ALTER TABLE list_partition_table_string COMPACT 'Minor'; Show segments for table list_partition_table_string; Expected Output: Segments Must be Displayed. Actual Output : Error: java.lang.NullPointerException (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1265: [CARBONDATA-1128] Add direct string encoding for sho...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1265 @jackylk it seems lot of tests are failing, can you check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1292 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1292 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand
GitHub user ashwini-krishnakumar opened a pull request: https://github.com/apache/carbondata/pull/1292 [CARBONDATA-649] fix for update with rand Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashwini-krishnakumar/carbondata master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1292.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1292 commit 40e897008fdb4922f5db84a239d9af482fec03d8 Author: ashwini-krishnakumar Date: 2017-08-28T13:31:00Z Changes for CARBONDATA-649 commit 691e0d9397b7913bffd1fdba14cee3d762544573 Author: ashwini-krishnakumar Date: 2017-08-28T13:55:50Z Changes to the [CARBONDATA-649] update with rand --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-1413) Incorrect result displays after creating a partition table with incorrect range_info
Vandana Yadav created CARBONDATA-1413: - Summary: Incorrect result displays after creating a partition table with incorrect range_info Key: CARBONDATA-1413 URL: https://issues.apache.org/jira/browse/CARBONDATA-1413 Project: CarbonData Issue Type: Bug Components: data-query, sql Affects Versions: 1.2.0 Environment: spark 2.1 Reporter: Vandana Yadav Priority: Minor Attachments: 2000_UniqData.csv, partition4.png Incorrect result displays after creating a partition table with incorrect range_info Description: While creating a partitioned table with string data type column if we provide wrong credentials it should not create partition but in this scenario when I am providing range info as any integer data type instead of string data type, it is creating a partitioned table which is not a correct result, it should display an error saying invalid credentials. Steps to Reproduce 1)Create a Partitioned table with incorrect credentials CREATE TABLE uniqdata_part2_incorrect1 (CUST_ID int,CUST_NAME String,DOB Timestamp,DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) PARTITIONED BY (ACTIVE_EMUI_VERSION string) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ('PARTITION_TYPE'='RANGE','RANGE_INFO'='1',"TABLE_BLOCKSIZE"= "256 MB"); 2) Load data into the partitioned table LOAD DATA INPATH 'hdfs://localhost:54310/uniqdata/2000_UniqData.csv' into table uniqdata_part2_incorrect1 OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1'); 3) Execute Query: show partitions uniqdata_part2_incorrect1; 4)Result On beeline: +---+--+ | partition | +---+--+ | 0, active_emui_version = DEFAULT | | 1, active_emui_version < 1| +---+--+ 5)Expected Result: The partitioned table should not be created as there were wrong credentials in the create table query(integer at the place of string) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1412) delete working incorrectly while using segment.starttime before ''
Sangeeta Gulia created CARBONDATA-1412: -- Summary: delete working incorrectly while using segment.starttime before '' Key: CARBONDATA-1412 URL: https://issues.apache.org/jira/browse/CARBONDATA-1412 Project: CarbonData Issue Type: Bug Components: data-query, test Environment: Spark-2.1 Reporter: Sangeeta Gulia Priority: Minor Fix For: 1.2.0 Issue exists in the below query : delete from table uniqdata_delete where segment.starttime before 'starttime_of_last_segment_created'; It should mark all those segments for delete whose start-time is before the given time and should not delete the segment with the given time. But it is marking the segment for delete which is having the exact start time also. To replicate the issue: CREATE TABLE uniqdata_delete (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double, INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB") LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table uniqdata_delete OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1') LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table uniqdata_delete OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1') delete from table uniqdata_delete where segment.starttime before 'starttime_of_last_segment_created'; -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[GitHub] carbondata issue #1289: [CARBONDATA-1406] Fixed the issue with the Quotation...
Github user sgururajshetty commented on the issue: https://github.com/apache/carbondata/pull/1289 LGTM The " " is been removed from the heading as it is not the standard to have " " in headings. @chenliang613 kindly review and merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1266 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1286: [CARBONDATA-1404] Added Unit test cases for Hive Int...
Github user PallaviSingh1992 commented on the issue: https://github.com/apache/carbondata/pull/1286 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata issue #1213: [CARBONDATA-1342] Fixed bugs for spark conf property...
Github user manishgupta88 commented on the issue: https://github.com/apache/carbondata/pull/1213 Already merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] carbondata pull request #1213: [CARBONDATA-1342] Fixed bugs for spark conf p...
Github user manishgupta88 closed the pull request at: https://github.com/apache/carbondata/pull/1213 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-1406) Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ in installation.md file
[ https://issues.apache.org/jira/browse/CARBONDATA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pallavi Singh updated CARBONDATA-1406: -- Component/s: website > Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ > in installation.md file > > > Key: CARBONDATA-1406 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1406 > Project: CarbonData > Issue Type: Bug > Components: docs, website >Affects Versions: 1.2.0 >Reporter: Pallavi Singh >Assignee: Pallavi Singh >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ > in installation.md file are creating conversion issue while generating the > documentation for the website from the docs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (CARBONDATA-1406) Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ in installation.md file
[ https://issues.apache.org/jira/browse/CARBONDATA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pallavi Singh updated CARBONDATA-1406: -- Affects Version/s: 1.2.0 > Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ > in installation.md file > > > Key: CARBONDATA-1406 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1406 > Project: CarbonData > Issue Type: Bug > Components: docs >Affects Versions: 1.2.0 >Reporter: Pallavi Singh >Assignee: Pallavi Singh >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ > in installation.md file are creating conversion issue while generating the > documentation for the website from the docs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (CARBONDATA-1411) Show Segment command gives Null Pointer Exception after the table is updated
Pallavi Singh created CARBONDATA-1411: - Summary: Show Segment command gives Null Pointer Exception after the table is updated Key: CARBONDATA-1411 URL: https://issues.apache.org/jira/browse/CARBONDATA-1411 Project: CarbonData Issue Type: Bug Affects Versions: 1.2.0 Environment: Linux, Hadoop 2.2.0 and spark 2.1.0 Reporter: Pallavi Singh Fix For: 1.2.0 I created a table : CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB") and loaded the table : LOAD DATA inpath 'hdfs://localhost:54310/data/2000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1') I loaded the table 7 times using multiple cvs. Then executed the following command : show segments for table uniqdata; and output was : 0: jdbc:hive2://localhost:1> show segments for table uniqdata; +++--+--+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | +++--+--+--+ | 5 | Success| 2017-08-28 13:19:01.779 | 2017-08-28 13:19:02.527 | | 4 | Success| 2017-08-28 13:18:58.597 | 2017-08-28 13:18:59.339 | | 3 | Compacted | 2017-08-28 13:18:48.341 | 2017-08-28 13:18:49.527 | | 2 | Compacted | 2017-08-28 13:18:44.96 | 2017-08-28 13:18:46.222 | | 1 | Compacted | 2017-08-28 13:17:56.818 | 2017-08-28 13:17:57.988 | | 0.1| Success| 2017-08-28 13:18:49.698 | 2017-08-28 13:18:50.659 | | 0 | Compacted | 2017-08-28 13:17:41.944 | 2017-08-28 13:17:43.564 | +++--+--+--+ now after that I executed the following query : update uniqdata set (dob)=('2016-12-31 12:00:00') where cust_name='CUST_NAME_01998'; and then again ran : show segments for table uniqdata; And now I am getting : Error: java.lang.NullPointerException (state=,code=0) -- This message was sent by Atlassian JIRA (v6.4.14#64029)