[GitHub] incubator-carbondata issue #452: [CARBONDATA-546] Extract data management co...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/452 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/286/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #275: [WIP][CARBONDATA-349] Support load local fi...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/275 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/285/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #452: [CARBONDATA-546] Extract data management co...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/452 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/284/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-551) Implement unit test cases for classes in processing package
Anurag Srivastava created CARBONDATA-551: Summary: Implement unit test cases for classes in processing package Key: CARBONDATA-551 URL: https://issues.apache.org/jira/browse/CARBONDATA-551 Project: CarbonData Issue Type: Test Reporter: Anurag Srivastava Priority: Trivial -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #452: [CARBONDATA-546] Extract data management co...
Github user jackylk commented on the issue: https://github.com/apache/incubator-carbondata/pull/452 @chenliang613 testcase added: CarbonCommandSuite --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #429: [CARBONDATA-530]Modified optimizer to place...
Github user ashokblend commented on the issue: https://github.com/apache/incubator-carbondata/pull/429 @jackylk is there any way to get build url for spark-2.0 as we have for spark-1.5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-501) CarbonData-Create-Delete-DeltaFile-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-501: - Assignee: Sujith > CarbonData-Create-Delete-DeltaFile-Support > -- > > Key: CARBONDATA-501 > URL: https://issues.apache.org/jira/browse/CARBONDATA-501 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add support to create Delete Delta files in order to support Update/Delete > functionality for CarbonData table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-502) CarbonData-Create-Update-DeltaFile-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-502: - Assignee: Sujith > CarbonData-Create-Update-DeltaFile-Support > -- > > Key: CARBONDATA-502 > URL: https://issues.apache.org/jira/browse/CARBONDATA-502 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to create Update Delta files to support update operation on > CarbonData table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-499) CarbonData-DML-Delete-Record-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-499: - Assignee: Sujith > CarbonData-DML-Delete-Record-Support > > > Key: CARBONDATA-499 > URL: https://issues.apache.org/jira/browse/CARBONDATA-499 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Provide SQL support for delete operation to delete a row in CarbonData table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-500) CarbonData-DML-Update-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-500: - Assignee: Sujith > CarbonData-DML-Update-Support > -- > > Key: CARBONDATA-500 > URL: https://issues.apache.org/jira/browse/CARBONDATA-500 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Provide SQL support for Update operation to update bulk data in CarbonData > table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-503) CarbonData-Cleanup-DeltaFiles-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-503: - Assignee: Sujith (was: Aniket Adnaik) > CarbonData-Cleanup-DeltaFiles-Support > - > > Key: CARBONDATA-503 > URL: https://issues.apache.org/jira/browse/CARBONDATA-503 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to support cleanup of delta files as a result of > Update/Delete operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-503) CarbonData-Cleanup-DeltaFiles-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-503: - Assignee: Aniket Adnaik > CarbonData-Cleanup-DeltaFiles-Support > - > > Key: CARBONDATA-503 > URL: https://issues.apache.org/jira/browse/CARBONDATA-503 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Aniket Adnaik > Fix For: 1.0.0-incubating > > > Add functionality to support cleanup of delta files as a result of > Update/Delete operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-504) CarbonData-Cleanup-DeltaFiles-Support
[ https://issues.apache.org/jira/browse/CARBONDATA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-504: - Assignee: Sujith > CarbonData-Cleanup-DeltaFiles-Support > - > > Key: CARBONDATA-504 > URL: https://issues.apache.org/jira/browse/CARBONDATA-504 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to support cleanup of delta files as a result of > Update/Delete operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-506) CarbonData-Exclude-DeletedRecords-On-Query
[ https://issues.apache.org/jira/browse/CARBONDATA-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-506: - Assignee: Sujith > CarbonData-Exclude-DeletedRecords-On-Query > -- > > Key: CARBONDATA-506 > URL: https://issues.apache.org/jira/browse/CARBONDATA-506 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality in CarbonData record scanner to exclude deleted records > from the scan. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-505) CarbonData-Implicit-TupleID-Creation
[ https://issues.apache.org/jira/browse/CARBONDATA-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-505: - Assignee: Sujith > CarbonData-Implicit-TupleID-Creation > > > Key: CARBONDATA-505 > URL: https://issues.apache.org/jira/browse/CARBONDATA-505 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to generate implicit tuple ids for the rows being deleted > or updated from CarbonData table. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-507) CarbonData-Include-UpdatedRecords-On-Query
[ https://issues.apache.org/jira/browse/CARBONDATA-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-507: - Assignee: Sujith > CarbonData-Include-UpdatedRecords-On-Query > -- > > Key: CARBONDATA-507 > URL: https://issues.apache.org/jira/browse/CARBONDATA-507 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to CarbonData record scanner to include updated records > from Update Delta files. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-508) CarbonDatat-Compaction-Delete-DeltaFiles
[ https://issues.apache.org/jira/browse/CARBONDATA-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-508: - Assignee: Sujith > CarbonDatat-Compaction-Delete-DeltaFiles > > > Key: CARBONDATA-508 > URL: https://issues.apache.org/jira/browse/CARBONDATA-508 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to compact multiple delta files into one delete delta file > as part of Update/Delete feature. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-509) CarbonDatat-Compaction-Update-DeltaFiles
[ https://issues.apache.org/jira/browse/CARBONDATA-509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-509: - Assignee: Sujith > CarbonDatat-Compaction-Update-DeltaFiles > > > Key: CARBONDATA-509 > URL: https://issues.apache.org/jira/browse/CARBONDATA-509 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to compact multiple Update delta files as part of > Update/Delete feature. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-510) CarbonData-Exclude-Invalid-Btree-After-Compaction
[ https://issues.apache.org/jira/browse/CARBONDATA-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Adnaik updated CARBONDATA-510: - Assignee: Sujith > CarbonData-Exclude-Invalid-Btree-After-Compaction > - > > Key: CARBONDATA-510 > URL: https://issues.apache.org/jira/browse/CARBONDATA-510 > Project: CarbonData > Issue Type: Sub-task > Components: core, data-query, examples, sql >Affects Versions: 0.2.0-incubating >Reporter: Aniket Adnaik >Assignee: Sujith > Fix For: 1.0.0-incubating > > > Add functionality to exclude invalid driver/executor block level btree after > compaction. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-550) Add unit test cases for Bigint, Big decimal value compression
Jihong MA created CARBONDATA-550: Summary: Add unit test cases for Bigint, Big decimal value compression Key: CARBONDATA-550 URL: https://issues.apache.org/jira/browse/CARBONDATA-550 Project: CarbonData Issue Type: Improvement Components: core Reporter: Jihong MA Assignee: Ashok Kumar Please add unit test cases for Bigint & Bigdecimal value compression after merging PR. the old code path is no longer exercised after the code change so as to the test cases in ValueCompressionUtilTest.java. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #453: [CARBONDATA-549] code improvements for bigi...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/453 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/283/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #453: [CARBONDATA-549] code improvements for bigi...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/453 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #453: [CARBONDATA-549] code improvements for bigi...
Github user JihongMA commented on the issue: https://github.com/apache/incubator-carbondata/pull/453 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #453: [CARBONDATA-549] code improvements for bigi...
Github user JihongMA commented on the issue: https://github.com/apache/incubator-carbondata/pull/453 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #453: [CARBONDATA-549] code improvements for bigi...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/453 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #453: [CARBONDATA-549] code improvements f...
GitHub user JihongMA opened a pull request: https://github.com/apache/incubator-carbondata/pull/453 [CARBONDATA-549] code improvements for bigint, decimal value compression misc code changes for bigint, decimal value compression mvn clean verify -- successful You can merge this pull request into a Git repository by running: $ git pull https://github.com/JihongMA/incubator-carbondata CARBONDATA-549 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/453.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #453 commit 1241ada35d3463eee2c9850590792b72bca4c416 Author: Jihong Ma Date: 2016-12-13T00:31:12Z Merge remote-tracking branch 'upstream/master' commit 0bf1fb35c79f0fe12cc0e61a8b6c53b51085bdcc Author: Jihong Ma Date: 2016-12-20T01:55:53Z Merge remote-tracking branch 'upstream/master' commit dda23a5142f9b4438a18718aa63df45a795bc448 Author: Jihong Ma Date: 2016-12-20T01:59:52Z rebase with master commit 9ec212669003ea41edc1c99f26e9ef289f9d4867 Author: Jihong Ma Date: 2016-12-21T19:59:45Z code cleanup for bigint compression commit a8f6a5f757a28bd2a8b272cfb71b2bee37ec03e6 Author: Jihong Ma Date: 2016-12-21T20:31:01Z Merge branch 'CARBONDATA-549' of https://github.com/JihongMA/incubator-carbondata into localbranch commit 62c1a80942c46c4be51ba75da150e0e95f28704e Author: Jihong Ma Date: 2016-12-21T23:26:35Z minor fix commit 5d811cb867657aeb4813960cc2f8c412fc0c6839 Author: Jihong Ma Date: 2016-12-21T23:51:12Z style fix --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-549) code improvement for bigint compression
Jihong MA created CARBONDATA-549: Summary: code improvement for bigint compression Key: CARBONDATA-549 URL: https://issues.apache.org/jira/browse/CARBONDATA-549 Project: CarbonData Issue Type: Sub-task Components: core Reporter: Jihong MA Assignee: Jihong MA code cleanup for big int/ decimal compression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-548) Miscellaneous code improvements
Jihong MA created CARBONDATA-548: Summary: Miscellaneous code improvements Key: CARBONDATA-548 URL: https://issues.apache.org/jira/browse/CARBONDATA-548 Project: CarbonData Issue Type: Improvement Components: core Reporter: Jihong MA Assignee: Jihong MA miscellaneous code improvements. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #358: [CARBONDATA-467] Adding bucketing to carbon...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/358 Build Failed with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/282/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #448: [CARBONDATA-547] Added CarbonSession and en...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/448 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/281/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-547) Add CarbonSession and enabled parser to use all carbon commands
Ravindra Pesala created CARBONDATA-547: -- Summary: Add CarbonSession and enabled parser to use all carbon commands Key: CARBONDATA-547 URL: https://issues.apache.org/jira/browse/CARBONDATA-547 Project: CarbonData Issue Type: Improvement Reporter: Ravindra Pesala Assignee: Ravindra Pesala Currently no DDL commands like CREATE,LOAD,ALTER,DROP,DESCRIBE, SHOW LOADS, DELETE SEGMENTS etc are not working in Spark 2.0 integration. So please add CarbonSession and overwrite the SQL parser to make all this commands work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #448: [WIP] Added CarbonSession and enabled parse...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/448 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/280/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anurag Srivastava updated CARBONDATA-422:
-
Attachment: (was: Screenshot2.png)
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Issue Comment Deleted] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anurag Srivastava updated CARBONDATA-422:
-
Comment: was deleted
(was: Hello SOURYAKANTA DWIVEDY ,
I have tested your same query with the latest build and get the result :
Quert : LOAD DATA inpath 'hdfs://localhost:54310/test1234567.csv' into table
emp5 options('DELIMITER'=',',
'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
'BAD_RECORDS_ACTION'='FORCE');
Result :
!https://issues.apache.org/jira/secure/attachment/12844241/Screenshot2.png!
Could you please verify this with latest build and close the bug?)
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot2.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (CARBONDATA-387) RLike and REGEXP showing all records in empty regex
[ https://issues.apache.org/jira/browse/CARBONDATA-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763842#comment-15763842 ] anubhav tarar edited comment on CARBONDATA-387 at 12/21/16 12:30 PM: - this query is running on spark directly result is from spark sql can we create our own parser was (Author: anubhavtarar): this query is running on spark directly result is from spark sql > RLike and REGEXP showing all records in empty regex > --- > > Key: CARBONDATA-387 > URL: https://issues.apache.org/jira/browse/CARBONDATA-387 > Project: CarbonData > Issue Type: Bug >Reporter: Prabhat Kashyap >Priority: Minor > > When I'm trying to run RLIKE with empty regex, it is showing me all the > records instead of no record. > select * from knolders where age RLIKE ''; > It is behaving in a similar manner for REGEXP operator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (CARBONDATA-327) Drop Daabase unexpected behaviour.
[ https://issues.apache.org/jira/browse/CARBONDATA-327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15766159#comment-15766159 ] anubhav tarar edited comment on CARBONDATA-327 at 12/21/16 12:29 PM: - can we create our own parser for show tables? was (Author: anubhavtarar): can we create our own parser for Rlike? > Drop Daabase unexpected behaviour. > --- > > Key: CARBONDATA-327 > URL: https://issues.apache.org/jira/browse/CARBONDATA-327 > Project: CarbonData > Issue Type: Bug >Reporter: Harmeet Singh > > Hey team, I am creating a database as below: > 0: jdbc:hive2://127.0.0.1:1> create database Test; > +-+--+ > | result | > +-+--+ > +-+--+ > After creating an database i am using that database using below command: > 0: jdbc:hive2://127.0.0.1:1> use Test; > +-+--+ > | result | > +-+--+ > +-+--+ > After That, i am drop the database as below: > 0: jdbc:hive2://127.0.0.1:1> drop database test; > +-+--+ > | result | > +-+--+ > +-+--+ > The database drop successfully. I am expecting, after that the carbon data > automatically switch to the "default" database. But when i trying to execute > command "show tables" the result return nothing as below : > 0: jdbc:hive2://127.0.0.1:1> show tables; > ++--+--+ > | tableName | isTemporary | > ++--+--+ > ++--+--+ > No rows selected (0.019 seconds) > But my default database contains some table as below: > 0: jdbc:hive2://127.0.0.1:1> use default; > +-+--+ > | result | > +-+--+ > +-+--+ > No rows selected (0.024 seconds) > 0: jdbc:hive2://127.0.0.1:1> show tables; > ++--+--+ > | tableName | isTemporary | > ++--+--+ > | one| false| > | two| false| > ++--+--+ > 2 rows selected (0.013 seconds) > If I am following all above step on Hive, Hive gave us an error on show > tables after drop the database as below: > hive> drop database test; > OK > Time taken: 0.628 seconds > hive> show databases; > OK > default > Time taken: 0.022 seconds, Fetched: 1 row(s) > hive> show tables; > FAILED: SemanticException [Error 10072]: Database does not exist: test -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15766923#comment-15766923
]
Anurag Srivastava edited comment on CARBONDATA-422 at 12/21/16 12:23 PM:
-
Hello SOURYAKANTA DWIVEDY ,
I have tested your same query with the latest build and get the result :
Quert : LOAD DATA inpath 'hdfs://localhost:54310/test1234567.csv' into table
emp5 options('DELIMITER'=',',
'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
'BAD_RECORDS_ACTION'='FORCE');
Result :
!https://issues.apache.org/jira/secure/attachment/12844241/Screenshot2.png!
Could you please verify this with latest build and close the bug?
was (Author: anuragknoldus):
Hello SOURYAKANTA DWIVEDY ,
I have tested your same query with the latest build and get the result :
Quert :
Result :
!https://issues.apache.org/jira/secure/attachment/12844241/Screenshot2.png!
Could you please verify this with latest build and close the bug?
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot2.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15766923#comment-15766923
]
Anurag Srivastava commented on CARBONDATA-422:
--
Hello SOURYAKANTA DWIVEDY ,
I have tested your same query with the latest build and get the result :
Quert :
Result :
!https://issues.apache.org/jira/secure/attachment/12844241/Screenshot2.png!
Could you please verify this with latest build and close the bug?
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot2.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anurag Srivastava updated CARBONDATA-422:
-
Attachment: (was: Screenshot1.png)
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot2.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anurag Srivastava updated CARBONDATA-422:
-
Attachment: Screenshot2.png
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot2.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CARBONDATA-422) [Bad Records]Select query failed with "NullPointerException" after data-load with options as MAXCOLUMN and BAD_RECORDS_ACTION
[
https://issues.apache.org/jira/browse/CARBONDATA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anurag Srivastava updated CARBONDATA-422:
-
Attachment: Screenshot1.png
> [Bad Records]Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> -
>
> Key: CARBONDATA-422
> URL: https://issues.apache.org/jira/browse/CARBONDATA-422
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
>Affects Versions: 0.1.1-incubating
> Environment: 3 node Cluster
>Reporter: SOURYAKANTA DWIVEDY
>Priority: Minor
> Attachments: Screenshot1.png
>
>
> Description : Select query failed with "NullPointerException" after data-load
> with options as MAXCOLUMN and BAD_RECORDS_ACTION
> Steps:
> 1. Create table
> 2. Load data into table with BAD_RECORDS_ACTION option [ Create Table --
> columns -9 ,CSV coulmn - 10 , Header - 9]
> 3. Do select * query ,it will pass
> 4. Then Load data into table with BAD_RECORDS_ACTION and MAXCOLUMN option [
> Create Table -- columns -9 ,CSV coulmn - 10 , Header - 9,MAXCOLUMNS -- 9]
> 5. Do select * query ,it will fail with "NullPointerException"
> Log :-
> ---
> 0: jdbc:hive2://ha-cluster/default> create table emp3(ID int,Name string,DOJ
> timestamp,Designation string,Salary double,Dept string,DOB timestamp,Addr
> string,Gender string) STORED BY 'org.apache.carbondata.format';
> +-+--+
> | result |
> +-+--+
> +-+--+
> No rows selected (0.589 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (2.415 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> +---+---+---+--+--+---+---++-+--+
> | id | name | doj | designation | salary | dept | dob | addr | gender |
> +---+---+---+--+--+---+---++-+--+
> | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL |
> | 1 | AAA | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 2 | BBB | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 3 | CCC | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 4 | DDD | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 5 | EEE | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | 6 | FFF | NULL | Trainee | 1.0 | IT | NULL | Pune | Male |
> | 7 | GGG | NULL | SE | 3.0 | NW | NULL | Bangalore | Female |
> | 8 | HHH | NULL | SSE | 4.0 | DATA | NULL | Mumbai | Female |
> | 9 | III | NULL | TL | 6.0 | OPER | NULL | Delhi | Male |
> | 10 | JJJ | NULL | STL | 8.0 | MAIN | NULL | Chennai | Female |
> | NULL | Name | NULL | Designation | NULL | Dept | NULL | Addr | Gender |
> +---+---+---+--+--+---+---++-+--+
> 12 rows selected (0.418 seconds)
> 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath
> 'hdfs://hacluster/chetan/emp11.csv' into table emp3 options('DELIMITER'=',',
> 'QUOTECHAR'='"','FILEHEADER'='ID,Name,DOJ,Designation,Salary,Dept,DOB,Addr,Gender','MAXCOLUMNS'='9',
> 'BAD_RECORDS_ACTION'='FORCE');
> +-+--+
> | Result |
> +-+--+
> +-+--+
> No rows selected (1.424 seconds)
> 0: jdbc:hive2://ha-cluster/default> select * from emp3;
> Error: java.io.IOException: java.lang.NullPointerException (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[GitHub] incubator-carbondata issue #310: [CARBONDATA-401] One Pass Load
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/310 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/279/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #452: [CARBONDATA-546] Extract data management co...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/452 please add test cases to validate the below commands after extracting: ShowLoads DeleteLoadById DeleteLoadByDate CleanFiles --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #452: [CARBONDATA-546] Extract data management co...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/452 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/278/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #310: [CARBONDATA-401] One Pass Load
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/310 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/277/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Resolved] (CARBONDATA-412) in windows, when load into table whose name has "_", the old segment will be deleted.
[ https://issues.apache.org/jira/browse/CARBONDATA-412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-412. - Resolution: Fixed Assignee: Jay Fix Version/s: 1.0.0-incubating > in windows, when load into table whose name has "_", the old segment will be > deleted. > - > > Key: CARBONDATA-412 > URL: https://issues.apache.org/jira/browse/CARBONDATA-412 > Project: CarbonData > Issue Type: Bug >Reporter: Jay >Assignee: Jay >Priority: Minor > Fix For: 1.0.0-incubating > > Time Spent: 2h > Remaining Estimate: 0h > > when carbon table name has "_", such as "load_test", then load into table > twice, in the second load, the first segment 0 will be deleted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #320: [CARBONDATA-412] Fix load bug when t...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/320 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #320: [CARBONDATA-412] Fix load bug when table na...
Github user jackylk commented on the issue: https://github.com/apache/incubator-carbondata/pull/320 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #310: [CARBONDATA-401] One Pass Load
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/310 Build Success with Spark 1.5.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/276/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
