[GitHub] incubator-carbondata issue #555: [WIP] All dictionary path issue

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/555
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/679/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #555: [WIP] All dictionary path issue

2017-01-18 Thread ManoharVanam
GitHub user ManoharVanam opened a pull request:

https://github.com/apache/incubator-carbondata/pull/555

[WIP] All dictionary path issue

 ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ManoharVanam/incubator-carbondata 
ALL_DICTIONARY_PATH_JIRA

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/555.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #555


commit ad3ffed908f9a80f2c6075803de0c9ce0b977fd9
Author: Manohar 
Date:   2017-01-19T07:21:45Z

Fixed ALL_DICTIONARY_PATH null pointer exception issue.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---



[GitHub] incubator-carbondata issue #554: [CARBONDATA-661] misc cleanup in carbon cor...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/554
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/677/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...

2017-01-18 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
@jackylk Handled comment, please review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #554: [CARBONDATA-661] misc cleanup in car...

2017-01-18 Thread JihongMA
GitHub user JihongMA opened a pull request:

https://github.com/apache/incubator-carbondata/pull/554

[CARBONDATA-661] misc cleanup in carbon core

cleanup un-exercised code/field/functions as well as minor fix.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JihongMA/incubator-carbondata carbondata-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/554.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #554


commit f1746d149e5efdef5dd928736781d6920077e9c2
Author: Jihong Ma 
Date:   2017-01-19T06:41:16Z

code cleanup




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core

2017-01-18 Thread JihongMA
Github user JihongMA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/552
  
close this PR for cleaner commit history. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread JihongMA
Github user JihongMA closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/552


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread JihongMA
Github user JihongMA commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/552#discussion_r96801631
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
 ---
@@ -143,17 +142,18 @@ private void intialize() {
 
   private int[] convertToArray(List list) {
 int[] ints = new int[list.size()];
-for (int i = 0; i < ints.length; i++) {
-  ints[i] = list.get(i);
+int i = 0;
+for (Integer ii : list) {
--- End diff --

just checked online, the performance difference is on List.forEach() as 
well as stream().. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Closed] (CARBONDATA-625) Abnormal behaviour of Int datatype

2017-01-18 Thread Geetika Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Geetika Gupta closed CARBONDATA-625.

Resolution: Fixed

> Abnormal behaviour of Int datatype
> --
>
> Key: CARBONDATA-625
> URL: https://issues.apache.org/jira/browse/CARBONDATA-625
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.0.0-incubating
> Environment: Spark: 1.6  and hadoop: 2.6.5 
>Reporter: Geetika Gupta
>Assignee: Manish Gupta
>Priority: Minor
> Attachments: Screenshot from 2017-01-11 18-36-24.png, 
> testMaxValueForBigInt.csv
>
>
> I was trying to create a table having int as a column and loaded data into 
> the table. Data loading was performed successfully but when I viewed the data 
> of the table, there was some wrong data present in the table. I was trying to 
> load BigInt data to an int column. All the data in int column is loaded with 
> the first value of the csv. Below are the details for the queries:
> create table xyz(a int, b string)stored by 'carbondata';
> Data load query:
> LOAD DATA INPATH 'hdfs://localhost:54311/testFiles/testMaxValueForBigInt.csv' 
> into table xyz OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','FILEHEADER'='a,b');
> select query:
> select * from xyz;
> PFA the screenshot of the output and the csv file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CARBONDATA-625) Abnormal behaviour of Int datatype

2017-01-18 Thread Manish Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829374#comment-15829374
 ] 

Manish Gupta commented on CARBONDATA-625:
-

This issue is fixed as part of PR-535 
(https://github.com/apache/incubator-carbondata/pull/535). This issue can be 
closed.

> Abnormal behaviour of Int datatype
> --
>
> Key: CARBONDATA-625
> URL: https://issues.apache.org/jira/browse/CARBONDATA-625
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.0.0-incubating
> Environment: Spark: 1.6  and hadoop: 2.6.5 
>Reporter: Geetika Gupta
>Assignee: Manish Gupta
>Priority: Minor
> Attachments: Screenshot from 2017-01-11 18-36-24.png, 
> testMaxValueForBigInt.csv
>
>
> I was trying to create a table having int as a column and loaded data into 
> the table. Data loading was performed successfully but when I viewed the data 
> of the table, there was some wrong data present in the table. I was trying to 
> load BigInt data to an int column. All the data in int column is loaded with 
> the first value of the csv. Below are the details for the queries:
> create table xyz(a int, b string)stored by 'carbondata';
> Data load query:
> LOAD DATA INPATH 'hdfs://localhost:54311/testFiles/testMaxValueForBigInt.csv' 
> into table xyz OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','FILEHEADER'='a,b');
> select query:
> select * from xyz;
> PFA the screenshot of the output and the csv file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/447
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/676/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/447
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/675/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #398: [CARBONDATA-400] Error message for d...

2017-01-18 Thread akashrn5
GitHub user akashrn5 reopened a pull request:

https://github.com/apache/incubator-carbondata/pull/398

[CARBONDATA-400] Error message for dataload with a column having more than 
10 characters.

* Problem: When the number of characters in a column exceeds 10 
characters whole string appears in beeline with exception.

Analysis: In univocity csv parser settings , the maximum number of 
characters per column is 10 and when it exceeds that limit, 
TextparsingException is thrown with
the complete string as error in beeline during data load.

Fix: Now a proper error message is displayed in beeline and complete error 
messages and parser settings details will be present in logs.
Impact area: Data loading with more than 10 characters in a single 
column.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/akashrn5/incubator-carbondata 
br_message_correction

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/398.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #398


commit dbe4c5ea048ed943b9b841acf697316be82232cc
Author: Akash R Nilugal 
Date:   2016-12-05T09:46:10Z

[CARBONDATA-400]
* Problem: When the number of characters in a column exceeds 10 
characters whole string appears in beeline with exception.

Analysis: In univocity csv parser settings , the maximum number of 
characters per column is 10 and when it exceeds that limit, 
TextparsingException is thrown with
the complete string as error in beeline during data load.

Fix: Now a proper error message is displayed in beeline and complete error 
messages and parser settings details will be present in logs.
Impact area: Data loading with more than 10 characters in a single 
column.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #398: [CARBONDATA-400] Error message for d...

2017-01-18 Thread akashrn5
Github user akashrn5 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/398


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/553
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/674/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...

2017-01-18 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/553
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread JihongMA
Github user JihongMA commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/552#discussion_r96787067
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
 ---
@@ -143,17 +142,18 @@ private void intialize() {
 
   private int[] convertToArray(List list) {
 int[] ints = new int[list.size()];
-for (int i = 0; i < ints.length; i++) {
-  ints[i] = list.get(i);
+int i = 0;
+for (Integer ii : list) {
--- End diff --

the foreach is slower than get(i) an indexing search? not aware of it, and 
I thought the other way around


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread jackylk
Github user jackylk commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781582
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
 ---
@@ -143,17 +142,18 @@ private void intialize() {
 
   private int[] convertToArray(List list) {
 int[] ints = new int[list.size()];
-for (int i = 0; i < ints.length; i++) {
-  ints[i] = list.get(i);
+int i = 0;
+for (Integer ii : list) {
+  ints[i++] = ii.intValue();
 }
 return ints;
   }
 
   private int[] convertToArray(Set set) {
 int[] ints = new int[set.size()];
 int i = 0;
-for (Iterator iterator = set.iterator(); iterator.hasNext(); ) {
-  ints[i++] = (Integer) iterator.next();
+for (Integer ii: set) {
+  ints[i++]= ii.intValue();
--- End diff --

add space before `=`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread jackylk
Github user jackylk commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781568
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
 ---
@@ -143,17 +142,18 @@ private void intialize() {
 
   private int[] convertToArray(List list) {
 int[] ints = new int[list.size()];
-for (int i = 0; i < ints.length; i++) {
-  ints[i] = list.get(i);
+int i = 0;
+for (Integer ii : list) {
+  ints[i++] = ii.intValue();
 }
 return ints;
   }
 
   private int[] convertToArray(Set set) {
 int[] ints = new int[set.size()];
 int i = 0;
-for (Iterator iterator = set.iterator(); iterator.hasNext(); ) {
-  ints[i++] = (Integer) iterator.next();
+for (Integer ii: set) {
--- End diff --

foreach style for loop is not encouraged to use because of performance


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread jackylk
Github user jackylk commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781406
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java
 ---
@@ -143,17 +142,18 @@ private void intialize() {
 
   private int[] convertToArray(List list) {
 int[] ints = new int[list.size()];
-for (int i = 0; i < ints.length; i++) {
-  ints[i] = list.get(i);
+int i = 0;
+for (Integer ii : list) {
--- End diff --

foreach style for loop is not encouraged to use because of performance


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core

2017-01-18 Thread jackylk
Github user jackylk commented on the issue:

https://github.com/apache/incubator-carbondata/pull/552
  
Can you squash your commit into one?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/553
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/673/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/553
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/672/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #553: [CARBONDATA-635]Insert query fails w...

2017-01-18 Thread ravipesala
GitHub user ravipesala opened a pull request:

https://github.com/apache/incubator-carbondata/pull/553

[CARBONDATA-635]Insert query fails when functions are used in select query

This PR fixes the insert query when functions are used in select query.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravipesala/incubator-carbondata insert_issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/553.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #553


commit f9a1393312a02b71ccd0eb453370787720ed7591
Author: ravipesala 
Date:   2017-01-19T01:00:24Z

Fixed insert with select query when functions are used in query

commit b815f27554f5d88655661949676ecc9f4a8332ea
Author: ravipesala 
Date:   2017-01-19T01:01:23Z

reverted example




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/671/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/670/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...

2017-01-18 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/546#discussion_r96743498
  
--- Diff: 
integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala
 ---
@@ -390,11 +390,19 @@ case class LoadTable(
   val useKettle = options.get("use_kettle") match {
 case Some(value) => value.toBoolean
 case _ =>
-  val useKettleLocal = System.getProperty("use.kettle")
+  var useKettleLocal = System.getProperty("use.kettle")
+  if (useKettleLocal == null && 
sqlContext.sparkContext.getConf.contains("use_kettle")) {
--- End diff --

Ok unified.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/552
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/669/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Assigned] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jihong MA reassigned CARBONDATA-661:


Assignee: Jihong MA

> misc cleanup in carbon core
> ---
>
> Key: CARBONDATA-661
> URL: https://issues.apache.org/jira/browse/CARBONDATA-661
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: core
>Reporter: Jihong MA
>Assignee: Jihong MA
>Priority: Minor
>
> cleanup un-exercised code/field/functions as well as minor code improvement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...

2017-01-18 Thread JihongMA
GitHub user JihongMA opened a pull request:

https://github.com/apache/incubator-carbondata/pull/552

[CARBONDATA-661] misc cleanup in core

cleanup un-exercised code/field/functions as well as minor code improvement.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/JihongMA/incubator-carbondata carbondata-1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/552.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #552


commit 1241ada35d3463eee2c9850590792b72bca4c416
Author: Jihong Ma 
Date:   2016-12-13T00:31:12Z

Merge remote-tracking branch 'upstream/master'

commit 0bf1fb35c79f0fe12cc0e61a8b6c53b51085bdcc
Author: Jihong Ma 
Date:   2016-12-20T01:55:53Z

Merge remote-tracking branch 'upstream/master'

commit f5483b6a58f4cdeec91850bf2127fba009eb6654
Author: Jihong Ma 
Date:   2016-12-24T16:11:20Z

Merge remote-tracking branch 'upstream/master'

commit 1600f4dc3314a492aedc8e6950fc9cbc33f0a76f
Author: Jihong Ma 
Date:   2017-01-03T22:09:39Z

Merge remote-tracking branch 'upstream/master'

commit 3bebe0a1f38258ebfe5ef5490fc1b95cb96e362f
Author: Jihong Ma 
Date:   2017-01-05T18:41:39Z

Merge remote-tracking branch 'upstream/master'

commit 5f991bb3ed05a185df4740feb4efa923a51e2345
Author: Jihong Ma 
Date:   2017-01-10T02:21:49Z

Merge remote-tracking branch 'upstream/master'

commit 5faad5d9e40dea0bd5d97bc346dbca903c17a496
Author: Jihong Ma 
Date:   2017-01-10T18:58:33Z

Merge remote-tracking branch 'upstream/master'

commit 0a00c54c1d6ceebb9ff15b8ea8a424a1e9523001
Author: Jihong Ma 
Date:   2017-01-18T01:48:44Z

rebase master

commit 3b9397d036a33f8e60f442bcd699bcacebb7a2d5
Author: Jihong Ma 
Date:   2017-01-18T19:21:50Z

misc code cleanup




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jihong MA updated CARBONDATA-661:
-
Issue Type: Sub-task  (was: Improvement)
Parent: CARBONDATA-548

> misc cleanup in carbon core
> ---
>
> Key: CARBONDATA-661
> URL: https://issues.apache.org/jira/browse/CARBONDATA-661
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: core
>Reporter: Jihong MA
>Priority: Minor
>
> cleanup un-exercised code/field/functions as well as minor code improvement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-661:


 Summary: misc cleanup in carbon core
 Key: CARBONDATA-661
 URL: https://issues.apache.org/jira/browse/CARBONDATA-661
 Project: CarbonData
  Issue Type: Improvement
  Components: core
Reporter: Jihong MA
Priority: Minor


cleanup un-exercised code/field/functions as well as minor code improvement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #551: [CARBONDATA-603] Fixed Date Filter issue

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/551
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/668/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (CARBONDATA-624) Complete CarbonData document to be present in git and the same needs to sync with the carbondata.apace.org and for further updates.

2017-01-18 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-624.

   Resolution: Fixed
Fix Version/s: 1.0.0-incubating

> Complete CarbonData document to be present in git and the same needs to sync 
> with the carbondata.apace.org and for further updates.
> ---
>
> Key: CARBONDATA-624
> URL: https://issues.apache.org/jira/browse/CARBONDATA-624
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
> Fix For: 1.0.0-incubating
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> The information about CarbonData is there is git and cwiki. So we have to 
> merge all the information and create the markdown files for each topic about 
> CarbonData.
> This markdown files will be having the complete information about CarbonData 
> like Overview, Installation, Configuration, DDL, DML, Use case and so on.
> Also these markdown information will be sync to the website documentation - 
> carbondata.apace.org



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #550: [CARBONDATA-624] Complete CarbonData...

2017-01-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/550


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #398: [CARBONDATA-400] Error message for dataload...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/398
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/667/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...

2017-01-18 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/447
  
@himani1 Please fix the testcase in travis


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...

2017-01-18 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/546#discussion_r96658462
  
--- Diff: 
integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala
 ---
@@ -390,11 +390,19 @@ case class LoadTable(
   val useKettle = options.get("use_kettle") match {
 case Some(value) => value.toBoolean
 case _ =>
-  val useKettleLocal = System.getProperty("use.kettle")
+  var useKettleLocal = System.getProperty("use.kettle")
+  if (useKettleLocal == null && 
sqlContext.sparkContext.getConf.contains("use_kettle")) {
--- End diff --

Same comments as jackly.  i suggest using  "useKettle", what is your 
opinion? @jackylk 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (CARBONDATA-656) Simplify the carbon session creation

2017-01-18 Thread Liang Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-656.
---
   Resolution: Fixed
Fix Version/s: 1.0.0-incubating

> Simplify the carbon session creation 
> -
>
> Key: CARBONDATA-656
> URL: https://issues.apache.org/jira/browse/CARBONDATA-656
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Ravindra Pesala
>Assignee: Ravindra Pesala
>Priority: Minor
> Fix For: 1.0.0-incubating
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> Now it is cumbersome to create CarbonSession through spark shell. We should 
> minimize steps to give more usability for first time users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #551: [CARBONDATA-603] Fixed Date Filter issue

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/551
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/666/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #547: [CARBONDATA-656]Simplify the carbon ...

2017-01-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/547


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...

2017-01-18 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/547
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #550: [CARBONDATA-624] Complete CarbonData docume...

2017-01-18 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/550
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #551: [CARBONDATA-603] Fixed Date Filter i...

2017-01-18 Thread kumarvishal09
GitHub user kumarvishal09 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/551

[CARBONDATA-603] Fixed Date Filter issue

**Problem**
select query with WHERE clause for date data type is failing, date values 
are coming as NULL
**Solution**
Currently both timestamp and date has same property need to add separate 
property for date format

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kumarvishal09/incubator-carbondata 
FixedDateFilterIssue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/551.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #551


commit 8d1ca417dfd11106295d69fd71c0d9a577c436a7
Author: kumarvishal 
Date:   2017-01-11T12:29:31Z

Date filter fix issue-CARBONDATA-603




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/540
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/665/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CARBONDATA-643) When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception.

2017-01-18 Thread Manohar Vanam (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828133#comment-15828133
 ] 

Manohar Vanam commented on CARBONDATA-643:
--

ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not 
exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary

@Payal Do you have data.dictionary file at the mentioned location?

Regards,
Manu

> When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null 
> pointer exception.
> --
>
> Key: CARBONDATA-643
> URL: https://issues.apache.org/jira/browse/CARBONDATA-643
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.0.0-incubating
> Environment: spark-1.6,spark-2.1
>Reporter: Payal
>Assignee: Manohar Vanam
>Priority: Minor
> Attachments: 7000_UniqData.csv
>
>
> When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null 
> pointer exception.
> //CREATE TABLE
> CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME 
> String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, 
> BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), 
> DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 
> double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2');
> //LOAD QUERY
>  LOAD DATA INPATH 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table 
> uniq_include_dictionary OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='""','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary');
> Error: java.lang.NullPointerException (state=,code=0)
> LOGS
> INFO  16-01 16:56:37,624 - Running query 'LOAD DATA INPATH 
> 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table 
> uniq_include_dictionary OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','MULTILINE'='true','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary')'
>  with 17ec3816-91e3-462e-aa9b-a7ae76405564
> INFO  16-01 16:56:37,625 - pool-26-thread-34 Query [LOAD DATA INPATH 
> 'HDFS://LOCALHOST:54311/PAYAL/7000_UNIQDATA.CSV' INTO TABLE 
> UNIQ_INCLUDE_DICTIONARY OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,DOUBLE_COLUMN1,DOUBLE_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='FALSE','MULTILINE'='TRUE','ALL_DICTIONARY_PATH'='HDFS://LOCALHOST:54311/OPT/ALLDICTIONARY/DATA.DICTIONARY')]
> INFO  16-01 16:56:37,641 - Successfully able to get the table metadata file 
> lock
> INFO  16-01 16:56:37,644 - pool-26-thread-34 Initiating Direct Load for the 
> Table : (default.uniq_include_dictionary)
> INFO  16-01 16:56:37,644 - pool-26-thread-34 Generate global dictionary from 
> dictionary files!
> ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not 
> exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary
> ERROR 16-01 16:56:37,645 - pool-26-thread-34 generate global dictionary failed
> java.lang.NullPointerException
> at 
> org.apache.carbondata.core.datastorage.store.filesystem.AbstractDFSCarbonFile.getName(AbstractDFSCarbonFile.java:83)
> at 
> org.apache.carbondata.spark.util.GlobalDictionaryUtil$.validateAllDictionaryPath(GlobalDictionaryUtil.scala:649)
> at 
> org.apache.carbondata.spark.util.GlobalDictionaryUtil$.generateGlobalDictionary(GlobalDictionaryUtil.scala:743)
> at 
> org.apache.spark.sql.execution.command.LoadTable.run(carbonTableSchema.scala:569)
> at 
> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58)
> at 
> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56)
> at 
> org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:70)
> at 
> org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:132)
> at 
> org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:130)
> at 
> org.apache.spark.rdd.RDDOperationScope$.with

[jira] [Comment Edited] (CARBONDATA-643) When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception.

2017-01-18 Thread Manohar Vanam (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828133#comment-15828133
 ] 

Manohar Vanam edited comment on CARBONDATA-643 at 1/18/17 2:12 PM:
---

ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not 
exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary

@Payal Do you have data.dictionary file at above mentioned location?

Regards,
Manu


was (Author: manoharvanam):
ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not 
exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary

@Payal Do you have data.dictionary file at the mentioned location?

Regards,
Manu

> When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null 
> pointer exception.
> --
>
> Key: CARBONDATA-643
> URL: https://issues.apache.org/jira/browse/CARBONDATA-643
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.0.0-incubating
> Environment: spark-1.6,spark-2.1
>Reporter: Payal
>Assignee: Manohar Vanam
>Priority: Minor
> Attachments: 7000_UniqData.csv
>
>
> When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null 
> pointer exception.
> //CREATE TABLE
> CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME 
> String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, 
> BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), 
> DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 
> double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2');
> //LOAD QUERY
>  LOAD DATA INPATH 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table 
> uniq_include_dictionary OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='""','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary');
> Error: java.lang.NullPointerException (state=,code=0)
> LOGS
> INFO  16-01 16:56:37,624 - Running query 'LOAD DATA INPATH 
> 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table 
> uniq_include_dictionary OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','MULTILINE'='true','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary')'
>  with 17ec3816-91e3-462e-aa9b-a7ae76405564
> INFO  16-01 16:56:37,625 - pool-26-thread-34 Query [LOAD DATA INPATH 
> 'HDFS://LOCALHOST:54311/PAYAL/7000_UNIQDATA.CSV' INTO TABLE 
> UNIQ_INCLUDE_DICTIONARY OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,DOUBLE_COLUMN1,DOUBLE_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='FALSE','MULTILINE'='TRUE','ALL_DICTIONARY_PATH'='HDFS://LOCALHOST:54311/OPT/ALLDICTIONARY/DATA.DICTIONARY')]
> INFO  16-01 16:56:37,641 - Successfully able to get the table metadata file 
> lock
> INFO  16-01 16:56:37,644 - pool-26-thread-34 Initiating Direct Load for the 
> Table : (default.uniq_include_dictionary)
> INFO  16-01 16:56:37,644 - pool-26-thread-34 Generate global dictionary from 
> dictionary files!
> ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not 
> exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary
> ERROR 16-01 16:56:37,645 - pool-26-thread-34 generate global dictionary failed
> java.lang.NullPointerException
> at 
> org.apache.carbondata.core.datastorage.store.filesystem.AbstractDFSCarbonFile.getName(AbstractDFSCarbonFile.java:83)
> at 
> org.apache.carbondata.spark.util.GlobalDictionaryUtil$.validateAllDictionaryPath(GlobalDictionaryUtil.scala:649)
> at 
> org.apache.carbondata.spark.util.GlobalDictionaryUtil$.generateGlobalDictionary(GlobalDictionaryUtil.scala:743)
> at 
> org.apache.spark.sql.execution.command.LoadTable.run(carbonTableSchema.scala:569)
> at 
> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58)
> at 
> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56)
> at 
> org.apache.spark.sql.exe

[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...

2017-01-18 Thread jackylk
Github user jackylk commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/546#discussion_r96641464
  
--- Diff: 
integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala
 ---
@@ -390,11 +390,19 @@ case class LoadTable(
   val useKettle = options.get("use_kettle") match {
 case Some(value) => value.toBoolean
 case _ =>
-  val useKettleLocal = System.getProperty("use.kettle")
+  var useKettleLocal = System.getProperty("use.kettle")
+  if (useKettleLocal == null && 
sqlContext.sparkContext.getConf.contains("use_kettle")) {
--- End diff --

It is strange that "use.kettle", "use_kettle", and "useKettle" are all 
different, can we use the same name for all  these  configuration?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #264: [CARBONDATA-341] CarbonTableIdentifier bein...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/264
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/664/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/547
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/663/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-660) Bad Records Logs and Raw CSVs should get display under segment id instead of Tasks id

2017-01-18 Thread Priyal Sachdeva (JIRA)
Priyal Sachdeva created CARBONDATA-660:
--

 Summary: Bad Records Logs and Raw CSVs should get display under 
segment id instead of Tasks id
 Key: CARBONDATA-660
 URL: https://issues.apache.org/jira/browse/CARBONDATA-660
 Project: CarbonData
  Issue Type: Improvement
  Components: data-load
Reporter: Priyal Sachdeva
Priority: Minor


create table if not exists Badrecords_test (imei string,AMSize int) STORED BY 
'org.apache.carbondata.format';

 LOAD DATA INPATH 'hdfs://hacluster/CSVs/bad_records.csv' into table 
Badrecords_test OPTIONS('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
'BAD_RECORDS_ACTION'='REDIRECT','FILEHEADER'='imei,AMSize');


Bad Records Logs and raw csvs are getting display under Task ID


linux-61:/srv/OSCON/BigData/HACluster/install/hadoop/datanode # 
bin/hadoop fs -ls /tmp/carbon/default/badrecords_test

drwxr-xr-x   - root users  0 2017-01-18 21:08 
/tmp/carbon/default/badrecords_test/0--->Task ID


0: jdbc:hive2://172.168.100.205:23040> show segments for table Badrecords_test;
++--+--+--+--+
| SegmentSequenceId  |  Status  | Load Start Time  |  Load 
End Time   |
++--+--+--+--+
| 8  | Partial Success  | 2017-01-18 21:12:58.018  | 2017-01-18 
21:12:59.652  |
| 7  | Partial Success  | 2017-01-18 21:08:07.426  | 2017-01-18 
21:08:11.791  |
| 6  | Partial Success  | 2017-01-18 21:07:07.645  | 2017-01-18 
21:07:08.747  |
| 5  | Partial Success  | 2017-01-18 19:34:16.163  | 2017-01-18 
19:34:18.163  |
| 4  | Partial Success  | 2017-01-18 19:34:13.669  | 2017-01-18 
19:34:15.811  |
| 3  | Partial Success  | 2017-01-18 19:30:18.753  | 2017-01-18 
19:30:19.644  |
| 2  | Partial Success  | 2017-01-18 19:30:13.508  | 2017-01-18 
19:30:15.578  |
| 1  | Partial Success  | 2017-01-18 19:18:54.787  | 2017-01-18 
19:18:54.94   |
| 0  | Partial Success  | 2017-01-18 19:18:53.741  | 2017-01-18 
19:18:54.614  |
++--+--+--+--+

Bad Records Logs and raw csvs are getting display under Task ID. It would be 
good to have the information of bad records as per the load i.e under segment 
id..



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...

2017-01-18 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/547
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (CARBONDATA-561) Merge the two CarbonOption.scala into one under spark-common

2017-01-18 Thread Liang Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-561.
---
Resolution: Fixed

> Merge the two CarbonOption.scala into one under spark-common
> 
>
> Key: CARBONDATA-561
> URL: https://issues.apache.org/jira/browse/CARBONDATA-561
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Liang Chen
>Assignee: He Xiaoqiao
>Priority: Minor
> Fix For: 1.0.0-incubating
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Merge the below two CarbonOption.scala into one under spark-common:
> /integration/spark-common/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala
> /integration/spark2/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #549: [CARBONDATA-561]Merge the two Carbon...

2017-01-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/549


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #549: [CARBONDATA-561]Merge the two CarbonOption....

2017-01-18 Thread QiangCai
Github user QiangCai commented on the issue:

https://github.com/apache/incubator-carbondata/pull/549
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-659) Should add WhitespaceAround and ParenPad to javastyle

2017-01-18 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-659:
---

 Summary: Should add WhitespaceAround and ParenPad to javastyle
 Key: CARBONDATA-659
 URL: https://issues.apache.org/jira/browse/CARBONDATA-659
 Project: CarbonData
  Issue Type: Improvement
Reporter: QiangCai
Assignee: QiangCai
Priority: Trivial






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/540
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/662/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #539: [WIP]add WhitespaceAround and ParenPad to j...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/539
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/661/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #549: CARBONDATA-561 delete duplicated code in sp...

2017-01-18 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/549
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Closed] (CARBONDATA-395) Unit Test cases for package org.apache.carbondata.scan.expression.ExpressionResult

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-395.


> Unit Test cases for package 
> org.apache.carbondata.scan.expression.ExpressionResult
> --
>
> Key: CARBONDATA-395
> URL: https://issues.apache.org/jira/browse/CARBONDATA-395
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-410) Implement test cases for core.datastore.file system

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-410.


> Implement test cases for core.datastore.file system
> ---
>
> Key: CARBONDATA-410
> URL: https://issues.apache.org/jira/browse/CARBONDATA-410
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-416) Add unit test case for result.impl package

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-416.


> Add unit test case for result.impl package
> --
>
> Key: CARBONDATA-416
> URL: https://issues.apache.org/jira/browse/CARBONDATA-416
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-427) In documentation ,applicable is not define properly in Parameters of Compaction

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-427.

Resolution: Fixed

> In documentation ,applicable is not define properly in Parameters of 
> Compaction 
> 
>
> Key: CARBONDATA-427
> URL: https://issues.apache.org/jira/browse/CARBONDATA-427
> Project: CarbonData
>  Issue Type: Bug
>  Components: docs
>Reporter: SWATI RAO
>
> Applicable is not define properly in Parameters of Compaction like
> In carbon.numberof.preserve.segments  applicable is Minor/Major, it should be 
> minor
> # carbon.allowed.compaction.days applicable is Minor/Major, it should be 
> minor
> #carbon.number.of.cores.while.compacting applicable is Minor/Major, it should 
> be minor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-419) Show tables in query for non-existing database do not show any exception

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-419.

Resolution: Fixed

> Show tables in query for non-existing database do not show any exception 
> -
>
> Key: CARBONDATA-419
> URL: https://issues.apache.org/jira/browse/CARBONDATA-419
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: SWATI RAO
>Assignee: Manohar Vanam
>
> When executing command 'show tables in' for an non-existing database, it do 
> not show any error,
> Example: show tables in test_tableMg;
> (where test_tableMg database do not exist)
> whereas when executing the same query on hive, it says : 
> FAILED: SemanticException [Error 10072]: Database does not exist: test_tableMg



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (CARBONDATA-427) In documentation ,applicable is not define properly in Parameters of Compaction

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO reopened CARBONDATA-427:
--

> In documentation ,applicable is not define properly in Parameters of 
> Compaction 
> 
>
> Key: CARBONDATA-427
> URL: https://issues.apache.org/jira/browse/CARBONDATA-427
> Project: CarbonData
>  Issue Type: Bug
>  Components: docs
>Reporter: SWATI RAO
>
> Applicable is not define properly in Parameters of Compaction like
> In carbon.numberof.preserve.segments  applicable is Minor/Major, it should be 
> minor
> # carbon.allowed.compaction.days applicable is Minor/Major, it should be 
> minor
> #carbon.number.of.cores.while.compacting applicable is Minor/Major, it should 
> be minor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (CARBONDATA-419) Show tables in query for non-existing database do not show any exception

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO reopened CARBONDATA-419:
--

> Show tables in query for non-existing database do not show any exception 
> -
>
> Key: CARBONDATA-419
> URL: https://issues.apache.org/jira/browse/CARBONDATA-419
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: SWATI RAO
>Assignee: Manohar Vanam
>
> When executing command 'show tables in' for an non-existing database, it do 
> not show any error,
> Example: show tables in test_tableMg;
> (where test_tableMg database do not exist)
> whereas when executing the same query on hive, it says : 
> FAILED: SemanticException [Error 10072]: Database does not exist: test_tableMg



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-434) Update test cases for AllDataTypesTestCase2

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-434.


> Update test cases for AllDataTypesTestCase2
> ---
>
> Key: CARBONDATA-434
> URL: https://issues.apache.org/jira/browse/CARBONDATA-434
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-442) Query result mismatching with Hive

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-442.


> Query result mismatching with Hive
> --
>
> Key: CARBONDATA-442
> URL: https://issues.apache.org/jira/browse/CARBONDATA-442
> Project: CarbonData
>  Issue Type: Bug
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>
> => I created table using following command : 
> create table Carbon_automation_test5 (imei string,deviceInformationId int,MAC 
> string,deviceColor string,device_backColor string,modelId string,marketName 
> string,AMSize string,ROMSize string,CUPAudit string,CPIClocked string,series 
> string,productionDate string,bomCode string,internalModels string, 
> deliveryTime string, channelsId string,channelsName string , deliveryAreaId 
> string, deliveryCountry string, deliveryProvince string, deliveryCity 
> string,deliveryDistrict string, deliveryStreet string,oxSingleNumber string, 
> ActiveCheckTime string, ActiveAreaId string, ActiveCountry string, 
> ActiveProvince string, Activecity string, ActiveDistrict string, ActiveStreet 
> string, ActiveOperatorId string, Active_releaseId string, Active_EMUIVersion 
> string,Active_operaSysVersion string, Active_BacVerNumber string, 
> Active_BacFlashVer string,Active_webUIVersion string, Active_webUITypeCarrVer 
> string,Active_webTypeDataVerNumber string, Active_operatorsVersion string, 
> Active_phonePADPartitionedVersions string,Latest_YEAR int, Latest_MONTH int, 
> Latest_DAY int, Latest_HOUR string, Latest_areaId string, Latest_country 
> string, Latest_province string, Latest_city string,Latest_district string, 
> Latest_street string, Latest_releaseId string,Latest_EMUIVersion string, 
> Latest_operaSysVersion string, Latest_BacVerNumber string,Latest_BacFlashVer 
> string, Latest_webUIVersion string, Latest_webUITypeCarrVer 
> string,Latest_webTypeDataVerNumber string, Latest_operatorsVersion 
> string,Latest_phonePADPartitionedVersions string, Latest_operatorId 
> string,gamePointDescription string, gamePointId int,contractNumber int) 
> stored by 'org.apache.carbondata.format' 
> => Load csv to table : 
> LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/100_olap.csv' INTO table 
> Carbon_automation_test5 OPTIONS('DELIMITER'= ',' ,'QUOTECHAR'= '"', 
> 'FILEHEADER'= 
> 'imei,deviceInformationId,MAC,deviceColor,device_backColor,modelId,marketName,AMSize,ROMSize,CUPAudit,CPIClocked,series,productionDate,bomCode,internalModels,deliveryTime,channelsId,channelsName,deliveryAreaId,deliveryCountry,deliveryProvince,deliveryCity,deliveryDistrict,deliveryStreet,oxSingleNumber,contractNumber,ActiveCheckTime,ActiveAreaId,ActiveCountry,ActiveProvince,Activecity,ActiveDistrict,ActiveStreet,ActiveOperatorId,Active_releaseId,Active_EMUIVersion,Active_operaSysVersion,Active_BacVerNumber,Active_BacFlashVer,Active_webUIVersion,Active_webUITypeCarrVer,Active_webTypeDataVerNumber,Active_operatorsVersion,Active_phonePADPartitionedVersions,Latest_YEAR,Latest_MONTH,Latest_DAY,Latest_HOUR,Latest_areaId,Latest_country,Latest_province,Latest_city,Latest_district,Latest_street,Latest_releaseId,Latest_EMUIVersion,Latest_operaSysVersion,Latest_BacVerNumber,Latest_BacFlashVer,Latest_webUIVersion,Latest_webUITypeCarrVer,Latest_webTypeDataVerNumber,Latest_operatorsVersion,Latest_phonePADPartitionedVersions,Latest_operatorId,gamePointId,gamePointDescription')
> =>now executed SELECT querry : 
> SELECT Carbon_automation_test5.AMSize AS AMSize, 
> Carbon_automation_test5.ActiveCountry AS ActiveCountry, 
> Carbon_automation_test5.Activecity AS Activecity , 
> SUM(Carbon_automation_test5.gamePointId) AS Sum_gamePointId FROM ( SELECT 
> AMSize,ActiveCountry,gamePointId, Activecity FROM (select * from 
> Carbon_automation_test5) SUB_QRY ) Carbon_automation_test5 INNER JOIN ( 
> SELECT ActiveCountry, Activecity, AMSize FROM (select * from 
> Carbon_automation_test5) SUB_QRY ) Carbon_automation_vmall_test1 ON 
> Carbon_automation_test5.AMSize = Carbon_automation_vmall_test1.AMSize WHERE 
> NOT(Carbon_automation_test5.AMSize <= '3RAM size') GROUP BY 
> Carbon_automation_test5.AMSize, Carbon_automation_test5.ActiveCountry, 
> Carbon_automation_test5.Activecity ORDER BY Carbon_automation_test5.AMSize 
> ASC, Carbon_automation_test5.ActiveCountry ASC, 
> Carbon_automation_test5.Activecity ASC;
> +++-+--+--+
> |   AMSize   | ActiveCountry  | Activecity  | Sum_gamePointId  |
> +++-+--+--+
> | 4RAM size  | Chinese| changsha| 200860   |
> | 4RAM size  | Chinese| guangzhou   | 38016|
> | 4RAM size  | Chinese| shenzhen| 49610|
> | 4RAM size  | Chinese| wuhan   | 117568   |
> | 4RAM size  | Ch

[jira] [Closed] (CARBONDATA-435) improve integration test case for AllDataTypesTestCase4

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-435.


> improve integration test case for AllDataTypesTestCase4
> ---
>
> Key: CARBONDATA-435
> URL: https://issues.apache.org/jira/browse/CARBONDATA-435
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-444) Improved integration test-case for AllDataTypesTestCase1

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-444.


> Improved integration test-case for AllDataTypesTestCase1
> 
>
> Key: CARBONDATA-444
> URL: https://issues.apache.org/jira/browse/CARBONDATA-444
> Project: CarbonData
>  Issue Type: Task
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-438) Add unit test for scan.scanner.impl package

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-438.


> Add unit test for scan.scanner.impl package
> ---
>
> Key: CARBONDATA-438
> URL: https://issues.apache.org/jira/browse/CARBONDATA-438
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Assignee: Kunal Kapoor
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-446) Add Unit Tests For Scan.collector.impl package

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-446.


> Add Unit Tests For Scan.collector.impl package
> --
>
> Key: CARBONDATA-446
> URL: https://issues.apache.org/jira/browse/CARBONDATA-446
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-460) Add Unit Tests For core.writer.sortindex package

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-460.


> Add Unit Tests For core.writer.sortindex package 
> -
>
> Key: CARBONDATA-460
> URL: https://issues.apache.org/jira/browse/CARBONDATA-460
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-472) Improve code coverage for core.cache package.

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-472.


> Improve code coverage for core.cache package.
> -
>
> Key: CARBONDATA-472
> URL: https://issues.apache.org/jira/browse/CARBONDATA-472
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Assignee: Kunal Kapoor
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-445) Improved integration test-case for AllDataTypesTestCase3

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-445.


>  Improved integration test-case for AllDataTypesTestCase3
> -
>
> Key: CARBONDATA-445
> URL: https://issues.apache.org/jira/browse/CARBONDATA-445
> Project: CarbonData
>  Issue Type: Task
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-450) Increase Test Coverage for Core.reader module

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-450.


> Increase Test Coverage for Core.reader module
> -
>
> Key: CARBONDATA-450
> URL: https://issues.apache.org/jira/browse/CARBONDATA-450
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
> Fix For: 1.0.0-incubating
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-483) Add Unit Tests For core.carbon.metadata package

2017-01-18 Thread SWATI RAO (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO closed CARBONDATA-483.


> Add Unit Tests For core.carbon.metadata package
> ---
>
> Key: CARBONDATA-483
> URL: https://issues.apache.org/jira/browse/CARBONDATA-483
> Project: CarbonData
>  Issue Type: Test
>Reporter: SWATI RAO
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (CARBONDATA-362) Optimize the parameters' name in CarbonDataRDDFactory.scala

2017-01-18 Thread Liang Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-362.
---
   Resolution: Fixed
Fix Version/s: 1.0.0-incubating

> Optimize the parameters' name in CarbonDataRDDFactory.scala
> ---
>
> Key: CARBONDATA-362
> URL: https://issues.apache.org/jira/browse/CARBONDATA-362
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Liang Chen
>Assignee: He Xiaoqiao
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>
> Optimize the parameters' name in CarbonDataRDDFactory.scala:
> changes the name of "hdfsStoreLocation"  to "storePath", because not only 
> support hdfs path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/660/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Closed] (CARBONDATA-379) Test Cases to be added for Scan package under org.apache.carbondata.core

2017-01-18 Thread DEEPAK MEHRA (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

DEEPAK MEHRA closed CARBONDATA-379.
---

It has been resolved

> Test Cases to be added for Scan package under org.apache.carbondata.core
> 
>
> Key: CARBONDATA-379
> URL: https://issues.apache.org/jira/browse/CARBONDATA-379
> Project: CarbonData
>  Issue Type: Test
>Reporter: DEEPAK MEHRA
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CARBONDATA-379) Test Cases to be added for Scan package under org.apache.carbondata.core

2017-01-18 Thread DEEPAK MEHRA (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827928#comment-15827928
 ] 

DEEPAK MEHRA commented on CARBONDATA-379:
-

It has been resolved

> Test Cases to be added for Scan package under org.apache.carbondata.core
> 
>
> Key: CARBONDATA-379
> URL: https://issues.apache.org/jira/browse/CARBONDATA-379
> Project: CarbonData
>  Issue Type: Test
>Reporter: DEEPAK MEHRA
>Priority: Trivial
> Fix For: 1.0.0-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #443: [CARBONDATA-534] Written the test ca...

2017-01-18 Thread HarshSharma8
Github user HarshSharma8 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/443


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #437: [CARBONDATA-533] Written the unit te...

2017-01-18 Thread HarshSharma8
Github user HarshSharma8 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/437


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #456: [CARBONDATA-553] Written the integra...

2017-01-18 Thread HarshSharma8
Github user HarshSharma8 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/456


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #445: [CARBONDATA-543] Write unit test cas...

2017-01-18 Thread harmeetsingh0013
Github user harmeetsingh0013 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/445


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #331: [CARBONDATA-396] Implement test case...

2017-01-18 Thread harmeetsingh0013
Github user harmeetsingh0013 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/331


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #444: [CARBONDATA -541] Tescases for dicti...

2017-01-18 Thread deepakmehra10
Github user deepakmehra10 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/444


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #430: [CARBONDATA -515] Test cases for con...

2017-01-18 Thread deepakmehra10
Github user deepakmehra10 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/430


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #464: [Carbondata-551] Test cases for prco...

2017-01-18 Thread deepakmehra10
Github user deepakmehra10 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/464


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/659/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/540
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/658/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #550: [CARBONDATA-624] Complete CarbonData docume...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/550
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #550: [CARBONDATA-624] Complete CarbonData...

2017-01-18 Thread sgururajshetty
GitHub user sgururajshetty opened a pull request:

https://github.com/apache/incubator-carbondata/pull/550

[CARBONDATA-624] Complete CarbonData document in md files

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[CARBONDATA-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
 - [ ] Testing done
 
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this 
change.
 
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
 
---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sgururajshetty/incubator-carbondata master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/550.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #550


commit fab13bd15fd8196c25889c4e5734773555e0b384
Author: sgururajshetty 
Date:   2017-01-09T12:06:03Z

Document update for UID

Two new DML commands added as part of the UID
UPDATE CARBON TABLE
DELETE RECORDS from CARBON TABLE

commit 6408094a9ba1dc7c52cfddec4b1f1d9ff4a0431d
Author: sgururajshetty 
Date:   2017-01-10T05:58:46Z

Merge branch 'master' into master

commit 9466537be49f4a06e75f10c56e3ea8c7d00d7eb5
Author: sgururajshetty 
Date:   2017-01-10T06:02:45Z

Hyperlink fixed

Some reference information removed.

commit bf61c596a533b1db9a1a6a777d3de30994b1ad4b
Author: sgururajshetty 
Date:   2017-01-10T06:14:35Z

Example refined

commit 59baa3163a7d63eef4ec2cef606cc88ea90c421f
Author: sgururajshetty 
Date:   2017-01-18T11:26:28Z

[CARBONDATA-624] Complete CarbonData document in md files

Complete CarbonData documentation in md files




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...

2017-01-18 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/547
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Closed] (CARBONDATA-639) "Delete data" feature doesn't work

2017-01-18 Thread Liang Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen closed CARBONDATA-639.
-
Resolution: Duplicate

> "Delete data" feature doesn't work
> --
>
> Key: CARBONDATA-639
> URL: https://issues.apache.org/jira/browse/CARBONDATA-639
> Project: CarbonData
>  Issue Type: Bug
>  Components: core
>Affects Versions: 1.0.0-incubating
>Reporter: Liang Chen
>Assignee: sounak chakraborty
> Fix For: 1.0.0-incubating
>
>
> 1.Version:CarbonData is the latest master , Spark 1.6.2
> 2.Test Environment: spark-shell with command of ./bin/spark-shell --master 
> local --jars ${carbondata_jar},${mysql_jar}
> 3.Reproduce steps:
> 1.Finish load data , query as below : cc.sql("select * from connectdemo1 
> where age > 40").show() :
> +--+--++---+---+
> |  name|gender|province|singler|age|
> +--+--++---+---+
> |Abbott|Female|  AB|  false| 54|
> |Abbott|Female|  AB|  false| 51|
> |Abbott|Female|  AB|  false| 65|
> |Abbott|Female|  AB|  false| 47|
> |Abbott|Female|  AB|  false| 56|
> |Abbott|Female|  AB|  false| 54|
> |Abbott|Female|  AB|  false| 61|
> |Abbott|Female|  AB|  false| 58|
> |Abbott|Female|  AB|  false| 62|
> |Abbott|Female|  AB|  false| 47|
> |Abbott|Female|  AB|  false| 49|
> |Abbott|Female|  AB|  false| 53|
> |Abbott|Female|  AB|  false| 63|
> |Abbott|Female|  AB|  false| 48|
> |Abbott|Female|  AB|  false| 52|
> |Abbott|Female|  AB|  false| 52|
> |Abbott|Female|  AB|  false| 62|
> |Abbott|Female|  AB|  false| 61|
> |Abbott|Female|  AB|  false| 63|
> |Abbott|Female|  AB|  false| 49|
> +--+--++---+---+
> cc.sql("select count(*) from connectdemo1").show()
> +---+
> |_c0|
> +---+
> |900|
> +---+
> 2.cc.sql("delete from connectdemo1 where age > 60").show
> 3.query again with cc.sql("select * from connectdemo1 where age > 40").show() 
> and cc.sql("select count(*) from connectdemo1").show()  : same result with 
> before deletion , so the delete operation is failed.
> +--+--++---+---+
> |  name|gender|province|singler|age|
> +--+--++---+---+
> |Abbott|Female|  AB|  false| 54|
> |Abbott|Female|  AB|  false| 51|
> |Abbott|Female|  AB|  false| 65|
> |Abbott|Female|  AB|  false| 47|
> |Abbott|Female|  AB|  false| 56|
> |Abbott|Female|  AB|  false| 54|
> |Abbott|Female|  AB|  false| 61|
> |Abbott|Female|  AB|  false| 58|
> |Abbott|Female|  AB|  false| 62|
> |Abbott|Female|  AB|  false| 47|
> |Abbott|Female|  AB|  false| 49|
> |Abbott|Female|  AB|  false| 53|
> |Abbott|Female|  AB|  false| 63|
> |Abbott|Female|  AB|  false| 48|
> |Abbott|Female|  AB|  false| 52|
> |Abbott|Female|  AB|  false| 52|
> |Abbott|Female|  AB|  false| 62|
> |Abbott|Female|  AB|  false| 61|
> |Abbott|Female|  AB|  false| 63|
> |Abbott|Female|  AB|  false| 49|
> +--+--++---+---+
> +---+
> |_c0|
> +---+
> |900|
> +---+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #510: Document update for UID

2017-01-18 Thread sgururajshetty
Github user sgururajshetty commented on the issue:

https://github.com/apache/incubator-carbondata/pull/510
  
@jackylk the review comments is been incorporated in the new md files.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #510: Document update for UID

2017-01-18 Thread sgururajshetty
Github user sgururajshetty closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/510


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CARBONDATA-399) [Bad Records] Data Load is not FAILED even bad_records_action="FAIL" .

2017-01-18 Thread Akash R Nilugal (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827844#comment-15827844
 ] 

Akash R Nilugal commented on CARBONDATA-399:


This issue is related to 
https://github.com/apache/incubator-carbondata/pull/332 . It gets resolved with 
PR-332.

> [Bad Records] Data Load is not FAILED even  bad_records_action="FAIL" .
> ---
>
> Key: CARBONDATA-399
> URL: https://issues.apache.org/jira/browse/CARBONDATA-399
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 0.1.0-incubating
> Environment: SUSE 11 SP4
> YARN HA 
> 3 Nodes
>Reporter: Babulal
>Assignee: Akash R Nilugal
>Priority: Minor
>
> Data Load is not FAILED when string data are loaded in the int column . 
> 1. Create table  defect_5 (imei string ,deviceInformationId int,mac 
> string,productdate timestamp,updatetime timestamp,gamePointId 
> double,contractNumber double) stored by 'carbondata' 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='deviceInformationId') ;
> deviceInformationId  is int  ( it will handled as  dimension). Now load the 
> data 
> 2.  0: jdbc:hive2://ha-cluster/default> LOAD DATA  inpath 
> 'hdfs://hacluster/tmp/100_default_date_11_header_2.csv' into table defect_5 
> options('DELIMITER'=',', 'bad_records_action'='FAIL',  
> 'QUOTECHAR'='"','FILEHEADER'='imei,deviceinformationid,mac,productdate,updatetime,gamepointid,contractnumber');
> +-+--+
> | Result  |
> +-+--+
> +-+--+
> No rows selected (0.969 seconds)
> 3. Data 
> imei,deviceinformationid,mac,productdate,updatetime,gamepointid,contractnumber
> 1AA1,babu,Mikaa1,2015-01-01 11:00:00,2015-01-01 13:00:00,10,260
> 1AA2,3,Mikaa2,2015-01-02 12:00:00,2015-01-01 14:00:00,278,230
> 1AA3,1,Mikaa1,2015-01-03 13:00:00,2015-01-01 15:00:00,2556,1
> 1AA4,10,Mikaa2,2015-01-04 14:00:00,2015-01-01 16:00:00,640,254
> 1AA5,10,Mikaa,2015-01-05 15:00:00,2015-01-01 17:00:00,980,256
> 1AA6,10,Mikaa,2015-01-06 16:00:00,2015-01-01 18:00:00,1,2378
> 1AA7,10,Mikaa,2015-01-07 17:00:00,2015-01-01 19:00:00,96,234
> 1AA8,9,max,2015-01-08 18:00:00,2015-01-01 20:00:00,89,236
> 1AA9,10,max,2015-01-09 19:00:00,2015-01-01 21:00:00,198.36,239.2
> Expect Outoput:- Data Load should FAIL 
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (CARBONDATA-604) Use Kettle wrong option in Thrift server give wrong error message

2017-01-18 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala reassigned CARBONDATA-604:
--

Assignee: Ravindra Pesala  (was: Manish Gupta)

> Use Kettle wrong option in Thrift server give wrong error message
> -
>
> Key: CARBONDATA-604
> URL: https://issues.apache.org/jira/browse/CARBONDATA-604
> Project: CarbonData
>  Issue Type: Bug
> Environment: Spark 1.6
>Reporter: Harmeet Singh
>Assignee: Ravindra Pesala
>Priority: Trivial
>
> I am using Thrift Server with following configuration: 
> -Duse.kettle=default
> Here kettle value is wrong and when I run the thrift server, the thrift 
> server is running successfully. After that, I am going to start beeline. In 
> beeline, I am executing load command without any kettle option as below: 
>  LOAD DATA INPATH 'hdfs://localhost:54310/csvs/3000_UniqData.csv' into table 
> uniqdata OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> After executing above command, I am getting Error: 
> java.lang.IllegalArgumentException: For input string: "default" 
> (state=,code=0)
> This error, seems to be wrong, because I am not using any default value in 
> load query, and default is used with thrift.
> So I have following Suggestions: 
> 1. Change the error message, while load query is executing.
> 2. While starting thrift server with wrong value, thrift give us an error and 
> not start.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata issue #546: [CARBONDATA-655]Make no kettle dataload flo...

2017-01-18 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/546
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/657/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


  1   2   >