[GitHub] incubator-carbondata issue #555: [WIP] All dictionary path issue
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/555 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/679/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #555: [WIP] All dictionary path issue
GitHub user ManoharVanam opened a pull request: https://github.com/apache/incubator-carbondata/pull/555 [WIP] All dictionary path issue ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ManoharVanam/incubator-carbondata ALL_DICTIONARY_PATH_JIRA Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/555.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #555 commit ad3ffed908f9a80f2c6075803de0c9ce0b977fd9 Author: Manohar Date: 2017-01-19T07:21:45Z Fixed ALL_DICTIONARY_PATH null pointer exception issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #554: [CARBONDATA-661] misc cleanup in carbon cor...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/554 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/677/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...
Github user ravipesala commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 @jackylk Handled comment, please review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #554: [CARBONDATA-661] misc cleanup in car...
GitHub user JihongMA opened a pull request: https://github.com/apache/incubator-carbondata/pull/554 [CARBONDATA-661] misc cleanup in carbon core cleanup un-exercised code/field/functions as well as minor fix. You can merge this pull request into a Git repository by running: $ git pull https://github.com/JihongMA/incubator-carbondata carbondata-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/554.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #554 commit f1746d149e5efdef5dd928736781d6920077e9c2 Author: Jihong Ma Date: 2017-01-19T06:41:16Z code cleanup --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core
Github user JihongMA commented on the issue: https://github.com/apache/incubator-carbondata/pull/552 close this PR for cleaner commit history. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user JihongMA closed the pull request at: https://github.com/apache/incubator-carbondata/pull/552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user JihongMA commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/552#discussion_r96801631 --- Diff: core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java --- @@ -143,17 +142,18 @@ private void intialize() { private int[] convertToArray(List list) { int[] ints = new int[list.size()]; -for (int i = 0; i < ints.length; i++) { - ints[i] = list.get(i); +int i = 0; +for (Integer ii : list) { --- End diff -- just checked online, the performance difference is on List.forEach() as well as stream().. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (CARBONDATA-625) Abnormal behaviour of Int datatype
[ https://issues.apache.org/jira/browse/CARBONDATA-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geetika Gupta closed CARBONDATA-625. Resolution: Fixed > Abnormal behaviour of Int datatype > -- > > Key: CARBONDATA-625 > URL: https://issues.apache.org/jira/browse/CARBONDATA-625 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.0.0-incubating > Environment: Spark: 1.6 and hadoop: 2.6.5 >Reporter: Geetika Gupta >Assignee: Manish Gupta >Priority: Minor > Attachments: Screenshot from 2017-01-11 18-36-24.png, > testMaxValueForBigInt.csv > > > I was trying to create a table having int as a column and loaded data into > the table. Data loading was performed successfully but when I viewed the data > of the table, there was some wrong data present in the table. I was trying to > load BigInt data to an int column. All the data in int column is loaded with > the first value of the csv. Below are the details for the queries: > create table xyz(a int, b string)stored by 'carbondata'; > Data load query: > LOAD DATA INPATH 'hdfs://localhost:54311/testFiles/testMaxValueForBigInt.csv' > into table xyz OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','FILEHEADER'='a,b'); > select query: > select * from xyz; > PFA the screenshot of the output and the csv file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CARBONDATA-625) Abnormal behaviour of Int datatype
[ https://issues.apache.org/jira/browse/CARBONDATA-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829374#comment-15829374 ] Manish Gupta commented on CARBONDATA-625: - This issue is fixed as part of PR-535 (https://github.com/apache/incubator-carbondata/pull/535). This issue can be closed. > Abnormal behaviour of Int datatype > -- > > Key: CARBONDATA-625 > URL: https://issues.apache.org/jira/browse/CARBONDATA-625 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.0.0-incubating > Environment: Spark: 1.6 and hadoop: 2.6.5 >Reporter: Geetika Gupta >Assignee: Manish Gupta >Priority: Minor > Attachments: Screenshot from 2017-01-11 18-36-24.png, > testMaxValueForBigInt.csv > > > I was trying to create a table having int as a column and loaded data into > the table. Data loading was performed successfully but when I viewed the data > of the table, there was some wrong data present in the table. I was trying to > load BigInt data to an int column. All the data in int column is loaded with > the first value of the csv. Below are the details for the queries: > create table xyz(a int, b string)stored by 'carbondata'; > Data load query: > LOAD DATA INPATH 'hdfs://localhost:54311/testFiles/testMaxValueForBigInt.csv' > into table xyz OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','FILEHEADER'='a,b'); > select query: > select * from xyz; > PFA the screenshot of the output and the csv file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/447 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/676/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/447 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/675/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #398: [CARBONDATA-400] Error message for d...
GitHub user akashrn5 reopened a pull request: https://github.com/apache/incubator-carbondata/pull/398 [CARBONDATA-400] Error message for dataload with a column having more than 10 characters. * Problem: When the number of characters in a column exceeds 10 characters whole string appears in beeline with exception. Analysis: In univocity csv parser settings , the maximum number of characters per column is 10 and when it exceeds that limit, TextparsingException is thrown with the complete string as error in beeline during data load. Fix: Now a proper error message is displayed in beeline and complete error messages and parser settings details will be present in logs. Impact area: Data loading with more than 10 characters in a single column. You can merge this pull request into a Git repository by running: $ git pull https://github.com/akashrn5/incubator-carbondata br_message_correction Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/398.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #398 commit dbe4c5ea048ed943b9b841acf697316be82232cc Author: Akash R Nilugal Date: 2016-12-05T09:46:10Z [CARBONDATA-400] * Problem: When the number of characters in a column exceeds 10 characters whole string appears in beeline with exception. Analysis: In univocity csv parser settings , the maximum number of characters per column is 10 and when it exceeds that limit, TextparsingException is thrown with the complete string as error in beeline during data load. Fix: Now a proper error message is displayed in beeline and complete error messages and parser settings details will be present in logs. Impact area: Data loading with more than 10 characters in a single column. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #398: [CARBONDATA-400] Error message for d...
Github user akashrn5 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/398 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/553 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/674/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...
Github user ravipesala commented on the issue: https://github.com/apache/incubator-carbondata/pull/553 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user JihongMA commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/552#discussion_r96787067 --- Diff: core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java --- @@ -143,17 +142,18 @@ private void intialize() { private int[] convertToArray(List list) { int[] ints = new int[list.size()]; -for (int i = 0; i < ints.length; i++) { - ints[i] = list.get(i); +int i = 0; +for (Integer ii : list) { --- End diff -- the foreach is slower than get(i) an indexing search? not aware of it, and I thought the other way around --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781582 --- Diff: core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java --- @@ -143,17 +142,18 @@ private void intialize() { private int[] convertToArray(List list) { int[] ints = new int[list.size()]; -for (int i = 0; i < ints.length; i++) { - ints[i] = list.get(i); +int i = 0; +for (Integer ii : list) { + ints[i++] = ii.intValue(); } return ints; } private int[] convertToArray(Set set) { int[] ints = new int[set.size()]; int i = 0; -for (Iterator iterator = set.iterator(); iterator.hasNext(); ) { - ints[i++] = (Integer) iterator.next(); +for (Integer ii: set) { + ints[i++]= ii.intValue(); --- End diff -- add space before `=` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781568 --- Diff: core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java --- @@ -143,17 +142,18 @@ private void intialize() { private int[] convertToArray(List list) { int[] ints = new int[list.size()]; -for (int i = 0; i < ints.length; i++) { - ints[i] = list.get(i); +int i = 0; +for (Integer ii : list) { + ints[i++] = ii.intValue(); } return ints; } private int[] convertToArray(Set set) { int[] ints = new int[set.size()]; int i = 0; -for (Iterator iterator = set.iterator(); iterator.hasNext(); ) { - ints[i++] = (Integer) iterator.next(); +for (Integer ii: set) { --- End diff -- foreach style for loop is not encouraged to use because of performance --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/552#discussion_r96781406 --- Diff: core/src/main/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthEquiSplitGenerator.java --- @@ -143,17 +142,18 @@ private void intialize() { private int[] convertToArray(List list) { int[] ints = new int[list.size()]; -for (int i = 0; i < ints.length; i++) { - ints[i] = list.get(i); +int i = 0; +for (Integer ii : list) { --- End diff -- foreach style for loop is not encouraged to use because of performance --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core
Github user jackylk commented on the issue: https://github.com/apache/incubator-carbondata/pull/552 Can you squash your commit into one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/553 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/673/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #553: [CARBONDATA-635]Insert query fails when fun...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/553 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/672/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #553: [CARBONDATA-635]Insert query fails w...
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/553 [CARBONDATA-635]Insert query fails when functions are used in select query This PR fixes the insert query when functions are used in select query. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ravipesala/incubator-carbondata insert_issue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/553.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #553 commit f9a1393312a02b71ccd0eb453370787720ed7591 Author: ravipesala Date: 2017-01-19T01:00:24Z Fixed insert with select query when functions are used in query commit b815f27554f5d88655661949676ecc9f4a8332ea Author: ravipesala Date: 2017-01-19T01:01:23Z reverted example --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/671/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/670/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/546#discussion_r96743498 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -390,11 +390,19 @@ case class LoadTable( val useKettle = options.get("use_kettle") match { case Some(value) => value.toBoolean case _ => - val useKettleLocal = System.getProperty("use.kettle") + var useKettleLocal = System.getProperty("use.kettle") + if (useKettleLocal == null && sqlContext.sparkContext.getConf.contains("use_kettle")) { --- End diff -- Ok unified. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #552: [CARBONDATA-661] misc cleanup in core
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/552 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/669/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Assigned] (CARBONDATA-661) misc cleanup in carbon core
[ https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA reassigned CARBONDATA-661: Assignee: Jihong MA > misc cleanup in carbon core > --- > > Key: CARBONDATA-661 > URL: https://issues.apache.org/jira/browse/CARBONDATA-661 > Project: CarbonData > Issue Type: Sub-task > Components: core >Reporter: Jihong MA >Assignee: Jihong MA >Priority: Minor > > cleanup un-exercised code/field/functions as well as minor code improvement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #552: [CARBONDATA-661] misc cleanup in cor...
GitHub user JihongMA opened a pull request: https://github.com/apache/incubator-carbondata/pull/552 [CARBONDATA-661] misc cleanup in core cleanup un-exercised code/field/functions as well as minor code improvement. You can merge this pull request into a Git repository by running: $ git pull https://github.com/JihongMA/incubator-carbondata carbondata-1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/552.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #552 commit 1241ada35d3463eee2c9850590792b72bca4c416 Author: Jihong Ma Date: 2016-12-13T00:31:12Z Merge remote-tracking branch 'upstream/master' commit 0bf1fb35c79f0fe12cc0e61a8b6c53b51085bdcc Author: Jihong Ma Date: 2016-12-20T01:55:53Z Merge remote-tracking branch 'upstream/master' commit f5483b6a58f4cdeec91850bf2127fba009eb6654 Author: Jihong Ma Date: 2016-12-24T16:11:20Z Merge remote-tracking branch 'upstream/master' commit 1600f4dc3314a492aedc8e6950fc9cbc33f0a76f Author: Jihong Ma Date: 2017-01-03T22:09:39Z Merge remote-tracking branch 'upstream/master' commit 3bebe0a1f38258ebfe5ef5490fc1b95cb96e362f Author: Jihong Ma Date: 2017-01-05T18:41:39Z Merge remote-tracking branch 'upstream/master' commit 5f991bb3ed05a185df4740feb4efa923a51e2345 Author: Jihong Ma Date: 2017-01-10T02:21:49Z Merge remote-tracking branch 'upstream/master' commit 5faad5d9e40dea0bd5d97bc346dbca903c17a496 Author: Jihong Ma Date: 2017-01-10T18:58:33Z Merge remote-tracking branch 'upstream/master' commit 0a00c54c1d6ceebb9ff15b8ea8a424a1e9523001 Author: Jihong Ma Date: 2017-01-18T01:48:44Z rebase master commit 3b9397d036a33f8e60f442bcd699bcacebb7a2d5 Author: Jihong Ma Date: 2017-01-18T19:21:50Z misc code cleanup --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (CARBONDATA-661) misc cleanup in carbon core
[ https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-661: - Issue Type: Sub-task (was: Improvement) Parent: CARBONDATA-548 > misc cleanup in carbon core > --- > > Key: CARBONDATA-661 > URL: https://issues.apache.org/jira/browse/CARBONDATA-661 > Project: CarbonData > Issue Type: Sub-task > Components: core >Reporter: Jihong MA >Priority: Minor > > cleanup un-exercised code/field/functions as well as minor code improvement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-661) misc cleanup in carbon core
Jihong MA created CARBONDATA-661: Summary: misc cleanup in carbon core Key: CARBONDATA-661 URL: https://issues.apache.org/jira/browse/CARBONDATA-661 Project: CarbonData Issue Type: Improvement Components: core Reporter: Jihong MA Priority: Minor cleanup un-exercised code/field/functions as well as minor code improvement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #551: [CARBONDATA-603] Fixed Date Filter issue
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/551 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/668/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Resolved] (CARBONDATA-624) Complete CarbonData document to be present in git and the same needs to sync with the carbondata.apace.org and for further updates.
[ https://issues.apache.org/jira/browse/CARBONDATA-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-624. Resolution: Fixed Fix Version/s: 1.0.0-incubating > Complete CarbonData document to be present in git and the same needs to sync > with the carbondata.apace.org and for further updates. > --- > > Key: CARBONDATA-624 > URL: https://issues.apache.org/jira/browse/CARBONDATA-624 > Project: CarbonData > Issue Type: Improvement >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty > Fix For: 1.0.0-incubating > > Time Spent: 40m > Remaining Estimate: 0h > > The information about CarbonData is there is git and cwiki. So we have to > merge all the information and create the markdown files for each topic about > CarbonData. > This markdown files will be having the complete information about CarbonData > like Overview, Installation, Configuration, DDL, DML, Use case and so on. > Also these markdown information will be sync to the website documentation - > carbondata.apace.org -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #550: [CARBONDATA-624] Complete CarbonData...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #398: [CARBONDATA-400] Error message for dataload...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/398 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/667/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #447: [CARBONDATA-325] Create table with columns ...
Github user ravipesala commented on the issue: https://github.com/apache/incubator-carbondata/pull/447 @himani1 Please fix the testcase in travis --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/546#discussion_r96658462 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -390,11 +390,19 @@ case class LoadTable( val useKettle = options.get("use_kettle") match { case Some(value) => value.toBoolean case _ => - val useKettleLocal = System.getProperty("use.kettle") + var useKettleLocal = System.getProperty("use.kettle") + if (useKettleLocal == null && sqlContext.sparkContext.getConf.contains("use_kettle")) { --- End diff -- Same comments as jackly. i suggest using "useKettle", what is your opinion? @jackylk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Resolved] (CARBONDATA-656) Simplify the carbon session creation
[ https://issues.apache.org/jira/browse/CARBONDATA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen resolved CARBONDATA-656. --- Resolution: Fixed Fix Version/s: 1.0.0-incubating > Simplify the carbon session creation > - > > Key: CARBONDATA-656 > URL: https://issues.apache.org/jira/browse/CARBONDATA-656 > Project: CarbonData > Issue Type: Improvement >Reporter: Ravindra Pesala >Assignee: Ravindra Pesala >Priority: Minor > Fix For: 1.0.0-incubating > > Time Spent: 2h 20m > Remaining Estimate: 0h > > Now it is cumbersome to create CarbonSession through spark shell. We should > minimize steps to give more usability for first time users. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #551: [CARBONDATA-603] Fixed Date Filter issue
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/551 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/666/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #547: [CARBONDATA-656]Simplify the carbon ...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/547 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/547 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #550: [CARBONDATA-624] Complete CarbonData docume...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/550 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #551: [CARBONDATA-603] Fixed Date Filter i...
GitHub user kumarvishal09 opened a pull request: https://github.com/apache/incubator-carbondata/pull/551 [CARBONDATA-603] Fixed Date Filter issue **Problem** select query with WHERE clause for date data type is failing, date values are coming as NULL **Solution** Currently both timestamp and date has same property need to add separate property for date format You can merge this pull request into a Git repository by running: $ git pull https://github.com/kumarvishal09/incubator-carbondata FixedDateFilterIssue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/551.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #551 commit 8d1ca417dfd11106295d69fd71c0d9a577c436a7 Author: kumarvishal Date: 2017-01-11T12:29:31Z Date filter fix issue-CARBONDATA-603 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/540 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/665/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (CARBONDATA-643) When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception.
[ https://issues.apache.org/jira/browse/CARBONDATA-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828133#comment-15828133 ] Manohar Vanam commented on CARBONDATA-643: -- ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary @Payal Do you have data.dictionary file at the mentioned location? Regards, Manu > When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null > pointer exception. > -- > > Key: CARBONDATA-643 > URL: https://issues.apache.org/jira/browse/CARBONDATA-643 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.0.0-incubating > Environment: spark-1.6,spark-2.1 >Reporter: Payal >Assignee: Manohar Vanam >Priority: Minor > Attachments: 7000_UniqData.csv > > > When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null > pointer exception. > //CREATE TABLE > CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME > String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, > BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), > DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 > double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' > TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2'); > //LOAD QUERY > LOAD DATA INPATH 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table > uniq_include_dictionary OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='""','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary'); > Error: java.lang.NullPointerException (state=,code=0) > LOGS > INFO 16-01 16:56:37,624 - Running query 'LOAD DATA INPATH > 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table > uniq_include_dictionary OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','MULTILINE'='true','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary')' > with 17ec3816-91e3-462e-aa9b-a7ae76405564 > INFO 16-01 16:56:37,625 - pool-26-thread-34 Query [LOAD DATA INPATH > 'HDFS://LOCALHOST:54311/PAYAL/7000_UNIQDATA.CSV' INTO TABLE > UNIQ_INCLUDE_DICTIONARY OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,DOUBLE_COLUMN1,DOUBLE_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='FALSE','MULTILINE'='TRUE','ALL_DICTIONARY_PATH'='HDFS://LOCALHOST:54311/OPT/ALLDICTIONARY/DATA.DICTIONARY')] > INFO 16-01 16:56:37,641 - Successfully able to get the table metadata file > lock > INFO 16-01 16:56:37,644 - pool-26-thread-34 Initiating Direct Load for the > Table : (default.uniq_include_dictionary) > INFO 16-01 16:56:37,644 - pool-26-thread-34 Generate global dictionary from > dictionary files! > ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not > exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary > ERROR 16-01 16:56:37,645 - pool-26-thread-34 generate global dictionary failed > java.lang.NullPointerException > at > org.apache.carbondata.core.datastorage.store.filesystem.AbstractDFSCarbonFile.getName(AbstractDFSCarbonFile.java:83) > at > org.apache.carbondata.spark.util.GlobalDictionaryUtil$.validateAllDictionaryPath(GlobalDictionaryUtil.scala:649) > at > org.apache.carbondata.spark.util.GlobalDictionaryUtil$.generateGlobalDictionary(GlobalDictionaryUtil.scala:743) > at > org.apache.spark.sql.execution.command.LoadTable.run(carbonTableSchema.scala:569) > at > org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58) > at > org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56) > at > org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:70) > at > org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:132) > at > org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:130) > at > org.apache.spark.rdd.RDDOperationScope$.with
[jira] [Comment Edited] (CARBONDATA-643) When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null pointer exception.
[ https://issues.apache.org/jira/browse/CARBONDATA-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828133#comment-15828133 ] Manohar Vanam edited comment on CARBONDATA-643 at 1/18/17 2:12 PM: --- ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary @Payal Do you have data.dictionary file at above mentioned location? Regards, Manu was (Author: manoharvanam): ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary @Payal Do you have data.dictionary file at the mentioned location? Regards, Manu > When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null > pointer exception. > -- > > Key: CARBONDATA-643 > URL: https://issues.apache.org/jira/browse/CARBONDATA-643 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.0.0-incubating > Environment: spark-1.6,spark-2.1 >Reporter: Payal >Assignee: Manohar Vanam >Priority: Minor > Attachments: 7000_UniqData.csv > > > When we are passing ALL_DICTIONARY_PATH' in load query ,it is throwing null > pointer exception. > //CREATE TABLE > CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME > String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, > BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), > DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 > double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' > TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2'); > //LOAD QUERY > LOAD DATA INPATH 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table > uniq_include_dictionary OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='""','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary'); > Error: java.lang.NullPointerException (state=,code=0) > LOGS > INFO 16-01 16:56:37,624 - Running query 'LOAD DATA INPATH > 'hdfs://localhost:54311/payal/7000_UniqData.csv' into table > uniq_include_dictionary OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='false','MULTILINE'='true','ALL_DICTIONARY_PATH'='hdfs://localhost:54311/opt/alldictionary/data.dictionary')' > with 17ec3816-91e3-462e-aa9b-a7ae76405564 > INFO 16-01 16:56:37,625 - pool-26-thread-34 Query [LOAD DATA INPATH > 'HDFS://LOCALHOST:54311/PAYAL/7000_UNIQDATA.CSV' INTO TABLE > UNIQ_INCLUDE_DICTIONARY OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', > 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,DOUBLE_COLUMN1,DOUBLE_COLUMN2,INTEGER_COLUMN1','SINGLE_PASS'='FALSE','MULTILINE'='TRUE','ALL_DICTIONARY_PATH'='HDFS://LOCALHOST:54311/OPT/ALLDICTIONARY/DATA.DICTIONARY')] > INFO 16-01 16:56:37,641 - Successfully able to get the table metadata file > lock > INFO 16-01 16:56:37,644 - pool-26-thread-34 Initiating Direct Load for the > Table : (default.uniq_include_dictionary) > INFO 16-01 16:56:37,644 - pool-26-thread-34 Generate global dictionary from > dictionary files! > ERROR 16-01 16:56:37,645 - pool-26-thread-34 Exception occured:File does not > exist: hdfs://localhost:54311/opt/alldictionary/data.dictionary > ERROR 16-01 16:56:37,645 - pool-26-thread-34 generate global dictionary failed > java.lang.NullPointerException > at > org.apache.carbondata.core.datastorage.store.filesystem.AbstractDFSCarbonFile.getName(AbstractDFSCarbonFile.java:83) > at > org.apache.carbondata.spark.util.GlobalDictionaryUtil$.validateAllDictionaryPath(GlobalDictionaryUtil.scala:649) > at > org.apache.carbondata.spark.util.GlobalDictionaryUtil$.generateGlobalDictionary(GlobalDictionaryUtil.scala:743) > at > org.apache.spark.sql.execution.command.LoadTable.run(carbonTableSchema.scala:569) > at > org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58) > at > org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56) > at > org.apache.spark.sql.exe
[GitHub] incubator-carbondata pull request #546: [CARBONDATA-655][CARBONDATA-604]Make...
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/546#discussion_r96641464 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -390,11 +390,19 @@ case class LoadTable( val useKettle = options.get("use_kettle") match { case Some(value) => value.toBoolean case _ => - val useKettleLocal = System.getProperty("use.kettle") + var useKettleLocal = System.getProperty("use.kettle") + if (useKettleLocal == null && sqlContext.sparkContext.getConf.contains("use_kettle")) { --- End diff -- It is strange that "use.kettle", "use_kettle", and "useKettle" are all different, can we use the same name for all these configuration? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #264: [CARBONDATA-341] CarbonTableIdentifier bein...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/264 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/664/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/547 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/663/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-660) Bad Records Logs and Raw CSVs should get display under segment id instead of Tasks id
Priyal Sachdeva created CARBONDATA-660: -- Summary: Bad Records Logs and Raw CSVs should get display under segment id instead of Tasks id Key: CARBONDATA-660 URL: https://issues.apache.org/jira/browse/CARBONDATA-660 Project: CarbonData Issue Type: Improvement Components: data-load Reporter: Priyal Sachdeva Priority: Minor create table if not exists Badrecords_test (imei string,AMSize int) STORED BY 'org.apache.carbondata.format'; LOAD DATA INPATH 'hdfs://hacluster/CSVs/bad_records.csv' into table Badrecords_test OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='REDIRECT','FILEHEADER'='imei,AMSize'); Bad Records Logs and raw csvs are getting display under Task ID linux-61:/srv/OSCON/BigData/HACluster/install/hadoop/datanode # bin/hadoop fs -ls /tmp/carbon/default/badrecords_test drwxr-xr-x - root users 0 2017-01-18 21:08 /tmp/carbon/default/badrecords_test/0--->Task ID 0: jdbc:hive2://172.168.100.205:23040> show segments for table Badrecords_test; ++--+--+--+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | ++--+--+--+--+ | 8 | Partial Success | 2017-01-18 21:12:58.018 | 2017-01-18 21:12:59.652 | | 7 | Partial Success | 2017-01-18 21:08:07.426 | 2017-01-18 21:08:11.791 | | 6 | Partial Success | 2017-01-18 21:07:07.645 | 2017-01-18 21:07:08.747 | | 5 | Partial Success | 2017-01-18 19:34:16.163 | 2017-01-18 19:34:18.163 | | 4 | Partial Success | 2017-01-18 19:34:13.669 | 2017-01-18 19:34:15.811 | | 3 | Partial Success | 2017-01-18 19:30:18.753 | 2017-01-18 19:30:19.644 | | 2 | Partial Success | 2017-01-18 19:30:13.508 | 2017-01-18 19:30:15.578 | | 1 | Partial Success | 2017-01-18 19:18:54.787 | 2017-01-18 19:18:54.94 | | 0 | Partial Success | 2017-01-18 19:18:53.741 | 2017-01-18 19:18:54.614 | ++--+--+--+--+ Bad Records Logs and raw csvs are getting display under Task ID. It would be good to have the information of bad records as per the load i.e under segment id.. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/547 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Resolved] (CARBONDATA-561) Merge the two CarbonOption.scala into one under spark-common
[ https://issues.apache.org/jira/browse/CARBONDATA-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen resolved CARBONDATA-561. --- Resolution: Fixed > Merge the two CarbonOption.scala into one under spark-common > > > Key: CARBONDATA-561 > URL: https://issues.apache.org/jira/browse/CARBONDATA-561 > Project: CarbonData > Issue Type: Improvement >Reporter: Liang Chen >Assignee: He Xiaoqiao >Priority: Minor > Fix For: 1.0.0-incubating > > Time Spent: 50m > Remaining Estimate: 0h > > Merge the below two CarbonOption.scala into one under spark-common: > /integration/spark-common/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala > /integration/spark2/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #549: [CARBONDATA-561]Merge the two Carbon...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #549: [CARBONDATA-561]Merge the two CarbonOption....
Github user QiangCai commented on the issue: https://github.com/apache/incubator-carbondata/pull/549 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-659) Should add WhitespaceAround and ParenPad to javastyle
QiangCai created CARBONDATA-659: --- Summary: Should add WhitespaceAround and ParenPad to javastyle Key: CARBONDATA-659 URL: https://issues.apache.org/jira/browse/CARBONDATA-659 Project: CarbonData Issue Type: Improvement Reporter: QiangCai Assignee: QiangCai Priority: Trivial -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/540 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/662/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #539: [WIP]add WhitespaceAround and ParenPad to j...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/539 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/661/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #549: CARBONDATA-561 delete duplicated code in sp...
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/549 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (CARBONDATA-395) Unit Test cases for package org.apache.carbondata.scan.expression.ExpressionResult
[ https://issues.apache.org/jira/browse/CARBONDATA-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-395. > Unit Test cases for package > org.apache.carbondata.scan.expression.ExpressionResult > -- > > Key: CARBONDATA-395 > URL: https://issues.apache.org/jira/browse/CARBONDATA-395 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-410) Implement test cases for core.datastore.file system
[ https://issues.apache.org/jira/browse/CARBONDATA-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-410. > Implement test cases for core.datastore.file system > --- > > Key: CARBONDATA-410 > URL: https://issues.apache.org/jira/browse/CARBONDATA-410 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-416) Add unit test case for result.impl package
[ https://issues.apache.org/jira/browse/CARBONDATA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-416. > Add unit test case for result.impl package > -- > > Key: CARBONDATA-416 > URL: https://issues.apache.org/jira/browse/CARBONDATA-416 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-427) In documentation ,applicable is not define properly in Parameters of Compaction
[ https://issues.apache.org/jira/browse/CARBONDATA-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-427. Resolution: Fixed > In documentation ,applicable is not define properly in Parameters of > Compaction > > > Key: CARBONDATA-427 > URL: https://issues.apache.org/jira/browse/CARBONDATA-427 > Project: CarbonData > Issue Type: Bug > Components: docs >Reporter: SWATI RAO > > Applicable is not define properly in Parameters of Compaction like > In carbon.numberof.preserve.segments applicable is Minor/Major, it should be > minor > # carbon.allowed.compaction.days applicable is Minor/Major, it should be > minor > #carbon.number.of.cores.while.compacting applicable is Minor/Major, it should > be minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-419) Show tables in query for non-existing database do not show any exception
[ https://issues.apache.org/jira/browse/CARBONDATA-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-419. Resolution: Fixed > Show tables in query for non-existing database do not show any exception > - > > Key: CARBONDATA-419 > URL: https://issues.apache.org/jira/browse/CARBONDATA-419 > Project: CarbonData > Issue Type: Bug > Components: data-query >Reporter: SWATI RAO >Assignee: Manohar Vanam > > When executing command 'show tables in' for an non-existing database, it do > not show any error, > Example: show tables in test_tableMg; > (where test_tableMg database do not exist) > whereas when executing the same query on hive, it says : > FAILED: SemanticException [Error 10072]: Database does not exist: test_tableMg -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (CARBONDATA-427) In documentation ,applicable is not define properly in Parameters of Compaction
[ https://issues.apache.org/jira/browse/CARBONDATA-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO reopened CARBONDATA-427: -- > In documentation ,applicable is not define properly in Parameters of > Compaction > > > Key: CARBONDATA-427 > URL: https://issues.apache.org/jira/browse/CARBONDATA-427 > Project: CarbonData > Issue Type: Bug > Components: docs >Reporter: SWATI RAO > > Applicable is not define properly in Parameters of Compaction like > In carbon.numberof.preserve.segments applicable is Minor/Major, it should be > minor > # carbon.allowed.compaction.days applicable is Minor/Major, it should be > minor > #carbon.number.of.cores.while.compacting applicable is Minor/Major, it should > be minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (CARBONDATA-419) Show tables in query for non-existing database do not show any exception
[ https://issues.apache.org/jira/browse/CARBONDATA-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO reopened CARBONDATA-419: -- > Show tables in query for non-existing database do not show any exception > - > > Key: CARBONDATA-419 > URL: https://issues.apache.org/jira/browse/CARBONDATA-419 > Project: CarbonData > Issue Type: Bug > Components: data-query >Reporter: SWATI RAO >Assignee: Manohar Vanam > > When executing command 'show tables in' for an non-existing database, it do > not show any error, > Example: show tables in test_tableMg; > (where test_tableMg database do not exist) > whereas when executing the same query on hive, it says : > FAILED: SemanticException [Error 10072]: Database does not exist: test_tableMg -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-434) Update test cases for AllDataTypesTestCase2
[ https://issues.apache.org/jira/browse/CARBONDATA-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-434. > Update test cases for AllDataTypesTestCase2 > --- > > Key: CARBONDATA-434 > URL: https://issues.apache.org/jira/browse/CARBONDATA-434 > Project: CarbonData > Issue Type: Improvement >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-442) Query result mismatching with Hive
[ https://issues.apache.org/jira/browse/CARBONDATA-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-442. > Query result mismatching with Hive > -- > > Key: CARBONDATA-442 > URL: https://issues.apache.org/jira/browse/CARBONDATA-442 > Project: CarbonData > Issue Type: Bug >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > > => I created table using following command : > create table Carbon_automation_test5 (imei string,deviceInformationId int,MAC > string,deviceColor string,device_backColor string,modelId string,marketName > string,AMSize string,ROMSize string,CUPAudit string,CPIClocked string,series > string,productionDate string,bomCode string,internalModels string, > deliveryTime string, channelsId string,channelsName string , deliveryAreaId > string, deliveryCountry string, deliveryProvince string, deliveryCity > string,deliveryDistrict string, deliveryStreet string,oxSingleNumber string, > ActiveCheckTime string, ActiveAreaId string, ActiveCountry string, > ActiveProvince string, Activecity string, ActiveDistrict string, ActiveStreet > string, ActiveOperatorId string, Active_releaseId string, Active_EMUIVersion > string,Active_operaSysVersion string, Active_BacVerNumber string, > Active_BacFlashVer string,Active_webUIVersion string, Active_webUITypeCarrVer > string,Active_webTypeDataVerNumber string, Active_operatorsVersion string, > Active_phonePADPartitionedVersions string,Latest_YEAR int, Latest_MONTH int, > Latest_DAY int, Latest_HOUR string, Latest_areaId string, Latest_country > string, Latest_province string, Latest_city string,Latest_district string, > Latest_street string, Latest_releaseId string,Latest_EMUIVersion string, > Latest_operaSysVersion string, Latest_BacVerNumber string,Latest_BacFlashVer > string, Latest_webUIVersion string, Latest_webUITypeCarrVer > string,Latest_webTypeDataVerNumber string, Latest_operatorsVersion > string,Latest_phonePADPartitionedVersions string, Latest_operatorId > string,gamePointDescription string, gamePointId int,contractNumber int) > stored by 'org.apache.carbondata.format' > => Load csv to table : > LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/100_olap.csv' INTO table > Carbon_automation_test5 OPTIONS('DELIMITER'= ',' ,'QUOTECHAR'= '"', > 'FILEHEADER'= > 'imei,deviceInformationId,MAC,deviceColor,device_backColor,modelId,marketName,AMSize,ROMSize,CUPAudit,CPIClocked,series,productionDate,bomCode,internalModels,deliveryTime,channelsId,channelsName,deliveryAreaId,deliveryCountry,deliveryProvince,deliveryCity,deliveryDistrict,deliveryStreet,oxSingleNumber,contractNumber,ActiveCheckTime,ActiveAreaId,ActiveCountry,ActiveProvince,Activecity,ActiveDistrict,ActiveStreet,ActiveOperatorId,Active_releaseId,Active_EMUIVersion,Active_operaSysVersion,Active_BacVerNumber,Active_BacFlashVer,Active_webUIVersion,Active_webUITypeCarrVer,Active_webTypeDataVerNumber,Active_operatorsVersion,Active_phonePADPartitionedVersions,Latest_YEAR,Latest_MONTH,Latest_DAY,Latest_HOUR,Latest_areaId,Latest_country,Latest_province,Latest_city,Latest_district,Latest_street,Latest_releaseId,Latest_EMUIVersion,Latest_operaSysVersion,Latest_BacVerNumber,Latest_BacFlashVer,Latest_webUIVersion,Latest_webUITypeCarrVer,Latest_webTypeDataVerNumber,Latest_operatorsVersion,Latest_phonePADPartitionedVersions,Latest_operatorId,gamePointId,gamePointDescription') > =>now executed SELECT querry : > SELECT Carbon_automation_test5.AMSize AS AMSize, > Carbon_automation_test5.ActiveCountry AS ActiveCountry, > Carbon_automation_test5.Activecity AS Activecity , > SUM(Carbon_automation_test5.gamePointId) AS Sum_gamePointId FROM ( SELECT > AMSize,ActiveCountry,gamePointId, Activecity FROM (select * from > Carbon_automation_test5) SUB_QRY ) Carbon_automation_test5 INNER JOIN ( > SELECT ActiveCountry, Activecity, AMSize FROM (select * from > Carbon_automation_test5) SUB_QRY ) Carbon_automation_vmall_test1 ON > Carbon_automation_test5.AMSize = Carbon_automation_vmall_test1.AMSize WHERE > NOT(Carbon_automation_test5.AMSize <= '3RAM size') GROUP BY > Carbon_automation_test5.AMSize, Carbon_automation_test5.ActiveCountry, > Carbon_automation_test5.Activecity ORDER BY Carbon_automation_test5.AMSize > ASC, Carbon_automation_test5.ActiveCountry ASC, > Carbon_automation_test5.Activecity ASC; > +++-+--+--+ > | AMSize | ActiveCountry | Activecity | Sum_gamePointId | > +++-+--+--+ > | 4RAM size | Chinese| changsha| 200860 | > | 4RAM size | Chinese| guangzhou | 38016| > | 4RAM size | Chinese| shenzhen| 49610| > | 4RAM size | Chinese| wuhan | 117568 | > | 4RAM size | Ch
[jira] [Closed] (CARBONDATA-435) improve integration test case for AllDataTypesTestCase4
[ https://issues.apache.org/jira/browse/CARBONDATA-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-435. > improve integration test case for AllDataTypesTestCase4 > --- > > Key: CARBONDATA-435 > URL: https://issues.apache.org/jira/browse/CARBONDATA-435 > Project: CarbonData > Issue Type: Improvement >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-444) Improved integration test-case for AllDataTypesTestCase1
[ https://issues.apache.org/jira/browse/CARBONDATA-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-444. > Improved integration test-case for AllDataTypesTestCase1 > > > Key: CARBONDATA-444 > URL: https://issues.apache.org/jira/browse/CARBONDATA-444 > Project: CarbonData > Issue Type: Task >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-438) Add unit test for scan.scanner.impl package
[ https://issues.apache.org/jira/browse/CARBONDATA-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-438. > Add unit test for scan.scanner.impl package > --- > > Key: CARBONDATA-438 > URL: https://issues.apache.org/jira/browse/CARBONDATA-438 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Assignee: Kunal Kapoor >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-446) Add Unit Tests For Scan.collector.impl package
[ https://issues.apache.org/jira/browse/CARBONDATA-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-446. > Add Unit Tests For Scan.collector.impl package > -- > > Key: CARBONDATA-446 > URL: https://issues.apache.org/jira/browse/CARBONDATA-446 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-460) Add Unit Tests For core.writer.sortindex package
[ https://issues.apache.org/jira/browse/CARBONDATA-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-460. > Add Unit Tests For core.writer.sortindex package > - > > Key: CARBONDATA-460 > URL: https://issues.apache.org/jira/browse/CARBONDATA-460 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-472) Improve code coverage for core.cache package.
[ https://issues.apache.org/jira/browse/CARBONDATA-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-472. > Improve code coverage for core.cache package. > - > > Key: CARBONDATA-472 > URL: https://issues.apache.org/jira/browse/CARBONDATA-472 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Assignee: Kunal Kapoor >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-445) Improved integration test-case for AllDataTypesTestCase3
[ https://issues.apache.org/jira/browse/CARBONDATA-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-445. > Improved integration test-case for AllDataTypesTestCase3 > - > > Key: CARBONDATA-445 > URL: https://issues.apache.org/jira/browse/CARBONDATA-445 > Project: CarbonData > Issue Type: Task >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-450) Increase Test Coverage for Core.reader module
[ https://issues.apache.org/jira/browse/CARBONDATA-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-450. > Increase Test Coverage for Core.reader module > - > > Key: CARBONDATA-450 > URL: https://issues.apache.org/jira/browse/CARBONDATA-450 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO > Fix For: 1.0.0-incubating > > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-483) Add Unit Tests For core.carbon.metadata package
[ https://issues.apache.org/jira/browse/CARBONDATA-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SWATI RAO closed CARBONDATA-483. > Add Unit Tests For core.carbon.metadata package > --- > > Key: CARBONDATA-483 > URL: https://issues.apache.org/jira/browse/CARBONDATA-483 > Project: CarbonData > Issue Type: Test >Reporter: SWATI RAO >Priority: Trivial > Fix For: 1.0.0-incubating > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (CARBONDATA-362) Optimize the parameters' name in CarbonDataRDDFactory.scala
[ https://issues.apache.org/jira/browse/CARBONDATA-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen resolved CARBONDATA-362. --- Resolution: Fixed Fix Version/s: 1.0.0-incubating > Optimize the parameters' name in CarbonDataRDDFactory.scala > --- > > Key: CARBONDATA-362 > URL: https://issues.apache.org/jira/browse/CARBONDATA-362 > Project: CarbonData > Issue Type: Bug >Reporter: Liang Chen >Assignee: He Xiaoqiao >Priority: Trivial > Fix For: 1.0.0-incubating > > > Optimize the parameters' name in CarbonDataRDDFactory.scala: > changes the name of "hdfsStoreLocation" to "storePath", because not only > support hdfs path. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 Build Success with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/660/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (CARBONDATA-379) Test Cases to be added for Scan package under org.apache.carbondata.core
[ https://issues.apache.org/jira/browse/CARBONDATA-379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DEEPAK MEHRA closed CARBONDATA-379. --- It has been resolved > Test Cases to be added for Scan package under org.apache.carbondata.core > > > Key: CARBONDATA-379 > URL: https://issues.apache.org/jira/browse/CARBONDATA-379 > Project: CarbonData > Issue Type: Test >Reporter: DEEPAK MEHRA >Priority: Trivial > Fix For: 1.0.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CARBONDATA-379) Test Cases to be added for Scan package under org.apache.carbondata.core
[ https://issues.apache.org/jira/browse/CARBONDATA-379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827928#comment-15827928 ] DEEPAK MEHRA commented on CARBONDATA-379: - It has been resolved > Test Cases to be added for Scan package under org.apache.carbondata.core > > > Key: CARBONDATA-379 > URL: https://issues.apache.org/jira/browse/CARBONDATA-379 > Project: CarbonData > Issue Type: Test >Reporter: DEEPAK MEHRA >Priority: Trivial > Fix For: 1.0.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #443: [CARBONDATA-534] Written the test ca...
Github user HarshSharma8 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/443 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #437: [CARBONDATA-533] Written the unit te...
Github user HarshSharma8 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/437 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #456: [CARBONDATA-553] Written the integra...
Github user HarshSharma8 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/456 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #445: [CARBONDATA-543] Write unit test cas...
Github user harmeetsingh0013 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/445 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #331: [CARBONDATA-396] Implement test case...
Github user harmeetsingh0013 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/331 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #444: [CARBONDATA -541] Tescases for dicti...
Github user deepakmehra10 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/444 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #430: [CARBONDATA -515] Test cases for con...
Github user deepakmehra10 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/430 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #464: [Carbondata-551] Test cases for prco...
Github user deepakmehra10 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/464 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655][CARBONDATA-604]Make no ket...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/659/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #540: [CARBONDATA-654] Add data update and deleti...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/540 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/658/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #550: [CARBONDATA-624] Complete CarbonData docume...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/550 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #550: [CARBONDATA-624] Complete CarbonData...
GitHub user sgururajshetty opened a pull request: https://github.com/apache/incubator-carbondata/pull/550 [CARBONDATA-624] Complete CarbonData document in md files Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/sgururajshetty/incubator-carbondata master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/550.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #550 commit fab13bd15fd8196c25889c4e5734773555e0b384 Author: sgururajshetty Date: 2017-01-09T12:06:03Z Document update for UID Two new DML commands added as part of the UID UPDATE CARBON TABLE DELETE RECORDS from CARBON TABLE commit 6408094a9ba1dc7c52cfddec4b1f1d9ff4a0431d Author: sgururajshetty Date: 2017-01-10T05:58:46Z Merge branch 'master' into master commit 9466537be49f4a06e75f10c56e3ea8c7d00d7eb5 Author: sgururajshetty Date: 2017-01-10T06:02:45Z Hyperlink fixed Some reference information removed. commit bf61c596a533b1db9a1a6a777d3de30994b1ad4b Author: sgururajshetty Date: 2017-01-10T06:14:35Z Example refined commit 59baa3163a7d63eef4ec2cef606cc88ea90c421f Author: sgururajshetty Date: 2017-01-18T11:26:28Z [CARBONDATA-624] Complete CarbonData document in md files Complete CarbonData documentation in md files --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata issue #547: [CARBONDATA-656]Simplify the carbon session...
Github user ravipesala commented on the issue: https://github.com/apache/incubator-carbondata/pull/547 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (CARBONDATA-639) "Delete data" feature doesn't work
[ https://issues.apache.org/jira/browse/CARBONDATA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen closed CARBONDATA-639. - Resolution: Duplicate > "Delete data" feature doesn't work > -- > > Key: CARBONDATA-639 > URL: https://issues.apache.org/jira/browse/CARBONDATA-639 > Project: CarbonData > Issue Type: Bug > Components: core >Affects Versions: 1.0.0-incubating >Reporter: Liang Chen >Assignee: sounak chakraborty > Fix For: 1.0.0-incubating > > > 1.Version:CarbonData is the latest master , Spark 1.6.2 > 2.Test Environment: spark-shell with command of ./bin/spark-shell --master > local --jars ${carbondata_jar},${mysql_jar} > 3.Reproduce steps: > 1.Finish load data , query as below : cc.sql("select * from connectdemo1 > where age > 40").show() : > +--+--++---+---+ > | name|gender|province|singler|age| > +--+--++---+---+ > |Abbott|Female| AB| false| 54| > |Abbott|Female| AB| false| 51| > |Abbott|Female| AB| false| 65| > |Abbott|Female| AB| false| 47| > |Abbott|Female| AB| false| 56| > |Abbott|Female| AB| false| 54| > |Abbott|Female| AB| false| 61| > |Abbott|Female| AB| false| 58| > |Abbott|Female| AB| false| 62| > |Abbott|Female| AB| false| 47| > |Abbott|Female| AB| false| 49| > |Abbott|Female| AB| false| 53| > |Abbott|Female| AB| false| 63| > |Abbott|Female| AB| false| 48| > |Abbott|Female| AB| false| 52| > |Abbott|Female| AB| false| 52| > |Abbott|Female| AB| false| 62| > |Abbott|Female| AB| false| 61| > |Abbott|Female| AB| false| 63| > |Abbott|Female| AB| false| 49| > +--+--++---+---+ > cc.sql("select count(*) from connectdemo1").show() > +---+ > |_c0| > +---+ > |900| > +---+ > 2.cc.sql("delete from connectdemo1 where age > 60").show > 3.query again with cc.sql("select * from connectdemo1 where age > 40").show() > and cc.sql("select count(*) from connectdemo1").show() : same result with > before deletion , so the delete operation is failed. > +--+--++---+---+ > | name|gender|province|singler|age| > +--+--++---+---+ > |Abbott|Female| AB| false| 54| > |Abbott|Female| AB| false| 51| > |Abbott|Female| AB| false| 65| > |Abbott|Female| AB| false| 47| > |Abbott|Female| AB| false| 56| > |Abbott|Female| AB| false| 54| > |Abbott|Female| AB| false| 61| > |Abbott|Female| AB| false| 58| > |Abbott|Female| AB| false| 62| > |Abbott|Female| AB| false| 47| > |Abbott|Female| AB| false| 49| > |Abbott|Female| AB| false| 53| > |Abbott|Female| AB| false| 63| > |Abbott|Female| AB| false| 48| > |Abbott|Female| AB| false| 52| > |Abbott|Female| AB| false| 52| > |Abbott|Female| AB| false| 62| > |Abbott|Female| AB| false| 61| > |Abbott|Female| AB| false| 63| > |Abbott|Female| AB| false| 49| > +--+--++---+---+ > +---+ > |_c0| > +---+ > |900| > +---+ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #510: Document update for UID
Github user sgururajshetty commented on the issue: https://github.com/apache/incubator-carbondata/pull/510 @jackylk the review comments is been incorporated in the new md files. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #510: Document update for UID
Github user sgururajshetty closed the pull request at: https://github.com/apache/incubator-carbondata/pull/510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (CARBONDATA-399) [Bad Records] Data Load is not FAILED even bad_records_action="FAIL" .
[ https://issues.apache.org/jira/browse/CARBONDATA-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827844#comment-15827844 ] Akash R Nilugal commented on CARBONDATA-399: This issue is related to https://github.com/apache/incubator-carbondata/pull/332 . It gets resolved with PR-332. > [Bad Records] Data Load is not FAILED even bad_records_action="FAIL" . > --- > > Key: CARBONDATA-399 > URL: https://issues.apache.org/jira/browse/CARBONDATA-399 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 0.1.0-incubating > Environment: SUSE 11 SP4 > YARN HA > 3 Nodes >Reporter: Babulal >Assignee: Akash R Nilugal >Priority: Minor > > Data Load is not FAILED when string data are loaded in the int column . > 1. Create table defect_5 (imei string ,deviceInformationId int,mac > string,productdate timestamp,updatetime timestamp,gamePointId > double,contractNumber double) stored by 'carbondata' > TBLPROPERTIES('DICTIONARY_INCLUDE'='deviceInformationId') ; > deviceInformationId is int ( it will handled as dimension). Now load the > data > 2. 0: jdbc:hive2://ha-cluster/default> LOAD DATA inpath > 'hdfs://hacluster/tmp/100_default_date_11_header_2.csv' into table defect_5 > options('DELIMITER'=',', 'bad_records_action'='FAIL', > 'QUOTECHAR'='"','FILEHEADER'='imei,deviceinformationid,mac,productdate,updatetime,gamepointid,contractnumber'); > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (0.969 seconds) > 3. Data > imei,deviceinformationid,mac,productdate,updatetime,gamepointid,contractnumber > 1AA1,babu,Mikaa1,2015-01-01 11:00:00,2015-01-01 13:00:00,10,260 > 1AA2,3,Mikaa2,2015-01-02 12:00:00,2015-01-01 14:00:00,278,230 > 1AA3,1,Mikaa1,2015-01-03 13:00:00,2015-01-01 15:00:00,2556,1 > 1AA4,10,Mikaa2,2015-01-04 14:00:00,2015-01-01 16:00:00,640,254 > 1AA5,10,Mikaa,2015-01-05 15:00:00,2015-01-01 17:00:00,980,256 > 1AA6,10,Mikaa,2015-01-06 16:00:00,2015-01-01 18:00:00,1,2378 > 1AA7,10,Mikaa,2015-01-07 17:00:00,2015-01-01 19:00:00,96,234 > 1AA8,9,max,2015-01-08 18:00:00,2015-01-01 20:00:00,89,236 > 1AA9,10,max,2015-01-09 19:00:00,2015-01-01 21:00:00,198.36,239.2 > Expect Outoput:- Data Load should FAIL > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (CARBONDATA-604) Use Kettle wrong option in Thrift server give wrong error message
[ https://issues.apache.org/jira/browse/CARBONDATA-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala reassigned CARBONDATA-604: -- Assignee: Ravindra Pesala (was: Manish Gupta) > Use Kettle wrong option in Thrift server give wrong error message > - > > Key: CARBONDATA-604 > URL: https://issues.apache.org/jira/browse/CARBONDATA-604 > Project: CarbonData > Issue Type: Bug > Environment: Spark 1.6 >Reporter: Harmeet Singh >Assignee: Ravindra Pesala >Priority: Trivial > > I am using Thrift Server with following configuration: > -Duse.kettle=default > Here kettle value is wrong and when I run the thrift server, the thrift > server is running successfully. After that, I am going to start beeline. In > beeline, I am executing load command without any kettle option as below: > LOAD DATA INPATH 'hdfs://localhost:54310/csvs/3000_UniqData.csv' into table > uniqdata OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1'); > After executing above command, I am getting Error: > java.lang.IllegalArgumentException: For input string: "default" > (state=,code=0) > This error, seems to be wrong, because I am not using any default value in > load query, and default is used with thrift. > So I have following Suggestions: > 1. Change the error message, while load query is executing. > 2. While starting thrift server with wrong value, thrift give us an error and > not start. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata issue #546: [CARBONDATA-655]Make no kettle dataload flo...
Github user CarbonDataQA commented on the issue: https://github.com/apache/incubator-carbondata/pull/546 Build Failed with Spark 1.6.2, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/657/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---