[GitHub] incubator-carbondata-site issue #2: Home Page changes

2016-12-19 Thread sgururajshetty
Github user sgururajshetty commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/2 @chenliang613 please review the changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Created] (CARBONDATA-545) Carbon Query GC Problem

2016-12-19 Thread kumar vishal (JIRA)
kumar vishal created CARBONDATA-545: --- Summary: Carbon Query GC Problem Key: CARBONDATA-545 URL: https://issues.apache.org/jira/browse/CARBONDATA-545 Project: CarbonData Issue Type:

Re: [Improvement] Carbon query gc problem

2016-12-19 Thread An Lan
+1, I have suffered from gc problem. As I understand, the BatchResult will be cached and continue to be kept in memory for a little long term, which cause a lot of data be moved from Young to Old. It is better to move it to off-heap. 2016-12-20 11:57 GMT+08:00 ZhuWilliam :

Re: [Improvement] Carbon query gc problem

2016-12-19 Thread ZhuWilliam
+1 Heap should not store data ,it should be used to store runtime temp data. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Improvement-Carbon-query-gc-problem-tp4322p4718.html Sent from the Apache CarbonData Mailing List archive mailing

Re: [Improvement] Carbon query gc problem

2016-12-19 Thread Liang Chen
Hi+1,Store data in offheap to avoid gc problem , the solution will help performance more. Kumar Vishal wrote > There are lots of gc when carbon is processing more number of > recordsduring query, which is impacting carbon query performance.To solve > this gcproblem happening when query output is

?????? InvalidInputException when loading data to table

2016-12-19 Thread 251469031
OK, thx~ It's a local path, well, in the error log, it shows that the dataFilePath is set to /home/hadoop/carbondata/sample.csv, and it is where my test file located. @see the log: Input path does not exist: /home/hadoop/carbondata/sample.csv in the following command, is the package of

Re: [DISCUSSION] CarbonData loading solution discussion

2016-12-19 Thread Kumar Vishal
+1 Now user will have flexibility to choose the output format.Will get performance benefit if dictionary files are already generated. -Regards Kumar Vishal On Fri, Dec 16, 2016 at 10:19 AM, Ravindra Pesala wrote: > +1 to have separate output formats, now user can have

?????? How to compile the latest source code of carbondata

2016-12-19 Thread 251469031
Thx liang. I solve the problem. In the file carbon-spark-shell, FWDIR was set to $SPARK_HOME. I have configure the $SPARK_HOME in /etc/profile and the output of command "echo $SPARK_HOME" is correct, which mean the $SPARK_HOME has been set. But if I don't run the command "export