Github user sgururajshetty commented on the issue:
https://github.com/apache/incubator-carbondata-site/pull/2
@chenliang613 please review the changes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
kumar vishal created CARBONDATA-545:
---
Summary: Carbon Query GC Problem
Key: CARBONDATA-545
URL: https://issues.apache.org/jira/browse/CARBONDATA-545
Project: CarbonData
Issue Type:
+1, I have suffered from gc problem. As I understand, the BatchResult will
be cached and continue to be kept in memory for a little long term, which
cause a lot of data be moved from Young to Old. It is better to move it to
off-heap.
2016-12-20 11:57 GMT+08:00 ZhuWilliam :
+1 Heap should not store data ,it should be used to store runtime temp
data.
--
View this message in context:
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Improvement-Carbon-query-gc-problem-tp4322p4718.html
Sent from the Apache CarbonData Mailing List archive mailing
Hi+1,Store data in offheap to avoid gc problem , the solution will help
performance more.
Kumar Vishal wrote
> There are lots of gc when carbon is processing more number of
> recordsduring query, which is impacting carbon query performance.To solve
> this gcproblem happening when query output is
OK, thx~
It's a local path, well, in the error log, it shows that the dataFilePath is
set to /home/hadoop/carbondata/sample.csv, and it is where my test file
located. @see the log:
Input path does not exist: /home/hadoop/carbondata/sample.csv
in the following command, is the package of
+1
Now user will have flexibility to choose the output format.Will get
performance benefit if dictionary files are already generated.
-Regards
Kumar Vishal
On Fri, Dec 16, 2016 at 10:19 AM, Ravindra Pesala
wrote:
> +1 to have separate output formats, now user can have
Thx liang.
I solve the problem.
In the file carbon-spark-shell, FWDIR was set to $SPARK_HOME. I have configure
the $SPARK_HOME in /etc/profile and the output of command "echo $SPARK_HOME" is
correct, which mean the $SPARK_HOME has been set.
But if I don't run the command "export