> Are there any frameworks like TPC-DS to benchmark Hive ACID functionality?
Are you trying to work on and improve Hive ACID?
I have a few ACID micro-benchmarks like this
https://github.com/t3rmin4t0r/acid2x-jmh
so that I can test the inner loops of ACID without having any ORC data at all.
h
Are there any frameworks like TPC-DS to benchmark Hive ACID functionality?
I would suggest removing -Pdist in the initial mvn command. That should
only be used to build tarballs for distribution. So your initial mvn
command should just be:
mvn clean install -DskipTests
Alan.
On Sat, Sep 23, 2017 at 3:55 AM, eric wong wrote:
> I try to add some q file test to hive, s
> Caused by:
> org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionError:
> VectorMapJoin Hash table loading exceeded memory limits.
> estimatedMemoryUsage: 1644167752 noconditionalTaskSize: 463667612
> inflationFactor: 2.0 threshold: 927335232 effectiveThreshold: 927335232
Most lik
Hi, I am trying to run one of the TPC-DS queries, query25 against a 25GB
dataset (my instance memory size is 64GB) and I get this error,
Caused by: org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionError:
VectorMapJoin Hash table loading exceeded memory limits. estimatedMemoryUsage:
Hello.
Hive would create a new Tez AM to coordinate the query (or use an existing
one if HS2 session pool is used). However, the YARN app for Tez should
only have a single container. Is this not the case?
If it’s running additional containers, what is hive.llap.execution.mode
set to? It should be s
'Pending' count of 4 for long time suggests that you may have to check the
cluster capacity.
~Rajesh.B
On Sun, Sep 24, 2017 at 7:41 AM, Krishnanand Khambadkone <
kkhambadk...@yahoo.com> wrote:
> Hi, I am trying to run a small 4GB TPC-DS test using the hortonworks
> hive-testbench framework. I
