That might be the truth. When I switched to a 4gb node it just worked.
Thanks
On Tue, Mar 29, 2022 at 8:49 PM Pau Tallada wrote:
> I don't know what to say.
> It it fails of OutOfMemory, then you have to assign more memory to it.
>
> Also a, 2GB VM for a hadoop node is too tiny. Hadoop
I don't know what to say.
It it fails of OutOfMemory, then you have to assign more memory to it.
Also a, 2GB VM for a hadoop node is too tiny. Hadoop ecosystem is usually
memory-intensive
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:46:
> Yes, a quite small table with 1 rows
Yes, a quite small table with 1 rows for test purposes.
Thanks
On Tue, Mar 29, 2022 at 8:43 PM Pau Tallada wrote:
> Hi,
>
> I think it depends a lot on the data volume you are trying to process.
> Does it work with a smaller table?
>
> Missatge de Bitfox del dia dt., 29 de març 2022 a les
Hi,
I think it depends a lot on the data volume you are trying to process.
Does it work with a smaller table?
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:39:
> 0: jdbc:hive2://localhost:1/default> set hive.tez.container.size=1024;
>
> No rows affected (0.027 seconds)
>
>
> 0:
0: jdbc:hive2://localhost:1/default> set hive.tez.container.size=1024;
No rows affected (0.027 seconds)
0: jdbc:hive2://localhost:1/default> set hive.execution.engine;
+---+
|set|
+---+
|
I assume you have to increase container size (if using tez/yarn)
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:30:
> My hive run out of memory even for a small query:
>
> 2022-03-29T20:26:51,440 WARN [Thread-1329] mapred.LocalJobRunner:
> job_local300585280_0011
>
>
My hive run out of memory even for a small query:
2022-03-29T20:26:51,440 WARN [Thread-1329] mapred.LocalJobRunner:
job_local300585280_0011
java.lang.Exception: java.lang.OutOfMemoryError: Java heap space
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:492)
