Hi,
There are some known issues and blockers of 2.4.1 release.
You can check it with the following query of JIRAs:
(project = Hadoop Common OR project = Hadoop HDFS OR project =
Hadoop YARN OR project = Hadoop Map/Reduce) AND Target Version/s
= 2.4.1 AND priority = Blocker
YARN-1929 and
Second attempt.
On Thu, Apr 17, 2014 at 6:44 PM, Manoj Samel manojsamelt...@gmail.comwrote:
Hi,
Following seq is done
hdfs dfs -mkdir /a
take snapshot s_0
hdfs dfs -mkdir -p /a/b/c
hdfs dfs -put foo /a/b/c
take snapshot s_1
Now the command line snapshotdiff between s_0 and s_1 shows
Hi Experts,
After I changed the column names in hive table,m the result showing all
null values with new column names, if i query with select * from table
giving the actual values result, what could be the problem please explain
what should i do now, help me.
--
Thanks,
Kishore.
You would get help from Hive user mailing list:
https://hive.apache.org/mailing_lists.html
Cheers
On Fri, Apr 18, 2014 at 8:27 AM, kishore alajangi alajangikish...@gmail.com
wrote:
Hi Experts,
After I changed the column names in hive table,m the result showing all
null values with new
Thanks for the tip. May be it's a different setting I need. Let me explain
the problem.
I get an heap error on the command line - Exception in thread main
java.lang.OutOfMemoryError: Java heap space. It woks when I set export
HADOOP_HEAPSIZE=4096 in my env. But how can I set it via the hadoop
You can pass hadoop conf properties through the -D option. Have you seen
this?
http://stackoverflow.com/questions/15490090/how-to-specify-system-property-in-hadoop-except-modify-hadoop-env-sh
This is not for system properties. The assumption is that you want to
specify hadoop conf property
Hi,
This is just to check with you, if it is possible to call MR jobs from Java
Webservices.
If yes, then could you please help me by pointing to some resouces/docs.
Actually, what I intend to do is create a Web UI with some functionality
which would call MR jobs and present the
Question: M/R jobs are supposed to run for a long time. They are
essentially batch processes. Do you plan to keep the Web UI blocked for
that while? Or are you looking for asynchronous invocation of the M/R job?
Or are you thinking about building sort of an Admin UI (e.g. PigLipstick)
What exactly
I guess then the question is, how do I set the (system?) property and what
property exactly is this?
export HADOOP_HEAPSIZE=4096 - Works from the environment.
And none of the following seem to work from the command line.
-Xmx4G
-Dmapred.child.java.opts=-Xmx4G
-DHADOOP_HEAPSIZE=4096
HADOOP_HEAPSIZE and HADOOP_OPTS are not hadoop properties. These seem to
be environment variables of the shell script.
Try this with a space between -D and the property name (
-Dmapred.child.java.opts)
See the properties available (for mrv1) here:
Hi Andy,
This is a client side property that you can set in hadoop-env.sh
(/etc/hadoop/conf). The hadoop script (/bin/hadoop)
itself, which is a bash shell script, contains code like the following.
if [ $HADOOP_HEAPSIZE != ]; then
#echo run with heapsize $HADOOP_HEAPSIZE
As far as I know there is no API to kick of M/R jobs. There is for M/R v2,
a REST API to get status of jobs:
http://hadoop.apache.org/docs/r2.3.0/hadoop-yarn/hadoop-yarn-site/MapredAppMasterRest.html#Mapreduce_Application_Master_Info_API
I would say that you have invoke M/R jobs in your middle
Play framework is reactive and uses push channels. It may be useful here if
the UI has to be asynchronous and reactive.
Mohan
On Sat, Apr 19, 2014 at 4:37 AM, Shahab Yunus shahab.yu...@gmail.comwrote:
As far as I know there is no API to kick of M/R jobs. There is for M/R v2,
a REST API to
13 matches
Mail list logo
