oozie installation error
hi All, I am trying to install oozie and getting following error. Any input is appreciated [INFO] BUILD FAILURE [INFO] [INFO] Total time: 18.326s [INFO] Finished at: Wed Sep 24 13:45:13 EDT 2014 [INFO] Final Memory: 26M/64M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-jar-plugin:2.3.1:jar (default-jar) on project oozie-client: Error assembling JAR: Failed to read filesystem attributes for: /home/user/oozie/client/pom.xml: Failed to retrieve numeric file attributes using: '/bin/sh -c ls -1nlad /home/user/oozie/client/pom.xml': Error while executing process. Cannot run program /bin/sh: java.io.IOException: error=12, Cannot allocate memory - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :oozie-client ERROR, Oozie distro creation failed
HiveException: Stateful expressions cannot be used inside of CASE
Hi Hive Users: I have a hive generic hive udf which is called protect_column. The udf works fine when I call it along. But when I run the following query: select case when id = 5 then protect_column(id, 'age', 12L) else id end from one_row_table ; It says Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Stateful expressions cannot be used inside of CASE I was reading the source code. And I think it is related to GenericCase and GenericWhen according to https://svn.apache.org/repos/asf/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java?p=1197837 Could anyone help explain explicitly what exactly is genericCase GenericWhen and why we cannot put the udf inside a case when ? Thanks for your time helping me out Best Dan
Suppress deprecated INFO message on hive startup
How do I suppress deprecated INFO on hive startup? -bash-4.1$ hive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative 14/09/24 05:58:17 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local nolonger has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connec ting to a remote metastore. Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-5.1.0-1.cdh5.1.0.p0.53/lib/hive/lib/hive-common-0.12.0-cdh5.1.0.jar!/hive-log4j.properties
Re: Suppress deprecated INFO message on hive startup
These are coming from hadoop. You can turn them off by changing the property org.apache.hadoop.conf.Configuration.deprecation in log4j.properties. # Uncomment the following line to turn off configuration deprecation warnings. # log4j.logger.org.apache.hadoop.conf.Configuration.deprecation=WARN ~Pratik On Wed, Sep 24, 2014 at 3:55 PM, Manoj Prasad manpr...@adobe.com wrote: How do I suppress deprecated INFO on hive startup? -bash-4.1$ hive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 14/09/24 05:58:16 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative 14/09/24 05:58:17 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local nolonger has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connec ting to a remote metastore. Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-5.1.0-1.cdh5.1.0.p0.53/lib/hive/lib/hive-common-0.12.0-cdh5.1.0.jar!/hive-log4j.properties
cannot find symbol: class DataInputByteBuffer
Am facing compilation error when running the following command. Any insights into this will be helpful. $ MAVEN_OPTS=-Xmx512m mvn clean install -DskipTests -Phadoop-1 [ERROR] COMPILATION ERROR : [INFO] - [ERROR] /Users/pkhadloya/OtherProjects/hive/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/CustomPartitionVertex.java:[37,27] cannot find symbol symbol : class DataInputByteBuffer location: package org.apache.hadoop.io [INFO] 1 error [INFO] - [INFO] [INFO] Reactor Summary: [INFO] [INFO] Hive .. SUCCESS [ 1.575 s] [INFO] Hive Shims Common . SUCCESS [ 1.483 s] [INFO] Hive Shims 0.20 ... SUCCESS [ 0.520 s] [INFO] Hive Shims Secure Common .. SUCCESS [ 0.735 s] [INFO] Hive Shims 0.20S .. SUCCESS [ 0.398 s] [INFO] Hive Shims 0.23 ... SUCCESS [ 1.004 s] [INFO] Hive Shims SUCCESS [ 0.184 s] [INFO] Hive Common ... SUCCESS [ 1.679 s] [INFO] Hive Serde SUCCESS [ 1.725 s] [INFO] Hive Metastore SUCCESS [ 7.183 s] [INFO] Hive Ant Utilities SUCCESS [ 0.192 s] [INFO] Hive Query Language ... FAILURE [ 11.413 s] Thanks, ~Pratik
