Re: Hive compilation error

Yes, I executed this command without success. On 10/01/2015 08:35 PM, Jimmy Xiang wrote: > Have you tried "mvn -U clean install -DskipTests -Pdist,hadoop-2"? > > On Thu, Oct 1, 2015 at 12:38 AM, Giannis Giannakopoulos > mailto:gg...@cslab.ece.ntua.gr>> wrote: > > Hello, > > thank you fo

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh! Thanks Carl for your contribution and leadership over the last few years! Zheng On Wed, Sep 16, 2015 at 12:50 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Congratulations Ashutosh! > > > > > > On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang

Re: Getting dot files for DAGs

I don’t believe the binary should need changing at all unless you need enhancements from recent commits. It should just be setting up the UI and configuring Tez for using YARN Timeline. The instructions that you can follow: http://tez.apache.org/tez-ui.html http://tez.apache.org/tez_yarn_ti

Re: Getting dot files for DAGs

Thanks for suggesting, I never used Tez UI before, and learned about it yesterday. I am trying to find out how I can enable/use it. Apparently it needs some changes in the binary that I am using (I had built the binary for tez 0.7 almost 2 months ago). On Wed, Sep 30, 2015 at 10:27 PM, Jörn Fra

Re: Better way to do UDF's for Hive

You can define them in groovy from inside the CLI... https://gist.github.com/mwinkle/ac9dbb152a1e10e06c16 On Thu, Oct 1, 2015 at 12:57 PM, Ryan Harris wrote: > If you want to use python... > > The python script should expect tab-separated input on stdin and it should > return tab-separated deli

Re: Hive compilation error

Have you tried "mvn -U clean install -DskipTests -Pdist,hadoop-2"? On Thu, Oct 1, 2015 at 12:38 AM, Giannis Giannakopoulos < gg...@cslab.ece.ntua.gr> wrote: > Hello, > > thank you for your prompt response. I tried to compile with those > options (also run mvn clean first) but I keep getting the s

RE: Better way to do UDF's for Hive

If you want to use python... The python script should expect tab-separated input on stdin and it should return tab-separated delimited columns for the output... add file mypython.py; SELECT TRANSFORM (tbl.id, tbl.name, tbl.city) USING 'python mypython.py' AS (id, name, city, state) FROM my_db.my_

RE: Hive SerDe regex error

depending on how you are submitting the statement to hive, you'll probably need to escape the backslash... try replacing every \ with \\ From: IT CTO [mailto:goi@gmail.com] Sent: Thursday, October 01, 2015 6:25 AM To: user@hive.apache.org Subject: Re: Hive SerDe regex error Your Regex gives

Re: Better way to do UDF's for Hive

In case of single string input Java UDF can be easier to write: accept string parameter, lookup hash map and return. In case of Python you have to use TRANSFORM clause and handle all columns, so it will be hard to reuse your Python script as the code may depend on the column position. One other po

Re: Better way to do UDF's for Hive

Perhaps a macro? CREATE TEMPORARY MACRO state_from_city (city string) " + /* HQL column logic */ ...; On 1 October 2015 at 14:11, Daniel Lopes wrote: > Hi, > > I'd like to know the good way to do a a UDF for a single field, like > > SELECT > tbl.id AS id, > tbl.name AS name, > tbl.city A

Better way to do UDF's for Hive

Hi, I'd like to know the good way to do a a UDF for a single field, like SELECT tbl.id AS id, tbl.name AS name, tbl.city AS city, state_from_city(tbl.city) AS state FROM my_db.my_table tbl; *Native Java*? *Python *over *Hadoop* *Streaming*? I prefer Python, but I don't know how to do

Re: Failed to execute command on hive - Relative path in absolute URI

Hi, To call a hive conf, get by this: ${hiveconf:NAME_OF_PROPERTY} Bye *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannyeuu Av. N

Re: Hive SerDe regex error

Your Regex gives different results. I want the last part to capture the rest of the string. I also tried this CREATE EXTERNAL TABLE syslog ( month STRING, day STRING, time STRING, source STRING, process STRING, pid STRING, uname STRING, message STRING) COMMENT 'This is the syslog s

Re: Hive SerDe regex error

Hi, You didn't escape the ^ character at the end. Try using this string instead: ([^ ]*) ([^ ]*) ([^ ]*) ([^ ]*) ([^ \[]*)\[([^ ]*)\]: \(([^ ]*)\) ([\^]*) Daniel On Thu, Oct 1, 2015 at 3:17 PM, IT CTO wrote: > Hi, > I am trying to create a table with Regex SerDe but failing with no good > reaso

Hive SerDe regex error

Hi, I am trying to create a table with Regex SerDe but failing with no good reason: CREATE EXTERNAL TABLE syslog ( month STRING, day STRING, time STRING, source STRING, process STRING, pid STRING, uname STRING, message STRING) COMMENT 'This is the syslog sample table' ROW FORMAT SER

Re: Hive Server gets stucked with Load Data InPath

Hi Guys, Any ideas about HiverServer issue while the service is up and running for few days. org.apache.thrift.TApplicationException: Internal error processing execute at org.apache.thrift.TApplicationException.read(TApplicationException.java:108) at org.apache.thrift.TServiceClie

Re: Hive compilation error

Hello, thank you for your prompt response. I tried to compile with those options (also run mvn clean first) but I keep getting the same output. Any other suggestions? Thanks again, Giannis On 10/01/2015 10:24 AM, Jitendra Yadav wrote: > Try with below options > > mvn clean install -DskipTests

Re: Hive compilation error

Try with below options mvn clean install -DskipTests -Pdist,hadoop-1 ( on MR1) or mvn clean install -DskipTests -Pdist,hadoop-2 ( on YARN) Thx On Thu, Oct 1, 2015 at 12:14 AM, Giannis Giannakopoulos < gg...@cslab.ece.ntua.gr> wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > >

Hive compilation error

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi all, I am trying to compile hive from source, but I get the following error: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project hive-storage-api: Compilation failure: Compilation