disable jython logging for pig embedded in python

2014-05-15 Thread Jerry Lam
Hi pig users, does anyone know how to disable jython logging? More specifically, when I run a pig script that is embedded in python, I constantly see logs like the following: *sys-package-mgr*: processing new jar, '/usr/lib/hadoop/lib/guava-11.0.2.jar' *sys-package-mgr*: processing new jar, '/usr

Re: How to run a PigUnit test with minimal output?

2014-05-15 Thread Serega Sheypak
What build tool do you use? Did you try to add log4.properties to test scope (if you use maven) with root level=ERROR 2014-05-13 19:09 GMT+04:00 Moshe Sayag : > Hi, > > When I run a PigUnit test, the full script is printed to stdout / log. > > Is there a way to run a test with minimal output, in

Frequency count in pig

2014-05-15 Thread Chengi Liu
Hi, My data is in format: user_id,movie_id,timestamp 123, abc,unix_timestamp 123, def, ... 123, abc, ... 234, sda, ... Now, I want to compute the number of times each movie is played in pig.. So the output I am expecting is: 123,abc,2 123,def,1 234,sda,1 and s