[jira] [Commented] (PIG-4059) Pig on Spark

2017-05-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16029733#comment-16029733 ] Julien Le Dem commented on PIG-4059: Congrats all! Thanks [~rohini]! > Pig o

[jira] [Assigned] (PIG-2845) Configure hadoop.tmp.dir under build/tmp for MiniCluster tests

2017-02-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned PIG-2845: -- Assignee: (was: Julien Le Dem) > Configure hadoop.tmp.dir under build/tmp for MiniClus

[jira] [Assigned] (PIG-2914) Logs from MiniCluster are too verbose in tests

2017-02-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem reassigned PIG-2914: -- Assignee: (was: Julien Le Dem) > Logs from MiniCluster are too verbose in te

Re: Where is parquet.pig.ParquetStorer

2017-01-16 Thread Julien Le Dem
packages have been renamed after move to ASF: https://github.com/apache/parquet-mr/blob/master/parquet-pig/src/main/java/org/apache/parquet/pig/ParquetStorer.java > On Jan 15, 2

[jira] [Commented] (PIG-3764) Compile physical operators to bytecode

2016-07-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365633#comment-15365633 ] Julien Le Dem commented on PIG-3764: [~rohini] This sounds good. It does not have t

Re: Welcome our new Pig PMC chair Rohini Palaniswamy

2015-03-19 Thread Julien Le Dem
Congrats Rohini! On Mar 18, 2015, at 6:48 PM, Cheolsoo Park wrote: > Hi all, > > Now it's official that Rohini Palaniswamy is our new Pig PMC chair. Please > join me in congratulating Rohini for her new role. Congrats! > > Thanks! > Cheolsoo

[jira] [Created] (PIG-4219) When parsing a schema, pig drops tuple inside of Bag if it contains only one field

2014-10-01 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-4219: -- Summary: When parsing a schema, pig drops tuple inside of Bag if it contains only one field Key: PIG-4219 URL: https://issues.apache.org/jira/browse/PIG-4219 Project

Re: [VOTE] Drop support for Hadoop 0.20 from Pig 0.14

2014-09-17 Thread Julien Le Dem
+1 Julien > -Original Message- > From: Rohini Palaniswamy [mailto:rohini.adi...@gmail.com] > Sent: Wednesday, September 17, 2014 12:38 PM > To: dev@pig.apache.org > Subject: [VOTE] Drop support for Hadoop 0.20 from Pig 0.14 > > Hi, > Hadoop has matured far from Hadoop 0.20 and has had

Re: [VOTE] Drop support for JDK 6 from Pig 0.14

2014-09-16 Thread Julien Le Dem
+1 On Tuesday, September 16, 2014, Rohini Palaniswamy wrote: > Hi, >Hadoop is dropping support for JDK6 from hadoop-2.7 this year as > mentioned in the mail below. Pig should also move to JDK7 to be able to > compile against future hadoop 2.x releases and start making releases with > jars (b

[jira] [Commented] (PIG-3760) Predicate pushdown for columnar file formats

2014-07-31 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081948#comment-14081948 ] Julien Le Dem commented on PIG-3760: FYI in Parquet the filter is not a hint an

[jira] [Updated] (PIG-4092) Predicate pushdown for Parquet

2014-07-31 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-4092: --- Description: See: https://github.com/apache/incubator-parquet-mr/pull/4 and: https://github.com/apache

[jira] [Updated] (PIG-4092) Predicate pushdown for Parquet

2014-07-31 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-4092: --- Description: See: https://github.com/apache/incubator-parquet-mr/pull/4 and: https://github.com/apache

[jira] [Commented] (PIG-3760) Predicate pushdown for columnar file formats

2014-07-31 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081944#comment-14081944 ] Julien Le Dem commented on PIG-3760: [~rohini] I added to the description of PIG-

[jira] [Commented] (PIG-3913) Pig should use job's jobClient wherever possible (fixes local mode counters)

2014-04-29 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985005#comment-13985005 ] Julien Le Dem commented on PIG-3913: This looks good to me. Please add javadoc

Congratulations to Cheolsoo Park the new Apache Pig project chair

2014-03-19 Thread Julien Le Dem
Congrats Cheolsoo, This is well deserved. Julien

[jira] [Commented] (PIG-3815) Hadoop bug causes to pig to fail silently with jar cache

2014-03-18 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939749#comment-13939749 ] Julien Le Dem commented on PIG-3815: [~rohini] in the code you quoted, don't

[jira] [Commented] (PIG-3815) Hadoop bug causes to pig to fail silently with jar cache

2014-03-18 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939606#comment-13939606 ] Julien Le Dem commented on PIG-3815: same comment as 1. from Cheolsoo otherwise,

[jira] [Commented] (PIG-3801) Auto local mode does not call storeSchema

2014-03-10 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13926350#comment-13926350 ] Julien Le Dem commented on PIG-3801: I would use properties.getProp

[jira] [Commented] (PIG-3801) Auto local mode does not call storeSchema

2014-03-10 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13926351#comment-13926351 ] Julien Le Dem commented on PIG-3801: +1 > Auto local mode does not call stor

[jira] [Commented] (PIG-3754) InputSizeReducerEstimator.getTotalInputFileSize reports incorrect size

2014-03-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923365#comment-13923365 ] Julien Le Dem commented on PIG-3754: LGTM

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-02-14 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13902218#comment-13902218 ] Julien Le Dem commented on PIG-3558: Is hive-exec the fat jar that assembles

Re: Pig 0.13.0 release

2014-02-13 Thread Julien Le Dem
ch to > a released version later. Seems that's much easier. > > On Thu, Feb 13, 2014 at 2:35 PM, Daniel Dai wrote: >> That works. I will roll a 0.14.0 release as soon as Hive 0.13.0 released. >> >> On Thu, Feb 13, 2014 at 2:25 PM, Julien Le Dem wrote: >>&g

Re: Pig 0.13.0 release

2014-02-13 Thread Julien Le Dem
.10.1 is totally independent in my opinion >>>>>>> >>>>>> I should have referenced my previous request on including 0.10.1 on >>> the >>>>>> top release page. >>>>>> http://www.mail-archive.com/dev@pig.apache.org/ms

[jira] [Updated] (PIG-2599) Mavenize Pig

2014-02-12 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2599: --- Labels: gsoc2014 (was: gsoc2013) > Mavenize Pig > > > K

Re: GSOC 2014

2014-02-12 Thread Julien Le Dem
t; - Rohini >> >> On Tue, Feb 11, 2014 at 11:49 AM, Julien Le Dem wrote: >> >>> Some project ideas: >>> - mavenize Pig (I know... but still, I think it should be done) >>> - Compile physical operators to bytecode. I have a prototype, that co

[jira] [Created] (PIG-3764) Compile physical operators to bytecode

2014-02-12 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3764: -- Summary: Compile physical operators to bytecode Key: PIG-3764 URL: https://issues.apache.org/jira/browse/PIG-3764 Project: Pig Issue Type: Improvement

Re: GSOC 2014

2014-02-11 Thread Julien Le Dem
Some project ideas: - mavenize Pig (I know... but still, I think it should be done) - Compile physical operators to bytecode. I have a prototype, that could be made real by a student: https://github.com/julienledem/pig/compare/trunk...compile_physical_plan Julien On Feb 11, 2014, at 9:42 AM

Re: Pig 0.13.0 release

2014-02-06 Thread Julien Le Dem
front release list, > I'd like to see minor release on 0.11 or 0.12 first. > > Koji > > > > > On Feb 6, 2014, at 4:25 PM, Cheolsoo Park > wrote: > >> +1 to 0.13 release. Why not if someone is volunteering? >> >> On Thu, Feb 6, 2014 at 4:0

Re: Pig 0.13.0 release

2014-02-06 Thread Julien Le Dem
To add to the discussion, I think we should release more often, based on time elapsed rather than volume of change. The more often we release, the easier it is to release. Also that makes it easier for contributors to use their own contributions in official releases. It is also probably a good id

[jira] [Commented] (PIG-3741) Utils.setTmpFileCompressionOnConf can cause side effect for SequenceFileInterStorage

2014-02-04 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891030#comment-13891030 ] Julien Le Dem commented on PIG-3741: Ideally each store would get its own config ob

Welcome to the newest Pig Committer - Mark Wagner

2014-01-31 Thread Julien Le Dem
It is my pleasure to announce that Mark Wagner became the newest addition to the Pig Committers! Mark has been actively contributing to Pig and in particular to the Pig-on-Tez effort. Please, join me in congratulating Mark!

[jira] [Commented] (PIG-3347) Store invocation brings side effect

2014-01-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887203#comment-13887203 ] Julien Le Dem commented on PIG-3347: I thought that the field UIDs were used to t

Welcome to the new Pig PMC member Aniket Mokashi

2014-01-14 Thread JULIEN LE DEM
It's my pleasure to announce that Aniket Mokashi became the newest addition to the Pig PMC. Aniket has been actively contributing to Pig for years. Please join me in congratulating Aniket! Julien

Re: Review Request 15852: PIG-3581 Incorrect scope resolution with nested foreach

2013-11-26 Thread Julien Le Dem
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15852/#review29456 --- Ship it! Ship It! - Julien Le Dem On Nov. 26, 2013, 2:22 a.m

Re: Review Request 14552: PIG-3480 TFile-based tmpfile compression crashes in some cases

2013-10-13 Thread Julien Le Dem
eption("unsupported format " + tmpFileCompressionStorage + ". Should be one of " + Arrays.toString(TEMPFILE_STORAGE.values())); } - Julien Le Dem On Oct. 12, 2013, 12:44 a.m., Aniket Mokashi wrote: > > --- > This i

Re: Review Request 14552: PIG-3480 TFile-based tmpfile compression crashes in some cases

2013-10-10 Thread Julien Le Dem
> On Oct. 10, 2013, 8:50 p.m., Julien Le Dem wrote: > > trunk/src/org/apache/pig/impl/util/Utils.java, line 259 > > <https://reviews.apache.org/r/14552/diff/3/?file=362607#file362607line259> > > > > We should throw an exception if the trimmed lowercased

Re: Review Request 14552: PIG-3480 TFile-based tmpfile compression crashes in some cases

2013-10-10 Thread Julien Le Dem
> On Oct. 10, 2013, 8:50 p.m., Julien Le Dem wrote: > > trunk/src/org/apache/pig/impl/util/Utils.java, line 259 > > <https://reviews.apache.org/r/14552/diff/3/?file=362607#file362607line259> > > > > We should throw an exception if the trimmed lowercased

Re: Review Request 14552: PIG-3480 TFile-based tmpfile compression crashes in some cases

2013-10-10 Thread Julien Le Dem
... } trunk/src/org/apache/pig/impl/util/Utils.java <https://reviews.apache.org/r/14552/#comment52338> else throw exception? we have a default if it's not set but we don't do anything if it's an inval

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785742#comment-13785742 ] Julien Le Dem commented on PIG-3445: I just released parquet-pig-bundle-1.2.3

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785610#comment-13785610 ] Julien Le Dem commented on PIG-3445: We merged the PR for parquet-pig-bundle I'

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785565#comment-13785565 ] Julien Le Dem commented on PIG-3445: parquet-format.version should be 1.0.0 &g

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785564#comment-13785564 ] Julien Le Dem commented on PIG-3445: I add a parquet-pig-bundle and the shadin

[jira] [Commented] (PIG-3082) outputSchema of a UDF allows two usages when describing a Tuple schema

2013-10-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785427#comment-13785427 ] Julien Le Dem commented on PIG-3082: This is intended. The second behavior descr

[jira] [Commented] (PIG-3446) Umbrella jira for Pig on Tez

2013-09-20 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773569#comment-13773569 ] Julien Le Dem commented on PIG-3446: Here is the work that Achal did for Pig-on

Re: Are we ready for Pig 0.12.0 release?

2013-09-20 Thread Julien Le Dem
I'd like to get PIG-3445 in too. Julien On Sep 20, 2013, at 3:03 PM, Daniel Dai wrote: > With regard to branching 0.12, I will try to commit PIG-2417 and Cheolsoo > will probably commit PIG-3471. After that I will branch 0.12, hopefully > over the weekend. Anything I miss? > > Thanks, > Daniel >

[jira] [Commented] (PIG-3367) Add assert keyword (operator) in pig

2013-09-17 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769985#comment-13769985 ] Julien Le Dem commented on PIG-3367: Looks good to me. Is there a way you can fa

[ANNOUNCE] Congratulations to our new PMC members Rohini Palaniswamy and Cheolsoo Park

2013-09-11 Thread Julien Le Dem
Please welcome Rohini Palaniswamy and Cheolsoo Park as our latest Pig PMC members. Congrats Rohini and Cheolsoo !

Re: Review Request 13781: Changes to add support for streaming_python udfs.

2013-09-04 Thread Julien Le Dem
's stackTrace src/org/apache/pig/impl/util/StorageUtil.java <https://reviews.apache.org/r/13781/#comment50575> why is that? - Julien Le Dem On Aug. 23, 2013, 8:19 p.m., Jeremy Karn wrote: > > --- > This is

Re: Parquet support built in Pig

2013-08-30 Thread Julien Le Dem
2013 at 4:47 PM, Russell Jurney > wrote: > >> I think this is awesome. Best thing since diet sliced bread (they cut the >> slices thin). >> >> >> On Thu, Aug 29, 2013 at 4:36 PM, Julien Le Dem wrote: >> >>> Hello fellow Pig developers >>>

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13754975#comment-13754975 ] Julien Le Dem commented on PIG-3419: +1 [~cheolsoo] LGTM! > Pl

Parquet support built in Pig

2013-08-29 Thread Julien Le Dem
Hello fellow Pig developers I have opened a JIRA to add Parquet as a buit-in format in Pig: https://issues.apache.org/jira/browse/PIG-3445 Please let me know what you think. Julien

[jira] [Created] (PIG-3445) Make Parquet format available out of the box in Pig

2013-08-29 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3445: -- Summary: Make Parquet format available out of the box in Pig Key: PIG-3445 URL: https://issues.apache.org/jira/browse/PIG-3445 Project: Pig Issue Type

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-29 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753912#comment-13753912 ] Julien Le Dem commented on PIG-3419: [~cheolsoo]: thanks a lot for looking into

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-23 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749226#comment-13749226 ] Julien Le Dem commented on PIG-3419: The advantage of having the Execution en

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-22 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748183#comment-13748183 ] Julien Le Dem commented on PIG-3419: +1 LGTM If test-commit passes I think we

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747064#comment-13747064 ] Julien Le Dem commented on PIG-3419: The point is to be able to implement alter

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-21 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746999#comment-13746999 ] Julien Le Dem commented on PIG-3419: I have submitted my review. This looks g

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-20 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13745398#comment-13745398 ] Julien Le Dem commented on PIG-3419: [~cheolsoo] 1. Do we really throw Exception

Pig ExecutionEngine abstraction

2013-08-14 Thread Julien Le Dem
Hello, Achal Soni has been working on Pig-on-Tez and has created a JIRA to recreate the ExecutionEngine abstraction in Pig. https://issues.apache.org/jira/browse/PIG-3419 This allows to plug in things like Pig-on-Tez or Spork (Pig-on-Spark) Achal has created reviews for this (see JIRA) It would be

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-13 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13738478#comment-13738478 ] Julien Le Dem commented on PIG-3419: Hi Achal for large patches, please create a re

Re: fuzzy logic through pig programming

2013-07-31 Thread Julien Le Dem
http://secondstring.sourceforge.net/ On Wed, Jul 31, 2013 at 1:48 AM, Harshit Bhargava wrote: > Hi, > I want a fuzzy logic in pig latin language which should match two string for > Example1 > I have two words ‘Ramesh’ and ‘Rahim’ I want to check how much percentage > of the string are equal > Exa

[jira] [Commented] (PIG-3367) Add assert keyword (operator) in pig

2013-06-27 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13694832#comment-13694832 ] Julien Le Dem commented on PIG-3367: I was thinking we could make the syntax par

Fwd: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test instance now.

2013-06-18 Thread Julien Le Dem
Julien Begin forwarded message: > From: "gmcdonald" > Date: June 18, 2013, 13:56:46 GMT+02:00 > To: , > Subject: IMPORTANT: Major Confluence Upgrade Coming Soon. Please review test > instance now. > Reply-To: priv...@pig.apache.org > Reply-To: > > [PMCs please forward to your dev list ; In

Re: Uploading patches for review

2013-06-06 Thread Julien Le Dem
+1 On Wed, Jun 5, 2013 at 11:53 PM, Cheolsoo Park wrote: > I agree that we should use the RB more often. > > > On Wed, Jun 5, 2013 at 6:50 PM, Jarek Jarcec Cecho wrote: > >> I can definitely recommend using the review board. We are using it already >> in all other projects that I'm participating

[jira] [Commented] (PIG-2828) DataType.compare null

2013-06-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672896#comment-13672896 ] Julien Le Dem commented on PIG-2828: Sounds good t

[jira] [Resolved] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-17 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-3307. Resolution: Fixed Fix Version/s: 0.12 Hadoop Flags: Reviewed > Refactor physi

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-17 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661202#comment-13661202 ] Julien Le Dem commented on PIG-3307: committed to TRUNK Committed revision 148

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-17 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_3.patch PIG-3307_3.patch addresses [~cheolsoo]'s com

Re: Review Request: Refactor physical operators to remove methods parameters that are always null

2013-05-17 Thread Julien Le Dem
That because I generated the patch ignoring whitespace to make it more readable. I will commit with correct indentation - Julien --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-16 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660033#comment-13660033 ] Julien Le Dem commented on PIG-3307: https://reviews.apache.org/r/11203/

Review Request: Refactor physical operators to remove methods parameters that are always null

2013-05-16 Thread Julien Le Dem
test/org/apache/pig/test/utils/POCastDummy.java b83ed51 test/org/apache/pig/test/utils/TestHelper.java 1efabbe Diff: https://reviews.apache.org/r/11203/diff/ Testing --- test-commit Thanks, Julien Le Dem

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-14 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657908#comment-13657908 ] Julien Le Dem commented on PIG-3307: It would be nice if someone could take a

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Julien Le Dem
dator - Julien Le Dem On May 14, 2013, 5:23 p.m., Travis Crawford wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.a

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Julien Le Dem
> On May 13, 2013, 11:23 p.m., Julien Le Dem wrote: > > src/org/apache/pig/PigConstants.java, lines 47-51 > > <https://reviews.apache.org/r/11032/diff/2/?file=290927#file290927line47> > > > > I would like to clearly separate keys for pig.pro

Re: Review Request: disable optimizations via pig properties

2013-05-13 Thread Julien Le Dem
al/optimizer/LogicalPlanOptimizer.java <https://reviews.apache.org/r/11032/#comment42287> would checkNotNull(ruleSet, "ruleSet") give a better error message ? - Julien Le Dem On May 13, 2013, 8:35 p.m., Travis Crawford wrote: > > --- &g

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-10 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13654887#comment-13654887 ] Julien Le Dem commented on PIG-3307: [~daijy] Also most likely it wont make

Re: JavaScript UDFs

2013-05-10 Thread Julien Le Dem
Yes that would be great. I contributed the javascript UDFs. Let me know if you find bugs On Thu, May 9, 2013 at 7:58 PM, Russell Jurney wrote: > That would be so cool! > > Russell Jurney http://datasyndrome.com > > On May 9, 2013, at 7:30 PM, Ruan Pethiyagoda wrote: > >> At Hack Reactor, we are

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-07 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651101#comment-13651101 ] Julien Le Dem commented on PIG-3307: [~daijy]what's the recommended approac

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650021#comment-13650021 ] Julien Le Dem commented on PIG-3307: [~daijy] This is removing parameters that were

[jira] [Resolved] (PIG-3311) add pig-withouthadoop-h2 to mvn-jar

2013-05-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-3311. Resolution: Fixed Fix Version/s: 0.12 > add pig-withouthadoop-h2 to mvn-

[jira] [Commented] (PIG-3311) add pig-withouthadoop-h2 to mvn-jar

2013-05-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649907#comment-13649907 ] Julien Le Dem commented on PIG-3311: Committed to TRUNK >

Re: Pig package supporting both hadoop 1 and 2

2013-05-06 Thread Julien Le Dem
path = `$hadoop_cmd classpath`; > > my $jarDir = "$pigJarRoot/lib-hadoop23"; > > if ($hadoopClasspath =~ m/hadoop-core-/) { > >$jarDir = "$pigJarRoot/lib-hadoop20"; > > } > > Regards, > Rohini > > > > On Fri,

[jira] [Updated] (PIG-3311) add pig-withouthadoop-h2 to mvn-jar

2013-05-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3311: --- Patch Info: Patch Available > add pig-withouthadoop-h2 to mvn-

Re: Function To Compute Product of Values in Bag

2013-05-03 Thread Julien Le Dem
As for the PRODUCT, I don't see why it could not be added to builtin. It is a very generic and dependency less function. On Fri, May 3, 2013 at 1:36 PM, Sergey Goder wrote: > Thanks for the tip about numerical accuracy issues and the elegant solution > exploiting log/exp. It is very much apprec

Pig package supporting both hadoop 1 and 2

2013-05-03 Thread Julien Le Dem
Hi Pig developers, I'm looking into having a Pig package that works both for Hadoop 1.0 and Hadoop 2.0 That means have both pig*.jar and pig*-h2.jar in the package and choosing the right one dynamically. In particular I created this JIRA as a first step: https://issues.apache.org/jira/browse/PIG

[jira] [Created] (PIG-3311) add pig-withouthadoop-h2 to mvn-jar

2013-05-03 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3311: -- Summary: add pig-withouthadoop-h2 to mvn-jar Key: PIG-3311 URL: https://issues.apache.org/jira/browse/PIG-3311 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-3311) add pig-withouthadoop-h2 to mvn-jar

2013-05-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3311: --- Attachment: PIG-3311.patch PIG-3311.patch adds -withouthadoop to the mvn-jar target

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-03 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_2.patch PIG-3307_2.patch removes the unused parameter in getNext

Welcome our newest committer Prashant Kommireddi

2013-05-02 Thread Julien Le Dem
All, Please join me in welcoming Prashant Kommireddi as our newest Pig committer. He's been contributing to Pig for a while now. We look forward to him being a part of the project. Julien

SVN access for Prashant

2013-05-02 Thread Julien Le Dem
Prashant, Your account has been created. I suggest you try out your commit rights by adding your name to the "who we are" page: http://svn.apache.org/viewvc/pig/site/author/src/documentation/content/xdocs/whoweare.xml?view=markup

Re: ICLA

2013-05-02 Thread Julien Le Dem
eddi wrote: > Thanks Julien and Daniel. > > > On Wed, May 1, 2013 at 3:54 PM, Julien Le Dem wrote: > >> This is done. >> Thanks for your patience! >> Congrats again Prashant >> Julien >> >> >> On Wed, May 1, 2013 at 3:53 PM, Daniel Dai wrot

Physical operators refactoring

2013-05-01 Thread Julien Le Dem
Just a heads up that I'm looking into this and that it is potentially a giant patch: https://issues.apache.org/jira/browse/PIG-3307 Feedback appreciated. Julien

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13647174#comment-13647174 ] Julien Le Dem commented on PIG-3307: It looks like we can get rid of the parameter

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_1.patch PIG-3307_1.patch introduces some more refactoring

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Description: The physical operators are sometimes overly complex. I'm trying to cleanup

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_0.patch PIG-3307_0.patch contains the initial refactoring

[jira] [Created] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3307: -- Summary: Refactor physical operators to remove methods parameters that are always null Key: PIG-3307 URL: https://issues.apache.org/jira/browse/PIG-3307 Project: Pig

[jira] [Resolved] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-3303. Resolution: Fixed Fix Version/s: 0.12 Merged in trunk > add hadoop

[jira] [Updated] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-04-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3303: --- Patch Info: Patch Available > add hadoop h2 artifact to publications in ivy.

[jira] [Updated] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-04-30 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3303: --- Attachment: PIG-3303.patch > add hadoop h2 artifact to publications in ivy.

  1   2   3   4   5   6   7   >