[jira] [Updated] (PIG-4103) Fix TestRegisteredJarVisibility(after PIG-4083)

2014-08-04 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang fang chen updated PIG-4103: Status: Patch Available (was: Open) > Fix TestRegisteredJarVisibility(after PIG-4083) >

[jira] [Updated] (PIG-4103) Fix TestRegisteredJarVisibility(after PIG-4083)

2014-08-04 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang fang chen updated PIG-4103: Attachment: PIG-4103.patch > Fix TestRegisteredJarVisibility(after PIG-4083) > --

[jira] [Created] (PIG-4103) Fix TestRegisteredJarVisibility(after PIG-4083)

2014-08-04 Thread fang fang chen (JIRA)
fang fang chen created PIG-4103: --- Summary: Fix TestRegisteredJarVisibility(after PIG-4083) Key: PIG-4103 URL: https://issues.apache.org/jira/browse/PIG-4103 Project: Pig Issue Type: Bug Aff

Jenkins build is back to normal : Pig-trunk #1623

2014-08-04 Thread Apache Jenkins Server
See

[jira] Subscription: PIG patch available

2014-08-04 Thread jira
Issue Subscription Filter: PIG patch available (13 issues) Subscriber: pigdaily Key Summary PIG-4066An optimization for ROLLUP operation in Pig https://issues.apache.org/jira/browse/PIG-4066 PIG-4004Upgrade the Pigmix queries from the (old) mapred API to mapreduce

Re: How pig make hadoop to recognize "pig.reduce.output.dirs" property to set output directory?

2014-08-04 Thread Daniel Dai
Pig in general do not deal with output directory, instead, it is handled by individual storer. Take PigStorage for example, in PigStorage.setStoreLocation, it invokes FileOutputFormat.setOutputPath, which then invoke set "mapreduce.output.fileoutputformat.outputdir". Thanks, Daniel On Mon, Aug 4,

Re: Create a constant relation in a Pig script

2014-08-04 Thread Daniel Dai
Does org.apache.pig.builtin.mock.Storage work for you? Thanks, Daniel On Mon, Aug 4, 2014 at 4:53 AM, Alfonso Nishikawa wrote: > Greetings. > > For testing purposes I need to create a relation in a Pig script. > I found 2 questions about this in StackOverflow: > > http://stackoverflow.com/questi

[jira] [Updated] (PIG-4008) Pig code change to enable Tez Local mode

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4008: Component/s: tez > Pig code change to enable Tez Local mode > - > >

[jira] [Updated] (PIG-4008) Pig code change to enable Tez Local mode

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4008: Resolution: Fixed Fix Version/s: 0.14.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Resolved] (PIG-4086) Fix Orc e2e tests for tez

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4086. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Fix O

[jira] [Updated] (PIG-4086) Fix Orc e2e tests for tez

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4086: Attachment: PIG-4086-3.patch Added "getContext().canCommit()" as discussed in TEZ-1351. > Fix Orc e2e tests

[jira] [Resolved] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-4100. Resolution: Not a Problem Closing the jira now. > TEZ bug broke hadoop compilation 2 in trunk >

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085394#comment-14085394 ] Daniel Dai commented on PIG-4100: - SNAPSHOT published. > TEZ bug broke hadoop compilation 2

[jira] [Resolved] (PIG-4091) Predicate pushdown for ORC

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4091. - Resolution: Fixed Assignee: Rohini Palaniswamy Hadoop Flags: Reviewed Patch committed to trun

[jira] [Created] (PIG-4102) Adding e2e tests and several improvements for Orc predicate pushdown

2014-08-04 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4102: --- Summary: Adding e2e tests and several improvements for Orc predicate pushdown Key: PIG-4102 URL: https://issues.apache.org/jira/browse/PIG-4102 Project: Pig Issue Typ

[jira] [Commented] (PIG-4091) Predicate pushdown for ORC

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085322#comment-14085322 ] Daniel Dai commented on PIG-4091: - The patch is already in good shape. All tests pass for me

Re: Review Request 24203: PIG-4091: Predicate pushdown for ORC

2014-08-04 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24203/#review49514 --- Ship it! Ship It! - Daniel Dai On Aug. 2, 2014, 5:58 a.m., Rohin

[jira] [Commented] (PIG-4008) Pig code change to enable Tez Local mode

2014-08-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085185#comment-14085185 ] Chen He commented on PIG-4008: -- multiDAG will be considered in TEZ-1376. Thank you [~daijy] and

[jira] [Updated] (PIG-4083) TestAccumuloPigCluster always failed with timeout error

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4083: Resolution: Fixed Fix Version/s: (was: 0.13.0) 0.13.1 Hadoop Flags: Reviewe

[jira] [Commented] (PIG-4083) TestAccumuloPigCluster always failed with timeout error

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085161#comment-14085161 ] Daniel Dai commented on PIG-4083: - I see. This will not happen on trunk since we switch to u

[jira] [Updated] (PIG-4101) Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4101: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085156#comment-14085156 ] Cheolsoo Park commented on PIG-4100: If it's delayed, I can revert PIG-4098 for now. Let

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085141#comment-14085141 ] Daniel Dai commented on PIG-4100: - Let me ask Tez folks to publish a SNAPSHOT. > TEZ bug br

[jira] [Commented] (PIG-4101) Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085137#comment-14085137 ] Daniel Dai commented on PIG-4101: - +1 > Lower tez.am.task.max.failed.attempts to 2 from 4 i

[jira] [Updated] (PIG-4008) Pig code change to enable Tez Local mode

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4008: Attachment: PIG-4008-4.patch Another update after TEZ-1343 check in. Now tez local mode should work in most

[jira] [Updated] (PIG-4008) Pig code change to enable Tez Local mode

2014-08-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4008: Priority: Major (was: Minor) > Pig code change to enable Tez Local mode > -

[jira] [Updated] (PIG-4101) Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4101: --- Status: Patch Available (was: Open) > Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cl

[jira] [Updated] (PIG-4101) Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4101: --- Attachment: PIG-4101-1.patch Uploading a patch. > Lower tez.am.task.max.failed.attempts to 2 from 4 in

[jira] [Created] (PIG-4101) Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster

2014-08-04 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4101: -- Summary: Lower tez.am.task.max.failed.attempts to 2 from 4 in Tez mini cluster Key: PIG-4101 URL: https://issues.apache.org/jira/browse/PIG-4101 Project: Pig Is

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085022#comment-14085022 ] Cheolsoo Park commented on PIG-4100: Indeed, my bad. > TEZ bug broke hadoop compilation

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085019#comment-14085019 ] Koji Noguchi commented on PIG-4100: --- bq. Tez snapshot jars are not published to maven yet,

How pig make hadoop to recognize "pig.reduce.output.dirs" property to set output directory?

2014-08-04 Thread Ji Mahn Ok
Hi, I would like to ask a question on pig property to set the output directory of MapReduce Job produced by pig. As we know, "mapreduce.output.fileoutputformat.outputdir" or "mapred.output.dir" is the property we use to set the output directory. It seems that pig sets "pig.reduce.output.dirs" prop

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084840#comment-14084840 ] Quang-Nhat HOANG-XUAN commented on PIG-4100: I got it. Thank you. > TEZ bug bro

[jira] [Comment Edited] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084831#comment-14084831 ] Cheolsoo Park edited comment on PIG-4100 at 8/4/14 4:06 PM: Sorr

[jira] [Commented] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084831#comment-14084831 ] Cheolsoo Park commented on PIG-4100: Sorry for the inconvenience. This is because of PIG

[jira] [Updated] (PIG-4083) TestAccumuloPigCluster always failed with timeout error

2014-08-04 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated PIG-4083: Assignee: fang fang chen (was: Josh Elser) > TestAccumuloPigCluster always failed with timeout error > -

Create a constant relation in a Pig script

2014-08-04 Thread Alfonso Nishikawa
Greetings. For testing purposes I need to create a relation in a Pig script. I found 2 questions about this in StackOverflow: http://stackoverflow.com/questions/13414172/how-to-create-a-small-constant-relationtable-in-pig http://stackoverflow.com/questions/12423399/define-tuple-datas-in-the-pig-s

Build failed in Jenkins: Pig-trunk #1622

2014-08-04 Thread Apache Jenkins Server
See Changes: [cheolsoo] PIG-4099: "ant copypom" failed with "could not find file $PIG_HOME/ivy/pig.pom to copy" (fang fang chen via cheolsoo) [cheolsoo] PIG-4098: Vertex Location Hint api update after TEZ-1041 (jeagles via cheolsoo) -

[jira] [Updated] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quang-Nhat HOANG-XUAN updated PIG-4100: --- Component/s: tez > TEZ bug broke hadoop compilation 2 in trunk > --

[jira] [Updated] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quang-Nhat HOANG-XUAN updated PIG-4100: --- Description: Cannot compile pig trunk (with parameter -Dhadoopversion=23) due to this e

[jira] [Created] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
Quang-Nhat HOANG-XUAN created PIG-4100: -- Summary: TEZ bug broke hadoop compilation 2 in trunk Key: PIG-4100 URL: https://issues.apache.org/jira/browse/PIG-4100 Project: Pig Issue Type: B

[jira] [Updated] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quang-Nhat HOANG-XUAN updated PIG-4100: --- Fix Version/s: 0.14.0 > TEZ bug broke hadoop compilation 2 in trunk > -

[jira] [Updated] (PIG-4100) TEZ bug broke hadoop compilation 2 in trunk

2014-08-04 Thread Quang-Nhat HOANG-XUAN (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quang-Nhat HOANG-XUAN updated PIG-4100: --- Description: Cannot compile pig trunk (with parameter -Dhadoopversion=23) due to this e