[jira] Subscription: PIG patch available

[jira]

Issue Subscription
Filter: PIG patch available (30 issues)

Subscriber: pigdaily

Key Summary
PIG-4796Authenticate with Kerberos using a keytab file
https://issues.apache.org/jira/browse/PIG-4796
PIG-4788the value BytesRead metric info always returns 0 even the length of 
input file is not 0 in spark engine
https://issues.apache.org/jira/browse/PIG-4788
PIG-4745DataBag should protect content of passed list of tuples
https://issues.apache.org/jira/browse/PIG-4745
PIG-4734TOMAP schema inferring breaks some scripts in type checking for 
bincond
https://issues.apache.org/jira/browse/PIG-4734
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues.apache.org/jira/browse/PIG-4656
PIG-4641Print the instance of Object without using toString()
https://issues.apache.org/jira/browse/PIG-4641
PIG-4598Allow user defined plan optimizer rules
https://issues.apache.org/jira/browse/PIG-4598
PIG-4581thread safe issue in NodeIdGenerator
https://issues.apache.org/jira/browse/PIG-4581
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues.apache.org/jira/browse/PIG-4539
PIG-4526Make setting up the build environment easier
https://issues.apache.org/jira/browse/PIG-4526
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues.apache.org/jira/browse/PIG-4515
PIG-4455Should use DependencyOrderWalker instead of DepthFirstWalker in 
MRPrinter
https://issues.apache.org/jira/browse/PIG-4455
PIG-4341Add CMX support to pig.tmpfilecompression.codec
https://issues.apache.org/jira/browse/PIG-4341
PIG-4323PackageConverter hanging in Spark
https://issues.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues.apache.org/jira/browse/PIG-4251
PIG-4111Make Pig compiles with avro-1.7.7
https://issues.apache.org/jira/browse/PIG-4111
PIG-4002Disable combiner when map-side aggregation is used
https://issues.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues.apache.org/jira/browse/PIG-3911
PIG-3906ant site errors out
https://issues.apache.org/jira/browse/PIG-3906
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues.apache.org/jira/browse/PIG-3873
PIG-3866Create ThreadLocal classloader per PigContext
https://issues.apache.org/jira/browse/PIG-3866
PIG-3864ToDate(userstring, format, timezone) computes DateTime with strange 
handling of Daylight Saving Time with location based timezones
https://issues.apache.org/jira/browse/PIG-3864
PIG-3851Upgrade jline to 2.11
https://issues.apache.org/jira/browse/PIG-3851
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues.apache.org/jira/browse/PIG-3668
PIG-3587add functionality for rolling over dates
https://issues.apache.org/jira/browse/PIG-3587

You may edit this subscription at:
https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=16328=12322384

Re: Welcome to our new Pig PMC member Xuefu Zhang

[Vijay K.N]

Congrats Xuefu..!!
On Feb 25, 2016 3:00 AM, "Rohini Palaniswamy" 
wrote:

> It is my pleasure to announce that Xuefu Zhang is our newest addition to
> the Pig PMC. Xuefu is a long time committer of Pig and has been actively
> involved in driving the Pig on Spark effort for the past year.
>
> Please join me in congratulating Xuefu !!!
>
> Regards,
> Rohini
>

[jira] [Commented] (PIG-4824) FOREACH throwing error

[vivek singh (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181505#comment-15181505
 ] 

vivek singh commented on PIG-4824:
--

Ah! it's mysterious.. the issue got resolved on its own..  I ran it now to get 
the logs but it worked this time..

> FOREACH throwing error
> --
>
> Key: PIG-4824
> URL: https://issues.apache.org/jira/browse/PIG-4824
> Project: Pig
>  Issue Type: Bug
>Reporter: vivek singh
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Welcome to our new Pig PMC member Xuefu Zhang

[Corey Nolet]

Congrats!

On Thu, Mar 3, 2016 at 4:40 AM, Lorand Bendig  wrote:

> Congratulations!
> --Lorand
> On Feb 24, 2016 22:30, "Rohini Palaniswamy" 
> wrote:
>
> > It is my pleasure to announce that Xuefu Zhang is our newest addition to
> > the Pig PMC. Xuefu is a long time committer of Pig and has been actively
> > involved in driving the Pig on Spark effort for the past year.
> >
> > Please join me in congratulating Xuefu !!!
> >
> > Regards,
> > Rohini
> >
>

[jira] [Updated] (PIG-4690) Union with self replicate join will fail in Tez

[Daniel Dai (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-4690:

Attachment: PIG-4690-branch-15.patch

Rebase the patch to branch 0.15.

> Union with self replicate join will fail in Tez
> ---
>
> Key: PIG-4690
> URL: https://issues.apache.org/jira/browse/PIG-4690
> Project: Pig
>  Issue Type: Bug
>Reporter: Rohini Palaniswamy
>Assignee: Rohini Palaniswamy
> Fix For: 0.16.0
>
> Attachments: PIG-4690-1.patch, PIG-4690-2.patch, PIG-4690-3.patch, 
> PIG-4690-branch-15.patch
>
>
> Found this while trying to get a reproducible script for a different issue. 
> Not a user reported one, but a possibility nonetheless. 
> A = LOAD 'x';
> B = LOAD 'y';
> C = UNION A, B;
> D = JOIN C, A using 'repl';
> DUMP D;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4825) Fix TestMultiQuery failure

[Xuefu Zhang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang updated PIG-4825:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to Spark branch. Thanks, Pallavi.

> Fix TestMultiQuery failure
> --
>
> Key: PIG-4825
> URL: https://issues.apache.org/jira/browse/PIG-4825
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4825.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (PIG-4825) Fix TestMultiQuery failure

[Xuefu Zhang (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180319#comment-15180319
 ] 

Xuefu Zhang commented on PIG-4825:
--

+1

> Fix TestMultiQuery failure
> --
>
> Key: PIG-4825
> URL: https://issues.apache.org/jira/browse/PIG-4825
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4825.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (PIG-4824) FOREACH throwing error

[Daniel Dai (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180314#comment-15180314
 ] 

Daniel Dai commented on PIG-4824:
-

The error message is too general. Can you find more log in Hadoop WebUI?

> FOREACH throwing error
> --
>
> Key: PIG-4824
> URL: https://issues.apache.org/jira/browse/PIG-4824
> Project: Pig
>  Issue Type: Bug
>Reporter: vivek singh
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4823) SparkMiniCluster does not cleanup old conf files during setup

[Xuefu Zhang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang updated PIG-4823:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to Spark branch. Thanks, Pallavi.

> SparkMiniCluster does not cleanup old conf files during setup
> -
>
> Key: PIG-4823
> URL: https://issues.apache.org/jira/browse/PIG-4823
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4823.patch
>
>
> If some of the tests fail or get killed, new tests will use the old hadoop 
> conf files left behind by the previous tests, causing the following failure:
> {noformat}
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Could not 
> create staging directory. 
>   at 
> org.apache.hadoop.mapreduce.v2.MiniMRYarnCluster.serviceInit(MiniMRYarnCluster.java:165)
>   at 
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>   at 
> org.apache.pig.test.SparkMiniCluster.setupMiniDfsAndMrClusters(SparkMiniCluster.java:93)
>   at 
> org.apache.pig.test.MiniGenericCluster.buildCluster(MiniGenericCluster.java:86)
>   at 
> org.apache.pig.test.MiniGenericCluster.buildCluster(MiniGenericCluster.java:68)
>   at 
> org.apache.pig.test.TestToolsPigServer.(TestToolsPigServer.java:42)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
>   at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
>   at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
>   at org.apache.hadoop.ipc.Client.call(Client.java:1472)
>   at org.apache.hadoop.ipc.Client.call(Client.java:1399)
>   at 
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
>   at com.sun.proxy.$Proxy15.mkdirs(Unknown Source)
>   at 
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:539)
>   at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
>   at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
>   at com.sun.proxy.$Proxy16.mkdirs(Unknown Source)
>   at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2753)
>   at org.apache.hadoop.fs.Hdfs.mkdir(Hdfs.java:311)
>   at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:724)
>   at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:720)
>   at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
>   at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:720)
>   at 
> org.apache.hadoop.mapreduce.v2.MiniMRYarnCluster.serviceInit(MiniMRYarnCluster.java:163)
> Caused by: java.net.ConnectException: Connection refused
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4820) Merge trunk[3] into spark branch

[Xuefu Zhang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang updated PIG-4820:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Patch committed to spark branch. [~pallavi.rao], I'm not sure if I have messed 
up anything during the merge, but please feel free to create a separate JIRA to 
address it if I did.

> Merge trunk[3] into spark branch
> 
>
> Key: PIG-4820
> URL: https://issues.apache.org/jira/browse/PIG-4820
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4820-conflicts.patch, PIG-4820.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4820) Merge trunk[3] into spark branch

[Pallavi Rao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Rao updated PIG-4820:
-
Attachment: PIG-4820-conflicts.patch

> Merge trunk[3] into spark branch
> 
>
> Key: PIG-4820
> URL: https://issues.apache.org/jira/browse/PIG-4820
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4820-conflicts.patch, PIG-4820.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4820) Merge trunk[3] into spark branch

[Pallavi Rao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Rao updated PIG-4820:
-
Attachment: (was: PIG-4820-conflicts.patch)

> Merge trunk[3] into spark branch
> 
>
> Key: PIG-4820
> URL: https://issues.apache.org/jira/browse/PIG-4820
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4820-conflicts.patch, PIG-4820.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4825) Fix TestMultiQuery failure

[Pallavi Rao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Rao updated PIG-4825:
-
Labels: spork  (was: )
Status: Patch Available  (was: Open)

[~xuefuz], [~kellyzly], [~mohitsabharwal], can you please review?

> Fix TestMultiQuery failure
> --
>
> Key: PIG-4825
> URL: https://issues.apache.org/jira/browse/PIG-4825
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
>  Labels: spork
> Fix For: spark-branch
>
> Attachments: PIG-4825.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PIG-4825) Fix TestMultiQuery failure

[Pallavi Rao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Rao updated PIG-4825:
-
Attachment: PIG-4825.patch

Small patch, no RB request.

> Fix TestMultiQuery failure
> --
>
> Key: PIG-4825
> URL: https://issues.apache.org/jira/browse/PIG-4825
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
> Fix For: spark-branch
>
> Attachments: PIG-4825.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (PIG-4825) Fix TestMultiQuery failure

[Pallavi Rao (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179694#comment-15179694
 ] 

Pallavi Rao commented on PIG-4825:
--

Test is failing because of the order in which the expected and actual results 
are compared.

> Fix TestMultiQuery failure
> --
>
> Key: PIG-4825
> URL: https://issues.apache.org/jira/browse/PIG-4825
> Project: Pig
>  Issue Type: Sub-task
>  Components: spark
>Reporter: Pallavi Rao
>Assignee: Pallavi Rao
> Fix For: spark-branch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (PIG-4825) Fix TestMultiQuery failure

[Pallavi Rao (JIRA)]

Pallavi Rao created PIG-4825:


 Summary: Fix TestMultiQuery failure
 Key: PIG-4825
 URL: https://issues.apache.org/jira/browse/PIG-4825
 Project: Pig
  Issue Type: Sub-task
Reporter: Pallavi Rao
Assignee: Pallavi Rao






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: Pig-trunk-commit #2301

[Apache Jenkins Server]

See