Jenkins build is unstable: Pig-trunk-commit #2496

[Apache Jenkins Server]

See 

[jira] [Commented] (PIG-4059) Pig on Spark

[Xuefu Zhang (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029736#comment-16029736
 ] 

Xuefu Zhang commented on PIG-4059:
--

Great jobs! Thanks to everyone for making this happen!

> Pig on Spark
> 
>
> Key: PIG-4059
> URL: https://issues.apache.org/jira/browse/PIG-4059
> Project: Pig
>  Issue Type: New Feature
>  Components: spark
>Reporter: Rohini Palaniswamy
>Assignee: Praveen Rachabattuni
>  Labels: spork
> Fix For: spark-branch, 0.17.0
>
> Attachments: Pig-on-Spark-Design-Doc.pdf, Pig-on-Spark-Scope.pdf
>
>
> Setting up your development environment:
> 0. download spark release package(currently pig on spark only support spark 
> 1.6).
> 1. Check out Pig Spark branch.
> 2. Build Pig by running "ant jar" and "ant -Dhadoopversion=23 jar" for 
> hadoop-2.x versions
> 3. Configure these environmental variables:
> export HADOOP_USER_CLASSPATH_FIRST="true"
> Now we support “local” and "yarn-client" mode, you can export system variable 
> “SPARK_MASTER” like:
> export SPARK_MASTER=local or export SPARK_MASTER="yarn-client"
> 4. In local mode: ./pig -x spark_local xxx.pig
> In yarn-client mode: 
> export SPARK_HOME=xx; 
> export SPARK_JAR=hdfs://example.com:8020/ (the hdfs location where 
> you upload the spark-assembly*.jar)
> ./pig -x spark xxx.pig



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (PIG-4059) Pig on Spark

[Julien Le Dem (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029733#comment-16029733
 ] 

Julien Le Dem commented on PIG-4059:


Congrats all! 
Thanks [~rohini]!

> Pig on Spark
> 
>
> Key: PIG-4059
> URL: https://issues.apache.org/jira/browse/PIG-4059
> Project: Pig
>  Issue Type: New Feature
>  Components: spark
>Reporter: Rohini Palaniswamy
>Assignee: Praveen Rachabattuni
>  Labels: spork
> Fix For: spark-branch, 0.17.0
>
> Attachments: Pig-on-Spark-Design-Doc.pdf, Pig-on-Spark-Scope.pdf
>
>
> Setting up your development environment:
> 0. download spark release package(currently pig on spark only support spark 
> 1.6).
> 1. Check out Pig Spark branch.
> 2. Build Pig by running "ant jar" and "ant -Dhadoopversion=23 jar" for 
> hadoop-2.x versions
> 3. Configure these environmental variables:
> export HADOOP_USER_CLASSPATH_FIRST="true"
> Now we support “local” and "yarn-client" mode, you can export system variable 
> “SPARK_MASTER” like:
> export SPARK_MASTER=local or export SPARK_MASTER="yarn-client"
> 4. In local mode: ./pig -x spark_local xxx.pig
> In yarn-client mode: 
> export SPARK_HOME=xx; 
> export SPARK_JAR=hdfs://example.com:8020/ (the hdfs location where 
> you upload the spark-assembly*.jar)
> ./pig -x spark xxx.pig



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Adam Szita (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029225#comment-16029225
 ] 

Adam Szita commented on PIG-5244:
-

+1, thanks for fixing this [~nkollar], [^PIG-5244_2.patch] is now committed to 
trunk and 0.17 branch.

> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0, 0.18.0
>
> Attachments: PIG-5244_2.patch, PIG-5244.patch
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Adam Szita (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5244:

   Resolution: Fixed
Fix Version/s: 0.18.0
   Status: Resolved  (was: Patch Available)

> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0, 0.18.0
>
> Attachments: PIG-5244_2.patch, PIG-5244.patch
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Nandor Kollar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5244:
---
Status: Patch Available  (was: Open)

> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0
>
> Attachments: PIG-5244_2.patch, PIG-5244.patch
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Nandor Kollar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5244:
---
Attachment: PIG-5244_2.patch

> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0
>
> Attachments: PIG-5244_2.patch, PIG-5244.patch
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Nandor Kollar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5244:
---
Attachment: PIG-5244.patch

> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0
>
> Attachments: PIG-5244.patch
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Nandor Kollar (JIRA)]

Nandor Kollar created PIG-5244:
--

 Summary: Several unit tests are failing in Tez mode after merging 
spark branch
 Key: PIG-5244
 URL: https://issues.apache.org/jira/browse/PIG-5244
 Project: Pig
  Issue Type: Bug
  Components: tez
Reporter: Nandor Kollar
Assignee: Nandor Kollar
 Fix For: 0.17.0


Looks like during the merge in build.xml PIG-5105 was accidentally partially 
reverted:
{code}



{code}
was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

[Nandor Kollar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5244:
---
Description: 
Looks like during the merge in build.xml PIG-5105 was accidentally partially 
reverted:
{code}



{code}
was removed.

  was:
Looks like during the merge in build.xml PIG-5105 was accidentally partially 
reverted:
{code}



{code}
was removed.


> Several unit tests are failing in Tez mode after merging spark branch
> -
>
> Key: PIG-5244
> URL: https://issues.apache.org/jira/browse/PIG-5244
> Project: Pig
>  Issue Type: Bug
>  Components: tez
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.17.0
>
>
> Looks like during the merge in build.xml PIG-5105 was accidentally partially 
> reverted:
> {code}
> 
> 
> 
> {code}
> was removed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] Subscription: PIG patch available

[jira]

Issue Subscription
Filter: PIG patch available (32 issues)

Subscriber: pigdaily

Key Summary
PIG-5225Several unit tests are not annotated with @Test
https://issues.apache.org/jira/browse/PIG-5225
PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown 
NPE in multithread env
https://issues.apache.org/jira/browse/PIG-5160
PIG-5157Upgrade to Spark 2.0
https://issues.apache.org/jira/browse/PIG-5157
PIG-5115Builtin AvroStorage generates incorrect avro schema when the same 
pig field name appears in the alias
https://issues.apache.org/jira/browse/PIG-5115
PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive 
set to true
https://issues.apache.org/jira/browse/PIG-5106
PIG-5081Can not run pig on spark source code distribution
https://issues.apache.org/jira/browse/PIG-5081
PIG-5080Support store alias as spark table
https://issues.apache.org/jira/browse/PIG-5080
PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput
https://issues.apache.org/jira/browse/PIG-5057
PIG-5029Optimize sort case when data is skewed
https://issues.apache.org/jira/browse/PIG-5029
PIG-4926Modify the content of start.xml for spark mode
https://issues.apache.org/jira/browse/PIG-4926
PIG-4913Reduce jython function initiation during compilation
https://issues.apache.org/jira/browse/PIG-4913
PIG-4849pig on tez will cause tez-ui to crash,because the content from 
timeline server is too long. 
https://issues.apache.org/jira/browse/PIG-4849
PIG-4750REPLACE_MULTI should compile Pattern once and reuse it
https://issues.apache.org/jira/browse/PIG-4750
PIG-4700Pig should call ProcessorContext.setProgress() in TezTaskContext
https://issues.apache.org/jira/browse/PIG-4700
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues.apache.org/jira/browse/PIG-4656
PIG-4598Allow user defined plan optimizer rules
https://issues.apache.org/jira/browse/PIG-4598
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues.apache.org/jira/browse/PIG-4539
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues.apache.org/jira/browse/PIG-4515
PIG-4323PackageConverter hanging in Spark
https://issues.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues.apache.org/jira/browse/PIG-4251
PIG-4002Disable combiner when map-side aggregation is used
https://issues.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues.apache.org/jira/browse/PIG-3911
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues.apache.org/jira/browse/PIG-3873
PIG-3864ToDate(userstring, format, timezone) computes DateTime with strange 
handling of Daylight Saving Time with location based timezones
https://issues.apache.org/jira/browse/PIG-3864
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues.apache.org/jira/browse/PIG-3668
PIG-3587add functionality for rolling over dates
https://issues.apache.org/jira/browse/PIG-3587
PIG-1804Alow Jython function to implement Algebraic and/or Accumulator 
interfaces
https://issues.apache.org/jira/browse/PIG-1804

You may edit this subscription at:
https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=16328=12322384