[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024218#comment-16024218 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: bq.I've checked this, it seems that

[jira] [Created] (PIG-5240) Fix TestPigRunner#simpleMultiQueryTest3 in spark mode for wrong inputStats

2017-05-24 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5240: - Summary: Fix TestPigRunner#simpleMultiQueryTest3 in spark mode for wrong inputStats Key: PIG-5240 URL: https://issues.apache.org/jira/browse/PIG-5240 Project: Pig

[jira] [Updated] (PIG-5239) Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5239: -- Issue Type: Sub-task (was: Bug) Parent: PIG-4059 > Investigate why there are duplicated

[jira] [Commented] (PIG-4924) Translate failures.maxpercent MR setting to Tez

2017-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024195#comment-16024195 ] Daniel Dai commented on PIG-4924: - +1 > Translate failures.maxpercent MR setting to Tez >

[jira] [Commented] (PIG-4662) New optimizer rule: filter nulls before inner joins

2017-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024192#comment-16024192 ] Daniel Dai commented on PIG-4662: - I prefer to do it in optimizer, it seems to be more clear. > New

[jira] [Commented] (PIG-4914) Add testcase for join with special characters in chararray

2017-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024182#comment-16024182 ] Daniel Dai commented on PIG-4914: - This is only for tuple join key, right? String join key of utf8

[jira] [Updated] (PIG-5185) Job name show "DefaultJobName" when running a Python script

2017-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5185: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Created] (PIG-5239) Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5239: - Summary: Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode Key: PIG-5239 URL: https://issues.apache.org/jira/browse/PIG-5239

Build failed in Jenkins: Pig-trunk-commit #2484

2017-05-24 Thread Apache Jenkins Server
See Changes: [daijy] PIG-5185: Job name show "DefaultJobName" when running a Python script -- [...truncated 172.29 KB...] A

Re: Preparing for Pig 0.17 release

2017-05-24 Thread Ranjana Rajendran
Hi Rohini, I want to unsubscribe from this email group ? How do I do that ? On Wed, May 24, 2017 at 3:34 PM, Rohini Palaniswamy wrote: > Hi all, >We are going to merge the Pig on Spark code by Friday and then branch > for Pig 0.17 release. Will be moving all jiras

[jira] [Updated] (PIG-4416) Fix or comment piggybank tests with ExecType.LOCAL

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4416: Fix Version/s: (was: 0.17.0) 0.18.0 > Fix or comment piggybank tests

[jira] [Updated] (PIG-5220) Improve NestedLimitOptimizer to handle general limit push up

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5220: Fix Version/s: (was: 0.17.0) 0.18.0 > Improve NestedLimitOptimizer to

[jira] [Updated] (PIG-5076) Pig 0.15.0 cannot STORE the same alias onto HDFS and Mysql both?

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5076: Fix Version/s: (was: 0.17.0) 0.18.0 > Pig 0.15.0 cannot STORE the same

[jira] [Updated] (PIG-5219) IndexOutOfBoundsException when loading multiple directories with different schemas using OrcStorage

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5219: Fix Version/s: (was: 0.17.0) 0.18.0 > IndexOutOfBoundsException when

[jira] [Updated] (PIG-4872) More POPartialAgg processing and spill improvements

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4872: Fix Version/s: (was: 0.17.0) 0.18.0 > More POPartialAgg processing and

[jira] [Updated] (PIG-5059) Pig 0.16 e2e Types_Order tests failed with Sort check failed

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5059: Fix Version/s: (was: 0.17.0) 0.18.0 > Pig 0.16 e2e Types_Order tests

[jira] [Updated] (PIG-4400) Documentation for RollupHIIOptimizer (PIG-4066)

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4400: Fix Version/s: (was: 0.17.0) 0.18.0 > Documentation for

[jira] [Updated] (PIG-4735) PartitionerDefinedVertexManager should do slowstart

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4735: Fix Version/s: (was: 0.17.0) 0.18.0 > PartitionerDefinedVertexManager

[jira] [Updated] (PIG-4910) Assert wrongly pushed up in optimizer

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4910: Fix Version/s: (was: 0.17.0) 0.18.0 > Assert wrongly pushed up in

[jira] [Updated] (PIG-4653) Remove unwanted config set on Tez DAG, vertices and edges

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4653: Fix Version/s: (was: 0.17.0) 0.18.0 > Remove unwanted config set on

[jira] [Updated] (PIG-4120) Broadcast the index file in case of POMergeCoGroup and POMergeJoin

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4120: Fix Version/s: (was: 0.17.0) 0.18.0 > Broadcast the index file in case

[jira] [Updated] (PIG-4740) e2e tests for PIG-4417: repo fetching for register

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4740: Fix Version/s: (was: 0.17.0) 0.18.0 > e2e tests for PIG-4417: repo

[jira] [Updated] (PIG-4555) Add -XX:+UseNUMA for Tez jobs

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4555: Fix Version/s: (was: 0.17.0) 0.18.0 > Add -XX:+UseNUMA for Tez jobs >

[jira] [Updated] (PIG-4341) Add CMX support to pig.tmpfilecompression.codec

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4341: Fix Version/s: (was: 0.17.0) 0.18.0 > Add CMX support to

[jira] [Updated] (PIG-4249) Size estimation should be done in sampler instead of sample aggregator

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4249: Fix Version/s: (was: 0.17.0) 0.18.0 > Size estimation should be done

[jira] [Updated] (PIG-4573) Set minimal configured required for Tez

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4573: Fix Version/s: (was: 0.17.0) 0.18.0 > Set minimal configured required

[jira] [Updated] (PIG-4914) Add testcase for join with special characters in chararray

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4914: Fix Version/s: (was: 0.17.0) 0.18.0 > Add testcase for join with

[jira] [Updated] (PIG-4922) Deadlock between SpillableMemoryManager and InternalSortedBag$SortedDataBagIterator

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4922: Fix Version/s: (was: 0.17.0) 0.18.0 > Deadlock between

[jira] [Updated] (PIG-4415) Fix or comment tests with ExecType.LOCAL

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4415: Fix Version/s: (was: 0.17.0) 0.18.0 > Fix or comment tests with

[jira] [Updated] (PIG-4958) Tez autoparallelism estimation for order by is higher than mapreduce

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4958: Fix Version/s: (was: 0.17.0) 0.18.0 > Tez autoparallelism estimation

[jira] [Updated] (PIG-4738) Implement StoreResources.getShipFiles() for all piggybank LoadFunc/StoreFunc/EvalFunc

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4738: Fix Version/s: (was: 0.17.0) 0.18.0 > Implement

[jira] [Updated] (PIG-4749) Include a 'latest' documentation directory

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4749: Fix Version/s: (was: 0.17.0) 0.18.0 > Include a 'latest' documentation

[jira] [Updated] (PIG-5030) kill command only kill application the session launches in Tez mode

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5030: Fix Version/s: (was: 0.17.0) 0.18.0 > kill command only kill

[jira] [Updated] (PIG-4626) [Pig on Tez] OOM in case of multiple outputs and POPartialAgg

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4626: Fix Version/s: (was: 0.17.0) 0.18.0 > [Pig on Tez] OOM in case of

[jira] [Updated] (PIG-4694) MultiStorageOutputFormat does not honor mapreduce.base.outputname

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4694: Fix Version/s: (was: 0.17.0) 0.18.0 > MultiStorageOutputFormat does

[jira] [Updated] (PIG-4912) Tez code does not differentiate between cache archives and files

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4912: Fix Version/s: (was: 0.17.0) 0.18.0 > Tez code does not differentiate

[jira] [Updated] (PIG-4566) Reimplement PIG-4066: An optimization for ROLLUP operation in Pig

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4566: Fix Version/s: (was: 0.17.0) 0.18.0 > Reimplement PIG-4066: An

[jira] [Updated] (PIG-4962) Estimate smaller Tez AM memory for smaller count of tasks

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4962: Fix Version/s: (was: 0.17.0) 0.18.0 > Estimate smaller Tez AM memory

[jira] [Updated] (PIG-5129) Add a global progress bar for Tez

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5129: Fix Version/s: (was: 0.17.0) 0.18.0 > Add a global progress bar for

[jira] [Updated] (PIG-5216) Customizable Error Handling for Loaders in Pig

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5216: Fix Version/s: (was: 0.17.0) 0.18.0 > Customizable Error Handling for

[jira] [Updated] (PIG-4652) [Pig on Tez] Key Comparison is slower than mapreduce

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4652: Fix Version/s: (was: 0.17.0) 0.18.0 > [Pig on Tez] Key Comparison is

[jira] [Updated] (PIG-5075) Pig ORCStorage with Snappy Compression will fail with NoClassDefFoundError org/iq80/snappy/Snappy

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5075: Fix Version/s: (was: 0.17.0) 0.18.0 > Pig ORCStorage with Snappy

[jira] [Updated] (PIG-4959) Tez autoparallelism estimation for skewed join is higher than mapreduce

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4959: Fix Version/s: (was: 0.17.0) 0.18.0 > Tez autoparallelism estimation

[jira] [Updated] (PIG-4548) Records Lost With Specific Combination of Commands and Streaming Function

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4548: Fix Version/s: (was: 0.17.0) 0.18.0 > Records Lost With Specific

[jira] [Updated] (PIG-4373) Implement PIG-3861 in Tez

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4373: Fix Version/s: (was: 0.17.0) 0.18.0 > Implement PIG-3861 in Tez >

[jira] [Updated] (PIG-4672) Document performance implication for Hive UDF

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4672: Fix Version/s: (was: 0.17.0) 0.18.0 > Document performance implication

[jira] [Updated] (PIG-5191) Pig HBase 2.0.0 support

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5191: Fix Version/s: (was: 0.17.0) 0.18.0 > Pig HBase 2.0.0 support >

[jira] [Updated] (PIG-4647) OrcStorage should refer to shaded kryo

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4647: Fix Version/s: (was: 0.17.0) 0.18.0 > OrcStorage should refer to

[jira] [Updated] (PIG-4764) Make Pig work with Hive 2.0

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4764: Fix Version/s: (was: 0.17.0) 0.18.0 > Make Pig work with Hive 2.0 >

[jira] [Updated] (PIG-4130) Store/Load the same file fails for AvroStorage/OrcStorage, etc

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4130: Fix Version/s: (was: 0.17.0) 0.18.0 > Store/Load the same file fails

[jira] [Updated] (PIG-4767) Partition filter not pushed down when filter clause references variable from another load path

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4767: Fix Version/s: (was: 0.17.0) 0.18.0 > Partition filter not pushed down

[jira] [Updated] (PIG-4785) Optimize multi-query plan for diamond shape edges

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4785: Fix Version/s: (was: 0.17.0) 0.18.0 > Optimize multi-query plan for

[jira] [Updated] (PIG-4428) Support UDFContext style getProperties() for different UDFs in Tez ObjectCache

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4428: Fix Version/s: (was: 0.17.0) 0.18.0 > Support UDFContext style

[jira] [Updated] (PIG-4617) XML loader is not working fine with pig 0.14 version

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4617: Fix Version/s: (was: 0.17.0) 0.18.0 > XML loader is not working fine

[jira] [Updated] (PIG-4662) New optimizer rule: filter nulls before inner joins

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4662: Fix Version/s: (was: 0.17.0) 0.18.0 > New optimizer rule: filter nulls

[jira] [Updated] (PIG-4567) Allow UDFs to specify a counter increment other than default of 1

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4567: Fix Version/s: (was: 0.17.0) 0.18.0 > Allow UDFs to specify a counter

[jira] [Updated] (PIG-4579) casting of primitive datetime data type should work

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4579: Fix Version/s: (was: 0.17.0) 0.18.0 > casting of primitive datetime

[jira] [Updated] (PIG-4932) Cache files not loaded when using 'limit' operator

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4932: Fix Version/s: (was: 0.17.0) 0.18.0 > Cache files not loaded when

[jira] [Updated] (PIG-4658) Reduce key comparisons in TezAccumulativeTupleBuffer

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4658: Fix Version/s: (was: 0.17.0) 0.18.0 > Reduce key comparisons in

[jira] [Commented] (PIG-4662) New optimizer rule: filter nulls before inner joins

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023848#comment-16023848 ] Rohini Palaniswamy commented on PIG-4662: - Have already done this in POBuildBloomRearrangeTez. You

[jira] [Assigned] (PIG-4662) New optimizer rule: filter nulls before inner joins

2017-05-24 Thread Satish Subhashrao Saley (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley reassigned PIG-4662: Assignee: Satish Subhashrao Saley > New optimizer rule: filter nulls before

[jira] [Updated] (PIG-4700) Pig should call ProcessorContext.setProgress() in TezTaskContext

2017-05-24 Thread Satish Subhashrao Saley (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley updated PIG-4700: - Attachment: PIG-4700-1.patch > Pig should call ProcessorContext.setProgress() in

[jira] [Updated] (PIG-4700) Pig should call ProcessorContext.setProgress() in TezTaskContext

2017-05-24 Thread Satish Subhashrao Saley (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley updated PIG-4700: - Status: Patch Available (was: Open) > Pig should call

[jira] [Updated] (PIG-4745) DataBag should protect content of passed list of tuples

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4745: Resolution: Invalid Status: Resolved (was: Patch Available) > DataBag should protect

[jira] [Updated] (PIG-4745) DataBag should protect content of passed list of tuples

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4745: Fix Version/s: (was: 0.17.0) It is the responsibility of the user to make a copy and pass

[jira] [Updated] (PIG-4924) Translate failures.maxpercent MR setting to Tez

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4924: Attachment: PIG-4924-1.patch > Translate failures.maxpercent MR setting to Tez >

[jira] [Updated] (PIG-4924) Translate failures.maxpercent MR setting to Tez

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4924: Status: Patch Available (was: Open) > Translate failures.maxpercent MR setting to Tez >

[jira] [Assigned] (PIG-4700) Pig should call ProcessorContext.setProgress() in TezTaskContext

2017-05-24 Thread Satish Subhashrao Saley (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley reassigned PIG-4700: Assignee: Satish Subhashrao Saley > Pig should call

[jira] [Commented] (PIG-5185) Job name show "DefaultJobName" when running a Python script

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023821#comment-16023821 ] Rohini Palaniswamy commented on PIG-5185: - +1 > Job name show "DefaultJobName" when running a

Preparing for Pig 0.17 release

2017-05-24 Thread Rohini Palaniswamy
Hi all, We are going to merge the Pig on Spark code by Friday and then branch for Pig 0.17 release. Will be moving all jiras marked for 0.17 that are not being worked on or not of high priority to 0.18 today. If you consider anything important for 0.17, please raise a comment in that jira.

[jira] [Assigned] (PIG-4449) Optimize the case of Order by + Limit in nested foreach

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy reassigned PIG-4449: --- Assignee: Rohini Palaniswamy Fix Version/s: 0.18.0 > Optimize the case of

Re: Review Request 59530: PIG-5157 Upgrade to Spark 2.0

2017-05-24 Thread Adam Szita
> On May 24, 2017, 9:21 p.m., Rohini Palaniswamy wrote: > > build.xml > > Lines 251 (patched) > > > > > > Can just load one property file for spark2, leaving the spark 1.6 > > version in libraries.properties AFAIK

[jira] [Resolved] (PIG-5204) Implement illustrate in Spark

2017-05-24 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita resolved PIG-5204. - Resolution: Duplicate > Implement illustrate in Spark > - > >

[jira] [Assigned] (PIG-5204) Implement illustrate in Spark

2017-05-24 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reassigned PIG-5204: --- Assignee: (was: Adam Szita) > Implement illustrate in Spark > - > >

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2017-05-24 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023727#comment-16023727 ] Adam Szita commented on PIG-4621: - I'd be happy to take this task, [~Pratyy], [~kellyzly] shall I reassign

Re: Review Request 59530: PIG-5157 Upgrade to Spark 2.0

2017-05-24 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59530/#review175998 --- build.xml Lines 243 (patched)

Re: Review Request 57317: Support Pig On Spark

2017-05-24 Thread Rohini Palaniswamy
> On March 21, 2017, 8:36 p.m., Rohini Palaniswamy wrote: > > src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java > > Lines 387-388 (patched) > > > > > > Why copy to local directory if already

Re: Review Request 57317: Support Pig On Spark

2017-05-24 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57317/#review175872 ---

Review Request 59530: PIG-5157 Upgrade to Spark 2.0

2017-05-24 Thread Nandor Kollar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59530/ --- Review request for pig, liyun zhang, Rohini Palaniswamy, and Adam Szita.

[jira] [Resolved] (PIG-2648) MapReduceLauncher squashes unchecked exceptions

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-2648. - Resolution: Duplicate > MapReduceLauncher squashes unchecked exceptions >

[jira] [Deleted] (PIG-5099) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5099: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5090) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5090: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5095) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5095: > AvroStorage on Tez with exception on nested records >

[jira] [Commented] (PIG-5108) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023133#comment-16023133 ] Rohini Palaniswamy commented on PIG-5108: - Deleted PIG-5090 to PIG-5099 which are duplicates of this

[jira] [Deleted] (PIG-5092) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5092: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5093) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5093: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5094) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5094: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5097) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5097: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5091) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5091: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5098) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5098: > AvroStorage on Tez with exception on nested records >

[jira] [Deleted] (PIG-5096) AvroStorage on Tez with exception on nested records

2017-05-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy deleted PIG-5096: > AvroStorage on Tez with exception on nested records >

[jira] [Assigned] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4266: -- Assignee: (was: liyunzhang_intel) > Umbrella jira for unit tests for Spark >

[jira] [Resolved] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4266. Resolution: Fixed > Umbrella jira for unit tests for Spark > -- >

[jira] [Commented] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023032#comment-16023032 ] Nandor Kollar commented on PIG-4266: Closing this Jira since all unit tests are passing on spark branch.

[jira] [Resolved] (PIG-4295) Enable unit test "TestPigContext" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4295. Resolution: Fixed Assignee: (was: liyunzhang_intel) > Enable unit test "TestPigContext" for

[jira] [Resolved] (PIG-4292) Enable unit test "TestMergeJoinOuter" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4292. Resolution: Fixed > Enable unit test "TestMergeJoinOuter" for spark >

[jira] [Assigned] (PIG-4277) Enable unit test "TestEvalPipeline2" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4277: -- Assignee: (was: Mohit Sabharwal) > Enable unit test "TestEvalPipeline2" for spark >

[jira] [Resolved] (PIG-4277) Enable unit test "TestEvalPipeline2" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4277. Resolution: Fixed > Enable unit test "TestEvalPipeline2" for spark >

[jira] [Resolved] (PIG-4291) Enable unit test "TestMergeJoin" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4291. Resolution: Fixed Assignee: (was: Praveen Rachabattuni) > Enable unit test "TestMergeJoin"

[jira] [Commented] (PIG-5238) Fix datetime related test issues after PIG-4748

2017-05-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022918#comment-16022918 ] Koji Noguchi commented on PIG-5238: --- +1 > Fix datetime related test issues after PIG-4748 >

  1   2   >