[jira] [Commented] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689248#comment-15689248 ] Xianda Ke commented on PIG-5068: [~kellyzly], 1. agree with you. it would be better to remov

[jira] [Commented] (PIG-5029) Optimize sort case when data is skewed

[ https://issues.apache.org/jira/browse/PIG-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689206#comment-15689206 ] liyunzhang_intel commented on PIG-5029: --- [~kexianda]: {quote} I hava a question:

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Attachment: PIG-5068.patch > Set SPARK_REDUCERS by pig.properties not by system configuration > --

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Attachment: (was: PIG-5068.patch) > Set SPARK_REDUCERS by pig.properties not by system configu

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (33 issues) Subscriber: pigdaily Key Summary PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput https://issues.apache.org/jira/browse/PIG-5057 PIG-5043Slowstart not applied in Tez with PARALLEL clau

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4926Modify the content of start.xml for spark mode https://issues-test.apache.org/jira/browse/PIG-4926 PIG-4922Deadlock between SpillableMemoryManager and InternalSortedBag

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Attachment: PIG-5068.patch [~kexianda]: help review, changes in PIG-5068 1. create SparkEnv.java 2

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Issue Type: Sub-task (was: Bug) Parent: PIG-4856 > Set SPARK_REDUCERS by pig.properties n

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Component/s: spark > Set SPARK_REDUCERS by pig.properties not by system configuration > --

[jira] [Created] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

liyunzhang_intel created PIG-5068: - Summary: Set SPARK_REDUCERS by pig.properties not by system configuration Key: PIG-5068 URL: https://issues.apache.org/jira/browse/PIG-5068 Project: Pig I

[jira] [Commented] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689022#comment-15689022 ] liyunzhang_intel commented on PIG-4899: --- [~szita]: +1 and [~xuefuz]: please commit it

Contributing UDFs in Java to PiggyBank

Hi, I joined this forum newly to contrinute 2 UDFs written in Java to PiggyBank. Can someone guide me as to how to go about this please? Thanks. - Ravi Ravi Annadanam Mobile: +91-98863-89105 -- *This e-mail and any attachments with it, are for the sole use of the intended recipient(s) and may

[jira] [Commented] (PIG-5029) Optimize sort case when data is skewed

[ https://issues.apache.org/jira/browse/PIG-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688696#comment-15688696 ] Xianda Ke commented on PIG-5029: Hi [~kellyzly], Salted key solution seem OK. JDK's Random

[jira] [Commented] (PIG-3938) Add LoadCaster to EvalFunc(UDF)

[ https://issues.apache.org/jira/browse/PIG-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687928#comment-15687928 ] Koji Noguchi commented on PIG-3938: --- Started looking. Assuming we'll add another {{getLoa

[jira] [Updated] (PIG-3938) Add LoadCaster to EvalFunc(UDF)

[ https://issues.apache.org/jira/browse/PIG-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3938: -- Summary: Add LoadCaster to EvalFunc(UDF) (was: Type cast doesn't work after flatten result of UDF) > Ad

Build failed in Jenkins: Pig-trunk-commit #2398

See Changes: [rohini] PIG-5025: Fix flaky test failures in TestLoad.java (szita via rohini) -- [...truncated 3005 lines...] [javadoc] Loading source files for package org.apache.pig.backend.h

[jira] [Updated] (PIG-5025) Fix flaky test failures in TestLoad.java

[ https://issues.apache.org/jira/browse/PIG-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5025: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Availabl

[jira] [Updated] (PIG-5025) Fix flaky test failures in TestLoad.java

[ https://issues.apache.org/jira/browse/PIG-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5025: Fix Version/s: 0.17.0 Summary: Fix flaky test failures in TestLoad.java (was: Improv

[jira] [Updated] (PIG-4952) Calculate the value of parallism for spark mode

[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4952: --- Attachment: PIG-4952_1.patch > Calculate the value of parallism for spark mode > ---

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687248#comment-15687248 ] Nandor Kollar commented on PIG-4952: [~kellyzly] could you please explain, what should P

[jira] [Assigned] (PIG-4952) Calculate the value of parallism for spark mode

[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4952: -- Assignee: Nandor Kollar > Calculate the value of parallism for spark mode > -

[jira] [Commented] (PIG-5025) Improve TestLoad.java: use own separated folder under /tmp

[ https://issues.apache.org/jira/browse/PIG-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15686400#comment-15686400 ] Adam Szita commented on PIG-5025: - Thanks for reviewing [~rohini] I fixed the relative path

[jira] [Updated] (PIG-5025) Improve TestLoad.java: use own separated folder under /tmp

[ https://issues.apache.org/jira/browse/PIG-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5025: Attachment: PIG-5025.3.patch > Improve TestLoad.java: use own separated folder under /tmp > --

[jira] [Updated] (PIG-5052) Initialize MRConfiguration.JOB_ID in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5052: Resolution: Fixed Status: Resolved (was: Patch Available) > Initialize MRConfiguration.JOB_ID in spar

[jira] [Commented] (PIG-5052) Initialize MRConfiguration.JOB_ID in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15686194#comment-15686194 ] Adam Szita commented on PIG-5052: - Thanks for the review and committing [~kellyzly] and [~xu