[jira] [Resolved] (SPARK-23736) High-order function: concat(array1, array2, ..., arrayN) → array

[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23736. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20858

[jira] [Assigned] (SPARK-23736) High-order function: concat(array1, array2, ..., arrayN) → array

[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23736: - Assignee: Marek Novotny > High-order function: concat(array1, array2, ..., arrayN) →

[jira] [Commented] (SPARK-22448) Add functions like Mode(), NumNulls(), etc. in Summarizer

[ https://issues.apache.org/jira/browse/SPARK-22448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445355#comment-16445355 ] Dedunu Dhananjaya commented on SPARK-22448: --- I'm thinking about implementing this. Is it okay

[jira] [Commented] (SPARK-23877) Metadata-only queries do not push down filter conditions

[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445302#comment-16445302 ] Apache Spark commented on SPARK-23877: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-23877) Metadata-only queries do not push down filter conditions

[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23877. - Resolution: Fixed Issue resolved by pull request 20988

[jira] [Assigned] (SPARK-23877) Metadata-only queries do not push down filter conditions

[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23877: --- Assignee: Ryan Blue > Metadata-only queries do not push down filter conditions >

[jira] [Commented] (SPARK-24016) Yarn does not update node blacklist in static allocation

[ https://issues.apache.org/jira/browse/SPARK-24016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445252#comment-16445252 ] Saisai Shao commented on SPARK-24016: - I think this can be useful if we enabled

[jira] [Commented] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

[ https://issues.apache.org/jira/browse/SPARK-24025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445104#comment-16445104 ] Hyukjin Kwon commented on SPARK-24025: -- would be nicer if we take an action. If it's almost

[jira] [Commented] (SPARK-24030) SparkSQL percentile_approx function is too slow for over 1,060,000 records.

[ https://issues.apache.org/jira/browse/SPARK-24030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445103#comment-16445103 ] Hyukjin Kwon commented on SPARK-24030: -- It should be easier to debug and find the cause if there're

[jira] [Created] (SPARK-24030) SparkSQL percentile_approx function is too slow for over 1,060,000 records.

Seok-Joon,Yun created SPARK-24030: - Summary: SparkSQL percentile_approx function is too slow for over 1,060,000 records. Key: SPARK-24030 URL: https://issues.apache.org/jira/browse/SPARK-24030

[jira] [Resolved] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-24028. Resolution: Cannot Reproduce Closing this for now - we're continuing to investigate this

[jira] [Assigned] (SPARK-24029) Set "reuse address" flag on listen sockets

[ https://issues.apache.org/jira/browse/SPARK-24029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24029: Assignee: (was: Apache Spark) > Set "reuse address" flag on listen sockets >

[jira] [Assigned] (SPARK-24029) Set "reuse address" flag on listen sockets

[ https://issues.apache.org/jira/browse/SPARK-24029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24029: Assignee: Apache Spark > Set "reuse address" flag on listen sockets >

[jira] [Commented] (SPARK-24029) Set "reuse address" flag on listen sockets

[ https://issues.apache.org/jira/browse/SPARK-24029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445028#comment-16445028 ] Apache Spark commented on SPARK-24029: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

[ https://issues.apache.org/jira/browse/SPARK-24025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444998#comment-16444998 ] Jacek Laskowski commented on SPARK-24025: - The other issue seems similar. > Join of bucketed and

[jira] [Created] (SPARK-24029) Set "reuse address" flag on listen sockets

Marcelo Vanzin created SPARK-24029: -- Summary: Set "reuse address" flag on listen sockets Key: SPARK-24029 URL: https://issues.apache.org/jira/browse/SPARK-24029 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444930#comment-16444930 ] Xiao Li commented on SPARK-24005: - cc [~maxgekk] > Remove usage of Scala’s parallel collection >

[jira] [Comment Edited] (SPARK-23996) Implement the optimal KLL algorithms for quantiles in streams

[ https://issues.apache.org/jira/browse/SPARK-23996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444909#comment-16444909 ] Miao Wang edited comment on SPARK-23996 at 4/19/18 10:34 PM: - [~timhunter]

[jira] [Commented] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

[ https://issues.apache.org/jira/browse/SPARK-24025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444911#comment-16444911 ] Takeshi Yamamuro commented on SPARK-24025: -- This is the same with 

[jira] [Commented] (SPARK-23996) Implement the optimal KLL algorithms for quantiles in streams

[ https://issues.apache.org/jira/browse/SPARK-23996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444909#comment-16444909 ] Miao Wang commented on SPARK-23996: --- [~timhunter] There is a Java implementation:

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444902#comment-16444902 ] Anirudh Ramanathan commented on SPARK-24028: My suspicion here is that this has to do with

[jira] [Comment Edited] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444902#comment-16444902 ] Anirudh Ramanathan edited comment on SPARK-24028 at 4/19/18 10:22 PM:

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444899#comment-16444899 ] Yinan Li commented on SPARK-24028: -- 2.3.0 does create a configmap for the init-container if one is used.

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444898#comment-16444898 ] Matt Cheah commented on SPARK-24028: [~liyinan926] just noticed your comment edit - agreed that the

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444894#comment-16444894 ] Matt Cheah commented on SPARK-24028: I don't think the 2.3.0 release creates any volume mounts except

[jira] [Comment Edited] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444890#comment-16444890 ] Yinan Li edited comment on SPARK-24028 at 4/19/18 10:14 PM: I run a 1.9.6

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444890#comment-16444890 ] Yinan Li commented on SPARK-24028: -- I run a 1.9.6 cluster. No, I was using the 2.3.0 release. > [K8s]

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444887#comment-16444887 ] Matt Cheah commented on SPARK-24028: [~liyinan926] what specific point version of Kubernetes are you

[jira] [Comment Edited] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444881#comment-16444881 ] Anirudh Ramanathan edited comment on SPARK-24028 at 4/19/18 10:09 PM:

[jira] [Resolved] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24022. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444881#comment-16444881 ] Anirudh Ramanathan commented on SPARK-24028: This is curious. Is this a recent change? You

[jira] [Assigned] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24022: -- Assignee: Gabor Somogyi > Flaky test: SparkContextSuite >

[jira] [Commented] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

[ https://issues.apache.org/jira/browse/SPARK-24028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444856#comment-16444856 ] Yinan Li commented on SPARK-24028: -- I am also running a 1.9 cluster on GKE and I have never run into the

[jira] [Created] (SPARK-24028) [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior

Matt Cheah created SPARK-24028: -- Summary: [K8s] Creating secrets and config maps before creating the driver pod has unpredictable behavior Key: SPARK-24028 URL: https://issues.apache.org/jira/browse/SPARK-24028

[jira] [Assigned] (SPARK-24020) Sort-merge join inner range optimization

[ https://issues.apache.org/jira/browse/SPARK-24020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24020: Assignee: Apache Spark > Sort-merge join inner range optimization >

[jira] [Assigned] (SPARK-24020) Sort-merge join inner range optimization

[ https://issues.apache.org/jira/browse/SPARK-24020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24020: Assignee: (was: Apache Spark) > Sort-merge join inner range optimization >

[jira] [Commented] (SPARK-24020) Sort-merge join inner range optimization

[ https://issues.apache.org/jira/browse/SPARK-24020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444814#comment-16444814 ] Apache Spark commented on SPARK-24020: -- User 'zecevicp' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24027) Support MapType(StringType, DataType) as root type by from_json

[ https://issues.apache.org/jira/browse/SPARK-24027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24027: Assignee: Apache Spark > Support MapType(StringType, DataType) as root type by from_json

[jira] [Assigned] (SPARK-24027) Support MapType(StringType, DataType) as root type by from_json

[ https://issues.apache.org/jira/browse/SPARK-24027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24027: Assignee: (was: Apache Spark) > Support MapType(StringType, DataType) as root type by

[jira] [Commented] (SPARK-24027) Support MapType(StringType, DataType) as root type by from_json

[ https://issues.apache.org/jira/browse/SPARK-24027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444724#comment-16444724 ] Apache Spark commented on SPARK-24027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-24027) Support MapType(StringType, DataType) as root type by from_json

Maxim Gekk created SPARK-24027: -- Summary: Support MapType(StringType, DataType) as root type by from_json Key: SPARK-24027 URL: https://issues.apache.org/jira/browse/SPARK-24027 Project: Spark

[jira] [Commented] (SPARK-19826) spark.ml Python API for PIC

[ https://issues.apache.org/jira/browse/SPARK-19826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444564#comment-16444564 ] Huaxin Gao commented on SPARK-19826: I am working on this and will have a PR soon. Thanks! >

[jira] [Commented] (SPARK-19827) spark.ml R API for PIC

[ https://issues.apache.org/jira/browse/SPARK-19827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1679#comment-1679 ] Miao Wang commented on SPARK-19827: --- [~felixcheung] The scala code is just merged. I can work this now.

[jira] [Resolved] (SPARK-22362) Add unit test for Window Aggregate Functions

[ https://issues.apache.org/jira/browse/SPARK-22362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22362. --- Resolution: Fixed Assignee: Attila Zsolt Piros Fix Version/s: 2.4.0

[jira] [Updated] (SPARK-23340) Upgrade Apache ORC to 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-23340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23340: Fix Version/s: 2.3.1 > Upgrade Apache ORC to 1.4.3 > --- > > Key:

[jira] [Updated] (SPARK-23990) Instruments logging improvements - ML regression package

[ https://issues.apache.org/jira/browse/SPARK-23990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23990: -- Shepherd: Joseph K. Bradley > Instruments logging improvements - ML regression package

[jira] [Assigned] (SPARK-23990) Instruments logging improvements - ML regression package

[ https://issues.apache.org/jira/browse/SPARK-23990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-23990: - Assignee: Weichen Xu > Instruments logging improvements - ML regression package

[jira] [Resolved] (SPARK-24026) spark.ml Scala/Java API for PIC

[ https://issues.apache.org/jira/browse/SPARK-24026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-24026. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21090

[jira] [Commented] (SPARK-24026) spark.ml Scala/Java API for PIC

[ https://issues.apache.org/jira/browse/SPARK-24026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444358#comment-16444358 ] Apache Spark commented on SPARK-24026: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24026) spark.ml Scala/Java API for PIC

[ https://issues.apache.org/jira/browse/SPARK-24026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24026: Assignee: Miao Wang (was: Apache Spark) > spark.ml Scala/Java API for PIC >

[jira] [Assigned] (SPARK-24026) spark.ml Scala/Java API for PIC

[ https://issues.apache.org/jira/browse/SPARK-24026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24026: Assignee: Apache Spark (was: Miao Wang) > spark.ml Scala/Java API for PIC >

[jira] [Created] (SPARK-24026) spark.ml Scala/Java API for PIC

Joseph K. Bradley created SPARK-24026: - Summary: spark.ml Scala/Java API for PIC Key: SPARK-24026 URL: https://issues.apache.org/jira/browse/SPARK-24026 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24020) Sort-merge join inner range optimization

[ https://issues.apache.org/jira/browse/SPARK-24020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444335#comment-16444335 ] Petar Zecevic commented on SPARK-24020: --- No, this implementation only applies to equi-joins that

[jira] [Resolved] (SPARK-23976) UTF8String.concat() or ByteArray.concat() may allocate shorter structure.

[ https://issues.apache.org/jira/browse/SPARK-23976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23976. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23989) When using `SortShuffleWriter`, the data will be overwritten

[ https://issues.apache.org/jira/browse/SPARK-23989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23989. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.4.0

[jira] [Commented] (SPARK-24019) AnalysisException for Window function expression to compute derivative

[ https://issues.apache.org/jira/browse/SPARK-24019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444202#comment-16444202 ] Barry Becker commented on SPARK-24019: -- Lowering to minor because I found a way to specify the

[jira] [Comment Edited] (SPARK-24019) AnalysisException for Window function expression to compute derivative

[ https://issues.apache.org/jira/browse/SPARK-24019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444202#comment-16444202 ] Barry Becker edited comment on SPARK-24019 at 4/19/18 3:07 PM: --- Lowering to

[jira] [Updated] (SPARK-24019) AnalysisException for Window function expression to compute derivative

[ https://issues.apache.org/jira/browse/SPARK-24019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barry Becker updated SPARK-24019: - Priority: Minor (was: Major) > AnalysisException for Window function expression to compute

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444099#comment-16444099 ] Apache Spark commented on SPARK-23711: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23711: Assignee: (was: Apache Spark) > Add fallback to interpreted execution logic >

[jira] [Assigned] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23711: Assignee: Apache Spark > Add fallback to interpreted execution logic >

[jira] [Resolved] (SPARK-24021) Fix bug in BlacklistTracker's updateBlacklistForFetchFailure

[ https://issues.apache.org/jira/browse/SPARK-24021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-24021. -- Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by pull

[jira] [Assigned] (SPARK-24021) Fix bug in BlacklistTracker's updateBlacklistForFetchFailure

[ https://issues.apache.org/jira/browse/SPARK-24021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-24021: Assignee: wuyi > Fix bug in BlacklistTracker's updateBlacklistForFetchFailure >

[jira] [Resolved] (SPARK-21811) Inconsistency when finding the widest common type of a combination of DateType, StringType, and NumericType

[ https://issues.apache.org/jira/browse/SPARK-21811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21811. -- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.4.0 Fixed in

[jira] [Commented] (SPARK-23964) why does Spillable wait for 32 elements?

[ https://issues.apache.org/jira/browse/SPARK-23964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444043#comment-16444043 ] Thomas Graves commented on SPARK-23964: --- so far in my testing I haven't seen any performance

[jira] [Assigned] (SPARK-23924) High-order function: element_at

[ https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23924: - Assignee: Kazuaki Ishizaki > High-order function: element_at >

[jira] [Resolved] (SPARK-23584) Add interpreted execution to NewInstance expression

[ https://issues.apache.org/jira/browse/SPARK-23584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23584. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23588. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443959#comment-16443959 ] Liang-Chi Hsieh commented on SPARK-23711: - Ok. > Add fallback to interpreted execution logic >

[jira] [Resolved] (SPARK-23924) High-order function: element_at

[ https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23924. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21053

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443934#comment-16443934 ] Herman van Hovell commented on SPARK-23711: --- Can you make a small PR initially so we can

[jira] [Updated] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-24022: -- Affects Version/s: (was: 2.4.0) 2.3.0 > Flaky test:

[jira] [Updated] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-24022: -- Component/s: (was: SQL) Spark Core > Flaky test: SparkContextSuite >

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443924#comment-16443924 ] Liang-Chi Hsieh commented on SPARK-23711: - Yeah, I agree that is a good rule. I will prepare a PR

[jira] [Updated] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

[ https://issues.apache.org/jira/browse/SPARK-24025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-24025: Attachment: join-jira.png > Join of bucketed and non-bucketed tables can give two

[jira] [Created] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

Jacek Laskowski created SPARK-24025: --- Summary: Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side Key: SPARK-24025 URL:

[jira] [Commented] (SPARK-24024) Fix deviance calculations in GLM to handle corner cases

[ https://issues.apache.org/jira/browse/SPARK-24024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443892#comment-16443892 ] Teng Peng commented on SPARK-24024: --- I will first reproduce the issue he has, check how does R handle

[jira] [Created] (SPARK-24024) Fix deviance calculations in GLM to handle corner cases

Teng Peng created SPARK-24024: - Summary: Fix deviance calculations in GLM to handle corner cases Key: SPARK-24024 URL: https://issues.apache.org/jira/browse/SPARK-24024 Project: Spark Issue

[jira] [Commented] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443884#comment-16443884 ] Hyukjin Kwon commented on SPARK-24023: -- cc [~shivaram] too of course. > Built-in SQL Functions

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443882#comment-16443882 ] Herman van Hovell commented on SPARK-23711: --- ObjectHashAggregateExec uses code generations for

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443879#comment-16443879 ] Liang-Chi Hsieh commented on SPARK-23711: - object hash aggregate? If you mean

[jira] [Updated] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24023: - Description: This JIRA targets to add an R functions corresponding to SPARK-23899. We have been

[jira] [Updated] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24023: - Issue Type: Umbrella (was: Improvement) > Built-in SQL Functions improvement in SparkR >

[jira] [Updated] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24023: - Description: This JIRA targets to add an R functions corresponding to SPARK-23899. We have been

[jira] [Commented] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443870#comment-16443870 ] Hyukjin Kwon commented on SPARK-24023: -- This is meant to be an umbrella. Please add a subtask.

[jira] [Created] (SPARK-24023) Built-in SQL Functions improvement in SparkR

Hyukjin Kwon created SPARK-24023: Summary: Built-in SQL Functions improvement in SparkR Key: SPARK-24023 URL: https://issues.apache.org/jira/browse/SPARK-24023 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-22797) Add multiple column support to PySpark Bucketizer

[ https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22797: Assignee: zhengruifeng (was: Apache Spark) > Add multiple column support to PySpark

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443866#comment-16443866 ] Herman van Hovell commented on SPARK-23711: --- There a lot of places where we do not fallback to

[jira] [Assigned] (SPARK-22797) Add multiple column support to PySpark Bucketizer

[ https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22797: Assignee: Apache Spark (was: zhengruifeng) > Add multiple column support to PySpark

[jira] [Updated] (SPARK-24009) spark2.3.0 INSERT OVERWRITE LOCAL DIRECTORY '/home/spark/aaaaab'

[ https://issues.apache.org/jira/browse/SPARK-24009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chris_j updated SPARK-24009: Description: local mode  spark execute "INSERT OVERWRITE LOCAL DIRECTORY " successfully. on yarn spark

[jira] [Commented] (SPARK-24009) spark2.3.0 INSERT OVERWRITE LOCAL DIRECTORY '/home/spark/aaaaab'

[ https://issues.apache.org/jira/browse/SPARK-24009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443860#comment-16443860 ] chris_j commented on SPARK-24009: - thanks your answer, but inoperant. local mode spark execute "INSERT

[jira] [Commented] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443797#comment-16443797 ] Apache Spark commented on SPARK-24022: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24022: Assignee: Apache Spark > Flaky test: SparkContextSuite > - >

[jira] [Assigned] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24022: Assignee: (was: Apache Spark) > Flaky test: SparkContextSuite >

[jira] [Commented] (SPARK-24022) Flaky test: SparkContextSuite

[ https://issues.apache.org/jira/browse/SPARK-24022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443779#comment-16443779 ] Gabor Somogyi commented on SPARK-24022: --- Working on this. > Flaky test: SparkContextSuite >

[jira] [Created] (SPARK-24022) Flaky test: SparkContextSuite

Gabor Somogyi created SPARK-24022: - Summary: Flaky test: SparkContextSuite Key: SPARK-24022 URL: https://issues.apache.org/jira/browse/SPARK-24022 Project: Spark Issue Type: Bug