[jira] [Commented] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

[ https://issues.apache.org/jira/browse/SPARK-23945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928869#comment-16928869 ] Herman van Hovell commented on SPARK-23945: --- You can use a left semi join, e.g.: {code} SELECT

[jira] [Resolved] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28716. --- Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed > Add

[jira] [Resolved] (SPARK-28836) Remove the canonicalize(attributes) method from PlanExpression

[ https://issues.apache.org/jira/browse/SPARK-28836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28836. --- Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Assigned] (SPARK-28715) Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-28715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-28715: - Assignee: Ali Afroozeh > Introduce collectInPlanAndSubqueries and

[jira] [Resolved] (SPARK-28715) Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-28715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28715. --- Fix Version/s: 3.0.0 Resolution: Fixed > Introduce

[jira] [Assigned] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database

[ https://issues.apache.org/jira/browse/SPARK-28775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-28775: - Assignee: Sean Owen (was: Herman van Hovell) > DateTimeUtilsSuite fails for

[jira] [Created] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018h or newer timezone database

Herman van Hovell created SPARK-28775: - Summary: DateTimeUtilsSuite fails for JDKs using the tzdata2018h or newer timezone database Key: SPARK-28775 URL: https://issues.apache.org/jira/browse/SPARK-28775

[jira] [Resolved] (SPARK-28583) Subqueries should not call `onUpdatePlan` in Adaptive Query Execution

[ https://issues.apache.org/jira/browse/SPARK-28583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28583. --- Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 3.0.0 >

[jira] [Resolved] (SPARK-28241) Show metadata operations on ThriftServerTab

[ https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28241. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Show

[jira] [Commented] (SPARK-27466) LEAD function with 'ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING' causes exception in Spark

[ https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875992#comment-16875992 ] Herman van Hovell commented on SPARK-27466: --- Well, we could add it. I am just not sure what

[jira] [Resolved] (SPARK-23128) A new approach to do adaptive execution in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23128. --- Resolution: Fixed Fix Version/s: 3.0.0 > A new approach to do adaptive

[jira] [Assigned] (SPARK-23128) A new approach to do adaptive execution in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23128: - Assignee: Maryann Xue > A new approach to do adaptive execution in Spark SQL >

[jira] [Resolved] (SPARK-28057) Add method `clone` in catalyst TreeNode

[ https://issues.apache.org/jira/browse/SPARK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28057. --- Resolution: Fixed Fix Version/s: 3.0.0 > Add method `clone` in catalyst

[jira] [Assigned] (SPARK-28057) Add method `clone` in catalyst TreeNode

[ https://issues.apache.org/jira/browse/SPARK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-28057: - Assignee: Maryann Xue > Add method `clone` in catalyst TreeNode >

[jira] [Resolved] (SPARK-27071) Expose additional metrics in status.api.v1.StageData

[ https://issues.apache.org/jira/browse/SPARK-27071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-27071. --- Resolution: Fixed Fix Version/s: 3.0.0 > Expose additional metrics in

[jira] [Assigned] (SPARK-27071) Expose additional metrics in status.api.v1.StageData

[ https://issues.apache.org/jira/browse/SPARK-27071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-27071: - Assignee: Tom van Bussel > Expose additional metrics in

[jira] [Created] (SPARK-27449) Clean-up checks in CodegenSupport.limitNotReachedCond

Herman van Hovell created SPARK-27449: - Summary: Clean-up checks in CodegenSupport.limitNotReachedCond Key: SPARK-27449 URL: https://issues.apache.org/jira/browse/SPARK-27449 Project: Spark

[jira] [Commented] (SPARK-27052) Using PySpark udf in transform yields NULL values

[ https://issues.apache.org/jira/browse/SPARK-27052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799017#comment-16799017 ] Herman van Hovell commented on SPARK-27052: --- This is not supported at the moment. This will

[jira] [Assigned] (SPARK-26656) Benchmark for date/time functions and expressions

[ https://issues.apache.org/jira/browse/SPARK-26656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-26656: - Assignee: Maxim Gekk > Benchmark for date/time functions and expressions >

[jira] [Resolved] (SPARK-26656) Benchmark for date/time functions and expressions

[ https://issues.apache.org/jira/browse/SPARK-26656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26656. --- Resolution: Fixed Fix Version/s: 3.0.0 > Benchmark for date/time functions

[jira] [Assigned] (SPARK-26690) Checkpoints of Dataframes are not visible in the SQL UI

[ https://issues.apache.org/jira/browse/SPARK-26690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-26690: - Assignee: Tom van Bussel > Checkpoints of Dataframes are not visible in the

[jira] [Resolved] (SPARK-26690) Checkpoints of Dataframes are not visible in the SQL UI

[ https://issues.apache.org/jira/browse/SPARK-26690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26690. --- Resolution: Fixed Fix Version/s: 3.0.0 > Checkpoints of Dataframes are not

[jira] [Resolved] (SPARK-26680) StackOverflowError if Stream passed to groupBy

[ https://issues.apache.org/jira/browse/SPARK-26680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26680. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 3.0.0

[jira] [Resolved] (SPARK-26657) Port DayWeek, DayOfWeek and WeekDay on Proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-26657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26657. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > Port

[jira] [Resolved] (SPARK-26618) Make typed Timestamp/Date literals consistent to casting

[ https://issues.apache.org/jira/browse/SPARK-26618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26618. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > Make

[jira] [Resolved] (SPARK-26593) Use Proleptic Gregorian calendar in casting UTF8String to date/timestamp types

[ https://issues.apache.org/jira/browse/SPARK-26593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26593. --- Resolution: Fixed Fix Version/s: 3.0.0 > Use Proleptic Gregorian calendar in

[jira] [Assigned] (SPARK-26593) Use Proleptic Gregorian calendar in casting UTF8String to date/timestamp types

[ https://issues.apache.org/jira/browse/SPARK-26593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-26593: - Assignee: Maxim Gekk > Use Proleptic Gregorian calendar in casting UTF8String

[jira] [Resolved] (SPARK-26550) New datasource for benchmarking

[ https://issues.apache.org/jira/browse/SPARK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26550. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > New

[jira] [Resolved] (SPARK-26450) Map of schema is built too frequently in some wide queries

[ https://issues.apache.org/jira/browse/SPARK-26450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26450. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 3.0.0 >

[jira] [Resolved] (SPARK-26502) Get rid of hiveResultString() in QueryExecution

[ https://issues.apache.org/jira/browse/SPARK-26502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26502. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > Get

[jira] [Resolved] (SPARK-26495) Simplify SelectedField extractor

[ https://issues.apache.org/jira/browse/SPARK-26495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26495. --- Resolution: Fixed Fix Version/s: 3.0.0 > Simplify SelectedField extractor >

[jira] [Resolved] (SPARK-26504) Rope-wise dumping of Spark plans

[ https://issues.apache.org/jira/browse/SPARK-26504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26504. --- Resolution: Fixed Fix Version/s: 3.0.0 > Rope-wise dumping of Spark plans >

[jira] [Assigned] (SPARK-26504) Rope-wise dumping of Spark plans

[ https://issues.apache.org/jira/browse/SPARK-26504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-26504: - Assignee: Maxim Gekk > Rope-wise dumping of Spark plans >

[jira] [Created] (SPARK-26495) Simplify SelectedField extractor

Herman van Hovell created SPARK-26495: - Summary: Simplify SelectedField extractor Key: SPARK-26495 URL: https://issues.apache.org/jira/browse/SPARK-26495 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-26191) Control number of truncated fields

[ https://issues.apache.org/jira/browse/SPARK-26191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26191. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 >

[jira] [Assigned] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-26038: - Assignee: Juliusz Sompolski > Decimal toScalaBigInt/toJavaBigInteger not work

[jira] [Resolved] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26038. --- Resolution: Fixed Fix Version/s: 3.0.0 > Decimal

[jira] [Created] (SPARK-26131) Remove sqlContext.conf from Spark SQL physical operators

Herman van Hovell created SPARK-26131: - Summary: Remove sqlContext.conf from Spark SQL physical operators Key: SPARK-26131 URL: https://issues.apache.org/jira/browse/SPARK-26131 Project: Spark

[jira] [Resolved] (SPARK-26084) AggregateExpression.references fails on unresolved expression trees

[ https://issues.apache.org/jira/browse/SPARK-26084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26084. --- Resolution: Fixed Assignee: Simeon Simeonov Fix Version/s: 3.0.0

[jira] [Commented] (SPARK-26084) AggregateExpression.references fails on unresolved expression trees

[ https://issues.apache.org/jira/browse/SPARK-26084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689312#comment-16689312 ] Herman van Hovell commented on SPARK-26084: --- [~simeons] since you have already propose a

[jira] [Resolved] (SPARK-26023) Dumping truncated plans to a file

[ https://issues.apache.org/jira/browse/SPARK-26023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26023. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 >

[jira] [Assigned] (SPARK-25767) Error reported in Spark logs when using the org.apache.spark:spark-sql_2.11:2.3.2 Java library

[ https://issues.apache.org/jira/browse/SPARK-25767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-25767: - Assignee: Peter Toth > Error reported in Spark logs when using the >

[jira] [Resolved] (SPARK-25767) Error reported in Spark logs when using the org.apache.spark:spark-sql_2.11:2.3.2 Java library

[ https://issues.apache.org/jira/browse/SPARK-25767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-25767. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 > Error

[jira] [Resolved] (SPARK-25560) Allow Function Injection in SparkSessionExtensions

[ https://issues.apache.org/jira/browse/SPARK-25560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-25560. --- Resolution: Fixed Assignee: Russell Spitzer Fix Version/s: 3.0.0 >

[jira] [Updated] (SPARK-25708) HAVING without GROUP BY means global aggregate

[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-25708: -- Labels: correctness release-notes (was: correctness) > HAVING without GROUP BY means

[jira] [Created] (SPARK-25463) Make sure single expression can parse sort order

Herman van Hovell created SPARK-25463: - Summary: Make sure single expression can parse sort order Key: SPARK-25463 URL: https://issues.apache.org/jira/browse/SPARK-25463 Project: Spark

[jira] [Commented] (SPARK-25378) ArrayData.toArray assume UTF8String

[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608122#comment-16608122 ] Herman van Hovell commented on SPARK-25378: --- I think this particular use is wrong.

[jira] [Resolved] (SPARK-25209) Optimization in Dataset.apply for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-25209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-25209. --- Resolution: Fixed Assignee: Bogdan Raducanu Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-19355) Use map output statistices to improve global limit's parallelism

[ https://issues.apache.org/jira/browse/SPARK-19355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19355. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 >

[jira] [Assigned] (SPARK-23908) High-order function: transform(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23908: - Assignee: Takuya Ueshin (was: Herman van Hovell) > High-order function:

[jira] [Commented] (SPARK-16203) regexp_extract to return an ArrayType(StringType())

[ https://issues.apache.org/jira/browse/SPARK-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551966#comment-16551966 ] Herman van Hovell commented on SPARK-16203: --- [~nnicolini] adding {{regexp_extract_all}} makes

[jira] [Resolved] (SPARK-24488) Analyzer throws when generator is aliased multiple times

[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24488. --- Resolution: Fixed Assignee: Brandon Krieger Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-24846) Stabilize expression cannonicalization

[ https://issues.apache.org/jira/browse/SPARK-24846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24846. --- Resolution: Fixed Fix Version/s: 2.4.0 Fixed by gvr's PR. I could not find

[jira] [Comment Edited] (SPARK-23908) High-order function: transform(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548427#comment-16548427 ] Herman van Hovell edited comment on SPARK-23908 at 7/18/18 9:30 PM:

[jira] [Commented] (SPARK-23908) High-order function: transform(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548427#comment-16548427 ] Herman van Hovell commented on SPARK-23908: --- Yeah I am, sorry for the hold up. I'll try to

[jira] [Updated] (SPARK-18600) BZ2 CRC read error needs better reporting

[ https://issues.apache.org/jira/browse/SPARK-18600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18600: -- Labels: spree (was: ) > BZ2 CRC read error needs better reporting >

[jira] [Updated] (SPARK-23612) Specify formats for individual DateType and TimestampType columns in schemas

[ https://issues.apache.org/jira/browse/SPARK-23612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23612: -- Labels: DataType date spree sql (was: DataType date sql) > Specify formats for

[jira] [Updated] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators

[ https://issues.apache.org/jira/browse/SPARK-24838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-24838: -- Labels: spree (was: ) > Support uncorrelated IN/EXISTS subqueries for more operators

[jira] [Created] (SPARK-24846) Stabilize expression cannonicalization

Herman van Hovell created SPARK-24846: - Summary: Stabilize expression cannonicalization Key: SPARK-24846 URL: https://issues.apache.org/jira/browse/SPARK-24846 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError

[ https://issues.apache.org/jira/browse/SPARK-24536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-24536: -- Labels: beginner spree (was: beginner) > Query with nonsensical LIMIT hits

[jira] [Resolved] (SPARK-24757) Improve error message for broadcast timeouts

[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24757. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-24704) The order of stages in the DAG graph is incorrect

[ https://issues.apache.org/jira/browse/SPARK-24704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24704. --- Resolution: Fixed Assignee: StanZhai Fix Version/s: 2.4.0 > The

[jira] [Resolved] (SPARK-24648) SQLMetrics counters are not thread safe

[ https://issues.apache.org/jira/browse/SPARK-24648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24648. --- Resolution: Fixed Assignee: Stacy Kerkela Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-24575) Prohibit window expressions inside WHERE and HAVING clauses

[ https://issues.apache.org/jira/browse/SPARK-24575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24575. --- Resolution: Fixed Assignee: Anton Okolnychyi > Prohibit window expressions

[jira] [Reopened] (SPARK-21743) top-most limit should not cause memory leak

[ https://issues.apache.org/jira/browse/SPARK-21743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-21743: --- Reopening issue, this is causing a regression in the CSV reader. > top-most limit

[jira] [Assigned] (SPARK-24500) UnsupportedOperationException when trying to execute Union plan with Stream of children

[ https://issues.apache.org/jira/browse/SPARK-24500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-24500: - Assignee: Herman van Hovell > UnsupportedOperationException when trying to

[jira] [Resolved] (SPARK-24119) Add interpreted execution to SortPrefix expression

[ https://issues.apache.org/jira/browse/SPARK-24119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24119. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-24076) very bad performance when shuffle.partition = 8192

[ https://issues.apache.org/jira/browse/SPARK-24076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24076. --- Resolution: Fixed Assignee: yucai Fix Version/s: 2.4.0 > very bad

[jira] [Resolved] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions

[ https://issues.apache.org/jira/browse/SPARK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24043. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-16406) Reference resolution for large number of columns should be faster

[ https://issues.apache.org/jira/browse/SPARK-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16406. --- Resolution: Fixed Fix Version/s: 2.4.0 > Reference resolution for large

[jira] [Updated] (SPARK-24133) Reading Parquet files containing large strings can fail with java.lang.ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-24133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-24133: -- Fix Version/s: 2.3.1 > Reading Parquet files containing large strings can fail with >

[jira] [Commented] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450293#comment-16450293 ] Herman van Hovell commented on SPARK-24051: --- [~mgaido] do you have any idea why this is failing

[jira] [Resolved] (SPARK-23589) Add interpreted execution for ExternalMapToCatalyst expression

[ https://issues.apache.org/jira/browse/SPARK-23589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23589. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23595) Add interpreted execution for ValidateExternalType expression

[ https://issues.apache.org/jira/browse/SPARK-23595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23595. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-22362) Add unit test for Window Aggregate Functions

[ https://issues.apache.org/jira/browse/SPARK-22362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-22362. --- Resolution: Fixed Assignee: Attila Zsolt Piros Fix Version/s: 2.4.0

[jira] [Resolved] (SPARK-23976) UTF8String.concat() or ByteArray.concat() may allocate shorter structure.

[ https://issues.apache.org/jira/browse/SPARK-23976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23976. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23989) When using `SortShuffleWriter`, the data will be overwritten

[ https://issues.apache.org/jira/browse/SPARK-23989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23989. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.4.0

[jira] [Resolved] (SPARK-23584) Add interpreted execution to NewInstance expression

[ https://issues.apache.org/jira/browse/SPARK-23584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23584. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23588. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443934#comment-16443934 ] Herman van Hovell commented on SPARK-23711: --- Can you make a small PR initially so we can

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443882#comment-16443882 ] Herman van Hovell commented on SPARK-23711: --- ObjectHashAggregateExec uses code generations for

[jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic

[ https://issues.apache.org/jira/browse/SPARK-23711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443866#comment-16443866 ] Herman van Hovell commented on SPARK-23711: --- There a lot of places where we do not fallback to

[jira] [Resolved] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

[ https://issues.apache.org/jira/browse/SPARK-23875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23875. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23873) Use accessors in interpreted LambdaVariable

[ https://issues.apache.org/jira/browse/SPARK-23873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23873. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23864. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add Unsafe* copy methods to

[jira] [Created] (SPARK-23951) Use java classed in ExprValue and simplify a bunch of stuff

Herman van Hovell created SPARK-23951: - Summary: Use java classed in ExprValue and simplify a bunch of stuff Key: SPARK-23951 URL: https://issues.apache.org/jira/browse/SPARK-23951 Project: Spark

[jira] [Commented] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

[ https://issues.apache.org/jira/browse/SPARK-23945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432039#comment-16432039 ] Herman van Hovell commented on SPARK-23945: --- [~nchammas] we didn't add explicit dataset support

[jira] [Commented] (SPARK-23897) Guava version

[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430301#comment-16430301 ] Herman van Hovell commented on SPARK-23897: --- It is currently being discussed on the mailing

[jira] [Assigned] (SPARK-23908) High-order function: transform(array, function<T, U>) → array

[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23908: - Assignee: Herman van Hovell > High-order function: transform(array, function

[jira] [Assigned] (SPARK-23911) High-order function: reduce(array, initialState S, inputFunction<S, T, S>, outputFunction<S, R>) → R

[ https://issues.apache.org/jira/browse/SPARK-23911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23911: - Assignee: Herman van Hovell > High-order function: reduce(array, initialState

[jira] [Assigned] (SPARK-23909) High-order function: filter(array, function<T, boolean>) → array

[ https://issues.apache.org/jira/browse/SPARK-23909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23909: - Assignee: Herman van Hovell > High-order function: filter(array, function

[jira] [Commented] (SPARK-23897) Guava version

[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429873#comment-16429873 ] Herman van Hovell commented on SPARK-23897: --- That is not going to happen for a minor release,

[jira] [Commented] (SPARK-23897) Guava version

[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429866#comment-16429866 ] Herman van Hovell commented on SPARK-23897: --- This is a duplicate or SPARK-23854. We are not

[jira] [Created] (SPARK-23898) Simplify code generation for Add/Subtract with CalendarIntervals

Herman van Hovell created SPARK-23898: - Summary: Simplify code generation for Add/Subtract with CalendarIntervals Key: SPARK-23898 URL: https://issues.apache.org/jira/browse/SPARK-23898 Project:

[jira] [Resolved] (SPARK-23893) Possible overflow in long = int * int

[ https://issues.apache.org/jira/browse/SPARK-23893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23893. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23892) Improve coverage and fix lint error in UTF8String-related Suite

[ https://issues.apache.org/jira/browse/SPARK-23892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23892. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Resolved] (SPARK-23882) Is UTF8StringSuite.writeToOutputStreamUnderflow() supported?

[ https://issues.apache.org/jira/browse/SPARK-23882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23882. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 >

[jira] [Updated] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23864: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add Unsafe* copy

[jira] [Resolved] (SPARK-23582) Add interpreted execution to StaticInvoke expression

[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23582. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution to

[jira] [Resolved] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23593. --- Resolution: Fixed > Add interpreted execution for InitializeJavaBean expression >

  1   2   3   4   5   6   7   8   9   10   >