[jira] [Commented] (SPARK-22451) Reduce decision tree aggregate size for unordered features from O(2^numCategories) to O(numCategories)

[ https://issues.apache.org/jira/browse/SPARK-22451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241634#comment-16241634 ] Weichen Xu commented on SPARK-22451: [~josephkb] I think it can be reconstructed from a summary with

[jira] [Assigned] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22464: Assignee: Apache Spark (was: Xiao Li) > <=> is not supported by Hive metastore partition

[jira] [Commented] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241607#comment-16241607 ] Apache Spark commented on SPARK-22464: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22464: Assignee: Xiao Li (was: Apache Spark) > <=> is not supported by Hive metastore partition

[jira] [Created] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

Xiao Li created SPARK-22464: --- Summary: <=> is not supported by Hive metastore partition predicate pushdown Key: SPARK-22464 URL: https://issues.apache.org/jira/browse/SPARK-22464 Project: Spark

[jira] [Comment Edited] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241577#comment-16241577 ] Serkan Taş edited comment on SPARK-19680 at 11/7/17 6:37 AM: - I frequently

[jira] [Comment Edited] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241577#comment-16241577 ] Serkan Taş edited comment on SPARK-19680 at 11/7/17 6:37 AM: - I frequently

[jira] [Commented] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241577#comment-16241577 ] Serkan Taş commented on SPARK-19680: I have the same issue also on a yarn cluster for a job running 4

[jira] [Updated] (SPARK-22289) Cannot save LogisticRegressionClassificationModel with bounds on coefficients

[ https://issues.apache.org/jira/browse/SPARK-22289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-22289: Shepherd: Yanbo Liang > Cannot save LogisticRegressionClassificationModel with bounds on

[jira] [Assigned] (SPARK-22289) Cannot save LogisticRegressionClassificationModel with bounds on coefficients

[ https://issues.apache.org/jira/browse/SPARK-22289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-22289: --- Assignee: yuhao yang > Cannot save LogisticRegressionClassificationModel with bounds on

[jira] [Updated] (SPARK-22453) Zookeeper configuration for MesosClusterDispatcher is not documented

[ https://issues.apache.org/jira/browse/SPARK-22453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jais Sebastian updated SPARK-22453: --- Priority: Critical (was: Major) > Zookeeper configuration for MesosClusterDispatcher is

[jira] [Commented] (SPARK-22373) Intermittent NullPointerException in org.codehaus.janino.IClass.isAssignableFrom

[ https://issues.apache.org/jira/browse/SPARK-22373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241469#comment-16241469 ] Kazuaki Ishizaki commented on SPARK-22373: -- If you can submit a program that can reproduce this,

[jira] [Issue Comment Deleted] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Peng updated SPARK-22359: -- Comment: was deleted (was: [~jiangxb] If I can have 1 test as reference, I will figure out the rests

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241392#comment-16241392 ] Teng Peng commented on SPARK-22359: --- [~jiangxb] If I can have 1 test as reference, I will figure out

[jira] [Commented] (SPARK-22463) Missing hadoop/hive/hbase/etc configuration files in SPARK_CONF_DIR to distributed archive

[ https://issues.apache.org/jira/browse/SPARK-22463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241389#comment-16241389 ] Apache Spark commented on SPARK-22463: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22463) Missing hadoop/hive/hbase/etc configuration files in SPARK_CONF_DIR to distributed archive

[ https://issues.apache.org/jira/browse/SPARK-22463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22463: Assignee: (was: Apache Spark) > Missing hadoop/hive/hbase/etc configuration files in

[jira] [Assigned] (SPARK-22463) Missing hadoop/hive/hbase/etc configuration files in SPARK_CONF_DIR to distributed archive

[ https://issues.apache.org/jira/browse/SPARK-22463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22463: Assignee: Apache Spark > Missing hadoop/hive/hbase/etc configuration files in

[jira] [Created] (SPARK-22463) Missing hadoop/hive/hbase/etc configuration files in SPARK_CONF_DIR to distributed archive

Kent Yao created SPARK-22463: Summary: Missing hadoop/hive/hbase/etc configuration files in SPARK_CONF_DIR to distributed archive Key: SPARK-22463 URL: https://issues.apache.org/jira/browse/SPARK-22463

[jira] [Updated] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-22462: -- Attachment: collect.png foreach.png > SQL metrics missing after

[jira] [Created] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

Juliusz Sompolski created SPARK-22462: - Summary: SQL metrics missing after foreach operation on dataframe Key: SPARK-22462 URL: https://issues.apache.org/jira/browse/SPARK-22462 Project: Spark

[jira] [Assigned] (SPARK-20652) Make SQL UI use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20652: Assignee: Apache Spark > Make SQL UI use new app state store >

[jira] [Commented] (SPARK-20652) Make SQL UI use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241245#comment-16241245 ] Apache Spark commented on SPARK-20652: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20652) Make SQL UI use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20652: Assignee: (was: Apache Spark) > Make SQL UI use new app state store >

[jira] [Assigned] (SPARK-22330) Linear containsKey operation for serialized maps.

[ https://issues.apache.org/jira/browse/SPARK-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22330: --- Assignee: Alexander > Linear containsKey operation for serialized maps. >

[jira] [Resolved] (SPARK-22330) Linear containsKey operation for serialized maps.

[ https://issues.apache.org/jira/browse/SPARK-22330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22330. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19553

[jira] [Created] (SPARK-22461) Move Spark ML model summaries into a dedicated package

Seth Hendrickson created SPARK-22461: Summary: Move Spark ML model summaries into a dedicated package Key: SPARK-22461 URL: https://issues.apache.org/jira/browse/SPARK-22461 Project: Spark

[jira] [Commented] (SPARK-22451) Reduce decision tree aggregate size for unordered features from O(2^numCategories) to O(numCategories)

[ https://issues.apache.org/jira/browse/SPARK-22451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240967#comment-16240967 ] Joseph K. Bradley commented on SPARK-22451: --- How does this work? For unordered features, we

[jira] [Resolved] (SPARK-22078) clarify exception behaviors for all data source v2 interfaces

[ https://issues.apache.org/jira/browse/SPARK-22078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22078. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19623

[jira] [Commented] (SPARK-20647) Make the Storage page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240895#comment-16240895 ] Apache Spark commented on SPARK-20647: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20647) Make the Storage page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20647: Assignee: (was: Apache Spark) > Make the Storage page use new app state store >

[jira] [Assigned] (SPARK-20647) Make the Storage page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20647: Assignee: Apache Spark > Make the Storage page use new app state store >

[jira] [Updated] (SPARK-22460) Spark De-serialization of Timestamp field is Incorrect

[ https://issues.apache.org/jira/browse/SPARK-22460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saniya Tech updated SPARK-22460: Description: We are trying to serialize Timestamp fields to Avro using spark-avro connector. I

[jira] [Created] (SPARK-22460) Spark De-serialization of Timestamp field is Incorrect

Saniya Tech created SPARK-22460: --- Summary: Spark De-serialization of Timestamp field is Incorrect Key: SPARK-22460 URL: https://issues.apache.org/jira/browse/SPARK-22460 Project: Spark Issue

[jira] [Assigned] (SPARK-20646) Make Executors page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20646: Assignee: Apache Spark > Make Executors page use new app state store >

[jira] [Assigned] (SPARK-20646) Make Executors page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20646: Assignee: (was: Apache Spark) > Make Executors page use new app state store >

[jira] [Commented] (SPARK-20646) Make Executors page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240805#comment-16240805 ] Apache Spark commented on SPARK-20646: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-20645) Make Environment page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240783#comment-16240783 ] Apache Spark commented on SPARK-20645: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20645) Make Environment page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20645: Assignee: Apache Spark > Make Environment page use new app state store >

[jira] [Assigned] (SPARK-20645) Make Environment page use new app state store

[ https://issues.apache.org/jira/browse/SPARK-20645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20645: Assignee: (was: Apache Spark) > Make Environment page use new app state store >

[jira] [Updated] (SPARK-22459) EdgeDirection "Either" Does Not Considerate Real "Either" Direction

[ https://issues.apache.org/jira/browse/SPARK-22459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom updated SPARK-22459: Description: When running functions involving

[jira] [Updated] (SPARK-22459) EdgeDirection "Either" Does Not Considerate Real "Either" Direction

[ https://issues.apache.org/jira/browse/SPARK-22459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom updated SPARK-22459: Description: When running functions involving

[jira] [Updated] (SPARK-22459) EdgeDirection "Either" Does Not Considerate Real "Either" Direction

[ https://issues.apache.org/jira/browse/SPARK-22459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom updated SPARK-22459: Description: When running functions involving

[jira] [Created] (SPARK-22459) EdgeDirection "Either" Does Not Considerate real "either" direction

Tom created SPARK-22459: --- Summary: EdgeDirection "Either" Does Not Considerate real "either" direction Key: SPARK-22459 URL: https://issues.apache.org/jira/browse/SPARK-22459 Project: Spark Issue

[jira] [Commented] (SPARK-22427) StackOverFlowError when using FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240662#comment-16240662 ] lyt commented on SPARK-22427: - Maybe it's problem of DataFrame. This problem won't occur when using pure

[jira] [Closed] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-22458. - > OutOfDirectMemoryError with Spark 2.2 > - > > Key:

[jira] [Resolved] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22458. --- Resolution: Not A Problem Changes in implementation between minor releases could change memory

[jira] [Reopened] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati reopened SPARK-22458: --- It's working with same configs using Spark 2.1, why not on Spark 2.2 and why Spark 2.2

[jira] [Resolved] (SPARK-22315) Check for version match between R package and JVM

[ https://issues.apache.org/jira/browse/SPARK-22315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-22315. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue

[jira] [Commented] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240537#comment-16240537 ] Kaushal Prajapati commented on SPARK-22458: --- yes, but we tried multiple times, same code is

[jira] [Commented] (SPARK-14516) Clustering evaluator

[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240468#comment-16240468 ] Apache Spark commented on SPARK-14516: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14540: Assignee: Apache Spark > Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[jira] [Assigned] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14540: Assignee: (was: Apache Spark) > Support Scala 2.12 closures and Java 8 lambdas in

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240422#comment-16240422 ] Apache Spark commented on SPARK-14540: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22458. --- Resolution: Not A Problem Please read http://spark.apache.org/contributing.html This just means

[jira] [Commented] (SPARK-22395) Fix the behavior of timestamp values for Pandas to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240396#comment-16240396 ] Apache Spark commented on SPARK-22395: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-20644) Hook up Spark UI to the new key-value store backend

[ https://issues.apache.org/jira/browse/SPARK-20644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20644. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19582

[jira] [Assigned] (SPARK-20644) Hook up Spark UI to the new key-value store backend

[ https://issues.apache.org/jira/browse/SPARK-20644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20644: Assignee: Marcelo Vanzin > Hook up Spark UI to the new key-value store backend >

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Resolved] (SPARK-22445) move CodegenContext.copyResult to CodegenSupport

[ https://issues.apache.org/jira/browse/SPARK-22445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22445. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19656

[jira] [Updated] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-22458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaushal Prajapati updated SPARK-22458: -- Description: We were using Spark 2.1 from last 6 months to execute multiple spark jobs

[jira] [Created] (SPARK-22458) OutOfDirectMemoryError with Spark 2.2

Kaushal Prajapati created SPARK-22458: - Summary: OutOfDirectMemoryError with Spark 2.2 Key: SPARK-22458 URL: https://issues.apache.org/jira/browse/SPARK-22458 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22456) Add new function dayofweek

[ https://issues.apache.org/jira/browse/SPARK-22456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240331#comment-16240331 ] Michael Styles commented on SPARK-22456: This functionality is part of the SQL standard and

[jira] [Updated] (SPARK-22457) Tables are supposed to be MANAGED only taking into account whether a path is provided

[ https://issues.apache.org/jira/browse/SPARK-22457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arroyo Cazorla updated SPARK-22457: - Description: As far as I know, since Spark 2.2, tables are supposed to be

[jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240314#comment-16240314 ] Sean Owen commented on SPARK-10399: --- I think this is mostly superseded by Arrow's intended role here,

[jira] [Updated] (SPARK-22457) Tables are supposed to be MANAGED only taking into account whether a path is provided

[ https://issues.apache.org/jira/browse/SPARK-22457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arroyo Cazorla updated SPARK-22457: - Description: As far as I know, since Spark 2.2, tables are supposed to be

[jira] [Updated] (SPARK-22457) Tables are supposed to be MANAGED only taking into account whether a path is provided

[ https://issues.apache.org/jira/browse/SPARK-22457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arroyo Cazorla updated SPARK-22457: - Description: As far as I know, since Spark 2.2, tables are supposed to be

[jira] [Created] (SPARK-22457) Tables are supposed to be MANAGED only taking into account whether a path is provided

David Arroyo Cazorla created SPARK-22457: Summary: Tables are supposed to be MANAGED only taking into account whether a path is provided Key: SPARK-22457 URL:

[jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240304#comment-16240304 ] Jim Pivarski commented on SPARK-10399: -- WontFix because PR 19222 has no conflicts and will be

[jira] [Commented] (SPARK-21640) Method mode with String parameters within DataFrameWriter is error prone

[ https://issues.apache.org/jira/browse/SPARK-21640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240298#comment-16240298 ] Apache Spark commented on SPARK-21640: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Comment Edited] (SPARK-3383) DecisionTree aggregate size could be smaller

[ https://issues.apache.org/jira/browse/SPARK-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240284#comment-16240284 ] Yan Facai (颜发才) edited comment on SPARK-3383 at 11/6/17 1:28 PM: -

[jira] [Commented] (SPARK-3383) DecisionTree aggregate size could be smaller

[ https://issues.apache.org/jira/browse/SPARK-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240284#comment-16240284 ] Yan Facai (颜发才) commented on SPARK-3383: [~WeichenXu123] Good work! I'd like to take a look if

[jira] [Assigned] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21195: Assignee: (was: Apache Spark) > MetricSystem should pick up dynamically registered

[jira] [Assigned] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21195: Assignee: Apache Spark > MetricSystem should pick up dynamically registered metrics in

[jira] [Reopened] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kruszewski reopened SPARK-21195: --- > MetricSystem should pick up dynamically registered metrics in sources >

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240274#comment-16240274 ] Robert Kruszewski commented on SPARK-21195: --- Thanks, indeed I responded that I missed the last

[jira] [Assigned] (SPARK-22456) Add new function dayofweek

[ https://issues.apache.org/jira/browse/SPARK-22456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22456: Assignee: (was: Apache Spark) > Add new function dayofweek >

[jira] [Commented] (SPARK-22456) Add new function dayofweek

[ https://issues.apache.org/jira/browse/SPARK-22456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240272#comment-16240272 ] Apache Spark commented on SPARK-22456: -- User 'ptkool' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22456) Add new function dayofweek

[ https://issues.apache.org/jira/browse/SPARK-22456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22456: Assignee: Apache Spark > Add new function dayofweek > -- > >

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240270#comment-16240270 ] Sean Owen commented on SPARK-21195: --- The PR hadn't been updated in almost half a year, and Jerry had

[jira] [Commented] (SPARK-22456) Add new function dayofweek

[ https://issues.apache.org/jira/browse/SPARK-22456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240269#comment-16240269 ] Sean Owen commented on SPARK-22456: --- Does it exist in other SQL dialects? that's the reason most

[jira] [Created] (SPARK-22456) Add new function dayofweek

Michael Styles created SPARK-22456: -- Summary: Add new function dayofweek Key: SPARK-22456 URL: https://issues.apache.org/jira/browse/SPARK-22456 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240267#comment-16240267 ] Robert Kruszewski commented on SPARK-21195: --- What's the justification for `won't fix` here? >

[jira] [Updated] (SPARK-22455) Provide an option to store the exception records/files and reasons in log files when reading data from a file-based data source.

[ https://issues.apache.org/jira/browse/SPARK-22455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22455: -- Flags: (was: Patch) Labels: (was: patch) Priority: Minor (was: Major) > Provide an

[jira] [Resolved] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21195. --- Resolution: Won't Fix > MetricSystem should pick up dynamically registered metrics in sources >

[jira] [Resolved] (SPARK-22154) add a shutdown hook that explains why the output is terminating

[ https://issues.apache.org/jira/browse/SPARK-22154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22154. --- Resolution: Won't Fix > add a shutdown hook that explains why the output is terminating >

[jira] [Resolved] (SPARK-20638) Optimize the CartesianRDD to reduce repeatedly data fetching

[ https://issues.apache.org/jira/browse/SPARK-20638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20638. --- Resolution: Won't Fix > Optimize the CartesianRDD to reduce repeatedly data fetching >

[jira] [Resolved] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10399. --- Resolution: Won't Fix > Off Heap Memory Access for non-JVM libraries (C++) >

[jira] [Resolved] (SPARK-13547) Add SQL query in web UI's SQL Tab

[ https://issues.apache.org/jira/browse/SPARK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13547. --- Resolution: Won't Fix > Add SQL query in web UI's SQL Tab > - > >

[jira] [Resolved] (SPARK-19458) loading hive jars from the local repo which has already downloaded

[ https://issues.apache.org/jira/browse/SPARK-19458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19458. --- Resolution: Won't Fix > loading hive jars from the local repo which has already downloaded >

[jira] [Resolved] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20044. --- Resolution: Won't Fix > Support Spark UI behind front-end reverse proxy using a path prefix >

[jira] [Resolved] (SPARK-19527) Approximate Size of Intersection of Bloom Filters

[ https://issues.apache.org/jira/browse/SPARK-19527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19527. --- Resolution: Won't Fix > Approximate Size of Intersection of Bloom Filters >

[jira] [Created] (SPARK-22455) Provide an option to store the exception records/files and reasons in log files when reading data from a file-based data source.

Sreenath Chothar created SPARK-22455: Summary: Provide an option to store the exception records/files and reasons in log files when reading data from a file-based data source. Key: SPARK-22455 URL:

[jira] [Commented] (SPARK-22297) Flaky test: BlockManagerSuite "Shuffle registration timeout and maxAttempts conf"

[ https://issues.apache.org/jira/browse/SPARK-22297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240228#comment-16240228 ] Apache Spark commented on SPARK-22297: -- User 'mpetruska' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22297) Flaky test: BlockManagerSuite "Shuffle registration timeout and maxAttempts conf"

[ https://issues.apache.org/jira/browse/SPARK-22297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22297: Assignee: (was: Apache Spark) > Flaky test: BlockManagerSuite "Shuffle registration

[jira] [Assigned] (SPARK-22297) Flaky test: BlockManagerSuite "Shuffle registration timeout and maxAttempts conf"

[ https://issues.apache.org/jira/browse/SPARK-22297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22297: Assignee: Apache Spark > Flaky test: BlockManagerSuite "Shuffle registration timeout and

[jira] [Commented] (SPARK-22454) ExternalShuffleClient.close() should check null

[ https://issues.apache.org/jira/browse/SPARK-22454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240192#comment-16240192 ] Apache Spark commented on SPARK-22454: -- User 'wangyum' has created a pull request for this issue:

  1   2   >