[jira] [Resolved] (SPARK-27069) Spark(2.3.2) LDA transfomation memory error(java.lang.OutOfMemoryError at java.io.ByteArrayOutputStream.hugeCapacity(ByteArrayOutputStream.java:1232

[ https://issues.apache.org/jira/browse/SPARK-27069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27069. --- Resolution: Duplicate > Spark(2.3.2) LDA transfomation memory error(java.lang.OutOfMemoryError at

[jira] [Resolved] (SPARK-27050) Bean Encoder serializes data in a wrong order if input schema is not ordered

[ https://issues.apache.org/jira/browse/SPARK-27050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27050. --- Resolution: Not A Problem > Bean Encoder serializes data in a wrong order if input schema is not

[jira] [Resolved] (SPARK-27146) Add two Yarn Configs according to spark home page configuration Instructions document

[ https://issues.apache.org/jira/browse/SPARK-27146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27146. --- Resolution: Won't Fix Fix Version/s: (was: 3.0.0) > Add two Yarn Configs according to

[jira] [Updated] (SPARK-27146) Add two Yarn Configs according to spark home page configuration Instructions document

[ https://issues.apache.org/jira/browse/SPARK-27146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27146: -- Issue Type: Improvement (was: Bug) > Add two Yarn Configs according to spark home page configuration

[jira] [Resolved] (SPARK-27150) Scheduling Within an Application : Spark SQL randomly failed on UDF

[ https://issues.apache.org/jira/browse/SPARK-27150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27150. --- Resolution: Duplicate I'm guessing this is a duplicate of SPARK-26555 > Scheduling Within an

[jira] [Updated] (SPARK-27167) What would be the possible impact if I upgrade /static/jquery-1.11.1.min.js ?

[ https://issues.apache.org/jira/browse/SPARK-27167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27167: -- Questions should go to the mailing list, and anything before Spark 2.3 is EOL. You may have a point, but

[jira] [Resolved] (SPARK-27156) why is the "http://:18080/static" browse able?

[ https://issues.apache.org/jira/browse/SPARK-27156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27156. --- Resolution: Invalid > why is the "http://:18080/static" browse able? >

[jira] [Resolved] (SPARK-27172) CRLF Injection/HTTP response splitting on spark embedded jetty servlet.

[ https://issues.apache.org/jira/browse/SPARK-27172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27172. --- Resolution: Won't Fix Spark 1.6 has been EOL for years > CRLF Injection/HTTP response splitting on

[jira] [Commented] (SPARK-27202) update comments to keep according with code

[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805405#comment-16805405 ] Sean Owen commented on SPARK-27202: --- Don't open JIRAs for things this minor > update comments to keep

[jira] [Updated] (SPARK-27202) update comments to keep according with code

[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27202: -- Priority: Trivial (was: Minor) > update comments to keep according with code >

[jira] [Resolved] (SPARK-27196) Beginning offset 115204574 is after the ending offset 115204516 for topic

[ https://issues.apache.org/jira/browse/SPARK-27196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27196. --- Resolution: Invalid Nothing here suggests a Spark problem right now. See the error message. JIRAs

[jira] [Resolved] (SPARK-27202) update comments to keep according with code

[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27202. --- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by

[jira] [Resolved] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27220. --- Resolution: Won't Fix > Remove Yarn specific leftover from CoarseGrainedSchedulerBackend >

[jira] [Resolved] (SPARK-27211) cast error when select column from Row

[ https://issues.apache.org/jira/browse/SPARK-27211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27211. --- Resolution: Invalid Questions should go to the mailing list. This is really hard to read; you

[jira] [Commented] (SPARK-27228) Spark long delay on close, possible problem with killing executors

[ https://issues.apache.org/jira/browse/SPARK-27228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805398#comment-16805398 ] Sean Owen commented on SPARK-27228: --- (Please don't reopen unless the info or discussion has materially

[jira] [Updated] (SPARK-27244) Conf Log Displays Password In Clear Text

[ https://issues.apache.org/jira/browse/SPARK-27244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27244: -- Priority: Minor (was: Major) > Conf Log Displays Password In Clear Text >

[jira] [Resolved] (SPARK-27244) Conf Log Displays Password In Clear Text

[ https://issues.apache.org/jira/browse/SPARK-27244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27244. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3.0.0

[jira] [Assigned] (SPARK-27244) Conf Log Displays Password In Clear Text

[ https://issues.apache.org/jira/browse/SPARK-27244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27244: - Assignee: Ninad > Conf Log Displays Password In Clear Text >

[jira] [Commented] (SPARK-27273) Compile break for UserDefinedType (DataType) subclasses with javac 8

[ https://issues.apache.org/jira/browse/SPARK-27273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805357#comment-16805357 ] Sean Owen commented on SPARK-27273: --- You mean this fails when you compile your own Java code, not

[jira] [Resolved] (SPARK-27284) Spark Standalone aggregated logs in 1 file per appid (ala yarn -logs -applicationId)

[ https://issues.apache.org/jira/browse/SPARK-27284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27284. --- Resolution: Invalid This is not nearly clearly enough described; I can't make out what this is

[jira] [Updated] (SPARK-27289) spark-submit explicit configuration does not take effect but Spark UI shows it's effective

[ https://issues.apache.org/jira/browse/SPARK-27289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27289: -- Priority: Minor (was: Major) > spark-submit explicit configuration does not take effect but Spark UI

[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805348#comment-16805348 ] Sean Owen commented on SPARK-27298: --- I think your data has newlines issues, causing it to be parsed

[jira] [Commented] (SPARK-27267) Snappy 1.1.7.1 fails when decompressing empty serialized data

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805338#comment-16805338 ] Sean Owen commented on SPARK-27267: --- That's fine, can't hurt, but won't do anything now. > Snappy

[jira] [Updated] (SPARK-27267) Snappy 1.1.7.1 fails when decompressing empty serialized data

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27267: -- Summary: Snappy 1.1.7.1 fails when decompressing empty serialized data (was: spark 2.4 use 1.1.7.x

[jira] [Assigned] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27267: - Assignee: Max Xie > spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from

[jira] [Commented] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805274#comment-16805274 ] Sean Owen commented on SPARK-27267: --- Good call, looks like it has a Java 9+ fix too, which we may need

[jira] [Created] (SPARK-27323) Use Single-Abstract-Method support in Scala 2.12 to simplify code

Sean Owen created SPARK-27323: - Summary: Use Single-Abstract-Method support in Scala 2.12 to simplify code Key: SPARK-27323 URL: https://issues.apache.org/jira/browse/SPARK-27323 Project: Spark

[jira] [Commented] (SPARK-27121) Resolve Scala compiler failure for Java 9+ in REPL

[ https://issues.apache.org/jira/browse/SPARK-27121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804555#comment-16804555 ] Sean Owen commented on SPARK-27121: --- Yeah you're right. I got the tests to pass without much change.

[jira] [Updated] (SPARK-26771) Make .unpersist(), .destroy() consistently non-blocking by default

[ https://issues.apache.org/jira/browse/SPARK-26771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26771: -- Docs Text: The RDD and DataFrame .unpersist() method, and Broadcast .destroy() method, take an

[jira] [Resolved] (SPARK-26914) ThriftServer scheduler pool may be unpredictably when using fair schedule mode

[ https://issues.apache.org/jira/browse/SPARK-26914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26914. --- Resolution: Fixed Assignee: zhoukang Fix Version/s: 3.0.0 Resolved by

[jira] [Commented] (SPARK-18262) JSON.org license is now CatX

[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802736#comment-16802736 ] Sean Owen commented on SPARK-18262: --- I don't see org.json:json in the output of mvn dependency:tree

[jira] [Resolved] (SPARK-27140) The feature is 'insert overwrite local directory' has an inconsistent behavior in different environment.

[ https://issues.apache.org/jira/browse/SPARK-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27140. --- Resolution: Duplicate > The feature is 'insert overwrite local directory' has an inconsistent >

[jira] [Resolved] (SPARK-27226) Reduce the code duplicate when upgrading built-in Hive

[ https://issues.apache.org/jira/browse/SPARK-27226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27226. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24166

[jira] [Assigned] (SPARK-27226) Reduce the code duplicate when upgrading built-in Hive

[ https://issues.apache.org/jira/browse/SPARK-27226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27226: - Assignee: Yuming Wang > Reduce the code duplicate when upgrading built-in Hive >

[jira] [Assigned] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26961: - Assignee: Ajith S > Found Java-level deadlock in Spark Driver >

[jira] [Resolved] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26961. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3.0.0

[jira] [Resolved] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27274. --- Resolution: Fixed Fix Version/s: 2.4.1 Resolved by

[jira] [Created] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.x

Sean Owen created SPARK-27274: - Summary: Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.x Key: SPARK-27274 URL: https://issues.apache.org/jira/browse/SPARK-27274 Project: Spark

[jira] [Resolved] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27198. --- Resolution: Fixed Fix Version/s: 2.4.2 Issue resolved by pull request 24140

[jira] [Assigned] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27198: - Assignee: Ajith S > Heartbeat interval mismatch in driver and executor >

[jira] [Assigned] (SPARK-27155) Docker Oracle XE image docker image has been removed by DockerHub

[ https://issues.apache.org/jira/browse/SPARK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27155: - Assignee: Zhu, Lipeng > Docker Oracle XE image docker image has been removed by DockerHub >

[jira] [Resolved] (SPARK-27155) Docker Oracle XE image docker image has been removed by DockerHub

[ https://issues.apache.org/jira/browse/SPARK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27155. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24086

[jira] [Resolved] (SPARK-27263) Hide `Hadoop Properties` table in Environment page if it's empty

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27263. --- Resolution: Won't Fix > Hide `Hadoop Properties` table in Environment page if it's empty >

[jira] [Resolved] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26132. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23098

[jira] [Resolved] (SPARK-27250) Scala 2.11 maven compile should target Java 1.8

[ https://issues.apache.org/jira/browse/SPARK-27250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27250. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24184

[jira] [Resolved] (SPARK-27154) Incomplete Execution for Spark/dev/run-test-jenkins.py

[ https://issues.apache.org/jira/browse/SPARK-27154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27154. --- Resolution: Not A Problem Target Version/s: (was: 2.4.0) Don't set Target or Shepherd.

[jira] [Resolved] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23643. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20793

[jira] [Assigned] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23643: - Assignee: Maxim Gekk > XORShiftRandom.hashSeed allocates unnecessary memory >

[jira] [Resolved] (SPARK-27141) Use ConfigEntry for hardcoded configs Yarn

[ https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27141. --- Resolution: Fixed Issue resolved by pull request 24103 [https://github.com/apache/spark/pull/24103]

[jira] [Assigned] (SPARK-27141) Use ConfigEntry for hardcoded configs Yarn

[ https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27141: - Assignee: wangjiaochun > Use ConfigEntry for hardcoded configs Yarn >

[jira] [Resolved] (SPARK-27235) Remove the Dead code in HashedRelation.scala file from sql core module

[ https://issues.apache.org/jira/browse/SPARK-27235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27235. --- Resolution: Invalid This isn't dead code. Option(SparkEnv.get) may be None > Remove the Dead code

[jira] [Assigned] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27205: - Assignee: Jungtaek Lim > spark-shell with packages option fails to load transitive

[jira] [Resolved] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27205. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24147

[jira] [Commented] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797460#comment-16797460 ] Sean Owen commented on SPARK-27220: --- Probably [~irashid] would know better > Remove Yarn specific

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27160: -- Fix Version/s: (was: 3.0.0) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27160: -- Priority: Major (was: Blocker) > Incorrect Literal Casting of DecimalType in OrcFilters >

[jira] [Resolved] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27179. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24114

[jira] [Assigned] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27179: - Assignee: Yuming Wang Priority: Minor (was: Major) > Exclude javax.ws.rs:jsr311-api from

[jira] [Resolved] (SPARK-27063) Spark on K8S Integration Tests timeouts are too short for some test clusters

[ https://issues.apache.org/jira/browse/SPARK-27063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27063. --- Resolution: Won't Fix > Spark on K8S Integration Tests timeouts are too short for some test

[jira] [Resolved] (SPARK-27135) Description column under jobs does not show complete text if there is overflow

[ https://issues.apache.org/jira/browse/SPARK-27135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27135. --- Resolution: Not A Problem > Description column under jobs does not show complete text if there is

[jira] [Assigned] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27164: - Assignee: Ajith S > RDD.countApprox on empty RDDs schedules jobs which never complete >

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26979: -- Docs Text: In Spark 3.0, certain Pyspark SQL functions that previously only accepted a Column object

[jira] [Assigned] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26979: - Assignee: Andre Sa de Mello > [PySpark] Some SQL functions do not take column names >

[jira] [Resolved] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26979. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23882

[jira] [Resolved] (SPARK-27164) RDD.countApprox on empty RDDs schedules jobs which never complete

[ https://issues.apache.org/jira/browse/SPARK-27164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27164. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24100

[jira] [Resolved] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27070. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24116

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794532#comment-16794532 ] Sean Owen commented on SPARK-26961: --- Yes, I think implementing in Java is viable just for this reason.

[jira] [Resolved] (SPARK-27122) YARN test failures in Java 9+

[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27122. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24088

[jira] [Assigned] (SPARK-27122) YARN test failures in Java 9+

[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27122: - Assignee: Ajith S > YARN test failures in Java 9+ > - > >

[jira] [Updated] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27175: -- Priority: Minor (was: Major) > Upgrade hadoop-3 to 3.2.0 > - > >

[jira] [Assigned] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26941: - Assignee: liupengcheng > incorrect computation of maxNumExecutorFailures in ApplicationMaster

[jira] [Resolved] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26941. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23845

[jira] [Updated] (SPARK-26941) incorrect computation of maxNumExecutorFailures in ApplicationMaster for streaming

[ https://issues.apache.org/jira/browse/SPARK-26941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26941: -- Priority: Minor (was: Major) > incorrect computation of maxNumExecutorFailures in ApplicationMaster

[jira] [Resolved] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27175. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24106

[jira] [Assigned] (SPARK-27175) Upgrade hadoop-3 to 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27175: - Assignee: Yuming Wang > Upgrade hadoop-3 to 3.2.0 > - > >

[jira] [Assigned] (SPARK-27157) Add Executor level metrics to monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27157: - Assignee: Lantao Jin > Add Executor level metrics to monitoring docs >

[jira] [Resolved] (SPARK-27157) Add Executor level metrics to monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-27157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27157. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24090

[jira] [Resolved] (SPARK-27134) array_distinct function does not work correctly with columns containing array of array

[ https://issues.apache.org/jira/browse/SPARK-27134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27134. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794300#comment-16794300 ] Sean Owen commented on SPARK-26961: --- Hm! OK, I believe it. That almost seems like a bug in the JDK. I

[jira] [Assigned] (SPARK-27159) Update MsSqlServer dialect

[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27159: - Assignee: Zhu, Lipeng > Update MsSqlServer dialect > -- > >

[jira] [Updated] (SPARK-27159) Update MsSqlServer dialect handling of BLOB type

[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27159: -- Priority: Minor (was: Major) > Update MsSqlServer dialect handling of BLOB type >

[jira] [Updated] (SPARK-27159) Update MsSqlServer dialect handling of BLOB type

[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27159: -- Summary: Update MsSqlServer dialect handling of BLOB type (was: Update MsSqlServer dialect) >

[jira] [Resolved] (SPARK-27159) Update MsSqlServer dialect

[ https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27159. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24091

[jira] [Commented] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793703#comment-16793703 ] Sean Owen commented on SPARK-27177: --- Seems OK to me. > Update jenkins locale to en_US.UTF-8 >

[jira] [Assigned] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27070: - Assignee: Yuli Fiterman > DefaultPartitionCoalescer can lock up driver for hours >

[jira] [Resolved] (SPARK-27070) DefaultPartitionCoalescer can lock up driver for hours

[ https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27070. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23986

[jira] [Assigned] (SPARK-27138) Remove AdminUtils calls

[ https://issues.apache.org/jira/browse/SPARK-27138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27138: - Assignee: Dylan Guedes > Remove AdminUtils calls > --- > >

[jira] [Resolved] (SPARK-27138) Remove AdminUtils calls

[ https://issues.apache.org/jira/browse/SPARK-27138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27138. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24071

[jira] [Resolved] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26152. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24056

[jira] [Assigned] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26152: - Assignee: Ajith S > Flaky test: BroadcastSuite > -- > >

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791739#comment-16791739 ] Sean Owen commented on SPARK-26961: --- When I run your class and print the result of

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791634#comment-16791634 ] Sean Owen commented on SPARK-26961: --- [~ajithshetty] I see, OK. It could happen in the class itself, in

[jira] [Updated] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27145: -- Issue Type: Improvement (was: Bug) > Close store after test, in the SQLAppStatusListenerSuite >

[jira] [Commented] (SPARK-27143) Provide REST API for JDBC/ODBC level information

[ https://issues.apache.org/jira/browse/SPARK-27143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791615#comment-16791615 ] Sean Owen commented on SPARK-27143: --- Likewise here, we have a metrics system already. This doesn't say

[jira] [Commented] (SPARK-27142) Provide REST API for SQL level information

[ https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791614#comment-16791614 ] Sean Owen commented on SPARK-27142: --- We have a metrics system for metrics and a SQL tab for SQL

[jira] [Assigned] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27010: - Assignee: zuotingbing > find out the actual port number when hive.server2.thrift.port=0 >

[jira] [Resolved] (SPARK-27010) find out the actual port number when hive.server2.thrift.port=0

[ https://issues.apache.org/jira/browse/SPARK-27010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27010. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23917

[jira] [Resolved] (SPARK-27090) Removing old LEGACY_DRIVER_IDENTIFIER ("")

[ https://issues.apache.org/jira/browse/SPARK-27090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27090. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24026

[jira] [Assigned] (SPARK-27090) Removing old LEGACY_DRIVER_IDENTIFIER ("")

[ https://issues.apache.org/jira/browse/SPARK-27090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27090: - Assignee: Shivu Sondur > Removing old LEGACY_DRIVER_IDENTIFIER ("") >

[jira] [Assigned] (SPARK-27041) large partition data cause pyspark with python2.x oom

[ https://issues.apache.org/jira/browse/SPARK-27041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27041: - Assignee: David Yang > large partition data cause pyspark with python2.x oom >

<    1   2   3   4   5   6   7   8   9   10   >