[jira] [Created] (SPARK-29005) build failed: sparkSession.createDataFrame[Int](Seq(1,2))

Zhou Zach created SPARK-29005: - Summary: build failed: sparkSession.createDataFrame[Int](Seq(1,2)) Key: SPARK-29005 URL: https://issues.apache.org/jira/browse/SPARK-29005 Project: Spark Issue

[jira] [Resolved] (SPARK-28613) Spark SQL action collect just judge size of compressed RDD's size, not accurate enough

[ https://issues.apache.org/jira/browse/SPARK-28613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28613. -- Resolution: Won't Fix > Spark SQL action collect just judge size of compressed RDD's size,

[jira] [Resolved] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot

[ https://issues.apache.org/jira/browse/SPARK-21870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21870. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 20965

[jira] [Assigned] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot

[ https://issues.apache.org/jira/browse/SPARK-21870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21870: --- Assignee: Takeshi Yamamuro > Split codegen'd aggregation code into small functions for the

[jira] [Commented] (SPARK-29003) Spark history server startup hang due to deadlock

[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923877#comment-16923877 ] Jungtaek Lim commented on SPARK-29003: -- Could you provide full of jstack? I guess unless you modify

[jira] [Comment Edited] (SPARK-28246) State of UDAF: buffer is not cleared

[ https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923875#comment-16923875 ] Jungtaek Lim edited comment on SPARK-28246 at 9/6/19 2:25 AM: -- The implicit

[jira] [Commented] (SPARK-28246) State of UDAF: buffer is not cleared

[ https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923875#comment-16923875 ] Jungtaek Lim commented on SPARK-28246: -- The implicit rule is when initialize or equivalent method

[jira] [Comment Edited] (SPARK-28246) State of UDAF: buffer is not cleared

[ https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923875#comment-16923875 ] Jungtaek Lim edited comment on SPARK-28246 at 9/6/19 2:24 AM: -- The implicit

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Fix Version/s: 3.0.0 Target Version/s: 2.4.4 Description: *SparkSQL create table as

[jira] [Updated] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29000: Description: When we set spark.sql.decimalOperations.allowPrecisionLoss=false. For the sql below, the

[jira] [Updated] (SPARK-29004) DataFrameWriter.save does not work with bucketBy [and sortBy]

[ https://issues.apache.org/jira/browse/SPARK-29004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Parkhomenko updated SPARK-29004: -- Description: bucketBy (and sortBy) does not work in DataFrameWriter at least for JSON

[jira] [Created] (SPARK-29004) DataFrameWriter.save does not work with bucketBy [and sortBy]

Pavel Parkhomenko created SPARK-29004: - Summary: DataFrameWriter.save does not work with bucketBy [and sortBy] Key: SPARK-29004 URL: https://issues.apache.org/jira/browse/SPARK-29004 Project:

[jira] [Commented] (SPARK-28246) State of UDAF: buffer is not cleared

[ https://issues.apache.org/jira/browse/SPARK-28246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923850#comment-16923850 ] Pavel Parkhomenko commented on SPARK-28246: --- It is about initialization, not merge. > State

[jira] [Updated] (SPARK-29003) Spark history server startup hang due to deadlock

[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated SPARK-29003: Description: Occasionally when starting Spark History Server, the service process will hang

[jira] [Created] (SPARK-29003) Spark history server startup hang due to deadlock

shanyu zhao created SPARK-29003: --- Summary: Spark history server startup hang due to deadlock Key: SPARK-29003 URL: https://issues.apache.org/jira/browse/SPARK-29003 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries

[ https://issues.apache.org/jira/browse/SPARK-26989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923818#comment-16923818 ] Jungtaek Lim edited comment on SPARK-26989 at 9/5/19 11:46 PM: ---

[jira] [Commented] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries

[ https://issues.apache.org/jira/browse/SPARK-26989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923818#comment-16923818 ] Jungtaek Lim commented on SPARK-26989: --

[jira] [Assigned] (SPARK-28802) Document DESCRIBE DATABASE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28802: --- Assignee: kevin yu > Document DESCRIBE DATABASE in SQL Reference. >

[jira] [Resolved] (SPARK-28802) Document DESCRIBE DATABASE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28802. - Fix Version/s: 3.0.0 Resolution: Fixed > Document DESCRIBE DATABASE in SQL Reference. >

[jira] [Created] (SPARK-29002) Avoid changing SMJ to BHJ if the build side has a high ratio of empty partitions

Maryann Xue created SPARK-29002: --- Summary: Avoid changing SMJ to BHJ if the build side has a high ratio of empty partitions Key: SPARK-29002 URL: https://issues.apache.org/jira/browse/SPARK-29002

[jira] [Comment Edited] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923746#comment-16923746 ] lioz nudel edited comment on SPARK-28921 at 9/5/19 9:59 PM: Hi [~dongjoon],

[jira] [Comment Edited] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923746#comment-16923746 ] lioz nudel edited comment on SPARK-28921 at 9/5/19 9:37 PM: Hi [~dongjoon],

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923746#comment-16923746 ] lioz nudel commented on SPARK-28921: Hi [~dongjoon], [~skonto] We just encountered the same issue

[jira] [Resolved] (SPARK-26046) Add a way for StreamingQueryManager to remove all listeners

[ https://issues.apache.org/jira/browse/SPARK-26046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres resolved SPARK-26046. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25518

[jira] [Commented] (SPARK-16854) mapWithState Support for Python

[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923742#comment-16923742 ] Rupal H commented on SPARK-16854: - I'm interested in contributing to this. Need some tip on how should I

[jira] [Commented] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923741#comment-16923741 ] Christopher Hoshino-Fish commented on SPARK-28977: -- thanks Sean! > JDBC Dataframe

[jira] [Resolved] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-28770. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25673

[jira] [Assigned] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-28770: Assignee: Wing Yew Poon > Flaky Tests: Test ReplayListenerSuite.End-to-end replay with

[jira] [Updated] (SPARK-28980) Remove most remaining deprecated items since <= 2.2.0 for 3.0

[ https://issues.apache.org/jira/browse/SPARK-28980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28980: -- Description: Following on https://issues.apache.org/jira/browse/SPARK-25908 I'd like to propose

[jira] [Commented] (SPARK-28981) Missing library for reading/writing Snappy-compressed files

[ https://issues.apache.org/jira/browse/SPARK-28981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923682#comment-16923682 ] Sean Owen commented on SPARK-28981: --- (Really we could say it's a duplicate of

[jira] [Created] (SPARK-29001) Print event thread stack trace when EventQueue starts to drop events

Xingbo Jiang created SPARK-29001: Summary: Print event thread stack trace when EventQueue starts to drop events Key: SPARK-29001 URL: https://issues.apache.org/jira/browse/SPARK-29001 Project: Spark

[jira] [Commented] (SPARK-28981) Missing library for reading/writing Snappy-compressed files

[ https://issues.apache.org/jira/browse/SPARK-28981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923652#comment-16923652 ] Dongjoon Hyun commented on SPARK-28981: --- [~psschwei]. If you still see this in 2.4.4, please feel

[jira] [Resolved] (SPARK-28981) Missing library for reading/writing Snappy-compressed files

[ https://issues.apache.org/jira/browse/SPARK-28981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28981. --- Resolution: Cannot Reproduce Since this is fixed at 2.4.4, this seems to be reported at a

[jira] [Updated] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29000: Description: When we set spark.sql.decimalOperations.allowPrecisionLoss=false. For the sql below, the

[jira] [Updated] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29000: Description: When we set spark.sql.decimalOperations.allowPrecisionLoss=false. For the sql below, the

[jira] [Updated] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29000: Attachment: screenshot-1.png > [SQL] Decimal precision overflow when don't allow precision loss >

[jira] [Updated] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

[ https://issues.apache.org/jira/browse/SPARK-29000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29000: Description: When we set spark.sql.decimalOperations.allowPrecisionLoss=false. For the sql below, the

[jira] [Created] (SPARK-29000) [SQL] Decimal precision overflow when don't allow precision loss

feiwang created SPARK-29000: --- Summary: [SQL] Decimal precision overflow when don't allow precision loss Key: SPARK-29000 URL: https://issues.apache.org/jira/browse/SPARK-29000 Project: Spark

[jira] [Created] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

ruiliang created SPARK-28999: Summary: Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;; Key: SPARK-28999 URL:

[jira] [Created] (SPARK-28998) reorganize the packages of DS v2 interfaces/classes

Wenchen Fan created SPARK-28998: --- Summary: reorganize the packages of DS v2 interfaces/classes Key: SPARK-28998 URL: https://issues.apache.org/jira/browse/SPARK-28998 Project: Spark Issue

[jira] [Commented] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923572#comment-16923572 ] Gengliang Wang commented on SPARK-28934: After consideration, I have open

[jira] [Comment Edited] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923572#comment-16923572 ] Gengliang Wang edited comment on SPARK-28934 at 9/5/19 4:05 PM: After

[jira] [Updated] (SPARK-28928) Use Kafka delegation token protocol on sources/sinks

[ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28928: -- Summary: Use Kafka delegation token protocol on sources/sinks (was: Take over Kafka

[jira] [Commented] (SPARK-27492) GPU scheduling - High level user documentation

[ https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923528#comment-16923528 ] Thomas Graves commented on SPARK-27492: --- I think we talked about this a big in the prs for the

[jira] [Created] (SPARK-28997) Add `spark.sql.dialect`

Gengliang Wang created SPARK-28997: -- Summary: Add `spark.sql.dialect` Key: SPARK-28997 URL: https://issues.apache.org/jira/browse/SPARK-28997 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-28991) spark submit --conf spark.lineage.enabled参数是什么意思啊

[ https://issues.apache.org/jira/browse/SPARK-28991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923481#comment-16923481 ] Yuming Wang commented on SPARK-28991: - It seems to be the configuration of Cloudera Spark:

[jira] [Resolved] (SPARK-28991) spark submit --conf spark.lineage.enabled参数是什么意思啊

[ https://issues.apache.org/jira/browse/SPARK-28991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28991. - Resolution: Invalid > spark submit --conf spark.lineage.enabled参数是什么意思啊 >

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923462#comment-16923462 ] fengchaoge commented on SPARK-28990: Thank you very much， I have some idea about it，Analyzer's

[jira] [Comment Edited] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923450#comment-16923450 ] Tomasz Belina edited comment on SPARK-21994 at 9/5/19 1:49 PM: --- I've

[jira] [Commented] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923450#comment-16923450 ] Tomasz Belina commented on SPARK-21994: --- I've experienced the same issue on spark 2.4.3 > Spark

[jira] [Updated] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28977: -- Fix Version/s: 2.4.5 > JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page >

[jira] [Resolved] (SPARK-28547) Make it work for wide (> 10K columns data)

[ https://issues.apache.org/jira/browse/SPARK-28547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28547. -- Resolution: Incomplete Let's bring and put a possible approach or design together. To me, it

[jira] [Resolved] (SPARK-28975) How do I overwrite a piece of data and recalculate it?

[ https://issues.apache.org/jira/browse/SPARK-28975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28975. -- Resolution: Invalid Please ask questions into mailing list before filing here as an issue. >

[jira] [Updated] (SPARK-28996) Add tests regarding username of HiveClient

[ https://issues.apache.org/jira/browse/SPARK-28996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28996: - Summary: Add tests regarding username of HiveClient (was: Add tests regarding username for

[jira] [Created] (SPARK-28996) Add tests regarding username for HiveClient

Jungtaek Lim created SPARK-28996: Summary: Add tests regarding username for HiveClient Key: SPARK-28996 URL: https://issues.apache.org/jira/browse/SPARK-28996 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-28974) centralize the Data Source V2 table capability checks

[ https://issues.apache.org/jira/browse/SPARK-28974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28974. - Issue resolved by pull request 25679 [https://github.com/apache/spark/pull/25679] > centralize the

[jira] [Commented] (SPARK-28995) Document working of Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-28995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923356#comment-16923356 ] Shivu Sondur commented on SPARK-28995: -- i will check this issue > Document working of Spark

[jira] [Updated] (SPARK-28995) Document working of Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-28995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-28995: - Summary: Document working of Spark Streaming (was: Document working for Spark

[jira] [Updated] (SPARK-28995) Document working for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-28995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-28995: - Summary: Document working for Spark Streaming (was: Document working for

[jira] [Commented] (SPARK-28995) Document working for Streaming

[ https://issues.apache.org/jira/browse/SPARK-28995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923350#comment-16923350 ] ABHISHEK KUMAR GUPTA commented on SPARK-28995: -- cc:[~smilegator] [~dkbiswal] > Document

[jira] [Created] (SPARK-28995) Document working for Streaming

ABHISHEK KUMAR GUPTA created SPARK-28995: Summary: Document working for Streaming Key: SPARK-28995 URL: https://issues.apache.org/jira/browse/SPARK-28995 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28993) Document Working of Bucketing

[ https://issues.apache.org/jira/browse/SPARK-28993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923339#comment-16923339 ] ABHISHEK KUMAR GUPTA commented on SPARK-28993: -- cc [~smilegator] [~dkbiswal] > Document

[jira] [Commented] (SPARK-28994) Document working of Adaptive

[ https://issues.apache.org/jira/browse/SPARK-28994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923337#comment-16923337 ] ABHISHEK KUMAR GUPTA commented on SPARK-28994: -- cc [~LI,Xiao] [~dkbiswal] > Document

[jira] [Commented] (SPARK-28993) Document Working of Bucketing

[ https://issues.apache.org/jira/browse/SPARK-28993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1692#comment-1692 ] Shivu Sondur commented on SPARK-28993: -- i will be working on this   > Document Working of

[jira] [Commented] (SPARK-28994) Document working of Adaptive

[ https://issues.apache.org/jira/browse/SPARK-28994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923334#comment-16923334 ] Shivu Sondur commented on SPARK-28994: -- i will be working on this > Document working of Adaptive >

[jira] [Created] (SPARK-28994) Document working of Adaptive

ABHISHEK KUMAR GUPTA created SPARK-28994: Summary: Document working of Adaptive Key: SPARK-28994 URL: https://issues.apache.org/jira/browse/SPARK-28994 Project: Spark Issue Type:

[jira] [Created] (SPARK-28993) Document Working of Bucketing

ABHISHEK KUMAR GUPTA created SPARK-28993: Summary: Document Working of Bucketing Key: SPARK-28993 URL: https://issues.apache.org/jira/browse/SPARK-28993 Project: Spark Issue Type:

[jira] [Created] (SPARK-28992) Support update dependencies from hdfs when task run on executor pods

Kent Yao created SPARK-28992: Summary: Support update dependencies from hdfs when task run on executor pods Key: SPARK-28992 URL: https://issues.apache.org/jira/browse/SPARK-28992 Project: Spark

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923299#comment-16923299 ] Steve Loughran commented on SPARK-28945: It's a core part of the hadoop MR commit protocols. I

[jira] [Created] (SPARK-28991) spark submit --conf spark.lineage.enabled参数是什么意思啊

Zhou Zach created SPARK-28991: - Summary: spark submit --conf spark.lineage.enabled参数是什么意思啊 Key: SPARK-28991 URL: https://issues.apache.org/jira/browse/SPARK-28991 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28169) Spark can’t push down partition predicate for OR expression

[ https://issues.apache.org/jira/browse/SPARK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28169: - Issue Type: Improvement (was: Bug) > Spark can’t push down partition predicate for OR

[jira] [Resolved] (SPARK-28983) Can not pruning hive partitions by Or predicate

[ https://issues.apache.org/jira/browse/SPARK-28983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28983. -- Resolution: Duplicate > Can not pruning hive partitions by Or predicate >

[jira] [Updated] (SPARK-28988) "CliSuite#Commands using SerDe provided in --jars" not strong enough

[ https://issues.apache.org/jira/browse/SPARK-28988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28988: Description: [CliSuite#Commands using SerDe provided in

[jira] [Resolved] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27921. -- Resolution: Done > Convert applicable *.sql tests into UDF integrated test base >

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Fix Version/s: 3.0.0 > Convert applicable *.sql tests into UDF integrated test base >

[jira] [Assigned] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27921: Assignee: Hyukjin Kwon > Convert applicable *.sql tests into UDF integrated test base >

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28990: Target Version/s: (was: 2.4.4) > SparkSQL invalid call to toAttribute on unresolved object,

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28990: Fix Version/s: (was: 2.4.4) > SparkSQL invalid call to toAttribute on unresolved object,

[jira] [Assigned] (SPARK-28971) Convert and port 'pgSQL/aggregates_part4.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28971: Assignee: Hyukjin Kwon > Convert and port 'pgSQL/aggregates_part4.sql' into UDF test

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923231#comment-16923231 ] Shivu Sondur commented on SPARK-28990: -- i will check this issue > SparkSQL invalid call to

[jira] [Assigned] (SPARK-28272) Convert and port 'pgSQL/aggregates_part3.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28272: Assignee: Hyukjin Kwon > Convert and port 'pgSQL/aggregates_part3.sql' into UDF test

[jira] [Resolved] (SPARK-28272) Convert and port 'pgSQL/aggregates_part3.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28272. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25676

[jira] [Resolved] (SPARK-28971) Convert and port 'pgSQL/aggregates_part4.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28971. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25677

[jira] [Resolved] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28977. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25687

[jira] [Assigned] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28977: Assignee: Sean Owen > JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page >

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923226#comment-16923226 ] Xianjin YE commented on SPARK-28945: Yeah, I can work on this.  > Allow concurrent writes to

[jira] [Updated] (SPARK-28985) Pyspark ClassificationModel and RegressionModel support column setters/getters/predict

[ https://issues.apache.org/jira/browse/SPARK-28985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-28985: - Description: 1, add common abstract classes like JavaClassificationModel &

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: h6. SparkSQL create table as select from one table which may not exists throw

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: h6. SparkSQL create table as select from one table which may not exists throw

[jira] [Comment Edited] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923139#comment-16923139 ] Diego García edited comment on SPARK-27491 at 9/5/19 8:36 AM: -- In 2.4.4

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description:                SparkSQL create table as select from one table which may not exists

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: SparkSQL create table as select from one table which may not exists throw exception

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: SparkSQL create table as select from one table which may not exists throw exception

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: {quote}               SparkSQL create table as select from one table which may not

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923197#comment-16923197 ] Gabor Somogyi commented on SPARK-28367: --- The main discussion on Kafka side started here:

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: {{SparkSQL create table as select from one table which may not exists

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: SparkSQL create table as select from one table which may not exists throw

[jira] [Updated] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-28990: --- Description: SparkSQL create table as select from one table which may not exists throw

[jira] [Created] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

fengchaoge created SPARK-28990: -- Summary: SparkSQL invalid call to toAttribute on unresolved object, tree: * Key: SPARK-28990 URL: https://issues.apache.org/jira/browse/SPARK-28990 Project: Spark

[jira] [Resolved] (SPARK-28782) explode() fails on aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-28782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28782. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25512

  1   2   >