[
https://issues.apache.org/jira/browse/SPARK-27490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27490.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24393
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-27490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27490:
---
Assignee: Gengliang Wang
> File source V2: return correct result for Dataset.inputFiles()
>
[
https://issues.apache.org/jira/browse/SPARK-27493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-27493:
Assignee: Dongjoon Hyun
> Upgrade ASM to 7.1
> --
>
> Key
[
https://issues.apache.org/jira/browse/SPARK-27493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27493.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24395
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27498:
--
Description:
_Caveat: I can see how this could be intentional if Spark believes that the
buil
[
https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27498:
--
Description:
_Caveat: I can see how this could be intentional if Spark believes that the
buil
[
https://issues.apache.org/jira/browse/SPARK-27498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27498:
--
Description:
_Caveat: I can see how this could be intentional if Spark believes that the
buil
[
https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27497:
--
Description:
The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that
[
https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27497:
--
Description:
The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that
[
https://issues.apache.org/jira/browse/SPARK-25422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820707#comment-16820707
]
Mike Chan commented on SPARK-25422:
---
Will this problem potentially hitting Spark 2.3.1
[
https://issues.apache.org/jira/browse/SPARK-27441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27441:
Summary: Add read/write tests to Hive serde tables(include Parquet
vectorized reader) (was: Add r
[
https://issues.apache.org/jira/browse/SPARK-27441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27441:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-27500
> Add read/write tests to Hiv
Yuming Wang created SPARK-27501:
---
Summary: Add test for HIVE-13083: Writing HiveDecimal to ORC can
wrongly suppress present stream
Key: SPARK-27501
URL: https://issues.apache.org/jira/browse/SPARK-27501
Yuming Wang created SPARK-27500:
---
Summary: Add tests for the built-in Hive 2.3
Key: SPARK-27500
URL: https://issues.apache.org/jira/browse/SPARK-27500
Project: Spark
Issue Type: Umbrella
Junjie Chen created SPARK-27499:
---
Summary: Support mapping spark.local.dir to hostPath volume
Key: SPARK-27499
URL: https://issues.apache.org/jira/browse/SPARK-27499
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820637#comment-16820637
]
william hesch commented on SPARK-17668:
---
+1
> Support representing structs with c
[
https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820619#comment-16820619
]
Stavros Kontopoulos commented on SPARK-27491:
-
Can you reach the rest api ou
Bruce Robbins created SPARK-27498:
-
Summary: Built-in parquet code path does not respect
hive.enforce.bucketing
Key: SPARK-27498
URL: https://issues.apache.org/jira/browse/SPARK-27498
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27497:
--
Description:
The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that
[
https://issues.apache.org/jira/browse/SPARK-27497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-27497:
--
Description:
The bucket spec gets wiped out after Spark writes to a Hive-bucketed table that
Bruce Robbins created SPARK-27497:
-
Summary: Spark wipes out bucket spec in metastore when updating
table stats
Key: SPARK-27497
URL: https://issues.apache.org/jira/browse/SPARK-27497
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820549#comment-16820549
]
Calvin Park edited comment on SPARK-27365 at 4/17/19 10:34 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820549#comment-16820549
]
Calvin Park edited comment on SPARK-27365 at 4/17/19 10:34 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820549#comment-16820549
]
Calvin Park commented on SPARK-27365:
-
Simple Jenkinsfile
{code:java}
pipeline {
[
https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820542#comment-16820542
]
t oo commented on SPARK-27491:
--
cc: [~skonto] [~mpmolek] [~gschiavon] [~scrapco...@gmail.co
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820525#comment-16820525
]
shahid commented on SPARK-27468:
[~zsxwing] Thanks
> "Storage Level" in "RDD Storage Pa
Shixiong Zhu created SPARK-27496:
Summary: RPC should send back the fatal errors
Key: SPARK-27496
URL: https://issues.apache.org/jira/browse/SPARK-27496
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820516#comment-16820516
]
Ryne Yang commented on SPARK-27434:
---
[~shahid]
were you able to reproduce this by t
[
https://issues.apache.org/jira/browse/SPARK-27473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820500#comment-16820500
]
Xiangrui Meng commented on SPARK-27473:
---
Given SPARK-25558 is WIP, we might want t
[
https://issues.apache.org/jira/browse/SPARK-27473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-27473:
-
Assignee: Weichen Xu
> Support filter push down for status fields in binary file data s
Thomas Graves created SPARK-27495:
-
Summary: Support Stage level resource scheduling
Key: SPARK-27495
URL: https://issues.apache.org/jira/browse/SPARK-27495
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Summary: Support Stage level resource configuration and scheduling (was:
Support Stage level
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820460#comment-16820460
]
Shixiong Zhu commented on SPARK-27468:
--
[~shahid] You need to use "--master local-c
Shixiong Zhu created SPARK-27494:
Summary: Null values don't work in Kafka source v2
Key: SPARK-27494
URL: https://issues.apache.org/jira/browse/SPARK-27494
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27493:
--
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-24417
> Upgrade ASM to 7.1
> --
Dongjoon Hyun created SPARK-27493:
-
Summary: Upgrade ASM to 7.1
Key: SPARK-27493
URL: https://issues.apache.org/jira/browse/SPARK-27493
Project: Spark
Issue Type: Improvement
Compon
[
https://issues.apache.org/jira/browse/SPARK-27276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820370#comment-16820370
]
shane knapp commented on SPARK-27276:
-
test currently running:
https://amplab.cs.ber
[
https://issues.apache.org/jira/browse/SPARK-25079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820364#comment-16820364
]
shane knapp commented on SPARK-25079:
-
from my email to dev@:
ok.
after much waili
[
https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp closed SPARK-27389.
---
> pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"
> --
[
https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820321#comment-16820321
]
Imran Rashid commented on SPARK-25088:
--
if you're allowing unauthed rest, what is t
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820309#comment-16820309
]
Imran Rashid commented on SPARK-6235:
-
[~glal14] actually this was fixed in 2.4. The
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-6235.
-
Resolution: Fixed
Fix Version/s: 2.4.0
> Address various 2G limits
> -
[
https://issues.apache.org/jira/browse/SPARK-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-24936.
--
Resolution: Won't Fix
As we've already shipped 2.4, I think its unlikely we're going to fix th
Thomas Graves created SPARK-27492:
-
Summary: High level user documentation
Key: SPARK-27492
URL: https://issues.apache.org/jira/browse/SPARK-27492
Project: Spark
Issue Type: Story
C
[
https://issues.apache.org/jira/browse/SPARK-27403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27403:
--
Summary: Fix `updateTableStats` to update table stats always with new stats
or None (was: Fai
[
https://issues.apache.org/jira/browse/SPARK-27403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27403:
--
Fix Version/s: 2.4.2
> Failed to update the table size automatically even though
> spark.sql.
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820229#comment-16820229
]
Gowtam Lal commented on SPARK-6235:
---
It would be great to see this go out. Any updates?
t oo created SPARK-27491:
Summary: SPARK REST API - "org.apache.spark.deploy.SparkSubmit
--status" returns empty response! therefore Airflow won't integrate with Spark
Key: SPARK-27491
URL: https://issues.apache.org/jira/
[
https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
t oo updated SPARK-27491:
-
Summary: SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status"
returns empty response! therefore Airfl
[
https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820211#comment-16820211
]
t oo commented on SPARK-27491:
--
cc: [~ash] [~bolke]
> SPARK REST API - "org.apache.spark.d
[
https://issues.apache.org/jira/browse/SPARK-27485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820189#comment-16820189
]
shahid commented on SPARK-27485:
Could you please share test to reproduce this?
> Certa
Gengliang Wang created SPARK-27490:
--
Summary: File source V2: return correct result for
Dataset.inputFiles()
Key: SPARK-27490
URL: https://issues.apache.org/jira/browse/SPARK-27490
Project: Spark
Thomas Graves created SPARK-27489:
-
Summary: UI updates to show executor resource information
Key: SPARK-27489
URL: https://issues.apache.org/jira/browse/SPARK-27489
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-27364:
---
reopening since it has a subtask
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820120#comment-16820120
]
Thomas Graves commented on SPARK-27364:
---
based on no comments on this I'm going to
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27364.
---
Resolution: Fixed
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820119#comment-16820119
]
Thomas Graves commented on SPARK-27488:
---
Note, the api design is here: https://iss
Thomas Graves created SPARK-27488:
-
Summary: Driver interface to support GPU resources
Key: SPARK-27488
URL: https://issues.apache.org/jira/browse/SPARK-27488
Project: Spark
Issue Type: Stor
[
https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820114#comment-16820114
]
Dave DeCaprio commented on SPARK-23904:
---
No, it's just in master, which is the 3.X
[
https://issues.apache.org/jira/browse/SPARK-27458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27458.
---
Resolution: Fixed
Assignee: William Wong
Fix Version/s: 3.0.0
Resolved by https://gi
[
https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820058#comment-16820058
]
Izek Greenfield commented on SPARK-23904:
-
[~DaveDeCaprio] Does that PR go into
[
https://issues.apache.org/jira/browse/SPARK-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19712.
-
Resolution: Fixed
Issue resolved by pull request 24331
[https://github.com/apache/spark/pull/243
[
https://issues.apache.org/jira/browse/SPARK-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19712:
---
Assignee: Dilip Biswal
> EXISTS and Left Semi join do not produce the same plan
> -
[
https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhanfeng Huo updated SPARK-3438:
Comment: was deleted
(was: This is a newest PR on master with commit
0d1cc4ae42e1f73538dd8b9b1880c
[
https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhanfeng Huo updated SPARK-3438:
Comment: was deleted
(was: test)
> Support for accessing secured HDFS in Standalone Mode
> ---
[
https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820005#comment-16820005
]
Zhanfeng Huo commented on SPARK-3438:
-
test
> Support for accessing secured HDFS in
[
https://issues.apache.org/jira/browse/SPARK-27430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27430.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24376
[https://gith
Vadym Holubnychyi created SPARK-27487:
-
Summary: Spark - Scala 2.12 compatibility
Key: SPARK-27487
URL: https://issues.apache.org/jira/browse/SPARK-27487
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819844#comment-16819844
]
Song Jun commented on SPARK-19842:
--
I think Constraint should be designed with DataSour
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819809#comment-16819809
]
Gabor Somogyi commented on SPARK-27409:
---
I mean does this cause any data processin
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27475:
Issue Type: Sub-task (was: Bug)
Parent: SPARK-23710
> dev/deps/spark-deps-hadoop-3.2 is i
71 matches
Mail list logo
