[
https://issues.apache.org/jira/browse/SPARK-24339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xdcjie updated SPARK-24339:
---
Priority: Minor (was: Major)
> spark sql can not prune column in transform/map/reduce query
> --
[
https://issues.apache.org/jira/browse/SPARK-24313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-24313:
Labels: correctness (was: )
> Collection functions interpreted execution doesn't work with complex
[
https://issues.apache.org/jira/browse/SPARK-24338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chaoran Yu updated SPARK-24338:
---
Description:
This
[commit|https://github.com/apache/spark/commit/ce13c2672318242748f7520ed4ce6bcfad4
[
https://issues.apache.org/jira/browse/SPARK-24292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin resolved SPARK-24292.
Resolution: Duplicate
> Proxy user cannot connect to HiveMetastore in local mode
>
Chaoran Yu created SPARK-24338:
--
Summary: Spark SQL fails to create a table in Hive when running in
a Apache Sentry-secured Environment
Key: SPARK-24338
URL: https://issues.apache.org/jira/browse/SPARK-24338
[
https://issues.apache.org/jira/browse/SPARK-24338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chaoran Yu updated SPARK-24338:
---
Attachment: exception.txt
> Spark SQL fails to create a table in Hive when running in a Apache
> Sen
[
https://issues.apache.org/jira/browse/SPARK-24313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-24313:
Priority: Critical (was: Minor)
> Collection functions interpreted execution doesn't work with com
xdcjie created SPARK-24339:
--
Summary: spark sql can not prune column in transform/map/reduce
query
Key: SPARK-24339
URL: https://issues.apache.org/jira/browse/SPARK-24339
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chaoran Yu updated SPARK-24338:
---
Summary: Spark SQL fails to create a Hive table when running in a Apache
Sentry-secured Environment
[
https://issues.apache.org/jira/browse/SPARK-24204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24204:
Assignee: (was: Apache Spark)
> Verify a write schema in Json/Orc/ParquetFileFormat
>
[
https://issues.apache.org/jira/browse/SPARK-24204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24204:
Assignee: Apache Spark
> Verify a write schema in Json/Orc/ParquetFileFormat
> ---
[
https://issues.apache.org/jira/browse/SPARK-24204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483468#comment-16483468
]
Apache Spark commented on SPARK-24204:
--
User 'maropu' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-24209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24209.
Resolution: Fixed
Assignee: Marco Gaido
Fix Version/s: 2.4.0
> 0 configurat
Shixiong Zhu created SPARK-24337:
Summary: Improve the error message for invalid SQL conf value
Key: SPARK-24337
URL: https://issues.apache.org/jira/browse/SPARK-24337
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483217#comment-16483217
]
Marcelo Vanzin commented on SPARK-22055:
IMO it would be a better idea to take Fe
[
https://issues.apache.org/jira/browse/SPARK-24309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-24309:
--
Assignee: Imran Rashid
> AsyncEventQueue should handle an interrupt from a Listener
>
[
https://issues.apache.org/jira/browse/SPARK-24336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483209#comment-16483209
]
Apache Spark commented on SPARK-24336:
--
User 'HeartSaVioR' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-24336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24336:
Assignee: (was: Apache Spark)
> Support 'pass through' transformation in BasicOperator
[
https://issues.apache.org/jira/browse/SPARK-24309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24309.
Resolution: Fixed
Fix Version/s: 2.3.1
2.4.0
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-24336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24336:
Assignee: Apache Spark
> Support 'pass through' transformation in BasicOperators
> ---
Jungtaek Lim created SPARK-24336:
Summary: Support 'pass through' transformation in BasicOperators
Key: SPARK-24336
URL: https://issues.apache.org/jira/browse/SPARK-24336
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483095#comment-16483095
]
H Lu commented on SPARK-23928:
--
Dear watchers,
Can you please help review and comment the P
[
https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23928:
Assignee: (was: Apache Spark)
> High-order function: shuffle(x) → array
>
[
https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483086#comment-16483086
]
Apache Spark commented on SPARK-23928:
--
User 'pkuwm' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23928:
Assignee: Apache Spark
> High-order function: shuffle(x) → array
> ---
Robert Reid created SPARK-24335:
---
Summary: Dataset.map schema not applied in some cases
Key: SPARK-24335
URL: https://issues.apache.org/jira/browse/SPARK-24335
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-24325.
-
Resolution: Fixed
Assignee: Maxim Gekk
Fix Version/s: 2.4.0
> Tests for Hadoop's LinesRea
[
https://issues.apache.org/jira/browse/SPARK-24334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483004#comment-16483004
]
Li Jin commented on SPARK-24334:
I have done some investigation and will submit a PR soon
Li Jin created SPARK-24334:
--
Summary: Race condition in ArrowPythonRunner causes unclean
shutdown of Arrow memory allocator
Key: SPARK-24334
URL: https://issues.apache.org/jira/browse/SPARK-24334
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482998#comment-16482998
]
Apache Spark commented on SPARK-24234:
--
User 'jose-torres' has created a pull reques
Joseph K. Bradley created SPARK-24333:
-
Summary: Add fit with validation set to spark.ml GBT: Python API
Key: SPARK-24333
URL: https://issues.apache.org/jira/browse/SPARK-24333
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley resolved SPARK-7132.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21129
[http
[
https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-24234:
-
Assignee: Jose Torres
> create the bottom-of-task RDD with row buffer
>
[
https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-24234.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 21337
[https://g
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23416:
Assignee: Apache Spark
> Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress te
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23416:
Assignee: (was: Apache Spark)
> Flaky test: KafkaSourceStressForDontFailOnDataLossSuit
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482922#comment-16482922
]
Apache Spark commented on SPARK-23416:
--
User 'jose-torres' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482901#comment-16482901
]
Imran Rashid commented on SPARK-6235:
-
[~tgraves]
WAL -- write-ahead-log for receiver-
[
https://issues.apache.org/jira/browse/SPARK-23754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23754:
Assignee: (was: Apache Spark)
> StopIterator exception in Python UDF results in partia
[
https://issues.apache.org/jira/browse/SPARK-23754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23754:
Assignee: Apache Spark
> StopIterator exception in Python UDF results in partial result
>
[
https://issues.apache.org/jira/browse/SPARK-23754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482884#comment-16482884
]
Apache Spark commented on SPARK-23754:
--
User 'e-dorigatti' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bimalendu Choudhary updated SPARK-24316:
Description:
When we create a table from a data frame using spark sql with columns
[
https://issues.apache.org/jira/browse/SPARK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bimalendu Choudhary updated SPARK-24316:
Description:
When we create a table from a data frame using spark sql with columns
[
https://issues.apache.org/jira/browse/SPARK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bimalendu Choudhary updated SPARK-24316:
Description:
When we create a table from a data frame using spark sql with columns
[
https://issues.apache.org/jira/browse/SPARK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bimalendu Choudhary updated SPARK-24316:
Affects Version/s: 2.4.0
2.3.0
Description:
When w
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482746#comment-16482746
]
Thomas Graves commented on SPARK-6235:
--
>> Still unsupported:
* large task results
[
https://issues.apache.org/jira/browse/SPARK-24332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24332:
Assignee: Apache Spark (was: Shixiong Zhu)
> Fix places reading 'spark.network.timeout' a
[
https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482699#comment-16482699
]
Imran Rashid commented on SPARK-6235:
-
Linked a [design
doc|https://docs.google.com/d
[
https://issues.apache.org/jira/browse/SPARK-24332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24332:
Assignee: Shixiong Zhu (was: Apache Spark)
> Fix places reading 'spark.network.timeout' a
[
https://issues.apache.org/jira/browse/SPARK-24332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482698#comment-16482698
]
Apache Spark commented on SPARK-24332:
--
User 'zsxwing' has created a pull request fo
Shixiong Zhu created SPARK-24332:
Summary: Fix places reading 'spark.network.timeout' as milliseconds
Key: SPARK-24332
URL: https://issues.apache.org/jira/browse/SPARK-24332
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-24330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-24330:
---
Description:
Refactor ExecuteWriteTask in FileFormatWriter to reduce common logic and
improv
[
https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482577#comment-16482577
]
Marek Novotny commented on SPARK-24331:
---
I will work on this. Thanks!
> Add cardin
Marek Novotny created SPARK-24331:
-
Summary: Add cardinality / arrays_overlap / array_repeat /
map_entries
Key: SPARK-24331
URL: https://issues.apache.org/jira/browse/SPARK-24331
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482562#comment-16482562
]
Jami Malikzade commented on SPARK-24273:
[~kiszk] , I have just noticed that I am
[
https://issues.apache.org/jira/browse/SPARK-24330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24330:
Assignee: (was: Apache Spark)
> Refactor ExecuteWriteTask in FileFormatWriter with Dat
[
https://issues.apache.org/jira/browse/SPARK-24330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24330:
Assignee: Apache Spark
> Refactor ExecuteWriteTask in FileFormatWriter with DataWriter(V2)
[
https://issues.apache.org/jira/browse/SPARK-24330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482539#comment-16482539
]
Apache Spark commented on SPARK-24330:
--
User 'gengliangwang' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23935.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21236
https://gi
[
https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23935:
-
Assignee: Marek Novotny
> High-order function: map_entries(map) → array>
> -
[
https://issues.apache.org/jira/browse/SPARK-24273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482533#comment-16482533
]
Jami Malikzade commented on SPARK-24273:
[~kiszk]
I was able to reproduce in
[
https://issues.apache.org/jira/browse/SPARK-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482512#comment-16482512
]
Steve Loughran commented on SPARK-19790:
Update on this, having spent lots of tim
[
https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482476#comment-16482476
]
Truong Duc Kien commented on SPARK-23309:
-
We're also having also a performance p
Gengliang Wang created SPARK-24330:
--
Summary: Refactor ExecuteWriteTask in FileFormatWriter with
DataWriter(V2)
Key: SPARK-24330
URL: https://issues.apache.org/jira/browse/SPARK-24330
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arseniy Tashoyan updated SPARK-20389:
-
Affects Version/s: 2.2.1
> Upgrade kryo to fix NegativeArraySizeException
> -
[
https://issues.apache.org/jira/browse/SPARK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482408#comment-16482408
]
Arseniy Tashoyan commented on SPARK-20389:
--
I confirm: the issue is in place for
[
https://issues.apache.org/jira/browse/SPARK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482330#comment-16482330
]
yijukang commented on SPARK-24302:
--
[~hyukjin.kwon] OK thanks
> when using spark persi
[
https://issues.apache.org/jira/browse/SPARK-24329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482295#comment-16482295
]
Apache Spark commented on SPARK-24329:
--
User 'MaxGekk' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-24329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24329:
Assignee: (was: Apache Spark)
> Remove comments filtering before parsing of CSV files
[
https://issues.apache.org/jira/browse/SPARK-24329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24329:
Assignee: Apache Spark
> Remove comments filtering before parsing of CSV files
> -
Maxim Gekk created SPARK-24329:
--
Summary: Remove comments filtering before parsing of CSV files
Key: SPARK-24329
URL: https://issues.apache.org/jira/browse/SPARK-24329
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482277#comment-16482277
]
zhengruifeng commented on SPARK-24283:
--
[~holdenk] do you mean that we should impl t
[
https://issues.apache.org/jira/browse/SPARK-24323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-24323:
Assignee: Kazuaki Ishizaki
> Java lint errors
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-24323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-24323.
--
Resolution: Fixed
Fixed in https://github.com/apache/spark/pull/21374
> Java lint errors
> ---
[
https://issues.apache.org/jira/browse/SPARK-24242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-24242:
Assignee: Liang-Chi Hsieh
> RangeExec should have correct outputOrdering
> ---
[
https://issues.apache.org/jira/browse/SPARK-24242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-24242.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21291
[https://git
[
https://issues.apache.org/jira/browse/SPARK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-24328.
-
Resolution: Fixed
Assignee: Takeshi Yamamuro
Fix Version/s: 2.3.0
> Fix scala.Mat
77 matches
Mail list logo