[
https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28519:
-
Description:
Sorry to disturb again, we ran unit tests on arm64 instance, and there are
other s
[
https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894302#comment-16894302
]
Hyukjin Kwon commented on SPARK-28519:
--
There are multiple issues related with it.
[
https://issues.apache.org/jira/browse/SPARK-28522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28522.
--
Resolution: Invalid
> Pass dynamic parameters to custom file input format
> --
[
https://issues.apache.org/jira/browse/SPARK-28522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894301#comment-16894301
]
Hyukjin Kwon commented on SPARK-28522:
--
You can use Hadoop configuration for hadoop
[
https://issues.apache.org/jira/browse/SPARK-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28526.
--
Resolution: Won't Fix
> Kinesis Metric Sink
> ---
>
> Key: SPA
[
https://issues.apache.org/jira/browse/SPARK-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894300#comment-16894300
]
Hyukjin Kwon commented on SPARK-28526:
--
I think that should better be existed as a
[
https://issues.apache.org/jira/browse/SPARK-28523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28523.
--
Resolution: Invalid
This looks an issue in HWC
> Cant Select from a partitioned table using t
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28533.
--
Resolution: Invalid
> PySpark datatype casting error
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894294#comment-16894294
]
Hyukjin Kwon commented on SPARK-28533:
--
That's because you specified the output typ
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28533:
-
Description:
Hello,
I have faced an issue while casting the datatype of a column in pyspark 2.4
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28533:
-
Description:
Hello,
I have faced an issue while casting the datatype of a column in pyspark 2.4
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28533:
-
Description:
Hello,
I have faced an issue while casting the datatype of a column in pyspark 2.4
[
https://issues.apache.org/jira/browse/SPARK-28530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28530.
-
Resolution: Fixed
Assignee: Yesheng Ma
Fix Version/s: 3.0.0
> Fix Join Reorder optimizer
[
https://issues.apache.org/jira/browse/SPARK-28532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-28532:
---
Assignee: Yesheng Ma
> Fix subquery optimizer rule to enforce idempotence
> ---
[
https://issues.apache.org/jira/browse/SPARK-28532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28532.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Fix subquery optimizer rule to enforce idempotence
> ---
[
https://issues.apache.org/jira/browse/SPARK-28528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894269#comment-16894269
]
Dongjoon Hyun edited comment on SPARK-28528 at 7/27/19 5:04 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-28528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894269#comment-16894269
]
Dongjoon Hyun commented on SPARK-28528:
---
[~manifoldQAQ]. All issues seems to be `I
[
https://issues.apache.org/jira/browse/SPARK-28450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894264#comment-16894264
]
Hyukjin Kwon commented on SPARK-28450:
--
[~angerszhuuu], please provide the self-con
[
https://issues.apache.org/jira/browse/SPARK-28450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28450.
--
Resolution: Incomplete
> When scan hive data of a not existed partition, it return an error
>
[
https://issues.apache.org/jira/browse/SPARK-28480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28480.
--
Resolution: Cannot Reproduce
> Types of input parameters of a UDF affect the ability to cache
[
https://issues.apache.org/jira/browse/SPARK-28442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28442.
--
Resolution: Incomplete
No feedback.
> Potentially persist data without leadership
> -
Hyukjin Kwon created SPARK-28536:
Summary: Reduce shuffle partitions in Python UDF tests in
SQLQueryTestSuite
Key: SPARK-28536
URL: https://issues.apache.org/jira/browse/SPARK-28536
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894238#comment-16894238
]
Nasir Ali commented on SPARK-28502:
---
I tried to set timzone to UTC as suggested by [~i
[
https://issues.apache.org/jira/browse/SPARK-28441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28441:
---
Assignee: Liang-Chi Hsieh
> PythonUDF used in correlated scalar subquery causes
> Unsuppor
[
https://issues.apache.org/jira/browse/SPARK-28441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28441.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25204
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-28535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28535:
--
Affects Version/s: 2.3.3
2.4.3
> Flaky test: JobCancellationSuite."inte
Marcelo Vanzin created SPARK-28535:
--
Summary: Flaky test: JobCancellationSuite."interruptible iterator
of shuffle reader"
Key: SPARK-28535
URL: https://issues.apache.org/jira/browse/SPARK-28535
Proje
Dongjoon Hyun created SPARK-28534:
-
Summary: Update node affinity for DockerForDesktop backend in
PVTestsSuite
Key: SPARK-28534
URL: https://issues.apache.org/jira/browse/SPARK-28534
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
RoopTeja Muppalla updated SPARK-28533:
--
Summary: PySpark datatype casting error (was: Spark datatype error)
> PySpark datatyp
RoopTeja Muppalla created SPARK-28533:
-
Summary: Spark datatype error
Key: SPARK-28533
URL: https://issues.apache.org/jira/browse/SPARK-28533
Project: Spark
Issue Type: Bug
Comp
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28518.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25259
[https://
[
https://issues.apache.org/jira/browse/SPARK-28518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-28518:
-
Assignee: Yuming Wang
> Fix StatisticsCollectionTestBase#getDataSize refer to
> Checks
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894134#comment-16894134
]
Li Jin commented on SPARK-28502:
Hmm.. I think this has sth to do with timezone, can you
[
https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25285:
--
Assignee: Luca Canali
> Add executor task metrics to track the number of tasks starte
[
https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25285.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22290
[https:
[
https://issues.apache.org/jira/browse/SPARK-27889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-27889:
---
Assignee: Weichen Xu (was: Xiao Li)
> Make development scripts under dev/ support Python 3
> -
[
https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-28476:
Comment: was deleted
(was: [~ivy.weichan.xu]
)
> Support ALTER DATABASE SET LOCATION
>
Yesheng Ma created SPARK-28532:
--
Summary: Fix subquery optimizer rule to enforce idempotence
Key: SPARK-28532
URL: https://issues.apache.org/jira/browse/SPARK-28532
Project: Spark
Issue Type: Su
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894025#comment-16894025
]
Bryan Cutler commented on SPARK-28502:
--
I'm not sure, but I don't think you can use
Yesheng Ma created SPARK-28531:
--
Summary: Fix Extract Python UDFs optimizer rule to enforce
idempotence
Key: SPARK-28531
URL: https://issues.apache.org/jira/browse/SPARK-28531
Project: Spark
Is
Yesheng Ma created SPARK-28530:
--
Summary: Fix Join Reorder optimizer rule to enforce idempotence
Key: SPARK-28530
URL: https://issues.apache.org/jira/browse/SPARK-28530
Project: Spark
Issue Type
Yesheng Ma created SPARK-28529:
--
Summary: Fix PullupCorrelatedPredicates optimizer rule to enforce
idempotence
Key: SPARK-28529
URL: https://issues.apache.org/jira/browse/SPARK-28529
Project: Spark
Yesheng Ma created SPARK-28528:
--
Summary: Fix Idempotence for Once batches in Catalyst optimizer
Key: SPARK-28528
URL: https://issues.apache.org/jira/browse/SPARK-28528
Project: Spark
Issue Type
Xiao Li created SPARK-28527:
---
Summary: Build a Test Framework for Thriftserver
Key: SPARK-28527
URL: https://issues.apache.org/jira/browse/SPARK-28527
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894015#comment-16894015
]
Xiao Li commented on SPARK-28527:
-
[~yumwang]
> Build a Test Framework for Thriftserve
[
https://issues.apache.org/jira/browse/SPARK-28507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28507:
-
Assignee: Huaxin Gao
> remove deprecated API context(self, sqlContext) from pyspark/ml/util.py
Nick Karpov created SPARK-28526:
---
Summary: Kinesis Metric Sink
Key: SPARK-28526
URL: https://issues.apache.org/jira/browse/SPARK-28526
Project: Spark
Issue Type: New Feature
Component
[
https://issues.apache.org/jira/browse/SPARK-28507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28507.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25246
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Karpov updated SPARK-28526:
Description:
Spark currently supports ConsoleSink, CSVSink, JmxSink, MetricsServlet,
GraphiteSink
Kousuke Saruta created SPARK-28525:
--
Summary: Allow Launcher to be applied Java options
Key: SPARK-28525
URL: https://issues.apache.org/jira/browse/SPARK-28525
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-28524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28524.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> ThriftServerTab lost erro
[
https://issues.apache.org/jira/browse/SPARK-28260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28260:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-28426
> Add CLOSED state to Executi
[
https://issues.apache.org/jira/browse/SPARK-28524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28524:
Description:
!3.0.0.png!
!2.4.3.png!
> ThriftServerTab lost error message
> ---
[
https://issues.apache.org/jira/browse/SPARK-28524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28524:
Attachment: 2.4.3.png
3.0.0.png
> ThriftServerTab lost error message
> ---
Yuming Wang created SPARK-28524:
---
Summary: ThriftServerTab lost error message
Key: SPARK-28524
URL: https://issues.apache.org/jira/browse/SPARK-28524
Project: Spark
Issue Type: Sub-task
Varun Rao created SPARK-28523:
-
Summary: Cant Select from a partitioned table using the Hive
Warehouse Connector
Key: SPARK-28523
URL: https://issues.apache.org/jira/browse/SPARK-28523
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28499.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25244
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-28499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28499:
-
Assignee: zhengruifeng
> Optimize MinMaxScaler
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893807#comment-16893807
]
Abhishek Somani commented on SPARK-16996:
-
We have worked on and open sourced a
[
https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893806#comment-16893806
]
Abhishek Somani commented on SPARK-15348:
-
We have worked on and open sourced a
[
https://issues.apache.org/jira/browse/SPARK-28505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893698#comment-16893698
]
Hyukjin Kwon commented on SPARK-28505:
--
I don't quite understand. Hive also reads p
[
https://issues.apache.org/jira/browse/SPARK-28505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28505.
--
Resolution: Invalid
> Add data source option for omitting partitioned columns when saving to f
[
https://issues.apache.org/jira/browse/SPARK-28521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28521:
Comment: was deleted
(was: I'm working on.)
> Fix error message for built-in functions
>
Ayan Mukherjee created SPARK-28522:
--
Summary: Pass dynamic parameters to custom file input format
Key: SPARK-28522
URL: https://issues.apache.org/jira/browse/SPARK-28522
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25809:
-
Assignee: Rob Vesse
> Support additional K8S cluster types for integration tests
>
[
https://issues.apache.org/jira/browse/SPARK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25809:
--
Fix Version/s: 3.0.0
> Support additional K8S cluster types for integration tests
> --
[
https://issues.apache.org/jira/browse/SPARK-28484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893448#comment-16893448
]
Kalle Jepsen commented on SPARK-28484:
--
thank you
> spark-submit uses wrong SPARK_
[
https://issues.apache.org/jira/browse/SPARK-28521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893438#comment-16893438
]
Yuming Wang commented on SPARK-28521:
-
[https://github.com/apache/spark/blob/832ff87
[
https://issues.apache.org/jira/browse/SPARK-28521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893429#comment-16893429
]
Yuming Wang commented on SPARK-28521:
-
I'm working on.
> Fix error message for buil
Yuming Wang created SPARK-28521:
---
Summary: Fix error message for built-in functions
Key: SPARK-28521
URL: https://issues.apache.org/jira/browse/SPARK-28521
Project: Spark
Issue Type: Bug
Kousuke Saruta created SPARK-28520:
--
Summary: WholeStageCodegen does not work property for
LocalTableScanExec
Key: SPARK-28520
URL: https://issues.apache.org/jira/browse/SPARK-28520
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28489.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.4
This is resolved via
[
https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangtianhua updated SPARK-28519:
-
Description:
Sorry to disturb again, we ran unit tests on arm64 instance, and there are
other s
huangtianhua created SPARK-28519:
Summary: Tests failed on aarch64 due the value of math.log and
power function is different
Key: SPARK-28519
URL: https://issues.apache.org/jira/browse/SPARK-28519
Pro
74 matches
Mail list logo