[
https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-31705:
Description:
Rewrite join condition to [conjunctive normal
[
https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-31705:
Description:
Rewrite join condition to [conjunctive normal
[
https://issues.apache.org/jira/browse/SPARK-27562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106846#comment-17106846
]
Apache Spark commented on SPARK-27562:
--
User 'turboFei' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106845#comment-17106845
]
Apache Spark commented on SPARK-27562:
--
User 'turboFei' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106836#comment-17106836
]
Hyukjin Kwon commented on SPARK-31693:
--
Thank you so much [~shaneknapp].
> Investigate AmpLab
[
https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingcan Cui updated SPARK-31632:
Description:
While starting some local tests, I occasionally encountered the following
[
https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31632.
--
Fix Version/s: 2.4.7
3.0.0
Assignee: Xingcan Cui
[
https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106830#comment-17106830
]
shane knapp commented on SPARK-31693:
-
grrr. ok, sorry. today was my zoom meeting day. i'll
[
https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106825#comment-17106825
]
Hyukjin Kwon commented on SPARK-31693:
--
Seems it's blocking many other PRs ...
> Investigate
[
https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31693:
-
Priority: Critical (was: Major)
> Investigate AmpLab Jenkins server network issue
>
[
https://issues.apache.org/jira/browse/SPARK-21033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106774#comment-17106774
]
Yunbo Fan commented on SPARK-21033:
---
[~clehene] Since it's 2020, have you solved the problem?
I‘m
[
https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-31705:
Issue Type: Improvement (was: New Feature)
> Rewrite join condition to conjunctive normal form
>
[
https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-31705:
Description:
Rewrite join condition to [conjunctive normal
[
https://issues.apache.org/jira/browse/SPARK-31708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31708:
Assignee: Apache Spark
> Add docs and examples for ANOVASelector and FValueSelector
>
[
https://issues.apache.org/jira/browse/SPARK-31708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31708:
Assignee: (was: Apache Spark)
> Add docs and examples for ANOVASelector and
[
https://issues.apache.org/jira/browse/SPARK-31708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106752#comment-17106752
]
Apache Spark commented on SPARK-31708:
--
User 'huaxingao' has created a pull request for this issue:
Huaxin Gao created SPARK-31708:
--
Summary: Add docs and examples for ANOVASelector and FValueSelector
Key: SPARK-31708
URL: https://issues.apache.org/jira/browse/SPARK-31708
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-31696:
-
Assignee: Dongjoon Hyun
> Support spark.kubernetes.driver.service.annotation
>
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31696.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28518
[
https://issues.apache.org/jira/browse/SPARK-31704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31704.
---
Resolution: Duplicate
> PandasUDFType.GROUPED_AGG with Java 11
>
[
https://issues.apache.org/jira/browse/SPARK-31704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106642#comment-17106642
]
Dongjoon Hyun commented on SPARK-31704:
---
+1 for [~bryanc]'s advice.
You may see Apache Spark
[
https://issues.apache.org/jira/browse/SPARK-31700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-31700.
-
> spark sql write orc file outformat
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-31700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31700.
---
Resolution: Invalid
Hi, please use dev mailing list.
> spark sql write orc file outformat
[
https://issues.apache.org/jira/browse/SPARK-31707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31707:
Assignee: (was: Apache Spark)
> Revert SPARK-30098 Use default datasource as
[
https://issues.apache.org/jira/browse/SPARK-31707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106638#comment-17106638
]
Apache Spark commented on SPARK-31707:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106637#comment-17106637
]
Apache Spark commented on SPARK-31707:
--
User 'HeartSaVioR' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31707:
Assignee: Apache Spark
> Revert SPARK-30098 Use default datasource as provider for
[
https://issues.apache.org/jira/browse/SPARK-31707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-31707:
-
Description:
According to the latest status of discussion in the dev@ mailing list,
[[DISCUSS]
Jungtaek Lim created SPARK-31707:
Summary: Revert SPARK-30098 Use default datasource as provider for
CREATE TABLE syntax
Key: SPARK-31707
URL: https://issues.apache.org/jira/browse/SPARK-31707
[
https://issues.apache.org/jira/browse/SPARK-23607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106562#comment-17106562
]
Zirui Li commented on SPARK-23607:
--
Hi [~zhouyejoe] wondering do you have any plan to post the PR?
[
https://issues.apache.org/jira/browse/SPARK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31706:
Assignee: Wenchen Fan (was: Apache Spark)
> add back the support of streaming update
[
https://issues.apache.org/jira/browse/SPARK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106504#comment-17106504
]
Apache Spark commented on SPARK-31706:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31706:
Assignee: Apache Spark (was: Wenchen Fan)
> add back the support of streaming update
[
https://issues.apache.org/jira/browse/SPARK-31704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106500#comment-17106500
]
Bryan Cutler commented on SPARK-31704:
--
This is due to a Netty API that Arrow uses and
Wenchen Fan created SPARK-31706:
---
Summary: add back the support of streaming update mode
Key: SPARK-31706
URL: https://issues.apache.org/jira/browse/SPARK-31706
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-31701:
-
Assignee: Hyukjin Kwon
> Bump up the minimum Arrow version as 0.15.1 in SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31701.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28520
[
https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106344#comment-17106344
]
Yuming Wang commented on SPARK-31705:
-
I'm working on.
> Rewrite join condition to conjunctive
Yuming Wang created SPARK-31705:
---
Summary: Rewrite join condition to conjunctive normal form
Key: SPARK-31705
URL: https://issues.apache.org/jira/browse/SPARK-31705
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106325#comment-17106325
]
Dan Griffin commented on SPARK-11664:
-
Hey. I'm wondering what the status of this capability being
Markus Tretzmüller created SPARK-31704:
--
Summary: PandasUDFType.GROUPED_AGG with Java 11
Key: SPARK-31704
URL: https://issues.apache.org/jira/browse/SPARK-31704
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michail Giannakopoulos updated SPARK-31703:
---
Description:
Trying to upgrade to Apache Spark 2.4.5 in our IBM systems
[
https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michail Giannakopoulos updated SPARK-31703:
---
Labels: BigEndian (was: )
> Changes made by SPARK-26985 break reading
Michail Giannakopoulos created SPARK-31703:
--
Summary: Changes made by SPARK-26985 break reading parquet files
correctly in BigEndian architectures (AIX + LinuxPPC64)
Key: SPARK-31703
URL:
[
https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michail Giannakopoulos updated SPARK-31703:
---
Attachment: Data_problem_Spark.gif
> Changes made by SPARK-26985 break
[
https://issues.apache.org/jira/browse/SPARK-31702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31702:
-
Description:
Old POSIXlt, POSIXct and Date become corrupt in SparkR. For example, see below:
Hyukjin Kwon created SPARK-31702:
Summary: Old POSIXlt, POSIXct and Date become corrupt due to
calendar difference
Key: SPARK-31702
URL: https://issues.apache.org/jira/browse/SPARK-31702
Project:
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31701:
Assignee: Apache Spark
> Bump up the minimum Arrow version as 0.15.1 in SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31701:
Assignee: (was: Apache Spark)
> Bump up the minimum Arrow version as 0.15.1 in
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106225#comment-17106225
]
Apache Spark commented on SPARK-31701:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31701:
-
Issue Type: Improvement (was: Bug)
> Bump up the minimum Arrow version as 0.15.1 in SparkR
>
Hyukjin Kwon created SPARK-31701:
Summary: Bump up the minimum Arrow version as 0.15.1 in SparkR
Key: SPARK-31701
URL: https://issues.apache.org/jira/browse/SPARK-31701
Project: Spark
Issue
Dexter Morgan created SPARK-31700:
-
Summary: spark sql write orc file outformat
Key: SPARK-31700
URL: https://issues.apache.org/jira/browse/SPARK-31700
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-31697.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28519
[
https://issues.apache.org/jira/browse/SPARK-29046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106104#comment-17106104
]
Jungtaek Lim commented on SPARK-29046:
--
Sorry I don't know. Also worth noting that Spark 2.3
[
https://issues.apache.org/jira/browse/SPARK-29046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106087#comment-17106087
]
Viacheslav Tradunsky commented on SPARK-29046:
--
[~kabhwan] Do you know a lower version of
[
https://issues.apache.org/jira/browse/SPARK-31686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31686.
--
Resolution: Not A Problem
> Return of String instead of array in function get_json_object
>
[
https://issues.apache.org/jira/browse/SPARK-31686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106084#comment-17106084
]
Hyukjin Kwon commented on SPARK-31686:
--
Yes, you don't know the output type before actually
[
https://issues.apache.org/jira/browse/SPARK-31690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106081#comment-17106081
]
Hyukjin Kwon commented on SPARK-31690:
--
It seems new API which isn't usually backported per
[
https://issues.apache.org/jira/browse/SPARK-31690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31690.
--
Resolution: Won't Fix
> Backport pyspark Interaction to Spark 2.4.x
>
[
https://issues.apache.org/jira/browse/SPARK-31698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-31698.
--
Resolution: Duplicate
The weird error message and stack trace is matched with SPARK-29046
angerszhu created SPARK-31699:
-
Summary: Optimize OpenSession speed in thriftserver
Key: SPARK-31699
URL: https://issues.apache.org/jira/browse/SPARK-31699
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-31695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106076#comment-17106076
]
Hyukjin Kwon commented on SPARK-31695:
--
You can explicitly set the scale and precision:
{code}
val
[
https://issues.apache.org/jira/browse/SPARK-31695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31695.
--
Resolution: Not A Problem
> BigDecimal setScale is not working in Spark UDF
>
[
https://issues.apache.org/jira/browse/SPARK-31698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viacheslav Tradunsky updated SPARK-31698:
-
Environment: AWS EMR: 30 machines, 7TB RAM total. (was: AWS EMR: 30
machine,
[
https://issues.apache.org/jira/browse/SPARK-31698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viacheslav Tradunsky updated SPARK-31698:
-
Environment: AWS EMR: 30 machine, 7TB RAM total. (was: AWS EMR)
> NPE on big
[
https://issues.apache.org/jira/browse/SPARK-31698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viacheslav Tradunsky updated SPARK-31698:
-
Docs Text: (was: org.apache.spark.SparkException: Job aborted.
[
https://issues.apache.org/jira/browse/SPARK-31698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viacheslav Tradunsky updated SPARK-31698:
-
Attachment: Spark_NPE_big_dataset.log
> NPE on big dataset plans
>
Viacheslav Tradunsky created SPARK-31698:
Summary: NPE on big dataset plans
Key: SPARK-31698
URL: https://issues.apache.org/jira/browse/SPARK-31698
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106035#comment-17106035
]
Apache Spark commented on SPARK-31697:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106034#comment-17106034
]
Apache Spark commented on SPARK-31697:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31697:
Assignee: Apache Spark (was: Kousuke Saruta)
> HistoryServer should set Content-Type
>
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31697:
Assignee: Kousuke Saruta (was: Apache Spark)
> HistoryServer should set Content-Type
>
[
https://issues.apache.org/jira/browse/SPARK-31697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-31697:
---
Summary: HistoryServer should set Content-Type (was: HistoryServer should
set Content-Type
Kousuke Saruta created SPARK-31697:
--
Summary: HistoryServer should set Content-Type header
Key: SPARK-31697
URL: https://issues.apache.org/jira/browse/SPARK-31697
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106001#comment-17106001
]
Apache Spark commented on SPARK-31696:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31696:
Assignee: (was: Apache Spark)
> Support spark.kubernetes.driver.service.annotation
>
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106000#comment-17106000
]
Apache Spark commented on SPARK-31696:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-31696:
Assignee: Apache Spark
> Support spark.kubernetes.driver.service.annotation
>
Dongjoon Hyun created SPARK-31696:
-
Summary: Support spark.kubernetes.driver.service.annotation
Key: SPARK-31696
URL: https://issues.apache.org/jira/browse/SPARK-31696
Project: Spark
Issue
80 matches
Mail list logo
