[
https://issues.apache.org/jira/browse/SPARK-28730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28730.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25453
[
https://issues.apache.org/jira/browse/SPARK-28730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28730:
---
Assignee: Gengliang Wang
> Configurable type coercion policy for table insertion
>
Dongjoon Hyun created SPARK-28857:
-
Summary: Clean up the comments of PR template during merging
Key: SPARK-28857
URL: https://issues.apache.org/jira/browse/SPARK-28857
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-28702:
--
Assignee: Shivu Sondur
> Display useful error message (instead of NPE) for invalid Dataset
[
https://issues.apache.org/jira/browse/SPARK-28702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-28702.
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25503
[
https://issues.apache.org/jira/browse/SPARK-28832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jobit mathew resolved SPARK-28832.
--
Resolution: Duplicate
Closing the JIRA as it will cover as a part of SHOW DATABASES statement
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913915#comment-16913915
]
Liang-Chi Hsieh commented on SPARK-23519:
-
Thanks for pinging me.
I am going on a flight soon.
[
https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913903#comment-16913903
]
Shivu Sondur commented on SPARK-28827:
--
i will work on this
> Document SELECT CURRENT_DATABASE in
[
https://issues.apache.org/jira/browse/SPARK-28823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913902#comment-16913902
]
Shivu Sondur commented on SPARK-28823:
--
i will work on this
> Document CREATE ROLE Statement
>
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913879#comment-16913879
]
jiangyu commented on SPARK-28482:
-
hi, [~bryanc] , i have tested toPandas(), it is okay. Row numbers is
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913855#comment-16913855
]
Wenchen Fan commented on SPARK-23519:
-
I think this is a bug and should be fixed. cc [~viirya] do
[
https://issues.apache.org/jira/browse/SPARK-27594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913665#comment-16913665
]
Owen O'Malley commented on SPARK-27594:
---
This is being caused by an ORC bug that was backported in
[
https://issues.apache.org/jira/browse/SPARK-28769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28769:
-
Assignee: Kousuke Saruta
> Improve warning message in Barrier Execution Mode in case required
[
https://issues.apache.org/jira/browse/SPARK-28769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28769.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25487
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913611#comment-16913611
]
Bryan Cutler commented on SPARK-28482:
--
I'm not really sure what you are doing above, are you
[
https://issues.apache.org/jira/browse/SPARK-28832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913560#comment-16913560
]
Dilip Biswal commented on SPARK-28832:
--
[~jobitmathew] Thanks .. Yeah it will be documented as part
[
https://issues.apache.org/jira/browse/SPARK-28846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-28846.
-
> Set OMP_NUM_THREADS to executor cores for python
>
[
https://issues.apache.org/jira/browse/SPARK-28846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue resolved SPARK-28846.
---
Resolution: Duplicate
> Set OMP_NUM_THREADS to executor cores for python
>
[
https://issues.apache.org/jira/browse/SPARK-28856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913426#comment-16913426
]
Terry Kim commented on SPARK-28856:
---
I will work on this.
> DataSourceV2: Support SHOW DATABASES
>
Terry Kim created SPARK-28856:
-
Summary: DataSourceV2: Support SHOW DATABASES
Key: SPARK-28856
URL: https://issues.apache.org/jira/browse/SPARK-28856
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-28577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-28577:
--
Docs Text: On YARN, The off heap memory size is now separately included for
the user in the
[
https://issues.apache.org/jira/browse/SPARK-28577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-28577:
--
Labels: release-notes (was: )
> Ensure executorMemoryHead requested value not less than
[
https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Yang Ang updated SPARK-28854:
-
Description:
scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs =>
[
https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-13677.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25383
[
https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-13677:
-
Assignee: zhengruifeng
> Support Tree-Based Feature Transformation for ML
>
[
https://issues.apache.org/jira/browse/SPARK-28776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28776.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25505
[
https://issues.apache.org/jira/browse/SPARK-28776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28776:
-
Assignee: Helen Yu
> SparkML MLWriter gets hadoop conf from spark context instead of session
>
Sean Owen created SPARK-28855:
-
Summary: Remove outdated Experimental, Evolving annotations
Key: SPARK-28855
URL: https://issues.apache.org/jira/browse/SPARK-28855
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao Yang Ang updated SPARK-28854:
-
Description:
scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs =>
Hao Yang Ang created SPARK-28854:
Summary: Zipping iterators in mapPartitions will fail
Key: SPARK-28854
URL: https://issues.apache.org/jira/browse/SPARK-28854
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28512:
---
Description:
In popular DBMS like MySQL/PostgreSQL/Oracle, runtime exceptions are thrown on
ZhangYao created SPARK-28853:
Summary: Support conf to organize filePartitions by file path
Key: SPARK-28853
URL: https://issues.apache.org/jira/browse/SPARK-28853
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28741:
---
Summary: New optional mode: Throw exceptions when casting to integers
causes overflow
[
https://issues.apache.org/jira/browse/SPARK-28503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-28503.
Resolution: Won't Fix
After consideration, I decide to close this one and open
[
https://issues.apache.org/jira/browse/SPARK-28741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28741:
---
Parent: SPARK-28589
Issue Type: Sub-task (was: New Feature)
> Throw exceptions
[
https://issues.apache.org/jira/browse/SPARK-28741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28741:
---
Parent: (was: SPARK-26217)
Issue Type: New Feature (was: Sub-task)
> Throw
Yuming Wang created SPARK-28852:
---
Summary: Implement GetCatalogsOperation
Key: SPARK-28852
URL: https://issues.apache.org/jira/browse/SPARK-28852
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-28852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28852:
Summary: Implement GetCatalogsOperation for Thrift Server (was: Implement
GetCatalogsOperation)
[
https://issues.apache.org/jira/browse/SPARK-28848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajith S resolved SPARK-28848.
-
Resolution: Duplicate
Will be fixed as part of SPARK-28659
> insert overwrite local directory stored
[
https://issues.apache.org/jira/browse/SPARK-28495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28495:
---
Description:
In Spark version 2.4 and earlier, when inserting into a table, Spark will cast
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913219#comment-16913219
]
Sandeep Katta commented on SPARK-28797:
---
PR is created https://github.com/apache/spark/pull/25553
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913183#comment-16913183
]
jiangyu edited comment on SPARK-28482 at 8/22/19 9:37 AM:
--
hi, [~bryanc] ,
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913183#comment-16913183
]
jiangyu commented on SPARK-28482:
-
hi, [~bryanc] , maybe you should produce more data, like 100,000
[
https://issues.apache.org/jira/browse/SPARK-28495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28495:
---
Summary: Introduce ANSI store assignment policy for table insertion (was:
Follow ANSI SQL
[
https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913181#comment-16913181
]
Nikita Gorbachevski edited comment on SPARK-22876 at 8/22/19 9:22 AM:
[
https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913181#comment-16913181
]
Nikita Gorbachevski commented on SPARK-22876:
-
Hi [~praveentallapudi], these options still
[
https://issues.apache.org/jira/browse/SPARK-28730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28730:
---
Description:
After all the discussions in the dev list:
[
https://issues.apache.org/jira/browse/SPARK-28851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ARUN KINDRA updated SPARK-28851:
Description:
Hi,
I am basically trying a sample Spark SQL Code which actually read data from
[
https://issues.apache.org/jira/browse/SPARK-28730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-28730:
---
Parent: SPARK-28589
Issue Type: Sub-task (was: Improvement)
> Configurable type
ARUN KINDRA created SPARK-28851:
---
Summary: Connect HBase using Spark SQL in Spark 2.x
Key: SPARK-28851
URL: https://issues.apache.org/jira/browse/SPARK-28851
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Lotz updated SPARK-28850:
---
Description:
When making a call to:
{code:java}
sc.binaryFiles(somePath){code}
It creates a
[
https://issues.apache.org/jira/browse/SPARK-28850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Lotz updated SPARK-28850:
---
Description:
When making a call to:
{code:java}
sc.binaryFiles(somePath){code}
It creates a
[
https://issues.apache.org/jira/browse/SPARK-28850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Lotz updated SPARK-28850:
---
Description:
When making a call to:
{code:java}
sc.binaryFiles(somePath){code}
It creates a
[
https://issues.apache.org/jira/browse/SPARK-28850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Lotz updated SPARK-28850:
---
Description:
When making a call to:
{code:java}
sc.binaryFiles(somePath){code}
It creates a
Marco Lotz created SPARK-28850:
--
Summary: Binary Files RDD allocates false number of threads
Key: SPARK-28850
URL: https://issues.apache.org/jira/browse/SPARK-28850
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913151#comment-16913151
]
nicolas paris commented on SPARK-28779:
---
good to know thanks
> CSV writer doesn't handle older
[
https://issues.apache.org/jira/browse/SPARK-28832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913149#comment-16913149
]
jobit mathew commented on SPARK-28832:
--
[~dkbiswal],But commands are different right, eventhough
[
https://issues.apache.org/jira/browse/SPARK-28836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28836.
--
Resolution: Won't Fix
See {{TPCDSQueryBenchmark}}. We already have the ways in Spark code
[
https://issues.apache.org/jira/browse/SPARK-28844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28844.
---
Fix Version/s: 2.4.4
2.3.4
3.0.0
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-26895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26895:
--
Fix Version/s: 2.3.4
> When running spark 2.3 as a proxy user (--proxy-user), SparkSubmit
[
https://issues.apache.org/jira/browse/SPARK-28847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-28847:
-
Assignee: Dongjoon Hyun
> Annotate HiveExternalCatalogVersionsSuite with
[
https://issues.apache.org/jira/browse/SPARK-28780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28780:
--
Fix Version/s: 2.3.4
> Delete the incorrect setWeightCol method in LinearSVCModel
>
[
https://issues.apache.org/jira/browse/SPARK-28780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28780:
--
Fix Version/s: 2.4.4
> Delete the incorrect setWeightCol method in LinearSVCModel
>
[
https://issues.apache.org/jira/browse/SPARK-28847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28847.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25550
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ABHISHEK KUMAR GUPTA resolved SPARK-28821.
--
Resolution: Duplicate
Will be covered in ANALYZE TABLE JIRA for document
>
[
https://issues.apache.org/jira/browse/SPARK-28848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28848:
-
Description:
{code}
0: jdbc:hive2://10.18.18.214:23040/func> insert overwrite local directory
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Attachment: D18F4.png
95330.png
91ADA.png
> Spark's
[
https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-28849:
Description:
Spark's {{UnsafeShuffleWriter}} may run into infinite loop when calling
Saisai Shao created SPARK-28849:
---
Summary: Spark's UnsafeShuffleWriter may run into infinite loop in
transferTo occasionally
Key: SPARK-28849
URL: https://issues.apache.org/jira/browse/SPARK-28849
[
https://issues.apache.org/jira/browse/SPARK-28844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28844:
--
Affects Version/s: 3.0.0
2.3.3
> Fix typo in SQLConf
[
https://issues.apache.org/jira/browse/SPARK-28848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913027#comment-16913027
]
Ajith S commented on SPARK-28848:
-
Thanks for reporting. Will look into this. On initial thoughts looks
ABHISHEK KUMAR GUPTA created SPARK-28848:
Summary: insert overwrite local directory stored as parquet
does not creates snappy.parquet data file at local directory path
Key: SPARK-28848
URL:
78 matches
Mail list logo