[
https://issues.apache.org/jira/browse/SPARK-30955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045211#comment-17045211
]
Peter Toth commented on SPARK-30955:
This affects only 3.0, doesn't it?
> Exclude Generate output
[
https://issues.apache.org/jira/browse/SPARK-30932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045168#comment-17045168
]
zhengruifeng commented on SPARK-30932:
--
I check the output result and do not find outstanding
L. C. Hsieh created SPARK-30955:
---
Summary: Exclude Generate output when aliasing in nested column
pruning
Key: SPARK-30955
URL: https://issues.apache.org/jira/browse/SPARK-30955
Project: Spark
zhengruifeng created SPARK-30954:
Summary: TreeModelWrappers class name do not correspond to file
name
Key: SPARK-30954
URL: https://issues.apache.org/jira/browse/SPARK-30954
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30932:
-
Attachment: (was: signature.diff)
> ML 3.0 QA: API: Java compatibility, docs
>
[
https://issues.apache.org/jira/browse/SPARK-30932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30932:
-
Attachment: (was: added_ml_class)
> ML 3.0 QA: API: Java compatibility, docs
>
[
https://issues.apache.org/jira/browse/SPARK-30932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30932:
-
Attachment: signature.diff
common_ml_class
added_ml_class
[
https://issues.apache.org/jira/browse/SPARK-30932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30932:
-
Attachment: (was: 1_process_script.sh)
> ML 3.0 QA: API: Java compatibility, docs
>
wuyi created SPARK-30953:
Summary: InsertAdaptiveSparkPlan should also skip v2 command
Key: SPARK-30953
URL: https://issues.apache.org/jira/browse/SPARK-30953
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-30950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30950.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27698
[
https://issues.apache.org/jira/browse/SPARK-30904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-30904:
Fix Version/s: (was: 3.1.0)
> Thrift RowBasedSet serialization throws NullPointerException on NULL
>
[
https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-30893:
Target Version/s: 3.0.0
> Expressions should not change its data type/behavior after it's created
>
[
https://issues.apache.org/jira/browse/SPARK-30952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bruce_zhao updated SPARK-30952:
---
Description:
We are trying to apply three-sigma rule in grouped data to detect anomaly data.
We
bruce_zhao created SPARK-30952:
--
Summary: Grouped pandas_udf crashed when a group returned an empty
DataFrame
Key: SPARK-30952
URL: https://issues.apache.org/jira/browse/SPARK-30952
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045100#comment-17045100
]
Dongjoon Hyun commented on SPARK-30855:
---
Sorry, but we don't have a snapshot distribution.
>
[
https://issues.apache.org/jira/browse/SPARK-24472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-24472.
---
Resolution: Duplicate
This is fixed at `3.0.0-preview2` by SPARK-23710.
> Orc
[
https://issues.apache.org/jira/browse/SPARK-24472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24472:
--
Affects Version/s: 2.4.5
> Orc RecordReaderFactory throws IndexOutOfBoundsException
>
[
https://issues.apache.org/jira/browse/SPARK-24472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045096#comment-17045096
]
Dongjoon Hyun commented on SPARK-24472:
---
I confirmed that this is fixed at 3.0.0-preview2.
{code}
[
https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045078#comment-17045078
]
YoungGyu Chun edited comment on SPARK-27148 at 2/26/20 2:27 AM:
[
https://issues.apache.org/jira/browse/SPARK-30950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30950:
--
Issue Type: Improvement (was: Story)
> Setting version to 3.1.0-SNAPSHOT
>
[
https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045078#comment-17045078
]
YoungGyu Chun commented on SPARK-27148:
---
[~maropu] Thank you :)
> Support CURRENT_TIME and
Bruce Robbins created SPARK-30951:
-
Summary: Potential data loss for legacy applications after switch
to proleptic Gregorian calendar
Key: SPARK-30951
URL: https://issues.apache.org/jira/browse/SPARK-30951
[
https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045066#comment-17045066
]
Takeshi Yamamuro commented on SPARK-27148:
--
Yea, feel free to take this over.
> Support
[
https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045060#comment-17045060
]
YoungGyu Chun commented on SPARK-27148:
---
[~maropu] I am wondering if I can work on this.
>
[
https://issues.apache.org/jira/browse/SPARK-29969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045059#comment-17045059
]
YoungGyu Chun commented on SPARK-29969:
---
[~xiaoxigua] is this issue is relating to Spark? The
Xiao Li created SPARK-30950:
---
Summary: Setting version to 3.1.0-SNAPSHOT
Key: SPARK-30950
URL: https://issues.apache.org/jira/browse/SPARK-30950
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-29333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-29333.
Resolution: Fixed
> Sample weight in RandomForestRegressor
>
[
https://issues.apache.org/jira/browse/SPARK-29333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045038#comment-17045038
]
Huaxin Gao commented on SPARK-29333:
This is resolved in
[
https://issues.apache.org/jira/browse/SPARK-30561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045015#comment-17045015
]
t oo commented on SPARK-30561:
--
[~rxin] looks like you committed val SLEEP_TIME_SECS = 5 in BlockManager,
[
https://issues.apache.org/jira/browse/SPARK-30561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045013#comment-17045013
]
t oo commented on SPARK-30561:
--
[~pwendell] looks like you added the sleep(5000), you don't happen to
[
https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045011#comment-17045011
]
Jungtaek Lim commented on SPARK-24295:
--
[~iqbal_khattra] [~alfredo-gimenez-bv]
Hi, if you're open
[
https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045009#comment-17045009
]
Jungtaek Lim commented on SPARK-29995:
--
[~zhangliming]
Hi, if you're open to try out something on
[
https://issues.apache.org/jira/browse/SPARK-30943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-30943.
--
Fix Version/s: 3.0.0
Assignee: Jungtaek Lim
Resolution: Fixed
> Show "batch
[
https://issues.apache.org/jira/browse/SPARK-30610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044974#comment-17044974
]
t oo commented on SPARK-30610:
--
>From [~holdenkarau]: In its present state it could help, you'd call decom
[
https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044970#comment-17044970
]
Onur Satici commented on SPARK-30949:
-
Hi [~dongjoon], sorry my mistake, changed it to improvement,
[
https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Onur Satici updated SPARK-30949:
Issue Type: Improvement (was: Dependency upgrade)
> Driver cores in kubernetes are coupled with
[
https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044963#comment-17044963
]
Dongjoon Hyun commented on SPARK-30949:
---
Hi, [~onursatici]. Thank you for filing a JIRA and making
[
https://issues.apache.org/jira/browse/SPARK-30918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-30918.
-
Fix Version/s: 3.0.0
Resolution: Fixed
> improve the splitting of skewed partitions
>
[
https://issues.apache.org/jira/browse/SPARK-18879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044931#comment-17044931
]
NITISH SHARMA edited comment on SPARK-18879 at 2/25/20 9:59 PM:
I have a
[
https://issues.apache.org/jira/browse/SPARK-18879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044931#comment-17044931
]
NITISH SHARMA commented on SPARK-18879:
---
I have a similar requirement where i am looking to update
[
https://issues.apache.org/jira/browse/SPARK-30378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao updated SPARK-30378:
---
Summary: FM support getter of training params (was: FM support getter of
training prams)
> FM
[
https://issues.apache.org/jira/browse/SPARK-30934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044908#comment-17044908
]
Huaxin Gao commented on SPARK-30934:
cc [~podongfeng]
I will change migration guide for the
[
https://issues.apache.org/jira/browse/SPARK-30928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043874#comment-17043874
]
Huaxin Gao edited comment on SPARK-30928 at 2/25/20 9:28 PM:
-
I audited
[
https://issues.apache.org/jira/browse/SPARK-24472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044744#comment-17044744
]
Shreyas commented on SPARK-24472:
-
Now that SPARK-23710 has been fixed, can this one be attended to?
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044741#comment-17044741
]
Benoit Roy commented on SPARK-30855:
Do you know if there is any distro available of the latest
[
https://issues.apache.org/jira/browse/SPARK-30928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043874#comment-17043874
]
Huaxin Gao edited comment on SPARK-30928 at 2/25/20 6:51 PM:
-
I audited
[
https://issues.apache.org/jira/browse/SPARK-30928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043874#comment-17043874
]
Huaxin Gao edited comment on SPARK-30928 at 2/25/20 6:47 PM:
-
I audited all
[
https://issues.apache.org/jira/browse/SPARK-30928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043874#comment-17043874
]
Huaxin Gao edited comment on SPARK-30928 at 2/25/20 6:43 PM:
-
I audited all
[
https://issues.apache.org/jira/browse/SPARK-30928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043874#comment-17043874
]
Huaxin Gao edited comment on SPARK-30928 at 2/25/20 6:40 PM:
-
I audited all
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044718#comment-17044718
]
Dongjoon Hyun commented on SPARK-30855:
---
Thanks, [~benoitroy] and [~petertoth].
> Issue using
[
https://issues.apache.org/jira/browse/SPARK-30942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30942.
---
Fix Version/s: 3.1.0
Assignee: Thomas Graves
Resolution: Fixed
> Fix the
[
https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Onur Satici updated SPARK-30949:
Description:
Drivers submitted in kubernetes cluster mode set the parallelism of various
Onur Satici created SPARK-30949:
---
Summary: Driver cores in kubernetes are coupled with container
resources, not spark.driver.cores
Key: SPARK-30949
URL: https://issues.apache.org/jira/browse/SPARK-30949
[
https://issues.apache.org/jira/browse/SPARK-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044607#comment-17044607
]
Dmitry Goldenberg edited comment on SPARK-8665 at 2/25/20 4:04 PM:
---
Any
[
https://issues.apache.org/jira/browse/SPARK-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044607#comment-17044607
]
Dmitry Goldenberg commented on SPARK-8665:
--
Any reason why this is marked as resolved?
[
https://issues.apache.org/jira/browse/SPARK-30948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
1kang updated SPARK-30948:
--
Affects Version/s: (was: 1.0.0)
1.6.0
> Sharing the same external shuffle
[
https://issues.apache.org/jira/browse/SPARK-30948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
1kang updated SPARK-30948:
--
Affects Version/s: (was: 2.4.3)
1.0.0
> Sharing the same external shuffle
[
https://issues.apache.org/jira/browse/SPARK-30948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wankang updated SPARK-30948:
Description: Multiple spark tasks sharing the same external shuffle
service will affect each other. if
wankang created SPARK-30948:
---
Summary: Sharing the same external shuffle service
Key: SPARK-30948
URL: https://issues.apache.org/jira/browse/SPARK-30948
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-30322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044561#comment-17044561
]
Thomas Graves commented on SPARK-30322:
---
Document the yarn priority behavior
> Add stage level
[
https://issues.apache.org/jira/browse/SPARK-30869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30869.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27618
[
https://issues.apache.org/jira/browse/SPARK-30869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30869:
---
Assignee: Maxim Gekk
> Convert dates to/from timestamps in microseconds precision
>
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044530#comment-17044530
]
Peter Toth commented on SPARK-30855:
Yes, it's been merged.
> Issue using 'explode' function
[
https://issues.apache.org/jira/browse/SPARK-30919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30919:
---
Assignee: Kent Yao
> Make interval multiply and divide's overflow behavior consisitent
[
https://issues.apache.org/jira/browse/SPARK-30919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30919.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27672
[
https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044514#comment-17044514
]
Steve Loughran commented on SPARK-6305:
---
bq. Also note that Log4j 2 now offers experimental support
[
https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044470#comment-17044470
]
YoungGyu Chun commented on SPARK-27148:
---
[~pavithraramachandran] are you still working on?
>
[
https://issues.apache.org/jira/browse/SPARK-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044467#comment-17044467
]
Shyam commented on SPARK-3875:
--
[~srowen] , I am still getting this error , its suggested this is the fix
wuyi created SPARK-30947:
Summary: Don't log accelerate resources when it's empty
Key: SPARK-30947
URL: https://issues.apache.org/jira/browse/SPARK-30947
Project: Spark
Issue Type: Improvement
Jungtaek Lim created SPARK-30946:
Summary: FileStreamSourceLog/FileStreamSinkLog: leverage UnsafeRow
type to serialize/deserialize entry
Key: SPARK-30946
URL: https://issues.apache.org/jira/browse/SPARK-30946
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044453#comment-17044453
]
Benoit Roy commented on SPARK-30855:
Awesome. Thanks for contributing the PR. I see that this PR
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Attachment: (was: SPARK-30885-master.patch)
> NullPointerException when Insert data to hive
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Attachment: SPARK-30885-master.patch
> NullPointerException when Insert data to hive mongo external
[
https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044374#comment-17044374
]
Wenchen Fan commented on SPARK-28024:
-
I've lowered the priority from blocker to major.
>
[
https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-28024:
Priority: Major (was: Blocker)
> Incorrect numeric values when out of range
>
[
https://issues.apache.org/jira/browse/SPARK-30096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044353#comment-17044353
]
Sandeep Katta commented on SPARK-30096:
---
[~abhishek.akg] I have cross checked the behaviour, those
[
https://issues.apache.org/jira/browse/SPARK-30096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Katta updated SPARK-30096:
--
Attachment: screenshot-1.png
> drop function does not delete the jars file from tmp folder-
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng reopened SPARK-30476:
> NullPointerException when Insert data to hive mongo external table by
> spark-sql
>
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Issue Type: Bug (was: Improvement)
> NullPointerException when Insert data to hive mongo external
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044322#comment-17044322
]
XiongCheng commented on SPARK-30476:
The root of this problem is that SPARK does not continue to
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Priority: Minor (was: Major)
> NullPointerException when Insert data to hive mongo external table
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Issue Type: Improvement (was: Bug)
> NullPointerException when Insert data to hive mongo external
[
https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiongCheng updated SPARK-30476:
---
Attachment: SPARK-30885-master.patch
> NullPointerException when Insert data to hive mongo external
[
https://issues.apache.org/jira/browse/SPARK-30841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-30841:
---
Summary: Add version information to the configuration of SQL (was: Display
the version of Spark
[
https://issues.apache.org/jira/browse/SPARK-30830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30830.
--
Resolution: Not A Problem
> method setQueryTimeout not support
>
[
https://issues.apache.org/jira/browse/SPARK-30830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044205#comment-17044205
]
Hyukjin Kwon edited comment on SPARK-30830 at 2/25/20 8:02 AM:
---
That
[
https://issues.apache.org/jira/browse/SPARK-30830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044205#comment-17044205
]
Hyukjin Kwon commented on SPARK-30830:
--
That should be fixed in the JDBC driver. Spark will also
87 matches
Mail list logo