[
https://issues.apache.org/jira/browse/SPARK-31308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071461#comment-17071461
]
L. C. Hsieh commented on SPARK-31308:
-
Thanks [~dongjoon]. So what I should set? 3.1.0?
> Make
[
https://issues.apache.org/jira/browse/SPARK-31276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071460#comment-17071460
]
Hyukjin Kwon commented on SPARK-31276:
--
Default scheme in URI is dependent on Hadoop's
[
https://issues.apache.org/jira/browse/SPARK-31276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31276.
--
Resolution: Won't Fix
> Contrived working example that works with multiple URI file storages
zhengruifeng created SPARK-31309:
Summary: Migrate the ChiSquareTest from MLlib to ML
Key: SPARK-31309
URL: https://issues.apache.org/jira/browse/SPARK-31309
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-31309:
-
Priority: Minor (was: Major)
> Migrate the ChiSquareTest from MLlib to ML
>
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071452#comment-17071452
]
zhengruifeng commented on SPARK-31301:
--
[~srowen] It is not targeted 3.0.0. I agree that we must
[
https://issues.apache.org/jira/browse/SPARK-31308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071447#comment-17071447
]
Dongjoon Hyun commented on SPARK-31308:
---
Hi, [~viirya]. We have 3.0.0 RC1 tag already. You should
[
https://issues.apache.org/jira/browse/SPARK-31142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071444#comment-17071444
]
Dongjoon Hyun commented on SPARK-31142:
---
This issue is resolved as `Invalid`. Please see the
[
https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31281.
--
Resolution: Invalid
> Hit OOM Error - GC Limit
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31274.
--
Fix Version/s: (was: 3.1.0)
Resolution: Invalid
Questions should go to mailing
[
https://issues.apache.org/jira/browse/SPARK-31260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31260.
--
Resolution: Invalid
Questions should go to mailing list or stackoverflow. Please see also
[
https://issues.apache.org/jira/browse/SPARK-31303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31303:
-
Summary: Structured streaming The offset in the checkpoint is suddenly
reset to the earliest
[
https://issues.apache.org/jira/browse/SPARK-31279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31279.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28042
[
https://issues.apache.org/jira/browse/SPARK-31279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31279:
Assignee: jiaan.geng
> Add version information to the configuration of Hive
>
[
https://issues.apache.org/jira/browse/SPARK-31295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31295:
Assignee: jiaan.geng
> Supplement version for configuration appear in doc
>
[
https://issues.apache.org/jira/browse/SPARK-31295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31295.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28064
[
https://issues.apache.org/jira/browse/SPARK-31282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31282.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28044
[
https://issues.apache.org/jira/browse/SPARK-31282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31282:
Assignee: jiaan.geng
> Supplement version for configuration appear in security doc
>
[
https://issues.apache.org/jira/browse/SPARK-31269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31269:
Assignee: jiaan.geng
> Supplement version for configuration only appear in configuration
[
https://issues.apache.org/jira/browse/SPARK-31269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31269.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28035
[
https://issues.apache.org/jira/browse/SPARK-31215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31215.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27981
[
https://issues.apache.org/jira/browse/SPARK-31215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31215:
Assignee: jiaan.geng
> Add version information to the static configuration of SQL
>
[
https://issues.apache.org/jira/browse/SPARK-31308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31308:
-
Component/s: Spark Submit
> Make Python dependencies available for Non-PySpark applications
>
[
https://issues.apache.org/jira/browse/SPARK-31222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng reassigned SPARK-31222:
Assignee: zhengruifeng
> Make ANOVATest Sparsity-Aware
> -
>
[
https://issues.apache.org/jira/browse/SPARK-31222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-31222.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27982
[
https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31280:
--
Fix Version/s: (was: 3.1.0)
> Perform propagating empty relation after
[
https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-31280:
---
> Perform propagating empty relation after RewritePredicateSubquery
>
L. C. Hsieh created SPARK-31308:
---
Summary: Make Python dependencies available for Non-PySpark
applications
Key: SPARK-31308
URL: https://issues.apache.org/jira/browse/SPARK-31308
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27093.
--
Resolution: Invalid
Resolving due to no feedback from the reporter.
> Honor ParseMode in
[
https://issues.apache.org/jira/browse/SPARK-30775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30775:
-
Assignee: Luca Canali
> Improve DOC for executor metrics
>
[
https://issues.apache.org/jira/browse/SPARK-30775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30775.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27526
[
https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-7101:
Priority: Major (was: Minor)
> Spark SQL should support java.sql.Time
>
[
https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-7101:
Affects Version/s: (was: 1.2.1)
3.1.0
> Spark SQL should support
[
https://issues.apache.org/jira/browse/SPARK-31142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31142.
--
Resolution: Invalid
> Remove useless conf set in pyspark context
>
[
https://issues.apache.org/jira/browse/SPARK-31288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31288:
--
Priority: Minor (was: Major)
> Remove `getRawTable` in `alterPartitions`
>
[
https://issues.apache.org/jira/browse/SPARK-31288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31288:
--
Summary: Remove `getRawTable` in `alterPartitions` (was: Reduce calls to
requireDbExists and
[
https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31297:
--
Parent: SPARK-30951
Issue Type: Sub-task (was: Improvement)
> Speed-up date-time
[
https://issues.apache.org/jira/browse/SPARK-31296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31296:
--
Parent: SPARK-30951
Issue Type: Sub-task (was: Test)
> Benchmark date-time rebasing
[
https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071298#comment-17071298
]
Dan Ziemba commented on SPARK-16859:
"spark.eventLog.logBlockUpdates.enabled=true" works for me on
[
https://issues.apache.org/jira/browse/SPARK-31307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071244#comment-17071244
]
Huaxin Gao commented on SPARK-31307:
cc [~kevinyu98]
> Add FValueTest Examples
>
Huaxin Gao created SPARK-31307:
--
Summary: Add FValueTest Examples
Key: SPARK-31307
URL: https://issues.apache.org/jira/browse/SPARK-31307
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YoungGyu Chun updated SPARK-7101:
-
Comment: was deleted
(was: I will work on this)
> Spark SQL should support java.sql.Time
>
[
https://issues.apache.org/jira/browse/SPARK-31219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-31219.
---
Fix Version/s: 3.1.0
3.0.0
Assignee: Manu Zhang
[
https://issues.apache.org/jira/browse/SPARK-31219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-31219:
--
Issue Type: Bug (was: Improvement)
> YarnShuffleService doesn't close idle netty channel
>
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description: The rand() function in PySpark, Spark, and R is documented as
drawing from U[0.0, 1.0]. This
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description: The rand() function in PySpark, Spark, and R is documented as
drawing from U[0.0, 1.0]. This
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-31306:
Description:
The rand() function in PySpark, Spark, and R is documented as drawing from
U[0.0, 1.0]. This
Ben created SPARK-31306:
---
Summary: rand() function documentation suggests an inclusive upper
bound of 1.0
Key: SPARK-31306
URL: https://issues.apache.org/jira/browse/SPARK-31306
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071122#comment-17071122
]
Sai Nikhilesh Kasturi edited comment on SPARK-19764 at 3/30/20, 4:38 PM:
[
https://issues.apache.org/jira/browse/SPARK-19764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071122#comment-17071122
]
Sai Nikhilesh Kasturi commented on SPARK-19764:
---
Hello, I am new to spark but I am also
Huaxin Gao created SPARK-31305:
--
Summary: Add a page to list all commands in SQL Reference
Key: SPARK-31305
URL: https://issues.apache.org/jira/browse/SPARK-31305
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071070#comment-17071070
]
Huaxin Gao commented on SPARK-31304:
cc [~kevinyu98]
> Add ANOVATest example
>
Huaxin Gao created SPARK-31304:
--
Summary: Add ANOVATest example
Key: SPARK-31304
URL: https://issues.apache.org/jira/browse/SPARK-31304
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071039#comment-17071039
]
Sean R. Owen commented on SPARK-31301:
--
Hm, tough call, just because of the behavior change. I am
[
https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070982#comment-17070982
]
Felix Kizhakkel Jose commented on SPARK-26345:
--
I have created a Jira in Parquet-mr for
[
https://issues.apache.org/jira/browse/SPARK-25804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070938#comment-17070938
]
pin_zhang commented on SPARK-25804:
---
Any comments on this issue?
> JDOPersistenceManager leak when
[
https://issues.apache.org/jira/browse/SPARK-29709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070877#comment-17070877
]
Vasu Dasari commented on SPARK-29709:
-
More details about the issue:
Spark structured Streaming
[
https://issues.apache.org/jira/browse/SPARK-31303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vasu Dasari updated SPARK-31303:
Description:
Spark structured Streaming -Kafka, ListOffsetRequest to earliest(-2) for
existing
Vasu Dasari created SPARK-31303:
---
Summary: CLONE - structured streaming The offset in the checkpoint
is suddenly reset to the earliest
Key: SPARK-31303
URL: https://issues.apache.org/jira/browse/SPARK-31303
[
https://issues.apache.org/jira/browse/SPARK-31302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stefan Goldener updated SPARK-31302:
Description:
Please change the deployment script for the workers to support one Shared
[
https://issues.apache.org/jira/browse/SPARK-31302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stefan Goldener updated SPARK-31302:
Description:
Please change the deployment script for the workers to support one Shared
[
https://issues.apache.org/jira/browse/SPARK-31302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stefan Goldener updated SPARK-31302:
Description:
Please change the deployment script for the workers to support one Shared
Stefan Goldener created SPARK-31302:
---
Summary: Shared Volume Spark Kubernetes
Key: SPARK-31302
URL: https://issues.apache.org/jira/browse/SPARK-31302
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070832#comment-17070832
]
rameshkrishnan muthusamy commented on SPARK-27093:
--
Is there someone working on this. I
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-31301:
-
Description:
{code:java}
scala> import org.apache.spark.ml.linalg.{Vector, Vectors}
import
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-31301:
-
Description:
{code:java}
scala> import org.apache.spark.ml.linalg.{Vector, Vectors}
import
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-31301:
-
Description:
{code:java}
scala> import org.apache.spark.ml.linalg.{Vector, Vectors}
import
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070827#comment-17070827
]
zhengruifeng commented on SPARK-31301:
--
friendly ping [~srowen] [~huaxingao]
> flatten the result
zhengruifeng created SPARK-31301:
Summary: flatten the result dataframe of tests in stat
Key: SPARK-31301
URL: https://issues.apache.org/jira/browse/SPARK-31301
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31296.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28057
[
https://issues.apache.org/jira/browse/SPARK-31296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31296:
---
Assignee: Maxim Gekk
> Benchmark date-time rebasing in Parquet datasource
>
zhengruifeng created SPARK-31300:
Summary: Migrate the implementation of algorithms from MLlib to ML
Key: SPARK-31300
URL: https://issues.apache.org/jira/browse/SPARK-31300
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070774#comment-17070774
]
Jorge Machado commented on SPARK-30272:
---
I failed to fix the guava stuff of course ... Today
Lukas Thaler created SPARK-31299:
Summary: Pyspark.ml.clustering illegalArgumentException with
dataframe created from rows
Key: SPARK-31299
URL: https://issues.apache.org/jira/browse/SPARK-31299
[
https://issues.apache.org/jira/browse/SPARK-30846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30846.
--
Resolution: Won't Fix
> Add AccumulatorV2 API in JavaSparkContext
>
77 matches
Mail list logo
