[
https://issues.apache.org/jira/browse/SPARK-19040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xiaowei updated SPARK-19040:
Labels: patch (was: )
> I just want to report a dug
> ---
>
>
xiaowei created SPARK-19040:
---
Summary: I just want to report a dug
Key: SPARK-19040
URL: https://issues.apache.org/jira/browse/SPARK-19040
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788833#comment-15788833
]
J.P Feng edited comment on SPARK-19037 at 12/31/16 3:31 AM:
yes, my spark
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788833#comment-15788833
]
J.P Feng commented on SPARK-19037:
--
yes, my spark version is version 2.1 downloaded from official site.
Joseph K. Bradley created SPARK-19039:
-
Summary: UDF ClosureCleaner bug when UDF, col applied in paste
mode in REPL
Key: SPARK-19039
URL: https://issues.apache.org/jira/browse/SPARK-19039
[
https://issues.apache.org/jira/browse/SPARK-18404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788734#comment-15788734
]
Jeffrey Shmain commented on SPARK-18404:
Yes, but with Akka response is in milliseconds (few
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Parente updated SPARK-19038:
--
Description:
h2. Stack Trace
{noformat}
Py4JJavaErrorTraceback (most recent call last)
in ()
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Parente updated SPARK-19038:
--
Environment: Hadoop / YARN 2.6, pyspark, yarn-client mode (was: Hadoop /
YARN 2.6, pyspark)
Peter Parente created SPARK-19038:
-
Summary: Can't find keytab file when using Hive catalog
Key: SPARK-19038
URL: https://issues.apache.org/jira/browse/SPARK-19038
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Parente updated SPARK-19038:
--
Description:
h2. Stack Trace
{noformat}
Py4JJavaErrorTraceback (most recent call last)
in ()
[
https://issues.apache.org/jira/browse/SPARK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-19016.
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14975:
Assignee: Apache Spark
> Predicted Probability per training instance for Gradient Boosted
[
https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788293#comment-15788293
]
Apache Spark commented on SPARK-14975:
--
User 'imatiach-msft' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14975:
Assignee: (was: Apache Spark)
> Predicted Probability per training instance for
[
https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788152#comment-15788152
]
Shixiong Zhu commented on SPARK-17463:
--
[~sunil.rangwani] Could you provide the codes that use
[
https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-18123.
-
Resolution: Resolved
Fix Version/s: 2.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18123:
Assignee: Dongjoon Hyun
> org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils.saveTable the case
>
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-19037.
---
Resolution: Duplicate
> Run count(distinct x) from sub query found some errors
>
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15788001#comment-15788001
]
Herman van Hovell commented on SPARK-19037:
---
NVM - this fix will be in the 2.1.1 release.
>
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787995#comment-15787995
]
Herman van Hovell commented on SPARK-19037:
---
This should be fixed in 2.1. See:
[
https://issues.apache.org/jira/browse/SPARK-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787910#comment-15787910
]
Ilya Matiach commented on SPARK-14975:
--
I can take a look into this issue. It looks like GBT needs
[
https://issues.apache.org/jira/browse/SPARK-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787809#comment-15787809
]
Sunil Rangwani commented on SPARK-17463:
Hi
I get the same error with Spark 2.0.2 on EMR 5.2.0
I
[
https://issues.apache.org/jira/browse/SPARK-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787786#comment-15787786
]
Liang-Chi Hsieh commented on SPARK-18781:
-
[~eyal] Do you have estimated time cost of the
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787733#comment-15787733
]
J.P Feng commented on SPARK-19037:
--
errors logs when doing dropDuplicates with sub-query in spark-shell:
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713
]
J.P Feng edited comment on SPARK-19037 at 12/30/16 2:02 PM:
errors logs when
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
J.P Feng updated SPARK-19037:
-
Description:
when i use spark-shell or spark-sql to execute count(distinct name) from
subquery, some
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
J.P Feng updated SPARK-19037:
-
Summary: Run count(distinct x) from sub query found some errors (was: Run
count(distinct name) from sub
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
J.P Feng updated SPARK-19037:
-
Description:
when i use spark-shell or spark-sql to execute count(distinct name) from
subquery, some
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713
]
J.P Feng edited comment on SPARK-19037 at 12/30/16 1:54 PM:
errors logs:
J.P Feng created SPARK-19037:
Summary: Run count(distinct name) from sub query found some errors
Key: SPARK-19037
URL: https://issues.apache.org/jira/browse/SPARK-19037
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787714#comment-15787714
]
J.P Feng commented on SPARK-19037:
--
errors logs:
> Run count(distinct name) from sub query found some
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787713#comment-15787713
]
J.P Feng commented on SPARK-19037:
--
errors logs:
> Run count(distinct name) from sub query found some
[
https://issues.apache.org/jira/browse/SPARK-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
J.P Feng updated SPARK-19037:
-
Comment: was deleted
(was: errors logs:)
> Run count(distinct name) from sub query found some errors
>
[
https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787622#comment-15787622
]
Dongjoon Hyun commented on SPARK-18857:
---
Hi, [~vishalagrwal].
I agree with you. This is an
[
https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18857:
Assignee: (was: Apache Spark)
> SparkSQL ThriftServer hangs while extracting huge
[
https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787618#comment-15787618
]
Apache Spark commented on SPARK-18857:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18857:
Assignee: Apache Spark
> SparkSQL ThriftServer hangs while extracting huge data volumes
[
https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-18808:
-
Assignee: Sean Owen
> ml.KMeansModel.transform is very inefficient
>
[
https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18808.
---
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 16328
[
https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-18808:
--
Priority: Minor (was: Major)
> ml.KMeansModel.transform is very inefficient
>
[
https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787428#comment-15787428
]
Dongjoon Hyun commented on SPARK-18857:
---
Thank you for testing and sharing that information!
>
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787426#comment-15787426
]
Sanjay Dasgupta commented on SPARK-19034:
-
Yes, the SPARK_HOME was the issue.
Apologies for the
[
https://issues.apache.org/jira/browse/SPARK-19032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-19032.
---
Resolution: Not A Problem
Agree, I don't see a reason to expect that sort order is preserved by
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787416#comment-15787416
]
Sean Owen commented on SPARK-19035:
---
The difference in behavior does sound like at least a cosmetic
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19035:
--
Comment: was deleted
(was: The core issue is why :
select case when a=1 then 1 else *1* end b,count(1)
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787410#comment-15787410
]
Dongjoon Hyun commented on SPARK-19034:
---
Hi, [~sanjay.dasgu...@gmail.com].
I tried the binary you
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787411#comment-15787411
]
Dongjoon Hyun commented on SPARK-19034:
---
+1
> Download packages on
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feng Yuan updated SPARK-19035:
--
Comment: was deleted
(was: The core issue is why :
select case when a=1 then 1 else *1* end b,count(1)
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787406#comment-15787406
]
Sean Owen commented on SPARK-19034:
---
I don't see that:
{code}
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787403#comment-15787403
]
Feng Yuan commented on SPARK-19035:
---
The core issue is why :
select case when a=1 then 1 else *1* end
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787402#comment-15787402
]
Feng Yuan commented on SPARK-19035:
---
The core issue is why :
select case when a=1 then 1 else *1* end
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787404#comment-15787404
]
Feng Yuan commented on SPARK-19035:
---
The core issue is why :
select case when a=1 then 1 else *1* end
[
https://issues.apache.org/jira/browse/SPARK-18737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18737.
---
Resolution: Duplicate
Good find, that looks like the same issue. It looks like the resolution was
[
https://issues.apache.org/jira/browse/SPARK-18737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reopened SPARK-18737:
---
> Serialization setting "spark.serializer" ignored in Spark 2.x
>
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787390#comment-15787390
]
Sanjay Dasgupta commented on SPARK-19034:
-
The "Direct download" link to the "Pre-built for
[
https://issues.apache.org/jira/browse/SPARK-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787331#comment-15787331
]
Sean Owen commented on SPARK-18933:
---
stdout and stderr exist for all processes. You can redirect them
[
https://issues.apache.org/jira/browse/SPARK-18986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787325#comment-15787325
]
Sean Owen commented on SPARK-18986:
---
(Priority really doesn't mean anything. Feel free to help review
[
https://issues.apache.org/jira/browse/SPARK-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-19034.
---
Resolution: Invalid
I checked several of the 2.1.0 artifacts and they appear to contain the correct
[
https://issues.apache.org/jira/browse/SPARK-18738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18738.
---
Resolution: Not A Problem
I am going to close this as not a problem unless there's more info here
[
https://issues.apache.org/jira/browse/SPARK-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787309#comment-15787309
]
Sean Owen commented on SPARK-18781:
---
I take it back, I see why remembering the result probably doesn't
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787298#comment-15787298
]
Sean Owen commented on SPARK-19035:
---
I'm not sure that's supposed to work. You are using a in the group
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787290#comment-15787290
]
Sean Owen commented on SPARK-19036:
---
This completely overlooks that merging batches means delaying any
[
https://issues.apache.org/jira/browse/SPARK-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787284#comment-15787284
]
Sean Owen commented on SPARK-18930:
---
You say the result of the select is correct. If you want a
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungho Ham updated SPARK-19036:
---
Summary: Merging dealyed micro batches (was: Merging dealyed micro batches
for parallelism )
>
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungho Ham updated SPARK-19036:
---
Component/s: Structured Streaming
> Merging dealyed micro batches for parallelism
>
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungho Ham updated SPARK-19036:
---
Description:
Efficiency of parallel execution get worsen when data is not evenly distributed
by
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungho Ham updated SPARK-19036:
---
Description:
Efficiency of parallel execution get worsen when data is not evenly distributed
by
[
https://issues.apache.org/jira/browse/SPARK-19036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungho Ham updated SPARK-19036:
---
Description:
Efficiency of parallel execution get worsen when data is not evenly distributed
by
Sungho Ham created SPARK-19036:
--
Summary: Merging dealyed micro batches for parallelism
Key: SPARK-19036
URL: https://issues.apache.org/jira/browse/SPARK-19036
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-19012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787194#comment-15787194
]
Jork Zijlstra commented on SPARK-19012:
---
[~hvanhovell] Its already working for me, I was already
[
https://issues.apache.org/jira/browse/SPARK-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feng Yuan updated SPARK-19035:
--
Summary: rand() function in case when cause failed (was: rand() function
in case when cause will
71 matches
Mail list logo