[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung reassigned SPARK-18136:
Assignee: Jakub Nowacki
> Make PySpark pip install works on windows
>
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248377#comment-16248377
]
Felix Cheung commented on SPARK-18136:
--
thanks [~hyukjin.kwon]
> Make PySpark pip install works on
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-18136:
-
Fix Version/s: 2.3.0
2.2.1
2.1.3
> Make PySpark pip
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-18136:
-
Affects Version/s: 2.3.0
2.1.2
2.2.0
Target
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248372#comment-16248372
]
Felix Cheung commented on SPARK-22042:
--
any taker? is this a blocker for 2.2.1?
>
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22042:
-
Target Version/s: 2.2.1
> ReorderJoinPredicates can break when child's partitioning is not
Hyukjin Kwon created SPARK-22495:
Summary: Fix setup of SPARK_HOME variable on Windows
Key: SPARK-22495
URL: https://issues.apache.org/jira/browse/SPARK-22495
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-18136.
--
Resolution: Fixed
> Make PySpark pip install works on windows
>
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248367#comment-16248367
]
Hyukjin Kwon edited comment on SPARK-18136 at 11/11/17 6:46 AM:
Let me
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248368#comment-16248368
]
Hyukjin Kwon commented on SPARK-18136:
--
Fixed in https://github.com/apache/spark/pull/19310
> Make
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248367#comment-16248367
]
Hyukjin Kwon commented on SPARK-18136:
--
Let me resolve this and separately open up another JIRA for
[
https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248366#comment-16248366
]
Felix Cheung commented on SPARK-22055:
--
moving to 2.3.0
I think it would be great to make progress
[
https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22055:
-
Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0)
> Port release scripts
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22054:
-
Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0)
> Allow release managers to inject their keys
>
[
https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248365#comment-16248365
]
Felix Cheung commented on SPARK-22054:
--
moving to 2.3.0
> Allow release managers to inject their
[
https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248364#comment-16248364
]
Felix Cheung commented on SPARK-22406:
--
is this still being targeted for 2.2.1?
> pyspark version
[
https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248361#comment-16248361
]
Felix Cheung commented on SPARK-18136:
--
is this still being targeted for 2.2.1?
> Make PySpark pip
[
https://issues.apache.org/jira/browse/SPARK-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248235#comment-16248235
]
Ivan Gozali commented on SPARK-13127:
-
Hello! I was looking to find more information on Parquet
[
https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248184#comment-16248184
]
Joseph K. Bradley commented on SPARK-21866:
---
[~timhunter] you made a similar comment above
[
https://issues.apache.org/jira/browse/SPARK-21667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-21667.
--
Resolution: Fixed
Assignee: Rekha Joshi
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-19644.
--
Resolution: Fixed
Assignee: Shixiong Zhu
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22494:
Assignee: (was: Apache Spark)
> Coalesce and AtLeastNNonNulls can cause 64KB JVM
[
https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22494:
Assignee: Apache Spark
> Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit
[
https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248076#comment-16248076
]
Apache Spark commented on SPARK-22494:
--
User 'mgaido91' has created a pull request for this issue:
Marco Gaido created SPARK-22494:
---
Summary: Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode
limit exception
Key: SPARK-22494
URL: https://issues.apache.org/jira/browse/SPARK-22494
Project:
[
https://issues.apache.org/jira/browse/SPARK-22346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248049#comment-16248049
]
Bago Amirbekian commented on SPARK-22346:
-
I think [~josephkb]'s version of Option 3 makes the
[
https://issues.apache.org/jira/browse/SPARK-22487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248045#comment-16248045
]
Apache Spark commented on SPARK-22487:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22284:
---
Assignee: Kazuaki Ishizaki
> Code of class
>
[
https://issues.apache.org/jira/browse/SPARK-22284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22284.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247973#comment-16247973
]
Apache Spark commented on SPARK-19644:
--
User 'zsxwing' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu reassigned SPARK-22294:
Assignee: Santiago Saavedra
> Reset spark.driver.bindAddress when starting a Checkpoint
>
[
https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247919#comment-16247919
]
Michael McAllister edited comment on SPARK-19834 at 11/10/17 7:01 PM:
[
https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247919#comment-16247919
]
Michael McAllister commented on SPARK-19834:
Is there an update on when this tickdet is going
[
https://issues.apache.org/jira/browse/SPARK-22243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-22243:
-
Fix Version/s: 2.2.1
> streaming job failed to restart from checkpoint
>
[
https://issues.apache.org/jira/browse/SPARK-22294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-22294.
--
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
> Reset
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247913#comment-16247913
]
Ran Haim commented on SPARK-22481:
--
No, it is not.
> CatalogImpl.refreshTable is slow
>
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247910#comment-16247910
]
Ganesh Sivalingam edited comment on SPARK-18755 at 11/10/17 6:55 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247910#comment-16247910
]
Ganesh Sivalingam commented on SPARK-18755:
---
[~yuhaoyan] No problem, I do have some things to
[
https://issues.apache.org/jira/browse/SPARK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247886#comment-16247886
]
Steve Loughran commented on SPARK-17593:
Hey nick,
yes, need to move to FileSystem.list(path,
[
https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247884#comment-16247884
]
Felix Cheung commented on SPARK-21693:
--
let's continue this conversation.
>From the first link on
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-22344.
--
Resolution: Fixed
Assignee: Shivaram Venkataraman
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247873#comment-16247873
]
Kazuaki Ishizaki commented on SPARK-22481:
--
Thanks.
Is that dataframe cached or not?
>
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247870#comment-16247870
]
yuhao yang commented on SPARK-18755:
Thanks for all the interests.
For anyone who wants to
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247858#comment-16247858
]
Ran Haim commented on SPARK-22481:
--
Ok, I'll create a simple app to reproduce this, later next week.
>
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247852#comment-16247852
]
Ran Haim commented on SPARK-22481:
--
I will double check on Sunday, but sparksession.table in the end
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247845#comment-16247845
]
Kazuaki Ishizaki commented on SPARK-22481:
--
Sorry, I overlooked "where it used to take 2
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247838#comment-16247838
]
Ran Haim commented on SPARK-22481:
--
I can check it again on Sunday.
I don't know why it is suprising, as
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247828#comment-16247828
]
Ran Haim edited comment on SPARK-22481 at 11/10/17 5:47 PM:
It is as I wrote
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247836#comment-16247836
]
Wenchen Fan commented on SPARK-22481:
-
Can you double check that a simple `SparkSession.table` can
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247828#comment-16247828
]
Ran Haim commented on SPARK-22481:
--
It is as I wrote above.
It takes 1 minute in 2.1.1 and 2 seconds in
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247826#comment-16247826
]
Kazuaki Ishizaki commented on SPARK-22481:
--
How long does it take in the old code?
Can you put
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247806#comment-16247806
]
Apache Spark commented on SPARK-18278:
--
User 'liyinan926' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22473.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19696
[
https://issues.apache.org/jira/browse/SPARK-22493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22493.
---
Resolution: Not A Problem
> sql null checks for Double.NaN do not work
>
[
https://issues.apache.org/jira/browse/SPARK-22493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247660#comment-16247660
]
Marco Gaido edited comment on SPARK-22493 at 11/10/17 3:39 PM:
---
{{NaN}} is
[
https://issues.apache.org/jira/browse/SPARK-22493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247660#comment-16247660
]
Marco Gaido commented on SPARK-22493:
-
`NaN` is not `null`. They are different things. If you want to
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247646#comment-16247646
]
cen yuhai commented on SPARK-22491:
---
If I set spark.sql.adaptive.enabled=falseļ¼ it is ok.
> union all
[
https://issues.apache.org/jira/browse/SPARK-22493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MIkhail Osckin updated SPARK-22493:
---
Priority: Minor (was: Major)
> sql null checks for Double.NaN do not work
>
[
https://issues.apache.org/jira/browse/SPARK-22493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MIkhail Osckin updated SPARK-22493:
---
Attachment: sql_null.png
> sql null checks for Double.NaN do not work
>
MIkhail Osckin created SPARK-22493:
--
Summary: sql null checks for Double.NaN do not work
Key: SPARK-22493
URL: https://issues.apache.org/jira/browse/SPARK-22493
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MIkhail Osckin updated SPARK-22492:
---
Description:
I want to run spark in standalone mode on localhost only. I set
export
MIkhail Osckin created SPARK-22492:
--
Summary: Spark master web ui server in standalone mode do not
honor host option
Key: SPARK-22492
URL: https://issues.apache.org/jira/browse/SPARK-22492
Project:
[
https://issues.apache.org/jira/browse/SPARK-22482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247516#comment-16247516
]
Sean Owen commented on SPARK-22482:
---
The error comes from Parquet and you are already pursuing there.
[
https://issues.apache.org/jira/browse/SPARK-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247515#comment-16247515
]
Sean Owen commented on SPARK-19371:
---
All: this isn't a bug. See issues above. If you rule these out,
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22491:
--
Priority: Minor (was: Major)
Issue Type: Improvement (was: Bug)
Doesn't sound like a bug. It's
[
https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247403#comment-16247403
]
Guillaume Van Delsen commented on SPARK-21994:
--
[~vsr] Good news, could share Cloudera
[
https://issues.apache.org/jira/browse/SPARK-22450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22450:
---
Assignee: Xianyang Liu
> Safely register class for mllib
> ---
[
https://issues.apache.org/jira/browse/SPARK-22450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22450.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19661
[
https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Pentreath reassigned SPARK-20199:
--
Assignee: pralabhkumar
> GradientBoostedTreesModel doesn't have
[
https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Pentreath resolved SPARK-20199.
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18118
[
https://issues.apache.org/jira/browse/SPARK-22487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22487:
---
Assignee: Kent Yao
> No usages of HIVE_EXECUTION_VERSION found in whole spark project
>
[
https://issues.apache.org/jira/browse/SPARK-22487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22487.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19712
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247316#comment-16247316
]
Ganesh Sivalingam edited comment on SPARK-18755 at 11/10/17 10:22 AM:
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247316#comment-16247316
]
Ganesh Sivalingam commented on SPARK-18755:
---
[~yuhaoyan] Whilst working at Parkopedia, I have
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247310#comment-16247310
]
Apache Spark commented on SPARK-18755:
--
User 'gnsiva' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
cen yuhai updated SPARK-22491:
--
Description:
test sql
set spark.sql.adaptive.enabled=true;
{code}
create table temp.test_yuhai_group
[
https://issues.apache.org/jira/browse/SPARK-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247215#comment-16247215
]
Jing Weng commented on SPARK-19371:
---
I'm also having the same issue in Spark 2.1.
> Cannot spread
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247202#comment-16247202
]
cen yuhai commented on SPARK-22491:
---
[~smilegator] [~cloud_fan]
> union all can't execute parallel
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
cen yuhai updated SPARK-22491:
--
Description:
test sql
{code}
create table temp.test_yuhai_group
as
select
city_name
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
cen yuhai updated SPARK-22491:
--
Attachment: screenshot-1.png
> union all can't execute parallel with group by
>
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
cen yuhai updated SPARK-22491:
--
Description:
test sql
{code}
create table temp.test_yuhai_group
as
select
city_name
cen yuhai created SPARK-22491:
-
Summary: union all can't execute parallel with group by
Key: SPARK-22491
URL: https://issues.apache.org/jira/browse/SPARK-22491
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
cen yuhai updated SPARK-22491:
--
Description:
test sql
{code}
create table temp.test_yuhai_group
as
select
city_name
83 matches
Mail list logo
