[
https://issues.apache.org/jira/browse/SPARK-19473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wayne Zhang updated SPARK-19473:
Summary: Several DataFrame Methods still fail with dot in column names
(was: Several DataFrame Me
Wayne Zhang created SPARK-19473:
---
Summary: Several DataFrame Method still fail with dot in column
names
Key: SPARK-19473
URL: https://issues.apache.org/jira/browse/SPARK-19473
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853629#comment-15853629
]
Aseem Bansal commented on SPARK-19449:
--
[~sowen] My results are actually determinist
[
https://issues.apache.org/jira/browse/SPARK-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853630#comment-15853630
]
DjvuLee commented on SPARK-17300:
-
[~rdblue] Is there any fix for this issue later?
> Cl
[
https://issues.apache.org/jira/browse/SPARK-19279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19279.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 16636
[https://githu
StanZhai created SPARK-19472:
Summary: [SQL]SQLParser fails to resolve nested CASE WHEN
statement with parentheses
Key: SPARK-19472
URL: https://issues.apache.org/jira/browse/SPARK-19472
Project: Spark
StanZhai created SPARK-19471:
Summary: [SQL]A confusing NullPointerException when creating table
Key: SPARK-19471
URL: https://issues.apache.org/jira/browse/SPARK-19471
Project: Spark
Issue Type:
Mingda Li created SPARK-19470:
-
Summary: Spark 1.6.4 in Intellij can't use jetty 8
Key: SPARK-19470
URL: https://issues.apache.org/jira/browse/SPARK-19470
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853474#comment-15853474
]
cen yuhai commented on SPARK-16441:
---
I don't know, I will use spark 2.1, this may not b
[
https://issues.apache.org/jira/browse/SPARK-19430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853466#comment-15853466
]
Song Jun commented on SPARK-19430:
--
I think this is not a bug. If you want to access the
[
https://issues.apache.org/jira/browse/SPARK-19447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853462#comment-15853462
]
Song Jun commented on SPARK-19447:
--
spark.range(1,100).show
there is some information i
[
https://issues.apache.org/jira/browse/SPARK-19421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk resolved SPARK-19421.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Thanks for fixing this, merged in 317fa750 :)
> Remove num
[
https://issues.apache.org/jira/browse/SPARK-19421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
holdenk reassigned SPARK-19421:
---
Assignee: zhengruifeng
> Remove numClasses and numFeatures methods in LinearSVC
> --
[
https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853434#comment-15853434
]
Genmao Yu commented on SPARK-19451:
---
Good catch! I will dig deeply into code and fix it
haiyangsea created SPARK-19469:
--
Summary: PySpark should allow driver process on different machine
Key: SPARK-19469
URL: https://issues.apache.org/jira/browse/SPARK-19469
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853431#comment-15853431
]
Apache Spark commented on SPARK-19407:
--
User 'uncleGen' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19407:
Assignee: Apache Spark
> defaultFS is used FileSystem.get instead of getting it from uri s
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19407:
Assignee: (was: Apache Spark)
> defaultFS is used FileSystem.get instead of getting it
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853426#comment-15853426
]
Genmao Yu commented on SPARK-19407:
---
[~aassudani] Are you still working on this? As thi
koert kuipers created SPARK-19468:
-
Summary: Dataset slow because of unnecessary shuffles
Key: SPARK-19468
URL: https://issues.apache.org/jira/browse/SPARK-19468
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley resolved SPARK-19247.
---
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 16607
[h
[
https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley reassigned SPARK-19247:
-
Assignee: Asher Krim
> Improve ml word2vec save/load scalability
> -
[
https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853413#comment-15853413
]
Apache Spark commented on SPARK-19467:
--
User 'zero323' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19467:
Assignee: (was: Apache Spark)
> PySpark ML shouldn't use circular imports
> --
[
https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19467:
Assignee: Apache Spark
> PySpark ML shouldn't use circular imports
> -
Maciej Szymkiewicz created SPARK-19467:
--
Summary: PySpark ML shouldn't use circular imports
Key: SPARK-19467
URL: https://issues.apache.org/jira/browse/SPARK-19467
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853408#comment-15853408
]
Ian commented on SPARK-19462:
-
Note that when spark.sql.adaptive.enabled is set "false" , th
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19466:
Assignee: Apache Spark
> Improve Fair Scheduler Logging
> --
>
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19466:
Assignee: (was: Apache Spark)
> Improve Fair Scheduler Logging
> -
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853377#comment-15853377
]
Apache Spark commented on SPARK-19466:
--
User 'erenavsarogullari' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19466:
--
Affects Version/s: (was: 2.2.0)
2.1.0
Priority: Minor (was: Maj
[
https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-19466:
---
Description:
Fair Scheduler Logging for the following cases can be useful for the use
Eren Avsarogullari created SPARK-19466:
--
Summary: Improve Fair Scheduler Logging
Key: SPARK-19466
URL: https://issues.apache.org/jira/browse/SPARK-19466
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853349#comment-15853349
]
Apache Spark commented on SPARK-19465:
--
User 'dhunziker' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19465:
Assignee: (was: Apache Spark)
> Support custom Boolean values in CSV
> ---
[
https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19465:
Assignee: Apache Spark
> Support custom Boolean values in CSV
> --
[
https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853344#comment-15853344
]
Apache Spark commented on SPARK-17629:
--
User 'Krimit' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17629:
Assignee: Apache Spark
> Should ml Word2Vec findSynonyms match the mllib implementation?
>
[
https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17629:
Assignee: (was: Apache Spark)
> Should ml Word2Vec findSynonyms match the mllib implem
[
https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asher Krim reopened SPARK-17629:
[~josephkb] gave his blessing for adding local versions of the synonyms methods
in the dev mailing lis
[
https://issues.apache.org/jira/browse/SPARK-19452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-19452.
--
Resolution: Fixed
Assignee: Wayne Zhang
Fix Version/s: 2.2.0
Target
[
https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853301#comment-15853301
]
Asher Krim commented on SPARK-10413:
I know I'm a little late to this discussion, but
[
https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853300#comment-15853300
]
Dominic Ricard commented on SPARK-16441:
Could this be fixed by either SPARK-1653
[
https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853293#comment-15853293
]
Dennis Hunziker commented on SPARK-19465:
-
I'll be raising a pull request for thi
[
https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Koert Kuipers updated SPARK-19428:
--
if I remember correctly window function is like a canned secondary sort
with limited functionality,
Dennis Hunziker created SPARK-19465:
---
Summary: Support custom Boolean values in CSV
Key: SPARK-19465
URL: https://issues.apache.org/jira/browse/SPARK-19465
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853272#comment-15853272
]
Herman van Hovell commented on SPARK-19428:
---
You could also use a window functi
[
https://issues.apache.org/jira/browse/SPARK-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853226#comment-15853226
]
Sungju Jin commented on SPARK-19457:
nvmd, now I understand why you were saying a dup
[
https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853214#comment-15853214
]
Sean Owen commented on SPARK-19428:
---
Yeah, I think it would require a custom aggregator
[
https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19464:
Assignee: Sean Owen (was: Apache Spark)
> Remove support for Hadoop 2.5 and earlier
> ---
[
https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19464:
Assignee: Apache Spark (was: Sean Owen)
> Remove support for Hadoop 2.5 and earlier
> ---
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853213#comment-15853213
]
Sean Owen commented on SPARK-19407:
---
[~aassudani] are you making a pull request?
> def
[
https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853212#comment-15853212
]
Apache Spark commented on SPARK-19464:
--
User 'srowen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19464:
--
Summary: Remove support for Hadoop 2.5 and earlier (was: Remove supports
for Hadoop 2.5 and earlier)
Sean Owen created SPARK-19464:
-
Summary: Remove supports for Hadoop 2.5 and earlier
Key: SPARK-19464
URL: https://issues.apache.org/jira/browse/SPARK-19464
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19461:
--
Priority: Trivial (was: Major)
Issue Type: Improvement (was: Bug)
[~jinxing6...@126.com] this w
[
https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-19461.
---
Resolution: Won't Fix
> Remove some unused imports.
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-19398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19398:
--
Affects Version/s: 2.1.0
Priority: Trivial (was: Minor)
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19463:
Assignee: Apache Spark
> refresh the table cache after InsertIntoHadoopFsRelation
> --
[
https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19463:
Assignee: (was: Apache Spark)
> refresh the table cache after InsertIntoHadoopFsRelati
[
https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853203#comment-15853203
]
Apache Spark commented on SPARK-19463:
--
User 'windpiger' has created a pull request
Song Jun created SPARK-19463:
Summary: refresh the table cache after InsertIntoHadoopFsRelation
Key: SPARK-19463
URL: https://issues.apache.org/jira/browse/SPARK-19463
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Description:
property spark.sql.adaptive.enabled needs to be set "true" for the issue to be
reproduced.
reproduci
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853188#comment-15853188
]
Ian edited comment on SPARK-19462 at 2/5/17 10:33 AM:
--
In fact, the
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Summary: when spark.sql.adaptive.enabled is enabled, DF is not resilient to
node/container failure (was: when spar
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Summary: when spark.sql.adaptive.enabled is enabled, DF is not resilient to
node container failure (was: when spar
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853188#comment-15853188
]
Ian edited comment on SPARK-19462 at 2/5/17 10:28 AM:
--
In fact, the
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Description:
property spark.sql.adaptive.enabled needs to be set "true"
reproducible steps using spark-shell
0. we
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Comment: was deleted
(was: When the RDD lineage contains ShuffledRowRDD, the above mentioned
behavior can be obser
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Description:
property spark.sql.adaptive.enabled needs to be set "true"
reproducible steps using spark-shell
0. we
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Summary: when spark.sql.adaptive.enabled is enabled, RDD is not resilient
to node container failure (was: when spa
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853188#comment-15853188
]
Ian commented on SPARK-19462:
-
In fact, the "Exchange not implemented for UnknownPartitioning
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853184#comment-15853184
]
Ian edited comment on SPARK-19462 at 2/5/17 10:14 AM:
--
When the RDD
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853184#comment-15853184
]
Ian commented on SPARK-19462:
-
When the RDD lineage contains ShuffledRowRDD, the above mentio
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Description:
property spark.sql.adaptive.enabled needs to be set "true"
reproducible steps using spark-shell
0. we
[
https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ian updated SPARK-19462:
Description:
property spark.sql.adaptive.enabled needs to be set "true"
reproducible steps using spark-shell
0. we
Ian created SPARK-19462:
---
Summary: when spark.sql.adaptive.enabled is enabled RDD is not
resilient to node container failure
Key: SPARK-19462
URL: https://issues.apache.org/jira/browse/SPARK-19462
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19461:
Assignee: (was: Apache Spark)
> Remove some unused imports.
>
[
https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19461:
Assignee: Apache Spark
> Remove some unused imports.
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853182#comment-15853182
]
Apache Spark commented on SPARK-19461:
--
User 'jinxing64' has created a pull request
jin xing created SPARK-19461:
Summary: Remove some unused imports.
Key: SPARK-19461
URL: https://issues.apache.org/jira/browse/SPARK-19461
Project: Spark
Issue Type: Bug
Components: Spa
81 matches
Mail list logo
