[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376449#comment-15376449 ] Saisai Shao commented on SPARK-16534: - Maybe I can take a try if no one is working on

[jira] [Updated] (SPARK-16343) Improve the PushDownPredicate rule to pushdown predicates currectly in non-deterministic condition

[ https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16343: --- Affects Version/s: 2.0.0 > Improve the PushDownPredicate rule to pushdown predicates currectly in >

[jira] [Updated] (SPARK-16343) Improve the PushDownPredicate rule to pushdown predicates currectly in non-deterministic condition

[ https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16343: --- Assignee: Jiang Xingbo > Improve the PushDownPredicate rule to pushdown predicates currectly in > no

[jira] [Created] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

Saisai Shao created SPARK-16540: --- Summary: Jars specified with --jars will added twice when running on YARN Key: SPARK-16540 URL: https://issues.apache.org/jira/browse/SPARK-16540 Project: Spark

[jira] [Updated] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-16540: Description: Currently when running spark on yarn, jars specified with \--jars, \--packages will b

[jira] [Commented] (SPARK-10404) Worker should terminate previous executor before launch new one

[ https://issues.apache.org/jira/browse/SPARK-10404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376498#comment-15376498 ] mingleizhang commented on SPARK-10404: -- Could you please post that some of the code

[jira] [Commented] (SPARK-16417) spark 1.5.2 receiver store(single-record) with ahead log enabled makes executor crash if there is an exception when BlockGenerator storing block

[ https://issues.apache.org/jira/browse/SPARK-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376504#comment-15376504 ] BinXu commented on SPARK-16417: --- I may face the same problem. Do you override a generate bl

[jira] [Commented] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376514#comment-15376514 ] Sean Owen commented on SPARK-14808: --- [~josephkb] I'd like to discuss this on dev@. I do

[jira] [Commented] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376519#comment-15376519 ] Apache Spark commented on SPARK-16540: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16540: Assignee: Apache Spark > Jars specified with --jars will added twice when running on YARN

[jira] [Assigned] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16540: Assignee: (was: Apache Spark) > Jars specified with --jars will added twice when runni

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376522#comment-15376522 ] Sean Owen commented on SPARK-16365: --- This might be better on user@ or dev@. I don't kno

[jira] [Created] (SPARK-16541) SparkTC application could not shutdown successfully

Yesha Vora created SPARK-16541: -- Summary: SparkTC application could not shutdown successfully Key: SPARK-16541 URL: https://issues.apache.org/jira/browse/SPARK-16541 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16541) SparkTC application could not shutdown successfully

[ https://issues.apache.org/jira/browse/SPARK-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376537#comment-15376537 ] Sean Owen commented on SPARK-16541: --- This really could be anything. Do you have more in

[jira] [Updated] (SPARK-16500) Add LBFG training not convergence warning for all ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16500: -- Assignee: Weichen Xu Priority: Trivial (was: Major) > Add LBFG training not convergence warning fo

[jira] [Resolved] (SPARK-16500) Add LBFG training not convergence warning for all ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16500. --- Resolution: Fixed Fix Version/s: 2.0.1 Issue resolved by pull request 14157 [https://github.co

[jira] [Resolved] (SPARK-16403) Example cleanup and fix minor issues

[ https://issues.apache.org/jira/browse/SPARK-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16403. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14081 [https://github.co

[jira] [Commented] (SPARK-14702) Expose SparkLauncher's ProcessBuilder for user flexibility

[ https://issues.apache.org/jira/browse/SPARK-14702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376544#comment-15376544 ] Apache Spark commented on SPARK-14702: -- User 'andreweduffy' has created a pull reque

[jira] [Updated] (SPARK-16403) Example cleanup and fix minor issues

[ https://issues.apache.org/jira/browse/SPARK-16403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16403: -- Assignee: Bryan Cutler Priority: Minor (was: Trivial) > Example cleanup and fix minor issues > ---

[jira] [Updated] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16534: -- Fix Version/s: (was: 2.0.0) > Kafka 0.10 Python support > - > >

[jira] [Updated] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16531: -- Assignee: Burak Yavuz > Remove TimeZone from DataFrameTimeWindowingSuite >

[jira] [Updated] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16532: -- External issue URL: (was: https://issues.apache.org/jira/browse/SPARK-5388) Target Version/s:

[jira] [Updated] (SPARK-16541) SparkTC application could not shutdown successfully

[ https://issues.apache.org/jira/browse/SPARK-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-16541: --- Description: SparkTC application in yarn-client mode was stuck at 10% progress. {code} spark-submit

[jira] [Commented] (SPARK-16541) SparkTC application could not shutdown successfully

[ https://issues.apache.org/jira/browse/SPARK-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376551#comment-15376551 ] Yesha Vora commented on SPARK-16541: [~sowen], Stack Trace updated. > SparkTC appl

[jira] [Commented] (SPARK-16541) SparkTC application could not shutdown successfully

[ https://issues.apache.org/jira/browse/SPARK-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376552#comment-15376552 ] Sean Owen commented on SPARK-16541: --- This doesn't help, just shows things have shut dow

[jira] [Commented] (SPARK-14963) YarnShuffleService should use YARN getRecoveryPath() for leveldb location

[ https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376564#comment-15376564 ] Apache Spark commented on SPARK-14963: -- User 'jerryshao' has created a pull request

[jira] [Created] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

Xiang Gao created SPARK-16542: - Summary: bugs about types that result an array of null when creating dataframe using python Key: SPARK-16542 URL: https://issues.apache.org/jira/browse/SPARK-16542 Project:

[jira] [Assigned] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16542: Assignee: Apache Spark > bugs about types that result an array of null when creating dataf

[jira] [Assigned] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16542: Assignee: (was: Apache Spark) > bugs about types that result an array of null when cre

[jira] [Commented] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376614#comment-15376614 ] Apache Spark commented on SPARK-16542: -- User 'zasdfgbnm' has created a pull request

[jira] [Resolved] (SPARK-16448) RemoveAliasOnlyProject should not remove alias with metadata

[ https://issues.apache.org/jira/browse/SPARK-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16448. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14106 [https://github.

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Created] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

Dongjoon Hyun created SPARK-16543: - Summary: Rename the columns of `SHOW PARTITION/COLUMNS` commands Key: SPARK-16543 URL: https://issues.apache.org/jira/browse/SPARK-16543 Project: Spark Iss

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Assigned] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

[ https://issues.apache.org/jira/browse/SPARK-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16543: Assignee: Apache Spark > Rename the columns of `SHOW PARTITION/COLUMNS` commands > ---

[jira] [Commented] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

[ https://issues.apache.org/jira/browse/SPARK-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376685#comment-15376685 ] Apache Spark commented on SPARK-16543: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

[ https://issues.apache.org/jira/browse/SPARK-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16543: Assignee: (was: Apache Spark) > Rename the columns of `SHOW PARTITION/COLUMNS` command

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using pyt

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using pyt

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376716#comment-15376716 ] Apache Spark commented on SPARK-16528: -- User 'jacek-lewandowski' has created a pull

[jira] [Assigned] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16528: Assignee: (was: Apache Spark) > HiveClientImpl throws NPE when reading database from a

[jira] [Assigned] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16528: Assignee: Apache Spark > HiveClientImpl throws NPE when reading database from a custom met

[jira] [Commented] (SPARK-16544) Support for conversion from compatible schema for Parquet data source when data types are not matched

[ https://issues.apache.org/jira/browse/SPARK-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376717#comment-15376717 ] Hyukjin Kwon commented on SPARK-16544: -- I am working on this. > Support for convers

[jira] [Created] (SPARK-16544) Support for conversion from compatible schema for Parquet data source when data types are not matched

Hyukjin Kwon created SPARK-16544: Summary: Support for conversion from compatible schema for Parquet data source when data types are not matched Key: SPARK-16544 URL: https://issues.apache.org/jira/browse/SPARK-16

[jira] [Created] (SPARK-16545) Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval

Mario Briggs created SPARK-16545: Summary: Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval Key: SPARK-16545 URL: https://issues.apache.org/jira/browse/SPARK-16545

[jira] [Commented] (SPARK-16545) Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval

[ https://issues.apache.org/jira/browse/SPARK-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376758#comment-15376758 ] Mario Briggs commented on SPARK-16545: -- While looking at the performance of Structur

[jira] [Comment Edited] (SPARK-16545) Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval

[ https://issues.apache.org/jira/browse/SPARK-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376758#comment-15376758 ] Mario Briggs edited comment on SPARK-16545 at 7/14/16 10:53 AM: ---

[jira] [Comment Edited] (SPARK-16545) Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval

[ https://issues.apache.org/jira/browse/SPARK-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376758#comment-15376758 ] Mario Briggs edited comment on SPARK-16545 at 7/14/16 11:01 AM: ---

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376867#comment-15376867 ] Yanbo Liang commented on SPARK-10078: - Had offline discussion with [~mengxr] and [~jo

[jira] [Commented] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376880#comment-15376880 ] Joao Vasques commented on SPARK-16532: -- Thanks for your feedback Sean. [~andrewor14

[jira] [Commented] (SPARK-14702) Expose SparkLauncher's ProcessBuilder for user flexibility

[ https://issues.apache.org/jira/browse/SPARK-14702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376890#comment-15376890 ] Apache Spark commented on SPARK-14702: -- User 'andreweduffy' has created a pull reque

[jira] [Commented] (SPARK-14963) YarnShuffleService should use YARN getRecoveryPath() for leveldb location

[ https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376913#comment-15376913 ] Thomas Graves commented on SPARK-14963: --- committed fix in https://github.com/apache

[jira] [Commented] (SPARK-15687) Columnar execution engine

[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376999#comment-15376999 ] Kazuaki Ishizaki commented on SPARK-15687: -- It would be good to introduce trait

[jira] [Comment Edited] (SPARK-15687) Columnar execution engine

[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376999#comment-15376999 ] Kazuaki Ishizaki edited comment on SPARK-15687 at 7/14/16 2:25 PM:

[jira] [Commented] (SPARK-13645) DAG Diagram not shown properly in Chrome

[ https://issues.apache.org/jira/browse/SPARK-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377022#comment-15377022 ] Maciej Bryński commented on SPARK-13645: I think that problem is resolved in 2.0.

[jira] [Updated] (SPARK-16505) YARN shuffle service should throw errors when it fails to start

[ https://issues.apache.org/jira/browse/SPARK-16505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-16505: -- Assignee: Marcelo Vanzin > YARN shuffle service should throw errors when it fails to start > --

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377055#comment-15377055 ] Tejas Patil commented on SPARK-16230: - With the fix from SPARK-13112, I see that `Lau

[jira] [Resolved] (SPARK-16505) YARN shuffle service should throw errors when it fails to start

[ https://issues.apache.org/jira/browse/SPARK-16505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-16505. --- Resolution: Fixed Fix Version/s: 2.1.0 > YARN shuffle service should throw errors when

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377065#comment-15377065 ] Apache Spark commented on SPARK-16230: -- User 'tejasapatil' has created a pull reques

[jira] [Resolved] (SPARK-16530) Wrong Keyword in ALTER TABLE CHANGE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16530. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Wrong Keyw

[jira] [Resolved] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

[ https://issues.apache.org/jira/browse/SPARK-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16543. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Rena

[jira] [Created] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

Weichen Xu created SPARK-16546: -- Summary: Dataframe.drop supported multi-columns in spark api and should make python api also support it. Key: SPARK-16546 URL: https://issues.apache.org/jira/browse/SPARK-16546

[jira] [Assigned] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16546: Assignee: (was: Apache Spark) > Dataframe.drop supported multi-columns in spark api an

[jira] [Created] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

Tejas Patil created SPARK-16547: --- Summary: EventLoggingListener to auto create log base dir if it does not exist Key: SPARK-16547 URL: https://issues.apache.org/jira/browse/SPARK-16547 Project: Spark

[jira] [Assigned] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16546: Assignee: Apache Spark > Dataframe.drop supported multi-columns in spark api and should ma

[jira] [Commented] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377144#comment-15377144 ] Apache Spark commented on SPARK-16546: -- User 'WeichenXu123' has created a pull reque

[jira] [Updated] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16546: --- Component/s: SQL PySpark > Dataframe.drop supported multi-columns in spark api and s

[jira] [Updated] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-16547: Description: When the HDFS namenode gets changed or replaced, one has to manually create the `spar

[jira] [Assigned] (SPARK-16520) Link executors to corresponding worker pages

[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16520: Assignee: (was: Apache Spark) > Link executors to corresponding worker pages > ---

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377167#comment-15377167 ] Apache Spark commented on SPARK-16520: -- User 'nblintao' has created a pull request f

[jira] [Assigned] (SPARK-16520) Link executors to corresponding worker pages

[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16520: Assignee: Apache Spark > Link executors to corresponding worker pages > --

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377197#comment-15377197 ] Tao Lin commented on SPARK-16520: - ## What changes were proposed in this pull request? A

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377198#comment-15377198 ] Tao Lin commented on SPARK-16520: - It looks like this if we use the worker URL as the pla

[jira] [Assigned] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16547: Assignee: Apache Spark > EventLoggingListener to auto create log base dir if it does not e

[jira] [Commented] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377219#comment-15377219 ] Apache Spark commented on SPARK-16547: -- User 'tejasapatil' has created a pull reques

[jira] [Assigned] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16547: Assignee: (was: Apache Spark) > EventLoggingListener to auto create log base dir if it

[jira] [Updated] (SPARK-16509) Rename window.partitionBy and window.orderBy

[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16509: -- Assignee: Sun Rui > Rename window.partitionBy and window.orderBy >

[jira] [Updated] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Vasques updated SPARK-16532: - Description: When I was looking at the Spark Master dashboard I noticed the existence of a REST

[jira] [Resolved] (SPARK-16509) Rename window.partitionBy and window.orderBy

[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16509. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Resolved] (SPARK-16538) Cannot use "SparkR::sql"

[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16538. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16440: Fix Version/s: (was: 2.0.1) 2.0.0 > Undeleted broadcast variables in Word2Ve

[jira] [Updated] (SPARK-16281) Implement parse_url SQL function

[ https://issues.apache.org/jira/browse/SPARK-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16281: Fix Version/s: (was: 2.0.1) 2.0.0 > Implement parse_url SQL function > -

[jira] [Updated] (SPARK-16350) Complete output mode does not output updated aggregated value in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16350: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Comp

[jira] [Updated] (SPARK-13638) Support for saving with a quote mode

[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13638: Fix Version/s: (was: 2.0.1) 2.0.0 > Support for saving with a quote mode > -

[jira] [Updated] (SPARK-16500) Add LBFG training not convergence warning for all ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16500: Fix Version/s: (was: 2.0.1) 2.0.0 > Add LBFG training not convergence warnin

[jira] [Updated] (SPARK-16435) Behavior changes if initialExecutor is less than minExecutor for dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16435: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Beha

[jira] [Updated] (SPARK-16276) Implement elt SQL function

[ https://issues.apache.org/jira/browse/SPARK-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16276: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16279) Implement map_values SQL function

[ https://issues.apache.org/jira/browse/SPARK-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16279: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16271) Implement Hive's UDFXPathUtil

[ https://issues.apache.org/jira/browse/SPARK-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16271: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16369) tallSkinnyQR of RowMatrix should aware of empty partition

[ https://issues.apache.org/jira/browse/SPARK-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16369: Fix Version/s: (was: 2.0.1) 2.0.0 > tallSkinnyQR of RowMatrix should aware o

  1   2   3   >