[jira] [Assigned] (SPARK-20670) Simplify FPGrowth transform

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20670: Assignee: (was: Apache Spark) > Simplify FPGrowth transform >

[jira] [Assigned] (SPARK-20670) Simplify FPGrowth transform

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20670: Assignee: Apache Spark > Simplify FPGrowth transform > --- > >

[jira] [Commented] (SPARK-20670) Simplify FPGrowth transform

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002098#comment-16002098 ] Apache Spark commented on SPARK-20670: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Created] (SPARK-20671) Processing muitple kafka topics with single spark streaming context hangs on batchSubmitted.

2017-05-08 Thread amit kumar (JIRA)
amit kumar created SPARK-20671: -- Summary: Processing muitple kafka topics with single spark streaming context hangs on batchSubmitted. Key: SPARK-20671 URL: https://issues.apache.org/jira/browse/SPARK-20671

[jira] [Assigned] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20668: Assignee: Apache Spark > Modify ScalaUDF to handle nullability. >

[jira] [Assigned] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20668: Assignee: (was: Apache Spark) > Modify ScalaUDF to handle nullability. >

[jira] [Commented] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002090#comment-16002090 ] Apache Spark commented on SPARK-20668: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-20670) Simplify FPGrowth transform

2017-05-08 Thread yuhao yang (JIRA)
yuhao yang created SPARK-20670: -- Summary: Simplify FPGrowth transform Key: SPARK-20670 URL: https://issues.apache.org/jira/browse/SPARK-20670 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20669: Assignee: Apache Spark > LogisticRegression family should be case insensitive >

[jira] [Assigned] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20669: Assignee: (was: Apache Spark) > LogisticRegression family should be case insensitive

[jira] [Commented] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002086#comment-16002086 ] Apache Spark commented on SPARK-20669: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-08 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-20669: Summary: LogisticRegression family should be case insensitive Key: SPARK-20669 URL: https://issues.apache.org/jira/browse/SPARK-20669 Project: Spark Issue

[jira] [Commented] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002082#comment-16002082 ] Apache Spark commented on SPARK-20661: -- User 'felixcheung' has created a pull request for this

[jira] [Created] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-08 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-20668: - Summary: Modify ScalaUDF to handle nullability. Key: SPARK-20668 URL: https://issues.apache.org/jira/browse/SPARK-20668 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20667: Assignee: Apache Spark (was: Xiao Li) > Cleanup the cataloged metadata after completing

[jira] [Assigned] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20667: Assignee: Xiao Li (was: Apache Spark) > Cleanup the cataloged metadata after completing

[jira] [Commented] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002035#comment-16002035 ] Apache Spark commented on SPARK-20667: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20667: Description: So far, we do not drop all the cataloged tables after each package. Sometimes, we might hit

[jira] [Updated] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20667: Description: So far, we do not drop all the cataloged tables after each package. Sometimes, we might hit

[jira] [Created] (SPARK-20667) Cleanup the cataloged metadata after completing the package of sql/core and sql/hive

2017-05-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20667: --- Summary: Cleanup the cataloged metadata after completing the package of sql/core and sql/hive Key: SPARK-20667 URL: https://issues.apache.org/jira/browse/SPARK-20667 Project:

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Summary: Flaky test - SparkListenerBus randomly failing on Windows (was: Flaky test - random ml

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Summary: Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only, always only when running

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Component/s: Spark Core > Flaky test - SparkListenerBus randomly failing on Windows >

[jira] [Updated] (SPARK-20666) Flaky test - random ml test failure on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only {code} Exception in

[jira] [Created] (SPARK-20666) Flaky test - random ml test failure on Windows

2017-05-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20666: Summary: Flaky test - random ml test failure on Windows Key: SPARK-20666 URL: https://issues.apache.org/jira/browse/SPARK-20666 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20666) Flaky test - random ml test failure on Windows

2017-05-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only {code}

[jira] [Commented] (SPARK-19581) running NaiveBayes model with 0 features can crash the executor with D rorreGEMV

2017-05-08 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-19581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001987#comment-16001987 ] Yan Facai (颜发才) commented on SPARK-19581: - [~barrybecker4] Could you give a sample code? >

[jira] [Assigned] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7856: --- Assignee: Apache Spark > Scalable PCA implementation for tall and fat matrices >

[jira] [Assigned] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7856: --- Assignee: (was: Apache Spark) > Scalable PCA implementation for tall and fat matrices >

[jira] [Commented] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001976#comment-16001976 ] Apache Spark commented on SPARK-7856: - User 'ghoto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20665: Assignee: (was: Apache Spark) > Spark-sql, "Bround" function return NULL >

[jira] [Assigned] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20665: Assignee: Apache Spark > Spark-sql, "Bround" function return NULL >

[jira] [Commented] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001970#comment-16001970 ] Apache Spark commented on SPARK-20665: -- User '10110346' has created a pull request for this issue:

[jira] [Commented] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001966#comment-16001966 ] Apache Spark commented on SPARK-20661: -- User 'felixcheung' has created a pull request for this

[jira] [Updated] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20665: Description: >select bround(12.3, 2); >NULL For this case, the expected result is 12.3, but it is null

[jira] [Updated] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20665: Description: >select bround(12.3, 2); >NULL For this case, we expected the result is 12.3, but it is null

[jira] [Created] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-08 Thread liuxian (JIRA)
liuxian created SPARK-20665: --- Summary: Spark-sql, "Bround" function return NULL Key: SPARK-20665 URL: https://issues.apache.org/jira/browse/SPARK-20665 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

2017-05-08 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001924#comment-16001924 ] sandflee commented on SPARK-18278: -- for a spark user, what benefits could we get? beside could co-run

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001917#comment-16001917 ] Saisai Shao commented on SPARK-20658: - It is mainly depends on YARN to measure the failure validity

[jira] [Comment Edited] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001551#comment-16001551 ] Ignacio Bermudez Corrales edited comment on SPARK-7856 at 5/9/17 1:59 AM:

[jira] [Comment Edited] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001551#comment-16001551 ] Ignacio Bermudez Corrales edited comment on SPARK-7856 at 5/9/17 2:00 AM:

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Created] (SPARK-20664) Remove stale applications from SHS listing

2017-05-08 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-20664: -- Summary: Remove stale applications from SHS listing Key: SPARK-20664 URL: https://issues.apache.org/jira/browse/SPARK-20664 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Priority: Major (was: Minor) > Data missing after insert overwrite table partition which is created on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Affects Version/s: (was: 2.1.1) > Data missing after insert overwrite table partition which is

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Labels: easyfix (was: ) > Data missing after insert overwrite table partition which is created on >

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Description: Use spark sql to create partition table first, and alter table by adding partition on

[jira] [Updated] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kobefeng updated SPARK-20663: - Docs Text: (was: -- create partition table first $ hadoop fs -mkdir /user/kofeng/partitioned_table $

[jira] [Created] (SPARK-20663) Data missing after insert overwrite table partition which is created on specific location

2017-05-08 Thread kobefeng (JIRA)
kobefeng created SPARK-20663: Summary: Data missing after insert overwrite table partition which is created on specific location Key: SPARK-20663 URL: https://issues.apache.org/jira/browse/SPARK-20663

[jira] [Assigned] (SPARK-20638) Optimize the CartesianRDD to reduce repeatedly data fetching

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20638: Assignee: (was: Apache Spark) > Optimize the CartesianRDD to reduce repeatedly data

[jira] [Assigned] (SPARK-20638) Optimize the CartesianRDD to reduce repeatedly data fetching

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20638: Assignee: Apache Spark > Optimize the CartesianRDD to reduce repeatedly data fetching >

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001811#comment-16001811 ] Marcelo Vanzin commented on SPARK-20658: Ok, so it's not an issue with old YARN jars being used.

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Paul Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001803#comment-16001803 ] Paul Jones commented on SPARK-20658: The jars are versioned 2.7.3. Finally finished grepping through

[jira] [Commented] (SPARK-20608) Standby namenodes should be allowed to included in yarn.spark.access.namenodes to support HDFS HA

2017-05-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001778#comment-16001778 ] Mingliang Liu commented on SPARK-20608: --- Quick question [~charliechen] : I think [~vanzin] is

[jira] [Reopened] (SPARK-1449) Please delete old releases from mirroring system

2017-05-08 Thread Sebb (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebb reopened SPARK-1449: - The mirror system includes the following: spark-1.6.2 spark-1.6.3 spark-2.0.1 spark-2.0.2 spark-2.1.0 spark-2.1.1

[jira] [Comment Edited] (SPARK-20600) KafkaRelation should be pretty printed in web UI (Details for Query)

2017-05-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001680#comment-16001680 ] Shixiong Zhu edited comment on SPARK-20600 at 5/8/17 10:38 PM: ---

[jira] [Commented] (SPARK-20600) KafkaRelation should be pretty printed in web UI (Details for Query)

2017-05-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001680#comment-16001680 ] Shixiong Zhu commented on SPARK-20600: -- [~jlaskowski] Hope you want do it soon. Then we can put it

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001638#comment-16001638 ] Marcelo Vanzin commented on SPARK-20658: That's different... what version of Hadoop libraries is

[jira] [Comment Edited] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001638#comment-16001638 ] Marcelo Vanzin edited comment on SPARK-20658 at 5/8/17 10:02 PM: - That's

[jira] [Commented] (SPARK-19268) File does not exist: /tmp/temporary-157b89c1-27bb-49f3-a70c-ca1b75022b4d/state/0/2/1.delta

2017-05-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001631#comment-16001631 ] Shixiong Zhu commented on SPARK-19268: -- [~skrishna] could you provide your codes, or the output of

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Paul Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001628#comment-16001628 ] Paul Jones commented on SPARK-20658: Ah... This is using Amazons version of Hadoop 2.7.3 {noformat}

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001623#comment-16001623 ] Marcelo Vanzin commented on SPARK-20658: That does not say which package you used (i.e. which

[jira] [Assigned] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20661: Assignee: Hossein Falaki > SparkR tableNames() test fails > -- > >

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Paul Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001612#comment-16001612 ] Paul Jones commented on SPARK-20658: {noformat} $ spark-submit --version version 2.1.0 Using Scala

[jira] [Resolved] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20661. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17903

[jira] [Assigned] (SPARK-20630) Thread Dump link available in Executors tab irrespective of spark.ui.threadDumpsEnabled

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20630: Assignee: (was: Apache Spark) > Thread Dump link available in Executors tab

[jira] [Assigned] (SPARK-20630) Thread Dump link available in Executors tab irrespective of spark.ui.threadDumpsEnabled

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20630: Assignee: Apache Spark > Thread Dump link available in Executors tab irrespective of >

[jira] [Commented] (SPARK-20630) Thread Dump link available in Executors tab irrespective of spark.ui.threadDumpsEnabled

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001609#comment-16001609 ] Apache Spark commented on SPARK-20630: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Commented] (SPARK-20580) Allow RDD cache with unserializable objects

2017-05-08 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001607#comment-16001607 ] Fernando Pereira commented on SPARK-20580: -- I understand that at some point it will be better to

[jira] [Resolved] (SPARK-20605) Deprecate not used AM and executor port configuration

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20605. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.3.0 > Deprecate

[jira] [Created] (SPARK-20662) Block jobs that have greater than a configured number of tasks

2017-05-08 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created SPARK-20662: --- Summary: Block jobs that have greater than a configured number of tasks Key: SPARK-20662 URL: https://issues.apache.org/jira/browse/SPARK-20662 Project: Spark

[jira] [Commented] (SPARK-20500) ML, Graph 2.2 QA: API: Binary incompatible changes

2017-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001564#comment-16001564 ] Joseph K. Bradley commented on SPARK-20500: --- I'll take this one. > ML, Graph 2.2 QA: API:

[jira] [Assigned] (SPARK-20500) ML, Graph 2.2 QA: API: Binary incompatible changes

2017-05-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-20500: - Assignee: Joseph K. Bradley > ML, Graph 2.2 QA: API: Binary incompatible

[jira] [Comment Edited] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001551#comment-16001551 ] Ignacio Bermudez Corrales edited comment on SPARK-7856 at 5/8/17 9:13 PM:

[jira] [Commented] (SPARK-7856) Scalable PCA implementation for tall and fat matrices

2017-05-08 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001551#comment-16001551 ] Ignacio Bermudez Corrales commented on SPARK-7856: -- Apart from implementing Probabilistic

[jira] [Assigned] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20661: Assignee: Apache Spark > SparkR tableNames() test fails > --

[jira] [Assigned] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20661: Assignee: (was: Apache Spark) > SparkR tableNames() test fails >

[jira] [Commented] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001521#comment-16001521 ] Apache Spark commented on SPARK-20661: -- User 'falaki' has created a pull request for this issue:

[jira] [Created] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-20661: -- Summary: SparkR tableNames() test fails Key: SPARK-20661 URL: https://issues.apache.org/jira/browse/SPARK-20661 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

2017-05-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001474#comment-16001474 ] Shixiong Zhu commented on SPARK-18057: -- [~helena_e] I didn't mean for Spark. Even in Spark, the

[jira] [Updated] (SPARK-20660) Not able to merge Dataframes with different column orders

2017-05-08 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michel Lemay updated SPARK-20660: - Description: Union on two dataframes with different column orders is not supported and lead to

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

2017-05-08 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000130#comment-16000130 ] Helena Edelson edited comment on SPARK-18057 at 5/8/17 8:23 PM: It's not

[jira] [Updated] (SPARK-20660) Not able to merge Dataframes with different column orders

2017-05-08 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michel Lemay updated SPARK-20660: - Description: Union on two dataframes with different column orders is not supported and lead to

[jira] [Updated] (SPARK-20660) Not able to merge Dataframes with different column orders

2017-05-08 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michel Lemay updated SPARK-20660: - Description: Union on two dataframes with different column orders is not supported and lead to

[jira] [Created] (SPARK-20660) Not able to merge Dataframes with different column orders

2017-05-08 Thread Michel Lemay (JIRA)
Michel Lemay created SPARK-20660: Summary: Not able to merge Dataframes with different column orders Key: SPARK-20660 URL: https://issues.apache.org/jira/browse/SPARK-20660 Project: Spark

[jira] [Created] (SPARK-20659) Remove StorageStatus, or make it private.

2017-05-08 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-20659: -- Summary: Remove StorageStatus, or make it private. Key: SPARK-20659 URL: https://issues.apache.org/jira/browse/SPARK-20659 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001440#comment-16001440 ] Marcelo Vanzin commented on SPARK-20658: The exact build of Spark you're using would help. You

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Paul Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001439#comment-16001439 ] Paul Jones commented on SPARK-20658: I know this likely isn't enough information to debug this issue.

[jira] [Created] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

2017-05-08 Thread Paul Jones (JIRA)
Paul Jones created SPARK-20658: -- Summary: spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect Key: SPARK-20658 URL: https://issues.apache.org/jira/browse/SPARK-20658 Project:

[jira] [Commented] (SPARK-20641) Key-value store abstraction and implementation for storing application data

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001432#comment-16001432 ] Apache Spark commented on SPARK-20641: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20641) Key-value store abstraction and implementation for storing application data

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20641: Assignee: (was: Apache Spark) > Key-value store abstraction and implementation for

[jira] [Assigned] (SPARK-20641) Key-value store abstraction and implementation for storing application data

2017-05-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20641: Assignee: Apache Spark > Key-value store abstraction and implementation for storing

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-08 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001429#comment-16001429 ] Ryan Blue commented on SPARK-12297: --- The Impala team has been working with the Parquet community

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001426#comment-16001426 ] Shixiong Zhu commented on SPARK-13747: -- [~revolucion09] The default dispatcher uses ForkJoinPool.

  1   2   3   >