[jira] [Commented] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

2015-05-11 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537674#comment-14537674 ] Bryan Cutler commented on SPARK-7522: - pinging [~josephkb] to verify > ML Examples op

[jira] [Commented] (SPARK-7273) The SQLContext.jsonFile() api has a problem when load a format json file?

2015-05-11 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537691#comment-14537691 ] Animesh Baranawal commented on SPARK-7273: -- I am getting no error on compiling yo

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

2015-05-11 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537702#comment-14537702 ] Nathan McCarthy commented on SPARK-5707: +1 seeing this as well. Is there a workar

[jira] [Commented] (SPARK-7513) Spark connecting cassandra throws NotSerialization error

2015-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537736#comment-14537736 ] Sean Owen commented on SPARK-7513: -- No, it clearly shows this is the problem: {{java.io.N

[jira] [Resolved] (SPARK-7513) Spark connecting cassandra throws NotSerialization error

2015-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7513. -- Resolution: Invalid Let's discuss further before you reopen this as I think you're not interpreting the

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-11 Thread Tomasz Bartczak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537762#comment-14537762 ] Tomasz Bartczak commented on SPARK-7483: hmm, class org.apache.spark.mllib.fpm.FPT

[jira] [Commented] (SPARK-6154) Support Kafka, JDBC in Scala 2.11

2015-05-11 Thread Aniket Bhatnagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537766#comment-14537766 ] Aniket Bhatnagar commented on SPARK-6154: - Yes. I haven't tested this approach wit

[jira] [Created] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-11 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7524: --- Summary: add configs for keytab and principal, move originals to internal Key: SPARK-7524 URL: https://issues.apache.org/jira/browse/SPARK-7524 Project: Spark Issue T

[jira] [Assigned] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7524: --- Assignee: (was: Apache Spark) > add configs for keytab and principal, move originals to i

[jira] [Commented] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537819#comment-14537819 ] Apache Spark commented on SPARK-7524: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Assigned] (SPARK-7524) add configs for keytab and principal, move originals to internal

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7524: --- Assignee: Apache Spark > add configs for keytab and principal, move originals to internal > -

[jira] [Created] (SPARK-7525) Could not read data from write ahead log record when Receiver failed and WAL is stored in Tachyon

2015-05-11 Thread Dibyendu Bhattacharya (JIRA)
Dibyendu Bhattacharya created SPARK-7525: Summary: Could not read data from write ahead log record when Receiver failed and WAL is stored in Tachyon Key: SPARK-7525 URL: https://issues.apache.org/jira/brow

[jira] [Commented] (SPARK-7525) Could not read data from write ahead log record when Receiver failed and WAL is stored in Tachyon

2015-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537824#comment-14537824 ] Sean Owen commented on SPARK-7525: -- Related to SPARK-7139? > Could not read data from wr

[jira] [Resolved] (SPARK-7326) Performing window() on a WindowedDStream doesn't work all the time

2015-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7326. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5871 [https://github.com/ap

[jira] [Updated] (SPARK-7326) Performing window() on a WindowedDStream doesn't work all the time

2015-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7326: - Assignee: Wesley Miao > Performing window() on a WindowedDStream doesn't work all the time > -

[jira] [Commented] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537839#comment-14537839 ] Apache Spark commented on SPARK-7110: - User 'srowen' has created a pull request for th

[jira] [Assigned] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7110: --- Assignee: Apache Spark > when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Tok

[jira] [Assigned] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7110: --- Assignee: (was: Apache Spark) > when use saveAsNewAPIHadoopFile, sometimes it throws "Del

[jira] [Created] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-11 Thread Weizhong (JIRA)
Weizhong created SPARK-7526: --- Summary: Specify ip of RBackend, MonitorServer and RRDD Socket server Key: SPARK-7526 URL: https://issues.apache.org/jira/browse/SPARK-7526 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7526: --- Assignee: (was: Apache Spark) > Specify ip of RBackend, MonitorServer and RRDD Socket ser

[jira] [Commented] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537913#comment-14537913 ] Apache Spark commented on SPARK-7526: - User 'Sephiroth-Lin' has created a pull request

[jira] [Assigned] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7526: --- Assignee: Apache Spark > Specify ip of RBackend, MonitorServer and RRDD Socket server > -

[jira] [Commented] (SPARK-7525) Could not read data from write ahead log record when Receiver failed and WAL is stored in Tachyon

2015-05-11 Thread Dibyendu Bhattacharya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537914#comment-14537914 ] Dibyendu Bhattacharya commented on SPARK-7525: -- This issue not happening whe

[jira] [Updated] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-7110: - Assignee: Sean Owen > when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can b

[jira] [Updated] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-7110: - Assignee: Sean Owen > when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can b

[jira] [Updated] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-7110: - Assignee: (was: Sean Owen) > when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation

[jira] [Commented] (SPARK-7110) when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be issued only with kerberos or web authentication"

2015-05-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537964#comment-14537964 ] Thomas Graves commented on SPARK-7110: -- [~gu chi] Any chance you can provide the inf

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL. Rela

[jira] [Commented] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538000#comment-14538000 ] Apache Spark commented on SPARK-7527: - User 'preeze' has created a pull request for th

[jira] [Assigned] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7527: --- Assignee: (was: Apache Spark) > Wrong detection of REPL mode in ClosureCleaner >

[jira] [Assigned] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7527: --- Assignee: Apache Spark > Wrong detection of REPL mode in ClosureCleaner > ---

[jira] [Updated] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Oleksii Kostyliev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksii Kostyliev updated SPARK-7527: - Description: If REPL class is not present on the classpath, the {{inIntetpreter}} boolean

[jira] [Created] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Oleksii Kostyliev (JIRA)
Oleksii Kostyliev created SPARK-7527: Summary: Wrong detection of REPL mode in ClosureCleaner Key: SPARK-7527 URL: https://issues.apache.org/jira/browse/SPARK-7527 Project: Spark Issue Ty

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started: http://search-hadoop.com/m/JW1q5j8z422/scalastyle+annoys+me+a+li

[jira] [Updated] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Oleksii Kostyliev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksii Kostyliev updated SPARK-7527: - Component/s: Spark Core Priority: Minor (was: Major) Affects Versio

[jira] [Commented] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-05-11 Thread Oleksii Kostyliev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537991#comment-14537991 ] Oleksii Kostyliev commented on SPARK-7527: -- Being addressed together with SPARK-7

[jira] [Assigned] (SPARK-7254) Extend PIC to handle Graphs directly

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7254: --- Assignee: Apache Spark > Extend PIC to handle Graphs directly > -

[jira] [Assigned] (SPARK-7254) Extend PIC to handle Graphs directly

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7254: --- Assignee: (was: Apache Spark) > Extend PIC to handle Graphs directly > --

[jira] [Commented] (SPARK-7254) Extend PIC to handle Graphs directly

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538023#comment-14538023 ] Apache Spark commented on SPARK-7254: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-7278) Inconsistent handling of dates in PySparks Row object

2015-05-11 Thread Kalle Jepsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538051#comment-14538051 ] Kalle Jepsen commented on SPARK-7278: - Shouldn't {{DateType}} at least find {{datetime

[jira] [Assigned] (SPARK-7278) Inconsistent handling of dates in PySparks Row object

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7278: --- Assignee: Apache Spark > Inconsistent handling of dates in PySparks Row object >

[jira] [Assigned] (SPARK-7278) Inconsistent handling of dates in PySparks Row object

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7278: --- Assignee: (was: Apache Spark) > Inconsistent handling of dates in PySparks Row object > -

[jira] [Commented] (SPARK-7278) Inconsistent handling of dates in PySparks Row object

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538060#comment-14538060 ] Apache Spark commented on SPARK-7278: - User 'yepzen' has created a pull request for th

[jira] [Commented] (SPARK-7278) Inconsistent handling of dates in PySparks Row object

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538063#comment-14538063 ] Apache Spark commented on SPARK-7278: - User 'ksonj' has created a pull request for thi

[jira] [Resolved] (SPARK-6092) Add RankingMetrics in PySpark/MLlib

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6092. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6044 [https://githu

[jira] [Created] (SPARK-7528) Java compatibility of RankingMetrics

2015-05-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7528: Summary: Java compatibility of RankingMetrics Key: SPARK-7528 URL: https://issues.apache.org/jira/browse/SPARK-7528 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-7443) MLlib 1.4 QA plan

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7443: - Description: TODO: create JIRAs for each task and assign them accordingly. h2. API * Check API c

[jira] [Updated] (SPARK-7497) test_count_by_value_and_window is flaky

2015-05-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7497: - Assignee: Davies Liu (was: Tathagata Das) > test_count_by_value_and_window is flaky > ---

[jira] [Created] (SPARK-7530) Add API to get the current state of a StreamingContext

2015-05-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7530: Summary: Add API to get the current state of a StreamingContext Key: SPARK-7530 URL: https://issues.apache.org/jira/browse/SPARK-7530 Project: Spark Issue Ty

[jira] [Created] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-05-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7529: Summary: Java compatibility check for MLlib 1.4 Key: SPARK-7529 URL: https://issues.apache.org/jira/browse/SPARK-7529 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7522. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6049 [https://githu

[jira] [Reopened] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-7522: -- Assignee: Bryan Cutler re-open for branch-1.3/1.2/1.1. > ML Examples option for dataFormat sh

[jira] [Updated] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7522: - Target Version/s: 1.1.2, 1.2.3, 1.3.2 Affects Version/s: 1.4.0 1.1.1

[jira] [Assigned] (SPARK-7530) Add API to get the current state of a StreamingContext

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7530: --- Assignee: Tathagata Das (was: Apache Spark) > Add API to get the current state of a Streamin

[jira] [Commented] (SPARK-7530) Add API to get the current state of a StreamingContext

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538126#comment-14538126 ] Apache Spark commented on SPARK-7530: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7530) Add API to get the current state of a StreamingContext

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7530: --- Assignee: Apache Spark (was: Tathagata Das) > Add API to get the current state of a Streamin

[jira] [Created] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7531: -- Summary: Install GPG on Jenkins machines Key: SPARK-7531 URL: https://issues.apache.org/jira/browse/SPARK-7531 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538148#comment-14538148 ] shane knapp commented on SPARK-7520: any particular version of ruby? 1.8.7? > Instal

[jira] [Updated] (SPARK-7458) Check 1.3-> 1.4 MLlib API compliance using java-compliance-checker

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7458: - Description: We should do this after 1.4-rc1 is cut. > Check 1.3-> 1.4 MLlib API compliance using

[jira] [Created] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-11 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7532: Summary: Make StreamingContext.start() idempotent Key: SPARK-7532 URL: https://issues.apache.org/jira/browse/SPARK-7532 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7532: - Component/s: Streaming > Make StreamingContext.start() idempotent > --

[jira] [Commented] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538154#comment-14538154 ] shane knapp commented on SPARK-7531: is this version sufficient? -bash-4.1$ gpg --ver

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

2015-05-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538159#comment-14538159 ] Marcelo Vanzin commented on SPARK-7504: --- If I understand correctly, what you're doin

[jira] [Assigned] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7355: --- Assignee: Andrew Or (was: Apache Spark) > FlakyTest - o.a.s.DriverSuite > --

[jira] [Commented] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538185#comment-14538185 ] Apache Spark commented on SPARK-7355: - User 'tedyu' has created a pull request for thi

[jira] [Assigned] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7355: --- Assignee: Apache Spark (was: Andrew Or) > FlakyTest - o.a.s.DriverSuite > --

[jira] [Assigned] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7532: --- Assignee: Tathagata Das (was: Apache Spark) > Make StreamingContext.start() idempotent > ---

[jira] [Commented] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538193#comment-14538193 ] Apache Spark commented on SPARK-7532: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7532: --- Assignee: Apache Spark (was: Tathagata Das) > Make StreamingContext.start() idempotent > ---

[jira] [Created] (SPARK-7533) Decrease spacing between AM-RM heartbeats.

2015-05-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-7533: - Summary: Decrease spacing between AM-RM heartbeats. Key: SPARK-7533 URL: https://issues.apache.org/jira/browse/SPARK-7533 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-05-11 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538209#comment-14538209 ] Alexander Ulanov commented on SPARK-5575: - Current implementation: https://github

[jira] [Created] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-11 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7534: --- Summary: Fix the Stage table when a stage is missing Key: SPARK-7534 URL: https://issues.apache.org/jira/browse/SPARK-7534 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7534: --- Assignee: (was: Apache Spark) > Fix the Stage table when a stage is missing > ---

[jira] [Commented] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538222#comment-14538222 ] Apache Spark commented on SPARK-7534: - User 'zsxwing' has created a pull request for t

[jira] [Updated] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7534: Description: Just improved the Stage table when a stage is missing. Please see the screenshots in h

[jira] [Assigned] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7534: --- Assignee: Apache Spark > Fix the Stage table when a stage is missing > --

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-11 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538236#comment-14538236 ] Eron Wright commented on SPARK-7400: - Given the above, my proposal is to modify [org

[jira] [Commented] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

2015-05-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538283#comment-14538283 ] Nicholas Chammas commented on SPARK-7507: - On a related note, perhaps we should al

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-05-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538288#comment-14538288 ] Joseph K. Bradley commented on SPARK-7483: -- I agree; it should work, but I'm not

[jira] [Resolved] (SPARK-7361) Throw unambiguous exception when attempting to start multiple StreamingContexts in the same JVM

2015-05-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7361. -- Resolution: Fixed Fix Version/s: 1.4.0 > Throw unambiguous exception when attempting to s

[jira] [Commented] (SPARK-7133) Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

2015-05-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538272#comment-14538272 ] Nicholas Chammas commented on SPARK-7133: - [~rxin] - Should we also implement {{\_

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538315#comment-14538315 ] shane knapp commented on SPARK-7520: i'll be installing ruby 2.2.2 via rvm, and jekyll

[jira] [Updated] (SPARK-7360) Compare Pyrolite performance affected by useMemo

2015-05-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7360: - Assignee: Nicholas Chammas > Compare Pyrolite performance affected by useMemo > --

[jira] [Commented] (SPARK-7533) Decrease spacing between AM-RM heartbeats.

2015-05-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538327#comment-14538327 ] Zoltán Zvara commented on SPARK-7533: - I will dive into this problem. > Decrease spac

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

2015-05-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538337#comment-14538337 ] Zoltán Zvara commented on SPARK-7504: - You are making a point. I will extend my soluti

[jira] [Commented] (SPARK-7462) By default retain group by columns in aggregate

2015-05-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538379#comment-14538379 ] Reynold Xin commented on SPARK-7462: Yup good idea. I will submit a followup PR to upd

[jira] [Commented] (SPARK-7133) Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

2015-05-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538385#comment-14538385 ] Reynold Xin commented on SPARK-7133: That should be a separate ticket if we want to do

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538403#comment-14538403 ] shane knapp commented on SPARK-7520: is passes, but there are some things in there i'm

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538410#comment-14538410 ] Shivaram Venkataraman commented on SPARK-7520: -- [~shaneknapp] SparkR docs req

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538439#comment-14538439 ] shane knapp commented on SPARK-7520: ok, there are a ton of other dependencies i need

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538442#comment-14538442 ] shane knapp commented on SPARK-7520: [~shivaram] any thoughts before i dive down this

[jira] [Comment Edited] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538449#comment-14538449 ] Shivaram Venkataraman edited comment on SPARK-7520 at 5/11/15 7:02 PM: -

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538449#comment-14538449 ] Shivaram Venkataraman commented on SPARK-7520: -- Can you just use R to resolve

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538451#comment-14538451 ] shane knapp commented on SPARK-7520: ooh fancy! trying that out right now... :) > I

[jira] [Resolved] (SPARK-6470) Allow Spark apps to put YARN node labels in their requests

2015-05-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-6470. --- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: (was: 1.4.0) > Allow Spark

[jira] [Updated] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-05-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7529: - Description: Check Java compatibility for MLlib 1.4. We should create separate JIRAs for

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538473#comment-14538473 ] shane knapp commented on SPARK-7520: ok, R packages installed and fresh build running:

[jira] [Created] (SPARK-7535) Audit Pipeline APIs

2015-05-11 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7535: Summary: Audit Pipeline APIs Key: SPARK-7535 URL: https://issues.apache.org/jira/browse/SPARK-7535 Project: Spark Issue Type: Sub-task Comp

[jira] [Updated] (SPARK-7443) MLlib 1.4 QA plan

2015-05-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7443: - Description: TODO: create JIRAs for each task and assign them accordingly. h2. API * Che

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538483#comment-14538483 ] shane knapp commented on SPARK-7520: ok, build is green and looks good. could someone

  1   2   3   >