[jira] [Updated] (SPARK-10657) Remove legacy SCP-based Jenkins log archiving code

2015-09-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10657: --- Summary: Remove legacy SCP-based Jenkins log archiving code (was: Remove legacy SSH-based Jenkins

[jira] [Updated] (SPARK-10657) Remove legacy SCP-based Jenkins log archiving code

2015-09-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10657: --- Description: As of https://issues.apache.org/jira/browse/SPARK-7561, we no longer need to use our

[jira] [Assigned] (SPARK-10657) Remove legacy SCP-based Jenkins log archiving code

2015-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10657: Assignee: Josh Rosen (was: Apache Spark) > Remove legacy SCP-based Jenkins log archiving

[jira] [Created] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2015-09-16 Thread ryanchou (JIRA)
ryanchou created SPARK-10658: Summary: Could pyspark provide addJars() as scala spark API? Key: SPARK-10658 URL: https://issues.apache.org/jira/browse/SPARK-10658 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2015-09-16 Thread ryanchou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryanchou updated SPARK-10658: - Description: My spark program was written by pyspark API , and it has used the spark-csv jar library.

[jira] [Commented] (SPARK-10606) Cube/Rollup/GrpSet doesn't create the correct plan when group by is on something other than an AttributeReference

2015-09-16 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791499#comment-14791499 ] Cheng Hao commented on SPARK-10606: --- [~rhbutani] Which version are you using, actually I've fixed the

[jira] [Created] (SPARK-10659) SparkSQL saveAsParquetFile does not preserve REQUIRED (not nullable) flag in schema

2015-09-16 Thread Vladimir Picka (JIRA)
Vladimir Picka created SPARK-10659: -- Summary: SparkSQL saveAsParquetFile does not preserve REQUIRED (not nullable) flag in schema Key: SPARK-10659 URL: https://issues.apache.org/jira/browse/SPARK-10659

[jira] [Updated] (SPARK-10659) DataFrames and SparkSQL saveAsParquetFile does not preserve REQUIRED (not nullable) flag in schema

2015-09-16 Thread Vladimir Picka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Picka updated SPARK-10659: --- Summary: DataFrames and SparkSQL saveAsParquetFile does not preserve REQUIRED (not nullable)

[jira] [Commented] (SPARK-10659) DataFrames and SparkSQL saveAsParquetFile does not preserve REQUIRED (not nullable) flag in schema

2015-09-16 Thread Vladimir Picka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791613#comment-14791613 ] Vladimir Picka commented on SPARK-10659: Here is unanswered attempt for discussion on a mailing

[jira] [Commented] (SPARK-8547) xgboost exploration

2015-09-16 Thread Tian Jian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791472#comment-14791472 ] Tian Jian Wang commented on SPARK-8547: --- Venkata I have started on this as a pet project before. If

[jira] [Created] (SPARK-10657) Remove legacy SSH-based Jenkins log archiving code

2015-09-16 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10657: -- Summary: Remove legacy SSH-based Jenkins log archiving code Key: SPARK-10657 URL: https://issues.apache.org/jira/browse/SPARK-10657 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2015-09-16 Thread ryanchou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryanchou updated SPARK-10658: - Description: My spark program was written by pyspark API , and it has used the spark-csv jar library.

[jira] [Resolved] (SPARK-10504) aggregate where NULL is defined as the value expression aborts when SUM used

2015-09-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10504. -- Resolution: Fixed Assignee: Yin Huai Fix Version/s: 1.5.0 > aggregate

[jira] [Resolved] (SPARK-2496) Compression streams should write its codec info to the stream

2015-09-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2496. --- Resolution: Incomplete Resolving as "Incomplete"; if we still want to do this then we should wait

[jira] [Resolved] (SPARK-2302) master should discard exceeded completedDrivers

2015-09-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2302. --- Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 1.1.0 > master should discard

[jira] [Commented] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

2015-09-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790924#comment-14790924 ] Josh Rosen commented on SPARK-4216: --- We now have a bot which deletes the duplicated posts after they're

[jira] [Updated] (SPARK-9715) Store numFeatures in all ML PredictionModel types

2015-09-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9715: - Shepherd: Joseph K. Bradley Assignee: Seth Hendrickson > Store numFeatures in all ML

[jira] [Created] (SPARK-10638) spark streaming stop gracefully keeps the spark context

2015-09-16 Thread Mamdouh Alramadan (JIRA)
Mamdouh Alramadan created SPARK-10638: - Summary: spark streaming stop gracefully keeps the spark context Key: SPARK-10638 URL: https://issues.apache.org/jira/browse/SPARK-10638 Project: Spark

[jira] [Created] (SPARK-10639) Need to convert UDAF's result from scala to sql type

2015-09-16 Thread Yin Huai (JIRA)
Yin Huai created SPARK-10639: Summary: Need to convert UDAF's result from scala to sql type Key: SPARK-10639 URL: https://issues.apache.org/jira/browse/SPARK-10639 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10638) spark streaming stop gracefully keeps the spark context

2015-09-16 Thread Mamdouh Alramadan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mamdouh Alramadan updated SPARK-10638: -- Description: With spark 1.4 on Mesos cluster, I am trying to stop the context with

[jira] [Updated] (SPARK-10638) spark streaming stop gracefully keeps the spark context

2015-09-16 Thread Mamdouh Alramadan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mamdouh Alramadan updated SPARK-10638: -- Description: With spark 1.4 on Mesos cluster, I am trying to stop the context with

[jira] [Created] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

2015-09-16 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10640: - Summary: Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied Key: SPARK-10640 URL: https://issues.apache.org/jira/browse/SPARK-10640

[jira] [Commented] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

2015-09-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790777#comment-14790777 ] Thomas Graves commented on SPARK-10640: --- looks like the jsonProtocol.taskEndReasonFromJson is just

<    1   2   3