[jira] [Closed] (SPARK-18130) Don't add inferred redundant isnotnull condition from constraints

2016-11-07 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-18130. --- Resolution: Won't Fix > Don't add inferred redundant isnotnull condition from constraints > -

[jira] [Updated] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-18298: - Description: When I started HistoryServer for reading event logs, the timestamp readed will be parsed us

[jira] [Updated] (SPARK-18298) HistoryServer use GMT time all time

2016-11-07 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-18298: - Description: When I started HistoryServer for reading event logs, the timestamp readed will be parsed us

[jira] [Commented] (SPARK-16753) Spark SQL doesn't handle skewed dataset joins properly

2016-11-07 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643525#comment-15643525 ] Damian Momot commented on SPARK-16753: -- Isn't it same problem as https://issues.apac

[jira] [Resolved] (SPARK-16904) Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16904. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Removal of Hive Built-

[jira] [Commented] (SPARK-18263) Configuring spark.kryo.registrator programmatically doesn't take effect

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643611#comment-15643611 ] Sean Owen commented on SPARK-18263: --- Where is the object defined? first you want to rul

[jira] [Resolved] (SPARK-16010) Code Refactoring, Test Case Improvement and Description Updates for SQLConf spark.sql.parquet.filterPushdown

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16010. --- Resolution: Won't Fix Since the PRs are being closed, I'm assuming you're considering these issues W

[jira] [Resolved] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18297. --- Resolution: Not A Problem Your code creates new contexts over and over. You can't create more than 1.

[jira] [Resolved] (SPARK-16894) take function for returning the first n elements of array column

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16894. --- Resolution: Invalid I'm not sure what this is suggesting, even. You can always manage to select the

[jira] [Resolved] (SPARK-16753) Spark SQL doesn't handle skewed dataset joins properly

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16753. --- Resolution: Duplicate > Spark SQL doesn't handle skewed dataset joins properly >

[jira] [Commented] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2016-11-07 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643750#comment-15643750 ] Vincent Warmerdam commented on SPARK-10523: --- If that is the case I'd say it is

[jira] [Closed] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2016-11-07 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Warmerdam closed SPARK-10523. - Resolution: Fixed > SparkR formula syntax to turn strings/factors into numerics > ---

[jira] [Reopened] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-10523: --- > SparkR formula syntax to turn strings/factors into numerics > -

[jira] [Resolved] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10523. --- Resolution: Duplicate > SparkR formula syntax to turn strings/factors into numerics > ---

[jira] [Commented] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread liuhongqiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643795#comment-15643795 ] liuhongqiang commented on SPARK-18297: -- I use a shared singleton SparkContext in pro

[jira] [Comment Edited] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread liuhongqiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643795#comment-15643795 ] liuhongqiang edited comment on SPARK-18297 at 11/7/16 10:41 AM: ---

[jira] [Commented] (SPARK-7344) Spark hangs reading and writing to the same S3 bucket

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643819#comment-15643819 ] Steve Loughran commented on SPARK-7344: --- I've been doing lots of work with S3a and n

[jira] [Resolved] (SPARK-7344) Spark hangs reading and writing to the same S3 bucket

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7344. -- Resolution: Cannot Reproduce > Spark hangs reading and writing to the same S3 bucket > -

[jira] [Comment Edited] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread liuhongqiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643795#comment-15643795 ] liuhongqiang edited comment on SPARK-18297 at 11/7/16 10:46 AM: ---

[jira] [Commented] (SPARK-13044) saveAsTextFile() doesn't support s3 Signature Version 4

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643827#comment-15643827 ] Steve Loughran commented on SPARK-13044: This is HADOOP-13325; jets3t doesn't sup

[jira] [Commented] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643830#comment-15643830 ] Sean Owen commented on SPARK-18297: --- That's a different question, but, still a problem

[jira] [Updated] (SPARK-13044) saveAsTextFile(s3n://) doesn't support s3 Signature Version 4

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-13044: --- Summary: saveAsTextFile(s3n://) doesn't support s3 Signature Version 4 (was: saveAsTextFile(

[jira] [Resolved] (SPARK-13044) saveAsTextFile(s3n://) doesn't support s3 Signature Version 4

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-13044. Resolution: Won't Fix > saveAsTextFile(s3n://) doesn't support s3 Signature Version 4 > ---

[jira] [Commented] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643838#comment-15643838 ] Apache Spark commented on SPARK-18297: -- User 'smallyard' has created a pull request

[jira] [Commented] (SPARK-18297) Fail if SparkContext run a new Thread in yarn-cluster

2016-11-07 Thread liuhongqiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643854#comment-15643854 ] liuhongqiang commented on SPARK-18297: -- In yarn-client model,that can run crrectly .

[jira] [Resolved] (SPARK-12378) CREATE EXTERNAL TABLE AS SELECT EXPORT AWS S3 ERROR

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-12378. Resolution: Cannot Reproduce > CREATE EXTERNAL TABLE AS SELECT EXPORT AWS S3 ERROR > --

[jira] [Commented] (SPARK-12378) CREATE EXTERNAL TABLE AS SELECT EXPORT AWS S3 ERROR

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643851#comment-15643851 ] Steve Loughran commented on SPARK-12378: This is amazon EMR; they've got their ow

[jira] [Commented] (SPARK-18017) Changing Hadoop parameter through sparkSession.sparkContext.hadoopConfiguration doesn't work

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643864#comment-15643864 ] Steve Loughran commented on SPARK-18017: you can check what's been picked up by g

[jira] [Resolved] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-11-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18125. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.1.0 > Sp

[jira] [Resolved] (SPARK-18291) SparkR glm predict should output original label when family = "binomial"

2016-11-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18291. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.1.0 Target V

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644092#comment-15644092 ] Steve Loughran commented on SPARK-10063: HADOOP-13786 covers adding a committer f

[jira] [Created] (SPARK-18299) Allow more aggregations on KeyValueGroupedDataset

2016-11-07 Thread Matthias Niehoff (JIRA)
Matthias Niehoff created SPARK-18299: Summary: Allow more aggregations on KeyValueGroupedDataset Key: SPARK-18299 URL: https://issues.apache.org/jira/browse/SPARK-18299 Project: Spark Iss

[jira] [Created] (SPARK-18300) ClassCastException during count distinct

2016-11-07 Thread Emlyn Corrin (JIRA)
Emlyn Corrin created SPARK-18300: Summary: ClassCastException during count distinct Key: SPARK-18300 URL: https://issues.apache.org/jira/browse/SPARK-18300 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2016-11-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15784: Shepherd: Yanbo Liang Assignee: Miao Wang > Add Power Iteration Clustering to spark.ml > --

[jira] [Commented] (SPARK-18172) AnalysisException in first/last during aggregation

2016-11-07 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644358#comment-15644358 ] Emlyn Corrin commented on SPARK-18172: -- I can also reproduce it in Spark SQL with th

[jira] [Created] (SPARK-18301) VectorAssembler does not support StructTypes

2016-11-07 Thread Steffen Herbold (JIRA)
Steffen Herbold created SPARK-18301: --- Summary: VectorAssembler does not support StructTypes Key: SPARK-18301 URL: https://issues.apache.org/jira/browse/SPARK-18301 Project: Spark Issue Type

[jira] [Commented] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644458#comment-15644458 ] Apache Spark commented on SPARK-18125: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-18262) JSON.org license is now CatX

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644501#comment-15644501 ] Sean Owen commented on SPARK-18262: --- {{org.json:json}} is brought in from the {{hive-ex

[jira] [Created] (SPARK-18302) correct several partition related behaviours of ExternalCatalog

2016-11-07 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-18302: --- Summary: correct several partition related behaviours of ExternalCatalog Key: SPARK-18302 URL: https://issues.apache.org/jira/browse/SPARK-18302 Project: Spark

[jira] [Assigned] (SPARK-18262) JSON.org license is now CatX

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18262: Assignee: Apache Spark (was: Sean Owen) > JSON.org license is now CatX >

[jira] [Assigned] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17990: Assignee: Apache Spark > ALTER TABLE ... ADD PARTITION does not play nice with mixed-case

[jira] [Assigned] (SPARK-18302) correct several partition related behaviours of ExternalCatalog

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18302: Assignee: Wenchen Fan (was: Apache Spark) > correct several partition related behaviours

[jira] [Commented] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644573#comment-15644573 ] Apache Spark commented on SPARK-17990: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-18302) correct several partition related behaviours of ExternalCatalog

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18302: Assignee: Apache Spark (was: Wenchen Fan) > correct several partition related behaviours

[jira] [Assigned] (SPARK-18262) JSON.org license is now CatX

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18262: Assignee: Sean Owen (was: Apache Spark) > JSON.org license is now CatX >

[jira] [Commented] (SPARK-18302) correct several partition related behaviours of ExternalCatalog

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644574#comment-15644574 ] Apache Spark commented on SPARK-18302: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17990: Assignee: (was: Apache Spark) > ALTER TABLE ... ADD PARTITION does not play nice with

[jira] [Commented] (SPARK-18262) JSON.org license is now CatX

2016-11-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644572#comment-15644572 ] Apache Spark commented on SPARK-18262: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

2016-11-07 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644841#comment-15644841 ] Erik Erlandson commented on SPARK-18278: I agree with [~willbenton] that Kube is

[jira] [Commented] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

2016-11-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644875#comment-15644875 ] Shivaram Venkataraman commented on SPARK-17822: --- Yeah just to provide some

[jira] [Created] (SPARK-18303) CLONE - Improving MLlib optimization APIs

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18303: - Summary: CLONE - Improving MLlib optimization APIs Key: SPARK-18303 URL: https://issues.apache.org/jira/browse/SPARK-18303 Project: Spark Issue Type: Umbre

[jira] [Created] (SPARK-18304) [SPARK-5256] Improving MLlib optimization APIs

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18304: - Summary: [SPARK-5256] Improving MLlib optimization APIs Key: SPARK-18304 URL: https://issues.apache.org/jira/browse/SPARK-18304 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18125) Spark generated code causes CompileException when groupByKey, reduceGroups and map(_._2) are used

2016-11-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18125: -- Fix Version/s: 2.0.3 > Spark generated code causes CompileException when groupByKey, re

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

2016-11-07 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644919#comment-15644919 ] Erik Erlandson commented on SPARK-18278: Another comment on external plug-ins for

[jira] [Created] (SPARK-18311) CLONE - Support model save/load in Python's Word2Vec

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18311: - Summary: CLONE - Support model save/load in Python's Word2Vec Key: SPARK-18311 URL: https://issues.apache.org/jira/browse/SPARK-18311 Project: Spark Issue

[jira] [Created] (SPARK-18308) CLONE - Support model save/load in Python's naive Bayes

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18308: - Summary: CLONE - Support model save/load in Python's naive Bayes Key: SPARK-18308 URL: https://issues.apache.org/jira/browse/SPARK-18308 Project: Spark Iss

[jira] [Created] (SPARK-18306) CLONE - Support model save/load in Python's ALS.

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18306: - Summary: CLONE - Support model save/load in Python's ALS. Key: SPARK-18306 URL: https://issues.apache.org/jira/browse/SPARK-18306 Project: Spark Issue Type

[jira] [Created] (SPARK-18305) CLONE - Python API for ML model import/export

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18305: - Summary: CLONE - Python API for ML model import/export Key: SPARK-18305 URL: https://issues.apache.org/jira/browse/SPARK-18305 Project: Spark Issue Type: U

[jira] [Created] (SPARK-18310) CLONE - Support model save/load in Python's KMeans

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18310: - Summary: CLONE - Support model save/load in Python's KMeans Key: SPARK-18310 URL: https://issues.apache.org/jira/browse/SPARK-18310 Project: Spark Issue Ty

[jira] [Created] (SPARK-18309) CLONE - Support model save/load in Python's tree models

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18309: - Summary: CLONE - Support model save/load in Python's tree models Key: SPARK-18309 URL: https://issues.apache.org/jira/browse/SPARK-18309 Project: Spark Iss

[jira] [Created] (SPARK-18307) CLONE - Support model save/load in Python's linear models

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18307: - Summary: CLONE - Support model save/load in Python's linear models Key: SPARK-18307 URL: https://issues.apache.org/jira/browse/SPARK-18307 Project: Spark I

[jira] [Created] (SPARK-18313) CLONE - Support model save/load in Python's FPGrowth

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18313: - Summary: CLONE - Support model save/load in Python's FPGrowth Key: SPARK-18313 URL: https://issues.apache.org/jira/browse/SPARK-18313 Project: Spark Issue

[jira] [Created] (SPARK-18312) CLONE - Support model save/load in Python's GaussianMixture

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18312: - Summary: CLONE - Support model save/load in Python's GaussianMixture Key: SPARK-18312 URL: https://issues.apache.org/jira/browse/SPARK-18312 Project: Spark

[jira] [Commented] (SPARK-18288) SparkLauncer 2.0.1 version working incosistently in yarn-client mode

2016-11-07 Thread Elkhan Dadashov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644927#comment-15644927 ] Elkhan Dadashov commented on SPARK-18288: - Let me replace while loop with Schedul

[jira] [Created] (SPARK-18314) CLONE - Support model save/load in Python's LDA

2016-11-07 Thread Iskender Unlu (JIRA)
Iskender Unlu created SPARK-18314: - Summary: CLONE - Support model save/load in Python's LDA Key: SPARK-18314 URL: https://issues.apache.org/jira/browse/SPARK-18314 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-18283) Add a test to make sure the default starting offset is latest

2016-11-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18283. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 > Add a test to make sur

[jira] [Commented] (SPARK-18305) CLONE - Python API for ML model import/export

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645049#comment-15645049 ] Sean Owen commented on SPARK-18305: --- [~iskenderunlu804] you just opened about 8 issues

[jira] [Created] (SPARK-18315) Cannot save JDBC tables in Parquet format in Spark 2.0.1

2016-11-07 Thread kiran (JIRA)
kiran created SPARK-18315: - Summary: Cannot save JDBC tables in Parquet format in Spark 2.0.1 Key: SPARK-18315 URL: https://issues.apache.org/jira/browse/SPARK-18315 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18315) Cannot save Solr or JDBC tables in Parquet format in Spark 2.0.1

2016-11-07 Thread kiran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kiran updated SPARK-18315: -- Summary: Cannot save Solr or JDBC tables in Parquet format in Spark 2.0.1 (was: Cannot save JDBC tables in Par

[jira] [Updated] (SPARK-18315) Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1

2016-11-07 Thread kiran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kiran updated SPARK-18315: -- Summary: Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1 (was: Cannot save Solr or JDBC table

[jira] [Resolved] (SPARK-18303) CLONE - Improving MLlib optimization APIs

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18303. --- Resolution: Invalid > CLONE - Improving MLlib optimization APIs > ---

[jira] [Resolved] (SPARK-18311) CLONE - Support model save/load in Python's Word2Vec

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18311. --- Resolution: Invalid > CLONE - Support model save/load in Python's Word2Vec >

[jira] [Resolved] (SPARK-18307) CLONE - Support model save/load in Python's linear models

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18307. --- Resolution: Invalid > CLONE - Support model save/load in Python's linear models > ---

[jira] [Resolved] (SPARK-18312) CLONE - Support model save/load in Python's GaussianMixture

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18312. --- Resolution: Invalid > CLONE - Support model save/load in Python's GaussianMixture > -

[jira] [Resolved] (SPARK-18308) CLONE - Support model save/load in Python's naive Bayes

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18308. --- Resolution: Invalid > CLONE - Support model save/load in Python's naive Bayes > -

[jira] [Resolved] (SPARK-18304) [SPARK-5256] Improving MLlib optimization APIs

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18304. --- Resolution: Invalid > [SPARK-5256] Improving MLlib optimization APIs > --

[jira] [Resolved] (SPARK-18305) CLONE - Python API for ML model import/export

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18305. --- Resolution: Invalid > CLONE - Python API for ML model import/export > ---

[jira] [Resolved] (SPARK-18310) CLONE - Support model save/load in Python's KMeans

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18310. --- Resolution: Invalid > CLONE - Support model save/load in Python's KMeans > --

[jira] [Resolved] (SPARK-18306) CLONE - Support model save/load in Python's ALS.

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18306. --- Resolution: Invalid > CLONE - Support model save/load in Python's ALS. >

[jira] [Resolved] (SPARK-18309) CLONE - Support model save/load in Python's tree models

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18309. --- Resolution: Invalid > CLONE - Support model save/load in Python's tree models > -

[jira] [Resolved] (SPARK-18314) CLONE - Support model save/load in Python's LDA

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18314. --- Resolution: Invalid > CLONE - Support model save/load in Python's LDA > -

[jira] [Resolved] (SPARK-18313) CLONE - Support model save/load in Python's FPGrowth

2016-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18313. --- Resolution: Invalid > CLONE - Support model save/load in Python's FPGrowth >

[jira] [Created] (SPARK-18322) CLONE - ML, Graph, R 2.0 QA: Update user guide for new features & APIs

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18322: - Summary: CLONE - ML, Graph, R 2.0 QA: Update user guide for new features & APIs Key: SPARK-18322 URL: https://issues.apache.org/jira/browse/SPARK-18322 Proj

[jira] [Created] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18316: - Summary: Spark MLlib, GraphX 2.1 QA umbrella Key: SPARK-18316 URL: https://issues.apache.org/jira/browse/SPARK-18316 Project: Spark Issue Type: Umb

[jira] [Created] (SPARK-18317) CLONE - ML, Graph 2.0 QA: API: Binary incompatible changes

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18317: - Summary: CLONE - ML, Graph 2.0 QA: API: Binary incompatible changes Key: SPARK-18317 URL: https://issues.apache.org/jira/browse/SPARK-18317 Project: Spark

[jira] [Created] (SPARK-18327) CLONE - R programming guide update

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18327: - Summary: CLONE - R programming guide update Key: SPARK-18327 URL: https://issues.apache.org/jira/browse/SPARK-18327 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-18325) CLONE - R Examples: Check for new R APIs requiring example code in 2.0

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18325: - Summary: CLONE - R Examples: Check for new R APIs requiring example code in 2.0 Key: SPARK-18325 URL: https://issues.apache.org/jira/browse/SPARK-18325 Proj

[jira] [Created] (SPARK-18320) CLONE - ML 2.0 QA: API: Python API coverage

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18320: - Summary: CLONE - ML 2.0 QA: API: Python API coverage Key: SPARK-18320 URL: https://issues.apache.org/jira/browse/SPARK-18320 Project: Spark Issue T

[jira] [Created] (SPARK-18321) CLONE - ML 2.0 QA: API: Java compatibility, docs

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18321: - Summary: CLONE - ML 2.0 QA: API: Java compatibility, docs Key: SPARK-18321 URL: https://issues.apache.org/jira/browse/SPARK-18321 Project: Spark Is

[jira] [Created] (SPARK-18324) CLONE - ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18324: - Summary: CLONE - ML, Graph, R 2.0 QA: Programming guide update and migration guide Key: SPARK-18324 URL: https://issues.apache.org/jira/browse/SPARK-18324 P

[jira] [Created] (SPARK-18328) CLONE - Additional fixes to Mllib 2.0 documentation

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18328: - Summary: CLONE - Additional fixes to Mllib 2.0 documentation Key: SPARK-18328 URL: https://issues.apache.org/jira/browse/SPARK-18328 Project: Spark

[jira] [Created] (SPARK-18323) CLONE - Update MLlib, GraphX, SparkR websites for 2.0

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18323: - Summary: CLONE - Update MLlib, GraphX, SparkR websites for 2.0 Key: SPARK-18323 URL: https://issues.apache.org/jira/browse/SPARK-18323 Project: Spark

[jira] [Created] (SPARK-18319) CLONE - ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18319: - Summary: CLONE - ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit Key: SPARK-18319 URL: https://issues.apache.org/jira/browse/SPARK-18319

[jira] [Created] (SPARK-18326) CLONE - R 2.0 QA: New R APIs and API docs

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18326: - Summary: CLONE - R 2.0 QA: New R APIs and API docs Key: SPARK-18326 URL: https://issues.apache.org/jira/browse/SPARK-18326 Project: Spark Issue Typ

[jira] [Created] (SPARK-18318) CLONE - ML, Graph 2.0 QA: API: New Scala APIs, docs

2016-11-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18318: - Summary: CLONE - ML, Graph 2.0 QA: API: New Scala APIs, docs Key: SPARK-18318 URL: https://issues.apache.org/jira/browse/SPARK-18318 Project: Spark

[jira] [Updated] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18316: -- Target Version/s: 2.1.0 (was: 2.0.0) > Spark MLlib, GraphX 2.1 QA umbrella > -

[jira] [Updated] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18316: -- Component/s: (was: SparkR) > Spark MLlib, GraphX 2.1 QA umbrella >

[jira] [Updated] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18316: -- Description: h1. WIP - still being updated! This JIRA lists tasks for the next Spark

[jira] [Updated] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18316: -- Fix Version/s: (was: 2.0.0) > Spark MLlib, GraphX 2.1 QA umbrella > ---

[jira] [Commented] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-11-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645121#comment-15645121 ] Joseph K. Bradley commented on SPARK-18316: --- Time to start another round of QA!

  1   2   3   4   >