[jira] [Resolved] (SPARK-10009) PySpark Param of Vector type can be set with Python array or numpy.array

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10009. --- Resolution: Fixed Fix Version/s: 2.0.0 > PySpark Param of Vector type can be

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209802#comment-15209802 ] Joseph K. Bradley commented on SPARK-4144: -- I'm wondering: Do you have a use case? I have not

[jira] [Updated] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4144: - Assignee: (was: Chris Fregly) > Support incremental model training of Naive Bayes

[jira] [Commented] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-23 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209801#comment-15209801 ] Yang Wang commented on SPARK-13911: --- Are there any new progresses here about this issue? We are facing

[jira] [Commented] (SPARK-13934) SqlParser.parseTableIdentifier cannot recognize table name start with scientific notation

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209796#comment-15209796 ] Apache Spark commented on SPARK-13934: -- User 'wangyang1992' has created a pull request for this

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-03-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209794#comment-15209794 ] Wenchen Fan commented on SPARK-13456: - oh i see, the problem is the paste mode, working on it. >

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-03-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209790#comment-15209790 ] Wenchen Fan commented on SPARK-13456: - I tried your example locally and everything goes well. How do

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-23 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209748#comment-15209748 ] Xin Wu commented on SPARK-13832: [~jfc...@us.ibm.com] For the above execution issue, i think it is a

[jira] [Comment Edited] (SPARK-8632) Poor Python UDF performance because of RDD caching

2016-03-23 Thread Bijay Kumar Pathak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209743#comment-15209743 ] Bijay Kumar Pathak edited comment on SPARK-8632 at 3/24/16 4:47 AM: I

[jira] [Comment Edited] (SPARK-8632) Poor Python UDF performance because of RDD caching

2016-03-23 Thread Bijay Kumar Pathak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209743#comment-15209743 ] Bijay Kumar Pathak edited comment on SPARK-8632 at 3/24/16 4:46 AM: I

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

2016-03-23 Thread Bijay Kumar Pathak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209743#comment-15209743 ] Bijay Kumar Pathak commented on SPARK-8632: --- I am still having this issue in Spark 1.6.0 on EMR.

[jira] [Commented] (SPARK-10691) Make Logistic, Linear Regression Model evaluate() method public

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209740#comment-15209740 ] Apache Spark commented on SPARK-10691: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10691) Make Logistic, Linear Regression Model evaluate() method public

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10691: Assignee: Apache Spark (was: Joseph K. Bradley) > Make Logistic, Linear Regression Model

[jira] [Assigned] (SPARK-10691) Make Logistic, Linear Regression Model evaluate() method public

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10691: Assignee: Joseph K. Bradley (was: Apache Spark) > Make Logistic, Linear Regression Model

[jira] [Updated] (SPARK-10691) Make Logistic, Linear Regression Model evaluate() method public

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10691: -- Summary: Make Logistic, Linear Regression Model evaluate() method public (was: Make

[jira] [Assigned] (SPARK-10691) Make LogisticRegressionModel.evaluate() method public

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-10691: - Assignee: Joseph K. Bradley > Make LogisticRegressionModel.evaluate() method

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209737#comment-15209737 ] Xin Wu commented on SPARK-14096: I simplied the query to: {code}select * from item order by i_item_id

[jira] [Closed] (SPARK-14093) org.apache.spark.ml.recommendation.ALSModel.save method cannot be used with HDFS

2016-03-23 Thread Dulaj Rajitha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dulaj Rajitha closed SPARK-14093. - Resolution: Fixed Fix Version/s: 1.6.0 I was able to solve the issue by using the

[jira] [Commented] (SPARK-14093) org.apache.spark.ml.recommendation.ALSModel.save method cannot be used with HDFS

2016-03-23 Thread Dulaj Rajitha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209724#comment-15209724 ] Dulaj Rajitha commented on SPARK-14093: --- I was able to solve the issue by using the

[jira] [Resolved] (SPARK-12183) Remove spark.mllib tree, forest implementations and use spark.ml

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12183. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11855

[jira] [Assigned] (SPARK-14110) PipedRDD to print the command ran on non zero exit

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14110: Assignee: Apache Spark > PipedRDD to print the command ran on non zero exit >

[jira] [Commented] (SPARK-14110) PipedRDD to print the command ran on non zero exit

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209702#comment-15209702 ] Apache Spark commented on SPARK-14110: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-14110) PipedRDD to print the command ran on non zero exit

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14110: Assignee: (was: Apache Spark) > PipedRDD to print the command ran on non zero exit >

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209688#comment-15209688 ] Xin Wu commented on SPARK-14096: [~jfc...@us.ibm.com] Can you try the query without ORDER BY? I noticed

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2016-03-23 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209686#comment-15209686 ] He Tianyi commented on SPARK-12194: --- Looking for OpenTSDB sink also. Would any committer check on this

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-23 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209687#comment-15209687 ] Xin Wu commented on SPARK-13832: The analysis issue reported in this jira is resolved in spark 2.0.. For

[jira] [Updated] (SPARK-14110) PipedRDD to print the command ran on non zero exit

2016-03-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-14110: Summary: PipedRDD to print the command ran on non zero exit (was: PipedRDD to print the command

[jira] [Updated] (SPARK-14110) PipedRDD to print the command ran on failure

2016-03-23 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-14110: Description: In case of failure in subprocess launched in PipedRDD, the failure exception reads

[jira] [Assigned] (SPARK-14111) Correct output nullability with constraints for logical plans

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14111: Assignee: Apache Spark > Correct output nullability with constraints for logical plans >

[jira] [Assigned] (SPARK-14111) Correct output nullability with constraints for logical plans

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14111: Assignee: (was: Apache Spark) > Correct output nullability with constraints for

[jira] [Commented] (SPARK-14111) Correct output nullability with constraints for logical plans

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209676#comment-15209676 ] Apache Spark commented on SPARK-14111: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-14111) Correct output nullability with constraints for logical plans

2016-03-23 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-14111: --- Summary: Correct output nullability with constraints for logical plans Key: SPARK-14111 URL: https://issues.apache.org/jira/browse/SPARK-14111 Project: Spark

[jira] [Closed] (SPARK-13903) Modify output nullability with constraints for Join and Filter operators

2016-03-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-13903. --- Resolution: Won't Fix > Modify output nullability with constraints for Join and Filter

[jira] [Updated] (SPARK-14085) Star Expansion for Hash

2016-03-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-14085: Affects Version/s: (was: 2.0.0) 1.6.1 > Star Expansion for Hash >

[jira] [Resolved] (SPARK-14085) Star Expansion for Hash

2016-03-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-14085. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11904

[jira] [Updated] (SPARK-14085) Star Expansion for Hash

2016-03-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-14085: Assignee: Xiao Li > Star Expansion for Hash > --- > > Key:

[jira] [Commented] (SPARK-14068) Pluggable DiskBlockManager

2016-03-23 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209624#comment-15209624 ] He Tianyi commented on SPARK-14068: --- For example: In my deployment, both SSDs and HDDs are installed on

[jira] [Commented] (SPARK-12083) java.lang.IllegalArgumentException: requirement failed: Overflowed precision (q98)

2016-03-23 Thread zhangdekun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209608#comment-15209608 ] zhangdekun commented on SPARK-12083: JDBCRDD.scala case java.sql.Types.DECIMAL if precision

[jira] [Commented] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209594#comment-15209594 ] Liyin Tang commented on SPARK-14105: I tested the PR with the same streaming job, and verified the

[jira] [Commented] (SPARK-14094) When shutdown spark streaming jobs , the MasterUI stop response, RPC Timeout exception occurs

2016-03-23 Thread Simon Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209592#comment-15209592 ] Simon Lee commented on SPARK-14094: --- Maybe I forgot config the parameter: spark.ui.retainedJobs

[jira] [Created] (SPARK-14110) PipedRDD to print the command ran on failure

2016-03-23 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-14110: --- Summary: PipedRDD to print the command ran on failure Key: SPARK-14110 URL: https://issues.apache.org/jira/browse/SPARK-14110 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14109) HDFSMetadataLog throws AbstractFilesSystem exception with common schemes like s3n

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14109: Assignee: Tathagata Das (was: Apache Spark) > HDFSMetadataLog throws AbstractFilesSystem

[jira] [Commented] (SPARK-14109) HDFSMetadataLog throws AbstractFilesSystem exception with common schemes like s3n

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209566#comment-15209566 ] Apache Spark commented on SPARK-14109: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14109) HDFSMetadataLog throws AbstractFilesSystem exception with common schemes like s3n

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14109: Assignee: Apache Spark (was: Tathagata Das) > HDFSMetadataLog throws AbstractFilesSystem

[jira] [Created] (SPARK-14109) HDFSMetadataLog throws AbstractFilesSystem exception with common schemes like s3n

2016-03-23 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-14109: - Summary: HDFSMetadataLog throws AbstractFilesSystem exception with common schemes like s3n Key: SPARK-14109 URL: https://issues.apache.org/jira/browse/SPARK-14109

[jira] [Commented] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

2016-03-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209561#comment-15209561 ] Takeshi Yamamuro commented on SPARK-13656: -- Okay, I'll make a new ticket with a basic idea

[jira] [Updated] (SPARK-9721) TreeTests.checkEqual should compare predictions on data

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9721: - Priority: Minor (was: Major) > TreeTests.checkEqual should compare predictions on data >

[jira] [Commented] (SPARK-9721) TreeTests.checkEqual should compare predictions on data

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209556#comment-15209556 ] Joseph K. Bradley commented on SPARK-9721: -- This issue came up when looking at the aggregation

[jira] [Commented] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test

2016-03-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209537#comment-15209537 ] José Pablo Cambronero commented on SPARK-8674: -- Don't mind at all. Thank you for picking this

[jira] [Updated] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

2016-03-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14083: Description: One big advantage of the Dataset API is the type safety, at the cost of performance

[jira] [Commented] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test

2016-03-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209523#comment-15209523 ] yuhao yang commented on SPARK-8674: --- Hi [~josepablocam] I've sent a PR for anderson darling test

[jira] [Commented] (SPARK-13383) Keep broadcast hint after column pruning

2016-03-23 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209519#comment-15209519 ] Yong Zhang commented on SPARK-13383: Will this fix back patch to 1.5.x or 1.6.x branches? > Keep

[jira] [Commented] (SPARK-14040) Null-safe and equality join produces incorrect result with filtered dataframe

2016-03-23 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209518#comment-15209518 ] Sunitha Kambhampati commented on SPARK-14040: - PR for SPARK-13801 is trying to resolve the

[jira] [Comment Edited] (SPARK-14040) Null-safe and equality join produces incorrect result with filtered dataframe

2016-03-23 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209503#comment-15209503 ] Sunitha Kambhampati edited comment on SPARK-14040 at 3/24/16 12:48 AM:

[jira] [Comment Edited] (SPARK-14040) Null-safe and equality join produces incorrect result with filtered dataframe

2016-03-23 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209503#comment-15209503 ] Sunitha Kambhampati edited comment on SPARK-14040 at 3/24/16 12:44 AM:

[jira] [Commented] (SPARK-14040) Null-safe and equality join produces incorrect result with filtered dataframe

2016-03-23 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209503#comment-15209503 ] Sunitha Kambhampati commented on SPARK-14040: - Here are my notes on the investigation. A

[jira] [Commented] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2016-03-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209486#comment-15209486 ] Reynold Xin commented on SPARK-12148: - Let's just do the renaming. Thanks! > SparkR: rename

[jira] [Commented] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-23 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209484#comment-15209484 ] Michel Lemay commented on SPARK-13710: -- Spark coordinates for curator did not change.. It still

[jira] [Updated] (SPARK-11892) Model export/import for spark.ml: OneVsRest

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11892: -- Shepherd: (was: Joseph K. Bradley) > Model export/import for spark.ml: OneVsRest >

[jira] [Updated] (SPARK-11893) Model export/import for spark.ml: TrainValidationSplit

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11893: -- Shepherd: Joseph K. Bradley Assignee: Xusen Yin Target

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Affects Version/s: 1.6.1 > Serialization issue for KafkaRDD > > >

[jira] [Closed] (SPARK-14099) Cleanup shuffles in ML version of ALS

2016-03-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-14099. --- Resolution: Duplicate > Cleanup shuffles in ML version of ALS > - > >

[jira] [Commented] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Kevin Long (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209395#comment-15209395 ] Kevin Long commented on SPARK-14105: tested on 1.6.1 and the issue is also there. > Serialization

[jira] [Updated] (SPARK-13874) Move docs of streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13874: - Summary: Move docs of streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to

[jira] [Commented] (SPARK-14107) PySpark spark.ml GBT algs need seed Param

2016-03-23 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209327#comment-15209327 ] Seth Hendrickson commented on SPARK-14107: -- I can work on this. > PySpark spark.ml GBT algs

[jira] [Commented] (SPARK-14014) Replace existing analysis.Catalog with SessionCatalog

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209322#comment-15209322 ] Apache Spark commented on SPARK-14014: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209321#comment-15209321 ] Apache Spark commented on SPARK-13923: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Created] (SPARK-14108) calling count() on empty dataframe throws java.util.NoSuchElementException

2016-03-23 Thread Krishna Shekhram (JIRA)
Krishna Shekhram created SPARK-14108: Summary: calling count() on empty dataframe throws java.util.NoSuchElementException Key: SPARK-14108 URL: https://issues.apache.org/jira/browse/SPARK-14108

[jira] [Resolved] (SPARK-14025) Fix streaming job descriptions on the event line

2016-03-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14025. -- Resolution: Fixed Assignee: Liwei Lin Fix Version/s: 2.0.0 > Fix streaming job

[jira] [Comment Edited] (SPARK-7992) Hide private classes/objects in in generated Java API doc

2016-03-23 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209280#comment-15209280 ] Jakob Odersky edited comment on SPARK-7992 at 3/23/16 10:16 PM: Hey

[jira] [Commented] (SPARK-7992) Hide private classes/objects in in generated Java API doc

2016-03-23 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209280#comment-15209280 ] Jakob Odersky commented on SPARK-7992: -- Hey Xiangrui, you caught me in a very busy time last week and

[jira] [Created] (SPARK-14107) PySpark spark.ml GBT algs need seed Param

2016-03-23 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14107: - Summary: PySpark spark.ml GBT algs need seed Param Key: SPARK-14107 URL: https://issues.apache.org/jira/browse/SPARK-14107 Project: Spark Issue

[jira] [Resolved] (SPARK-13952) spark.ml GBT algs need to use random seed

2016-03-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13952. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11903

[jira] [Commented] (SPARK-12818) Implement Bloom filter and count-min sketch in DataFrames

2016-03-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209262#comment-15209262 ] Reynold Xin commented on SPARK-12818: - I think we have implemented the common ones that make sense.

[jira] [Updated] (SPARK-14041) Locate possible duplicates and group them into subtasks

2016-03-23 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-14041: -- Description: Please go through the current example code and list possible duplicates. To find out all

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Attachment: Screenshot 2016-03-23 09.04.51.png The screenshot of KafkaRDD's serialization >

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Component/s: (was: Spark Core) > Serialization issue for KafkaRDD >

[jira] [Commented] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209226#comment-15209226 ] Apache Spark commented on SPARK-14105: -- User 'liyintang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14105: Assignee: Apache Spark > Serialization issue for KafkaRDD >

[jira] [Assigned] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14105: Assignee: (was: Apache Spark) > Serialization issue for KafkaRDD >

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-23 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209220#comment-15209220 ] Xin Wu commented on SPARK-13832: [~jfc...@us.ibm.com] I think when using grouping_id(), you need to pass

[jira] [Comment Edited] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

2016-03-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209211#comment-15209211 ] Sean Owen edited comment on SPARK-14101 at 3/23/16 9:30 PM: Java 7 or 8 is

[jira] [Commented] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

2016-03-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209211#comment-15209211 ] Sean Owen commented on SPARK-14101: --- It needs to be what {{java}} invokes. This was the error that

[jira] [Commented] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209175#comment-15209175 ] Steve Loughran commented on SPARK-14106: The solution I propose is for {{LoadedAppUI}} to return

[jira] [Reopened] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-03-23 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski reopened SPARK-13456: - In today's Spark 2.0.0-SNAPSHOT: {code} scala> :pa // Entering paste mode (ctrl-D to

[jira] [Commented] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209168#comment-15209168 ] Steve Loughran commented on SPARK-14106: Is this serious? Not if the probes returned by the

[jira] [Comment Edited] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209153#comment-15209153 ] Steve Loughran edited comment on SPARK-14106 at 3/23/16 8:56 PM: - This

[jira] [Commented] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-03-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209153#comment-15209153 ] Steve Loughran commented on SPARK-14106: This surfaced in logs of my yarn timeline integration

[jira] [Commented] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

2016-03-23 Thread Shankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209149#comment-15209149 ] Shankar commented on SPARK-14101: - You mean I have to use Java 7 explicitly? I have already installed

[jira] [Created] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-03-23 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-14106: -- Summary: history server application cache doesn't detect that apps are completed Key: SPARK-14106 URL: https://issues.apache.org/jira/browse/SPARK-14106 Project:

[jira] [Commented] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209134#comment-15209134 ] Sean Owen commented on SPARK-13710: --- Hm. The maven coordinates didn't change. I wonder if there is

[jira] [Updated] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-14105: --- Affects Version/s: 1.5.2 Component/s: Streaming Spark Core >

[jira] [Commented] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-23 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209127#comment-15209127 ] Michel Lemay commented on SPARK-13710: -- Looks like it was renamed to a different package. Therefore

[jira] [Created] (SPARK-14105) Serialization issue for KafkaRDD

2016-03-23 Thread Liyin Tang (JIRA)
Liyin Tang created SPARK-14105: -- Summary: Serialization issue for KafkaRDD Key: SPARK-14105 URL: https://issues.apache.org/jira/browse/SPARK-14105 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-14080) Improve the codegen for Filter

2016-03-23 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng closed SPARK-14080. --- Resolution: Won't Fix It would probably be cosmic issue and Java compiler could optimize this redundancy

[jira] [Commented] (SPARK-14104) All Python param setters should use the `_set` method.

2016-03-23 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209118#comment-15209118 ] Seth Hendrickson commented on SPARK-14104: -- I am planning to work on this. > All Python param

[jira] [Created] (SPARK-14104) All Python param setters should use the `_set` method.

2016-03-23 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-14104: Summary: All Python param setters should use the `_set` method. Key: SPARK-14104 URL: https://issues.apache.org/jira/browse/SPARK-14104 Project: Spark

[jira] [Commented] (SPARK-13710) Spark shell shows ERROR when launching on Windows

2016-03-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209114#comment-15209114 ] Sean Owen commented on SPARK-13710: --- I agree that's a likely explanation. Maybe the conflict only

[jira] [Commented] (SPARK-14102) Block `reset` command in SparkShell

2016-03-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209101#comment-15209101 ] Apache Spark commented on SPARK-14102: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-14102) Block `reset` command in SparkShell

2016-03-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14102. --- Resolution: Duplicate I think we decided to leave the stock Scala shell basically as-is here. I'm

  1   2   3   >