[jira] [Assigned] (SPARK-19390) Replace the unnecessary usages of hiveQlTable

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19390: Assignee: Apache Spark (was: Xiao Li) > Replace the unnecessary usages of hiveQlTable >

[jira] [Commented] (SPARK-19390) Replace the unnecessary usages of hiveQlTable

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843932#comment-15843932 ] Apache Spark commented on SPARK-19390: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19390) Replace the unnecessary usages of hiveQlTable

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19390: Assignee: Xiao Li (was: Apache Spark) > Replace the unnecessary usages of hiveQlTable >

[jira] [Created] (SPARK-19390) Replace the unnecessary usages of hiveQlTable

2017-01-27 Thread Xiao Li (JIRA)
Xiao Li created SPARK-19390: --- Summary: Replace the unnecessary usages of hiveQlTable Key: SPARK-19390 URL: https://issues.apache.org/jira/browse/SPARK-19390 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19377) Killed tasks should have the status as KILLED

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843902#comment-15843902 ] Apache Spark commented on SPARK-19377: -- User 'devaraj-kavali' has created a pull request for this

[jira] [Assigned] (SPARK-19377) Killed tasks should have the status as KILLED

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19377: Assignee: (was: Apache Spark) > Killed tasks should have the status as KILLED >

[jira] [Assigned] (SPARK-19377) Killed tasks should have the status as KILLED

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19377: Assignee: Apache Spark > Killed tasks should have the status as KILLED >

[jira] [Commented] (SPARK-19208) MultivariateOnlineSummarizer performance optimization

2017-01-27 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843884#comment-15843884 ] zhengruifeng commented on SPARK-19208: -- [~josephkb] I have considered of the analogy of Double

[jira] [Commented] (SPARK-19104) CompileException with Map and Case Class in Spark 2.1.0

2017-01-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843809#comment-15843809 ] Takeshi Yamamuro commented on SPARK-19104: -- I think this issue is related to SPARK-18891 >

[jira] [Commented] (SPARK-16636) Missing documentation for CalendarIntervalType type in sql-programming-guide.md

2017-01-27 Thread Artem Stasiuk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843801#comment-15843801 ] Artem Stasiuk commented on SPARK-16636: --- I'm going to take a look on that one > Missing

[jira] [Resolved] (SPARK-19359) partition path created by Hive should be deleted after rename a partition with upper-case

2017-01-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19359. - Resolution: Fixed Assignee: Song Jun Fix Version/s: 2.2.0 > partition path created by

[jira] [Commented] (SPARK-19352) Sorting issues on relatively big datasets

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843736#comment-15843736 ] Apache Spark commented on SPARK-19352: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19352) Sorting issues on relatively big datasets

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19352: Assignee: Apache Spark > Sorting issues on relatively big datasets >

[jira] [Assigned] (SPARK-19352) Sorting issues on relatively big datasets

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19352: Assignee: (was: Apache Spark) > Sorting issues on relatively big datasets >

[jira] [Commented] (SPARK-19389) Minor doc fixes, including Since tags in Python Params

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843699#comment-15843699 ] Apache Spark commented on SPARK-19389: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19389) Minor doc fixes, including Since tags in Python Params

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19389: Assignee: Apache Spark (was: Joseph K. Bradley) > Minor doc fixes, including Since tags

[jira] [Assigned] (SPARK-19389) Minor doc fixes, including Since tags in Python Params

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19389: Assignee: Joseph K. Bradley (was: Apache Spark) > Minor doc fixes, including Since tags

[jira] [Updated] (SPARK-19247) Improve ml word2vec save/load scalability

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19247: -- Component/s: ML > Improve ml word2vec save/load scalability >

[jira] [Updated] (SPARK-19294) improve LocalLDAModel save/load scaling for large models

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19294: -- Component/s: ML > improve LocalLDAModel save/load scaling for large models >

[jira] [Updated] (SPARK-19247) Improve ml word2vec save/load scalability

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19247: -- Summary: Improve ml word2vec save/load scalability (was: improve ml word2vec

[jira] [Updated] (SPARK-19247) Improve ml word2vec save/load scalability

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19247: -- Issue Type: Improvement (was: Bug) > Improve ml word2vec save/load scalability >

[jira] [Updated] (SPARK-19294) improve LocalLDAModel save/load scaling for large models

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19294: -- Summary: improve LocalLDAModel save/load scaling for large models (was: improve ml

[jira] [Updated] (SPARK-19294) improve LocalLDAModel save/load scaling for large models

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19294: -- Issue Type: Improvement (was: Bug) > improve LocalLDAModel save/load scaling for

[jira] [Created] (SPARK-19389) Minor doc fixes, including Since tags in Python Params

2017-01-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-19389: - Summary: Minor doc fixes, including Since tags in Python Params Key: SPARK-19389 URL: https://issues.apache.org/jira/browse/SPARK-19389 Project: Spark

[jira] [Resolved] (SPARK-19336) LinearSVC Python API

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-19336. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16694

[jira] [Commented] (SPARK-9478) Add sample weights to Random Forest

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843675#comment-15843675 ] Apache Spark commented on SPARK-9478: - User 'sethah' has created a pull request for this issue:

[jira] [Commented] (SPARK-19208) MultivariateOnlineSummarizer performance optimization

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843670#comment-15843670 ] Joseph K. Bradley commented on SPARK-19208: --- Thanks for writing out your ideas. Here are my

[jira] [Updated] (SPARK-19208) MultivariateOnlineSummarizer performance optimization

2017-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19208: -- Summary: MultivariateOnlineSummarizer performance optimization (was:

[jira] [Resolved] (SPARK-19365) Optimize RequestMessage serialization

2017-01-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19365. -- Resolution: Fixed Fix Version/s: 2.2.0 > Optimize RequestMessage serialization >

[jira] [Closed] (SPARK-19388) Reading an empty folder as parquet causes an Analysis Exception

2017-01-27 Thread Franklyn Dsouza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklyn Dsouza closed SPARK-19388. --- Resolution: Fixed > Reading an empty folder as parquet causes an Analysis Exception >

[jira] [Created] (SPARK-19388) Reading an empty folder as parquet causes an Analysis Exception

2017-01-27 Thread Franklyn Dsouza (JIRA)
Franklyn Dsouza created SPARK-19388: --- Summary: Reading an empty folder as parquet causes an Analysis Exception Key: SPARK-19388 URL: https://issues.apache.org/jira/browse/SPARK-19388 Project: Spark

[jira] [Commented] (SPARK-12240) FileNotFoundException: (Too many open files) when using multiple groupby on DataFrames

2017-01-27 Thread Shawn Lavelle (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843549#comment-15843549 ] Shawn Lavelle commented on SPARK-12240: --- Hi [~Wisely Chen] , Do you have any guidance on how high

[jira] [Commented] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Brendan Dwyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843493#comment-15843493 ] Brendan Dwyer commented on SPARK-19387: --- Should this be under [SPARK-15799]? > CRAN tests do not

[jira] [Resolved] (SPARK-19324) JVM stdout output is dropped in SparkR

2017-01-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19324. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1

[jira] [Assigned] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19387: Assignee: Felix Cheung (was: Apache Spark) > CRAN tests do not run with SparkR source

[jira] [Commented] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843347#comment-15843347 ] Apache Spark commented on SPARK-19387: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19387: Assignee: Apache Spark (was: Felix Cheung) > CRAN tests do not run with SparkR source

[jira] [Commented] (SPARK-19380) YARN - Dynamic allocation should use configured number of executors as max number of executors

2017-01-27 Thread Min Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843340#comment-15843340 ] Min Shen commented on SPARK-19380: -- [~srowen], What we want is to be able to also cap the number of

[jira] [Updated] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19387: - Description: It looks like sparkR.session() is not installing Spark - as a result, running R

[jira] [Created] (SPARK-19387) CRAN tests do not run with SparkR source package

2017-01-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19387: Summary: CRAN tests do not run with SparkR source package Key: SPARK-19387 URL: https://issues.apache.org/jira/browse/SPARK-19387 Project: Spark Issue Type:

[jira] [Created] (SPARK-19386) Bisecting k-means in SparkR documentation

2017-01-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19386: Summary: Bisecting k-means in SparkR documentation Key: SPARK-19386 URL: https://issues.apache.org/jira/browse/SPARK-19386 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-19333) Files out of compliance with ASF policy

2017-01-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19333: - Affects Version/s: 2.0.0 2.1.0 > Files out of compliance with ASF policy

[jira] [Updated] (SPARK-19333) Files out of compliance with ASF policy

2017-01-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19333: - Affects Version/s: 2.0.1 2.0.2 > Files out of compliance with ASF policy

[jira] [Resolved] (SPARK-19333) Files out of compliance with ASF policy

2017-01-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19333. -- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1

[jira] [Updated] (SPARK-19220) SSL redirect handler only redirects the server's root

2017-01-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-19220: --- Fix Version/s: 2.0.3 > SSL redirect handler only redirects the server's root >

[jira] [Commented] (SPARK-19369) SparkConf not getting properly initialized in PySpark 2.1.0

2017-01-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843199#comment-15843199 ] Marcelo Vanzin commented on SPARK-19369: Don't really know; but it doesn't take too long,

[jira] [Commented] (SPARK-19385) During canonicalization, `NOT(l, r)` should not expect such cases that l.hashcode > r.hashcode

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842993#comment-15842993 ] Apache Spark commented on SPARK-19385: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19385) During canonicalization, `NOT(l, r)` should not expect such cases that l.hashcode > r.hashcode

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19385: Assignee: (was: Apache Spark) > During canonicalization, `NOT(l, r)` should not

[jira] [Assigned] (SPARK-19385) During canonicalization, `NOT(l, r)` should not expect such cases that l.hashcode > r.hashcode

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19385: Assignee: Apache Spark > During canonicalization, `NOT(l, r)` should not expect such

[jira] [Created] (SPARK-19385) During canonicalization, `NOT(l, r)` should not expect such cases that l.hashcode > r.hashcode

2017-01-27 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-19385: - Summary: During canonicalization, `NOT(l, r)` should not expect such cases that l.hashcode > r.hashcode Key: SPARK-19385 URL: https://issues.apache.org/jira/browse/SPARK-19385

[jira] [Commented] (SPARK-19383) Spark Sql Fails with Cassandra 3.6 and later PER PARTITION LIMIT option

2017-01-27 Thread Brent Dorsey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842893#comment-15842893 ] Brent Dorsey commented on SPARK-19383: -- I agree it’s not Hive syntax.  It’s a power Cassandra CQL

[jira] [Resolved] (SPARK-19087) Numpy types fail to be casted to any other types

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19087. --- Resolution: Duplicate > Numpy types fail to be casted to any other types >

[jira] [Commented] (SPARK-19369) SparkConf not getting properly initialized in PySpark 2.1.0

2017-01-27 Thread Sidney Feiner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842726#comment-15842726 ] Sidney Feiner commented on SPARK-19369: --- Ok, thanks :) When is 2.1.1 estimated to be released? >

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2017-01-27 Thread Gregor Moehler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842701#comment-15842701 ] Gregor Moehler commented on SPARK-7768: --- +1 for UdtRegistration. Can we make it public for the next

[jira] [Commented] (SPARK-12606) Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ?

2017-01-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842630#comment-15842630 ] Hyukjin Kwon commented on SPARK-12606: -- Do you mind if I ask to fix the title and contents in more

[jira] [Commented] (SPARK-19384) forget unpersist input dataset in IsotonicRegression

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842629#comment-15842629 ] Apache Spark commented on SPARK-19384: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-19384) forget unpersist input dataset in IsotonicRegression

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19384: Assignee: Apache Spark > forget unpersist input dataset in IsotonicRegression >

[jira] [Assigned] (SPARK-19384) forget unpersist input dataset in IsotonicRegression

2017-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19384: Assignee: (was: Apache Spark) > forget unpersist input dataset in IsotonicRegression

[jira] [Created] (SPARK-19384) forget unpersist input dataset in IsotonicRegression

2017-01-27 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-19384: Summary: forget unpersist input dataset in IsotonicRegression Key: SPARK-19384 URL: https://issues.apache.org/jira/browse/SPARK-19384 Project: Spark Issue

[jira] [Commented] (SPARK-19087) Numpy types fail to be casted to any other types

2017-01-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842619#comment-15842619 ] Hyukjin Kwon commented on SPARK-19087: -- Is this a duplicate of SPARK-12157? > Numpy types fail to

[jira] [Commented] (SPARK-10908) ClassCastException in HadoopRDD.getJobConf

2017-01-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842610#comment-15842610 ] Hyukjin Kwon commented on SPARK-10908: -- Would you be possible to provide a self-reproducer? I am

[jira] [Commented] (SPARK-19368) Very bad performance in BlockMatrix.toIndexedRowMatrix()

2017-01-27 Thread Ohad Raviv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842581#comment-15842581 ] Ohad Raviv commented on SPARK-19368: well, not with the same elegant code. the main problem is that

[jira] [Commented] (SPARK-19383) Spark Sql Fails with Cassandra 3.6 and later PER PARTITION LIMIT option

2017-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842524#comment-15842524 ] Herman van Hovell commented on SPARK-19383: --- This is definitely not Hive/Spark syntax and

[jira] [Comment Edited] (SPARK-19383) Spark Sql Fails with Cassandra 3.6 and later PER PARTITION LIMIT option

2017-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842524#comment-15842524 ] Herman van Hovell edited comment on SPARK-19383 at 1/27/17 10:39 AM: -

[jira] [Closed] (SPARK-19383) Spark Sql Fails with Cassandra 3.6 and later PER PARTITION LIMIT option

2017-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-19383. - Resolution: Not A Problem > Spark Sql Fails with Cassandra 3.6 and later PER PARTITION

[jira] [Updated] (SPARK-19379) SparkAppHandle.getState not registering FAILED state upon Spark app failure in Local mode

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19379: -- Priority: Minor (was: Blocker) (Don't set Blocker) > SparkAppHandle.getState not registering FAILED

[jira] [Updated] (SPARK-19380) YARN - Dynamic allocation should use configured number of executors as max number of executors

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19380: -- Target Version/s: (was: 1.6.4) (Don't set target version) This doesn't sound like a problem. You're

[jira] [Commented] (SPARK-19383) Spark Sql Fails with Cassandra 3.6 and later PER PARTITION LIMIT option

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842488#comment-15842488 ] Sean Owen commented on SPARK-19383: --- This sounds like unsupported syntax. I'm not even sure "PER

[jira] [Updated] (SPARK-12970) Error in documentation on creating rows with schemas defined by structs

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12970: -- Assignee: Hyukjin Kwon > Error in documentation on creating rows with schemas defined by structs >

[jira] [Resolved] (SPARK-12970) Error in documentation on creating rows with schemas defined by structs

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12970. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16703

[jira] [Updated] (SPARK-19304) Kinesis checkpoint recovery is 10x slow

2017-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19304: -- Issue Type: Improvement (was: Bug) Sounds reasonable. Please go ahead with a PR. > Kinesis

[jira] [Updated] (SPARK-19104) CompileException with Map and Case Class in Spark 2.1.0

2017-01-27 Thread Nils Grabbert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nils Grabbert updated SPARK-19104: -- Component/s: Optimizer > CompileException with Map and Case Class in Spark 2.1.0 >