[jira] [Assigned] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14745: Assignee: (was: Apache Spark) > CEP support in Spark Streaming >

[jira] [Assigned] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14745: Assignee: Apache Spark > CEP support in Spark Streaming > --

[jira] [Commented] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249289#comment-15249289 ] Apache Spark commented on SPARK-14745: -- User 'agsachin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14639. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12509

[jira] [Updated] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14639: --- Assignee: Dongjoon Hyun > Add `bround` function in Python/R. > -- >

[jira] [Comment Edited] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249261#comment-15249261 ] Mario Briggs edited comment on SPARK-14745 at 4/20/16 5:18 AM: --- Document

[jira] [Updated] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-14745: - Attachment: SparkStreamingCEP.pdf Examples, Features and possible API > CEP support in Spark

[jira] [Created] (SPARK-14745) CEP support in Spark Streaming

2016-04-19 Thread Mario Briggs (JIRA)
Mario Briggs created SPARK-14745: Summary: CEP support in Spark Streaming Key: SPARK-14745 URL: https://issues.apache.org/jira/browse/SPARK-14745 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-14600) Push predicates through Expand

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14600. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12496

[jira] [Updated] (SPARK-14704) create accumulators in TaskMetrics

2016-04-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14704: Issue Type: Sub-task (was: Improvement) Parent: SPARK-14626 > create accumulators in

[jira] [Resolved] (SPARK-14704) create accumulators in TaskMetrics

2016-04-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14704. - Resolution: Fixed Fix Version/s: 2.0.0 > create accumulators in TaskMetrics >

[jira] [Resolved] (SPARK-13419) SubquerySuite should use checkAnswer rather than ScalaTest's assertResult

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13419. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12269

[jira] [Created] (SPARK-14744) Put examples packaging on a diet

2016-04-19 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-14744: -- Summary: Put examples packaging on a diet Key: SPARK-14744 URL: https://issues.apache.org/jira/browse/SPARK-14744 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-14743) Improve delegation token handling in secure clusters

2016-04-19 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-14743: -- Summary: Improve delegation token handling in secure clusters Key: SPARK-14743 URL: https://issues.apache.org/jira/browse/SPARK-14743 Project: Spark

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS

2016-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-14521: - Summary: StackOverflowError in Kryo when executing TPC-DS (was: StackOverflowError in

[jira] [Resolved] (SPARK-13905) Change signature of as.data.frame() to be consistent with the R base package

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13905. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Closed] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2016-04-19 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov closed SPARK-8327. -- Resolution: Not A Problem > Ganglia failed to start while starting standalone on EC 2

[jira] [Created] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-04-19 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-14742: Summary: Redirect spark-ec2 doc to new location Key: SPARK-14742 URL: https://issues.apache.org/jira/browse/SPARK-14742 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2016-04-19 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249144#comment-15249144 ] Nicholas Chammas commented on SPARK-8327: - [~vvladymyrov] - Is this still an issue? If so, I

[jira] [Commented] (SPARK-6527) sc.binaryFiles can not access files on s3

2016-04-19 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249141#comment-15249141 ] Nicholas Chammas commented on SPARK-6527: - Did the s3a suggestion work? If not, did anybody file

[jira] [Comment Edited] (SPARK-6527) sc.binaryFiles can not access files on s3

2016-04-19 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249141#comment-15249141 ] Nicholas Chammas edited comment on SPARK-6527 at 4/20/16 2:27 AM: -- Did

[jira] [Assigned] (SPARK-14741) Streaming from partitioned directory structure captures unintended partition columns

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14741: Assignee: Tathagata Das (was: Apache Spark) > Streaming from partitioned directory

[jira] [Assigned] (SPARK-14741) Streaming from partitioned directory structure captures unintended partition columns

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14741: Assignee: Apache Spark (was: Tathagata Das) > Streaming from partitioned directory

[jira] [Commented] (SPARK-14741) Streaming from partitioned directory structure captures unintended partition columns

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249139#comment-15249139 ] Apache Spark commented on SPARK-14741: -- User 'tdas' has created a pull request for this issue:

[jira] [Created] (SPARK-14741) Streaming from partitioned directory structure captures unintended partition columns

2016-04-19 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-14741: - Summary: Streaming from partitioned directory structure captures unintended partition columns Key: SPARK-14741 URL: https://issues.apache.org/jira/browse/SPARK-14741

[jira] [Commented] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2016-04-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249109#comment-15249109 ] Sun Rui commented on SPARK-12148: - [~felixcheung] Go ahead with this:) > SparkR: rename DataFrame to

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249084#comment-15249084 ] Apache Spark commented on SPARK-14739: -- User 'arashpa' has created a pull request for this issue:

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Vishnu Prasad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249080#comment-15249080 ] Vishnu Prasad commented on SPARK-14739: --- I've merged your PR with your test fixes. Thank you >

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Arash Parsa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249078#comment-15249078 ] Arash Parsa commented on SPARK-14739: - Sorry wasn't able to pull from your branch. I submitted a new

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249077#comment-15249077 ] Apache Spark commented on SPARK-14739: -- User 'arashpa' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14521: Assignee: Apache Spark > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Assigned] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14521: Assignee: (was: Apache Spark) > StackOverflowError in Kryo when executing TPC-DS

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249067#comment-15249067 ] Apache Spark commented on SPARK-14521: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249061#comment-15249061 ] Maciej Szymkiewicz commented on SPARK-14739: I extracted relevant test fixes and made PR

[jira] [Commented] (SPARK-14571) Log instrumentation in ALS

2016-04-19 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249058#comment-15249058 ] Timothy Hunter commented on SPARK-14571: Yes, please feel free to take this task. Thanks! >

[jira] [Updated] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-14740: - Description: If you tune hyperparameters using a CrossValidator object in PySpark, you may not

[jira] [Updated] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-14740: - Description: If you tune hyperparameters using a CrossValidator object in PySpark, you may not

[jira] [Updated] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-14740: - Description: If you tune hyperparameters using a CrossValidator object in PySpark, you may not

[jira] [Updated] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-14740: - Description: If you tune hyperparameters using a CrossValidator object in PySpark, you may not

[jira] [Updated] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-14740: - Description: If you tune hyperparameters using a CrossValidator object in PySpark, you may not

[jira] [Created] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-19 Thread Paul Shearer (JIRA)
Paul Shearer created SPARK-14740: Summary: CrossValidatorModel.bestModel does not include hyper-parameters Key: SPARK-14740 URL: https://issues.apache.org/jira/browse/SPARK-14740 Project: Spark

[jira] [Comment Edited] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249053#comment-15249053 ] Maciej Szymkiewicz edited comment on SPARK-14739 at 4/20/16 12:47 AM:

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249053#comment-15249053 ] Maciej Szymkiewicz commented on SPARK-14739: Sure, but your latest PR still doesn't resolve

[jira] [Resolved] (SPARK-13929) Use Scala reflection for UDFs

2016-04-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13929. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12149

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249036#comment-15249036 ] Apache Spark commented on SPARK-14739: -- User 'vishnu667' has created a pull request for this issue:

[jira] [Commented] (SPARK-14735) PySpark HashingTF hashAlgorithm param + docs

2016-04-19 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249034#comment-15249034 ] zhengruifeng commented on SPARK-14735: -- I can work on this after SPARK-10574 is resolved > PySpark

[jira] [Resolved] (SPARK-14407) Hide HadoopFsRelation related data source API to execution package

2016-04-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14407. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12361

[jira] [Comment Edited] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249012#comment-15249012 ] Rajesh Balamohan edited comment on SPARK-14521 at 4/20/16 12:31 AM:

[jira] [Resolved] (SPARK-14717) Scala, Python APIs for Dataset.unpersist differ in default blocking value

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14717. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12507

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Arash Parsa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249028#comment-15249028 ] Arash Parsa commented on SPARK-14739: - [~zero323] sure I can adjust my PR (move the tests), but since

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249020#comment-15249020 ] Apache Spark commented on SPARK-14739: -- User 'vishnu667' has created a pull request for this issue:

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249012#comment-15249012 ] Rajesh Balamohan commented on SPARK-14521: -- Update: - By default, spark-thrift server disables

[jira] [Updated] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14639: -- Component/s: SparkR PySpark > Add `bround` function in Python/R. >

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248994#comment-15248994 ] Maciej Szymkiewicz commented on SPARK-14739: This solves only small part of the problem.

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248995#comment-15248995 ] Apache Spark commented on SPARK-14739: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Arash Parsa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248973#comment-15248973 ] Arash Parsa commented on SPARK-14739: - Thanks for posting the ticket on Jira, I created the PR here:

[jira] [Assigned] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14739: Assignee: (was: Apache Spark) > Vectors.parse doesn't handle dense vectors of size 0

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248972#comment-15248972 ] Apache Spark commented on SPARK-14739: -- User 'arashpa' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14739: Assignee: Apache Spark > Vectors.parse doesn't handle dense vectors of size 0 and sparse

[jira] [Updated] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14719: --- Target Version/s: (was: 2.0.0) > WriteAheadLogBasedBlockHandler should ignore BlockManager put

[jira] [Resolved] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14719. Resolution: Won't Fix > WriteAheadLogBasedBlockHandler should ignore BlockManager put errors >

[jira] [Updated] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14719: --- Fix Version/s: (was: 2.0.0) > WriteAheadLogBasedBlockHandler should ignore BlockManager put

[jira] [Reopened] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-14719: Reverted this patch and am marking as "won't fix" for now. See discussion on PR for explanation of

[jira] [Created] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-14739: -- Summary: Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices Key: SPARK-14739 URL:

[jira] [Commented] (SPARK-14571) Log instrumentation in ALS

2016-04-19 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248859#comment-15248859 ] Miao Wang commented on SPARK-14571: --- Since nobody takes this one, can I learn it and give it a try?

[jira] [Resolved] (SPARK-12224) R support for JDBC source

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12224. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12224) R support for JDBC source

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12224: -- Assignee: Felix Cheung (was: Apache Spark) > R support for JDBC source >

[jira] [Resolved] (SPARK-14733) Allow custom timing control in microbenchmarks

2016-04-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14733. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Allow custom

[jira] [Commented] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248848#comment-15248848 ] Apache Spark commented on SPARK-14639: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14639: Assignee: (was: Apache Spark) > Add `bround` function in Python/R. >

[jira] [Assigned] (SPARK-14639) Add `bround` function in Python/R.

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14639: Assignee: Apache Spark > Add `bround` function in Python/R. >

[jira] [Commented] (SPARK-14478) Should StandardScaler use biased variance to scale?

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248825#comment-15248825 ] Joseph K. Bradley commented on SPARK-14478: --- Adding a param seems reasonable, though probably

[jira] [Commented] (SPARK-8884) 1-sample Anderson-Darling Goodness-of-Fit test

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248822#comment-15248822 ] Joseph K. Bradley commented on SPARK-8884: -- I'm not sure this will make 2.0, so I'm changing the

[jira] [Updated] (SPARK-8884) 1-sample Anderson-Darling Goodness-of-Fit test

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8884: - Target Version/s: 2.1.0 (was: 2.0.0) > 1-sample Anderson-Darling Goodness-of-Fit test >

[jira] [Updated] (SPARK-10388) Public dataset loader interface

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10388: -- Target Version/s: 2.1.0 (was: 2.0.0) > Public dataset loader interface >

[jira] [Resolved] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-4226. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12306

[jira] [Commented] (SPARK-14738) Separate Docker Integration Tests from main spark build

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248788#comment-15248788 ] Apache Spark commented on SPARK-14738: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14738) Separate Docker Integration Tests from main spark build

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14738: Assignee: (was: Apache Spark) > Separate Docker Integration Tests from main spark

[jira] [Assigned] (SPARK-14738) Separate Docker Integration Tests from main spark build

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14738: Assignee: Apache Spark > Separate Docker Integration Tests from main spark build >

[jira] [Created] (SPARK-14738) Separate Docker Integration Tests from main spark build

2016-04-19 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-14738: --- Summary: Separate Docker Integration Tests from main spark build Key: SPARK-14738 URL: https://issues.apache.org/jira/browse/SPARK-14738 Project: Spark

[jira] [Updated] (SPARK-14717) Scala, Python APIs for Dataset.unpersist differ in default blocking value

2016-04-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14717: --- Assignee: Felix Cheung > Scala, Python APIs for Dataset.unpersist differ in default blocking value >

[jira] [Assigned] (SPARK-14717) Scala, Python APIs for Dataset.unpersist differ in default blocking value

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14717: Assignee: Apache Spark > Scala, Python APIs for Dataset.unpersist differ in default

[jira] [Assigned] (SPARK-14717) Scala, Python APIs for Dataset.unpersist differ in default blocking value

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14717: Assignee: (was: Apache Spark) > Scala, Python APIs for Dataset.unpersist differ in

[jira] [Commented] (SPARK-14717) Scala, Python APIs for Dataset.unpersist differ in default blocking value

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248721#comment-15248721 ] Apache Spark commented on SPARK-14717: -- User 'felixcheung' has created a pull request for this

[jira] [Resolved] (SPARK-14042) Add support for custom coalescers

2016-04-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14042. - Resolution: Fixed Assignee: Nezih Yigitbasi Fix Version/s: 2.0.0 > Add support

[jira] [Resolved] (SPARK-14656) Benchmark.getPorcessorName() always return "Unknown processor" on Linux

2016-04-19 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-14656. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.0.0 >

[jira] [Assigned] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14736: Assignee: (was: Apache Spark) > Deadlock in registering applications while the Master

[jira] [Assigned] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14736: Assignee: Apache Spark > Deadlock in registering applications while the Master is in the

[jira] [Commented] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

2016-04-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248693#comment-15248693 ] Apache Spark commented on SPARK-14736: -- User 'nirandaperera' has created a pull request for this

[jira] [Created] (SPARK-14737) Kafka Brokers are down - spark stream should retry

2016-04-19 Thread Faisal (JIRA)
Faisal created SPARK-14737: -- Summary: Kafka Brokers are down - spark stream should retry Key: SPARK-14737 URL: https://issues.apache.org/jira/browse/SPARK-14737 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-10574) HashingTF should use MurmurHash3

2016-04-19 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248627#comment-15248627 ] Simeon Simeonov edited comment on SPARK-10574 at 4/19/16 9:05 PM: --

[jira] [Commented] (SPARK-10574) HashingTF should use MurmurHash3

2016-04-19 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248627#comment-15248627 ] Simeon Simeonov commented on SPARK-10574: - [~josephkb] I agree that it would be an improvement.

[jira] [Updated] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

2016-04-19 Thread niranda perera (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niranda perera updated SPARK-14736: --- Affects Version/s: 1.5.0 1.6.0 > Deadlock in registering applications

[jira] [Created] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

2016-04-19 Thread niranda perera (JIRA)
niranda perera created SPARK-14736: -- Summary: Deadlock in registering applications while the Master is in the RECOVERING mode Key: SPARK-14736 URL: https://issues.apache.org/jira/browse/SPARK-14736

[jira] [Created] (SPARK-14735) PySpark HashingTF hashAlgorithm param + docs

2016-04-19 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14735: - Summary: PySpark HashingTF hashAlgorithm param + docs Key: SPARK-14735 URL: https://issues.apache.org/jira/browse/SPARK-14735 Project: Spark Issue

[jira] [Updated] (SPARK-10574) HashingTF should use MurmurHash3

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10574: -- Shepherd: Joseph K. Bradley > HashingTF should use MurmurHash3 >

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

2016-04-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248557#comment-15248557 ] Felix Cheung commented on SPARK-14692: -- is Sys.getenv("SPARK_HOME") valid? > Error While Setting

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13448: -- Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13448: -- Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can

[jira] [Commented] (SPARK-10574) HashingTF should use MurmurHash3

2016-04-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248514#comment-15248514 ] Joseph K. Bradley commented on SPARK-10574: --- Copying comments from [~simeons] from the PR:

  1   2   3   >