[jira] [Resolved] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

2015-07-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9081. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7523

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Assignee: Xiangrui Meng Add @since tags to mllib.classification

[jira] [Commented] (SPARK-8641) Native Spark Window Functions

2015-07-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635205#comment-14635205 ] Herman van Hovell commented on SPARK-8641: -- We need to wait for the new UDAF

[jira] [Updated] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-21 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Attachment: debug-log-spark-1.5-fail spark-submit-log-1.5.0-fail spark-submit

[jira] [Resolved] (SPARK-9193) Avoid assigning tasks to executors under killing

2015-07-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-9193. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7528

[jira] [Commented] (SPARK-9220) Streaming K-means implementation exception while processing windowed stream

2015-07-21 Thread Iaroslav Zeigerman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635240#comment-14635240 ] Iaroslav Zeigerman commented on SPARK-9220: --- Looks like the issue reproduces

[jira] [Resolved] (SPARK-9168) Add nanvl expression

2015-07-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9168. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7523

[jira] [Created] (SPARK-9221) Support IntervalType in Range Frame

2015-07-21 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-9221: Summary: Support IntervalType in Range Frame Key: SPARK-9221 URL: https://issues.apache.org/jira/browse/SPARK-9221 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Assignee: Patrick Baier (was: Xiangrui Meng) Add @since tags to mllib.classification

[jira] [Updated] (SPARK-8915) Add @since tags to mllib.classification

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8915: - Shepherd: DB Tsai Add @since tags to mllib.classification

[jira] [Updated] (SPARK-8922) Add @since tags to mllib.evaluation

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8922: - Shepherd: Shuo Xiang Add @since tags to mllib.evaluation ---

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635300#comment-14635300 ] Shivaram Venkataraman commented on SPARK-9121: -- Yeah we can add

[jira] [Updated] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

2015-07-21 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-9210: --- Description: When a result column in {{SELECT ... GROUP BY}} is neither one of the {{GROUP

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

2015-07-21 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636180#comment-14636180 ] Joseph Batchik commented on SPARK-8668: --- Does this look like what you were thinking?

[jira] [Created] (SPARK-9241) Supporting multiple DISTINCT columns

2015-07-21 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9241: --- Summary: Supporting multiple DISTINCT columns Key: SPARK-9241 URL: https://issues.apache.org/jira/browse/SPARK-9241 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-07-21 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9242: --- Summary: Audit both built-in aggregate function and UDAF interface before 1.5.0 release Key: SPARK-9242 URL: https://issues.apache.org/jira/browse/SPARK-9242 Project: Spark

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636324#comment-14636324 ] Reynold Xin commented on SPARK-8668: Yes - the only thing is you cannot split blindly

[jira] [Created] (SPARK-9237) Added Top N Column Values for DataFrames

2015-07-21 Thread Ted Malaska (JIRA)
Ted Malaska created SPARK-9237: -- Summary: Added Top N Column Values for DataFrames Key: SPARK-9237 URL: https://issues.apache.org/jira/browse/SPARK-9237 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-3056) Sort-based Aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3056: --- Assignee: Apache Spark Sort-based Aggregation --

[jira] [Commented] (SPARK-3947) Support UDAF

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636199#comment-14636199 ] Apache Spark commented on SPARK-3947: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-3056) Sort-based Aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636200#comment-14636200 ] Apache Spark commented on SPARK-3056: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-4367) Partial aggregation support the DISTINCT aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636198#comment-14636198 ] Apache Spark commented on SPARK-4367: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-4367) Partial aggregation support the DISTINCT aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4367: --- Assignee: Apache Spark Partial aggregation support the DISTINCT aggregation

[jira] [Commented] (SPARK-4233) Simplify the Aggregation Function implementation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636197#comment-14636197 ] Apache Spark commented on SPARK-4233: - User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9243: - Component/s: Documentation Update crosstab doc for pairs that have no occurrences

[jira] [Created] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9243: Summary: Update crosstab doc for pairs that have no occurrences Key: SPARK-9243 URL: https://issues.apache.org/jira/browse/SPARK-9243 Project: Spark Issue

[jira] [Resolved] (SPARK-8915) Add @since tags to mllib.classification

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8915. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7371

[jira] [Closed] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9036. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0

[jira] [Closed] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5423. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 ExternalAppendOnlyMap

[jira] [Resolved] (SPARK-9154) Implement code generation for StringFormat

2015-07-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9154. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7546

[jira] [Commented] (SPARK-8231) complex function: array_contains

2015-07-21 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635425#comment-14635425 ] Pedro Rodriguez commented on SPARK-8231: I can give this one a shot since I

[jira] [Updated] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9122: - Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Remaining

[jira] [Updated] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8481: - Assignee: Dariusz Kobylarz GaussianMixtureModel predict accepting single vector

[jira] [Commented] (SPARK-3157) Avoid duplicated stats in DecisionTree extractLeftRightNodeAggregates

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635469#comment-14635469 ] Joseph K. Bradley commented on SPARK-3157: -- Good point, I'll close this. Thanks!

[jira] [Assigned] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9224: --- Assignee: (was: Apache Spark) OnlineLDAOptimizer Performance Improvements

[jira] [Assigned] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9224: --- Assignee: Apache Spark OnlineLDAOptimizer Performance Improvements

[jira] [Commented] (SPARK-9154) Implement code generation for StringFormat

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635510#comment-14635510 ] Apache Spark commented on SPARK-9154: - User 'marmbrus' has created a pull request for

[jira] [Closed] (SPARK-9128) Get outerclasses and objects at the same time in ClosureCleaner

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9128. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Get outerclasses and

[jira] [Updated] (SPARK-7171) Allow for more flexible use of metric sources

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7171: - Assignee: Jacek Lewandowski Allow for more flexible use of metric sources

[jira] [Closed] (SPARK-7171) Allow for more flexible use of metric sources

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7171. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Allow for more flexible

[jira] [Resolved] (SPARK-5989) Model import/export for LDAModel

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5989. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6948

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635460#comment-14635460 ] Reynold Xin commented on SPARK-9183: Actually even that error message is bad - we

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

2015-07-21 Thread Robert Beauchemin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635480#comment-14635480 ] Robert Beauchemin commented on SPARK-9078: -- That was quick. Not sure that I have

[jira] [Assigned] (SPARK-9024) Unsafe HashJoin

2015-07-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9024: - Assignee: Davies Liu Unsafe HashJoin --- Key: SPARK-9024

[jira] [Commented] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635424#comment-14635424 ] Manoj Kumar commented on SPARK-7105: Hi, Are you still working on this? Support

[jira] [Created] (SPARK-9223) Support model save/load in Python's LDA

2015-07-21 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-9223: -- Summary: Support model save/load in Python's LDA Key: SPARK-9223 URL: https://issues.apache.org/jira/browse/SPARK-9223 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

2015-07-21 Thread Robert Beauchemin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635459#comment-14635459 ] Robert Beauchemin commented on SPARK-9078: -- Great, I didn't realize that

[jira] [Created] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

2015-07-21 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9224: Summary: OnlineLDAOptimizer Performance Improvements Key: SPARK-9224 URL: https://issues.apache.org/jira/browse/SPARK-9224 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-21 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9225: Summary: LDASuite needs unit tests for empty documents Key: SPARK-9225 URL: https://issues.apache.org/jira/browse/SPARK-9225 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

2015-07-21 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9224: - Priority: Major (was: Critical) Issue Type: Improvement (was: Bug) OnlineLDAOptimizer

[jira] [Closed] (SPARK-4598) Paginate stage page to avoid OOM with 100,000 tasks

2015-07-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4598. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Target Version/s:

[jira] [Updated] (SPARK-9165) Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

2015-07-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9165: Shepherd: Michael Armbrust Implement code generation for CreateArray, CreateStruct, and

[jira] [Created] (SPARK-9222) Make class instantiation variables in DistributedLDAModel [private] clustering

2015-07-21 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-9222: -- Summary: Make class instantiation variables in DistributedLDAModel [private] clustering Key: SPARK-9222 URL: https://issues.apache.org/jira/browse/SPARK-9222 Project:

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635461#comment-14635461 ] Reynold Xin commented on SPARK-9078: Want to submit a pull request? :) Use of

[jira] [Reopened] (SPARK-9154) Implement code generation for StringFormat

2015-07-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-9154: - Reopening since this broke the build. Implement code generation for StringFormat

[jira] [Commented] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635454#comment-14635454 ] Joseph K. Bradley commented on SPARK-9122: -- OK thank you! spark.mllib

[jira] [Resolved] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8481. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6906

[jira] [Closed] (SPARK-3157) Avoid duplicated stats in DecisionTree extractLeftRightNodeAggregates

2015-07-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-3157. Resolution: Fixed Assignee: Joseph K. Bradley Fix Version/s: 1.2.0 Avoid

[jira] [Commented] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635496#comment-14635496 ] Apache Spark commented on SPARK-9224: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-9238) two extra useless entries for bytesOfCodePointInUTF8

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636206#comment-14636206 ] Apache Spark commented on SPARK-9238: - User 'zhichao-li' has created a pull request

[jira] [Created] (SPARK-9238) two extra useless entries for bytesOfCodePointInUTF8

2015-07-21 Thread zhichao-li (JIRA)
zhichao-li created SPARK-9238: - Summary: two extra useless entries for bytesOfCodePointInUTF8 Key: SPARK-9238 URL: https://issues.apache.org/jira/browse/SPARK-9238 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9240) Hybrid aggregate operator

2015-07-21 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9240: --- Summary: Hybrid aggregate operator Key: SPARK-9240 URL: https://issues.apache.org/jira/browse/SPARK-9240 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9240: Summary: Hybrid aggregate operator using unsafe row (was: Hybrid aggregate operator) Hybrid aggregate

[jira] [Created] (SPARK-9244) Increase some default memory limits

2015-07-21 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-9244: Summary: Increase some default memory limits Key: SPARK-9244 URL: https://issues.apache.org/jira/browse/SPARK-9244 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636060#comment-14636060 ] Shivaram Venkataraman commented on SPARK-9053: -- Yeah - there are a bunch of

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

2015-07-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-8641: - Description: *Rationale* The window operator currently uses Hive UDAFs for all

[jira] [Updated] (SPARK-7368) add QR decomposition for RowMatrix

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7368: - Shepherd: Xiangrui Meng add QR decomposition for RowMatrix --

[jira] [Updated] (SPARK-7368) add QR decomposition for RowMatrix

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7368: - Assignee: yuhao yang add QR decomposition for RowMatrix --

[jira] [Updated] (SPARK-7368) add QR decomposition for RowMatrix

2015-07-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7368: - Issue Type: New Feature (was: Improvement) add QR decomposition for RowMatrix

[jira] [Created] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-21 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9239: --- Summary: HiveUDAF support for AggregateFunction2 Key: SPARK-9239 URL: https://issues.apache.org/jira/browse/SPARK-9239 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636321#comment-14636321 ] Apache Spark commented on SPARK-9053: - User 'yu-iskw' has created a pull request for

[jira] [Assigned] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9053: --- Assignee: (was: Apache Spark) Fix spaces around parens, infix operators etc.

[jira] [Resolved] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9121. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9121: - Assignee: Yu Ishikawa Get rid of the warnings about `no visible global function

[jira] [Created] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

2015-07-21 Thread Vitalii Slobodianyk (JIRA)
Vitalii Slobodianyk created SPARK-9236: -- Summary: Left Outer Join with empty JavaPairRDD returns empty RDD Key: SPARK-9236 URL: https://issues.apache.org/jira/browse/SPARK-9236 Project: Spark

[jira] [Assigned] (SPARK-9238) two extra useless entries for bytesOfCodePointInUTF8

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9238: --- Assignee: (was: Apache Spark) two extra useless entries for bytesOfCodePointInUTF8

[jira] [Assigned] (SPARK-9238) two extra useless entries for bytesOfCodePointInUTF8

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9238: --- Assignee: Apache Spark two extra useless entries for bytesOfCodePointInUTF8

[jira] [Commented] (SPARK-8232) complex function: sort_array

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636146#comment-14636146 ] Apache Spark commented on SPARK-8232: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8232) complex function: sort_array

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8232: --- Assignee: Apache Spark (was: Cheng Hao) complex function: sort_array

[jira] [Assigned] (SPARK-8232) complex function: sort_array

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8232: --- Assignee: Cheng Hao (was: Apache Spark) complex function: sort_array

[jira] [Updated] (SPARK-4366) Aggregation Improvement

2015-07-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4366: Priority: Critical (was: Major) Aggregation Improvement --- Key:

[jira] [Assigned] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9053: --- Assignee: Apache Spark Fix spaces around parens, infix operators etc.

[jira] [Commented] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

2015-07-21 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636115#comment-14636115 ] Simeon Simeonov commented on SPARK-9210: Standalone test demonstrating the problem

[jira] [Assigned] (SPARK-4367) Partial aggregation support the DISTINCT aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4367: --- Assignee: (was: Apache Spark) Partial aggregation support the DISTINCT aggregation

[jira] [Assigned] (SPARK-3056) Sort-based Aggregation

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3056: --- Assignee: (was: Apache Spark) Sort-based Aggregation --

[jira] [Commented] (SPARK-9227) Add option to set logging level in Spark Context Constructor

2015-07-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635655#comment-14635655 ] Sean Owen commented on SPARK-9227: -- Why? there's already logging framework APIs for this,

[jira] [Created] (SPARK-9227) Add option to set logging level in Spark Context Constructor

2015-07-21 Thread JIRA
Auberon López created SPARK-9227: Summary: Add option to set logging level in Spark Context Constructor Key: SPARK-9227 URL: https://issues.apache.org/jira/browse/SPARK-9227 Project: Spark

[jira] [Commented] (SPARK-9131) UDFs change data values

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635690#comment-14635690 ] Reynold Xin commented on SPARK-9131: I see. Even if we have a relatively large

[jira] [Created] (SPARK-9229) pyspark yarn-cluster PYSPARK_PYTHON not set

2015-07-21 Thread Eric Kimbrel (JIRA)
Eric Kimbrel created SPARK-9229: --- Summary: pyspark yarn-cluster PYSPARK_PYTHON not set Key: SPARK-9229 URL: https://issues.apache.org/jira/browse/SPARK-9229 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9229) pyspark yarn-cluster PYSPARK_PYTHON not set

2015-07-21 Thread Eric Kimbrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Kimbrel updated SPARK-9229: Environment: centos Cloudera 5.4.1 based off Apache Hadoop 2.6.0, using spark 1.5.0 built for

[jira] [Resolved] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

2015-07-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8357. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7560

[jira] [Created] (SPARK-9226) Change default log level to WARN in python REPL

2015-07-21 Thread JIRA
Auberon López created SPARK-9226: Summary: Change default log level to WARN in python REPL Key: SPARK-9226 URL: https://issues.apache.org/jira/browse/SPARK-9226 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9154) Implement code generation for StringFormat

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635618#comment-14635618 ] Apache Spark commented on SPARK-9154: - User 'tarekauel' has created a pull request for

[jira] [Commented] (SPARK-9227) Add option to set logging level in Spark Context Constructor

2015-07-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635665#comment-14635665 ] Marcelo Vanzin commented on SPARK-9227: --- A programmatic API for this is overkill.

[jira] [Created] (SPARK-9228) Adjust Spark SQL Configs

2015-07-21 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9228: --- Summary: Adjust Spark SQL Configs Key: SPARK-9228 URL: https://issues.apache.org/jira/browse/SPARK-9228 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635597#comment-14635597 ] Michael Armbrust commented on SPARK-8007: - I'm going to propose that we don't

[jira] [Updated] (SPARK-9213) Improve regular expression performance (via joni)

2015-07-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9213: --- Description: I'm creating an umbrella ticket to improve regular expression performance for string

[jira] [Commented] (SPARK-8103) DAGScheduler should not launch multiple concurrent attempts for one stage on fetch failures

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635663#comment-14635663 ] Apache Spark commented on SPARK-8103: - User 'markhamstra' has created a pull request

[jira] [Created] (SPARK-9233) Enable code-gen in window function unit tests

2015-07-21 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9233: --- Summary: Enable code-gen in window function unit tests Key: SPARK-9233 URL: https://issues.apache.org/jira/browse/SPARK-9233 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9222) Make class instantiation variables in DistributedLDAModel [private] clustering

2015-07-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635729#comment-14635729 ] Apache Spark commented on SPARK-9222: - User 'MechCoder' has created a pull request for

  1   2   3   >