[jira] [Created] (SPARK-9355) Remove Internal.get generic getter call in columnar cache code

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9355: -- Summary: Remove Internal.get generic getter call in columnar cache code Key: SPARK-9355 URL: https://issues.apache.org/jira/browse/SPARK-9355 Project: Spark Iss

[jira] [Created] (SPARK-9354) Remove Internal.get generic getter call in Hive integration code

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9354: -- Summary: Remove Internal.get generic getter call in Hive integration code Key: SPARK-9354 URL: https://issues.apache.org/jira/browse/SPARK-9354 Project: Spark I

[jira] [Resolved] (SPARK-9350) Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9350. Resolution: Fixed Fix Version/s: 1.5.0 > Introduce an InternalRow generic getter that require

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-07-25 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641864#comment-14641864 ] Yanbo Liang commented on SPARK-8518: [~meihuawu] Got it, I agree to start with expone

[jira] [Assigned] (SPARK-9353) Standalone scheduling memory requirement incorrect if cores per executor is not set

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9353: --- Assignee: Andrew Or (was: Apache Spark) > Standalone scheduling memory requirement incorrect

[jira] [Commented] (SPARK-9353) Standalone scheduling memory requirement incorrect if cores per executor is not set

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641856#comment-14641856 ] Apache Spark commented on SPARK-9353: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-9353) Standalone scheduling memory requirement incorrect if cores per executor is not set

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9353: --- Assignee: Apache Spark (was: Andrew Or) > Standalone scheduling memory requirement incorrect

[jira] [Assigned] (SPARK-9352) Add tests for standalone scheduling code

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9352: --- Assignee: Andrew Or (was: Apache Spark) > Add tests for standalone scheduling code > ---

[jira] [Assigned] (SPARK-9352) Add tests for standalone scheduling code

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9352: --- Assignee: Apache Spark (was: Andrew Or) > Add tests for standalone scheduling code > ---

[jira] [Commented] (SPARK-9352) Add tests for standalone scheduling code

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641855#comment-14641855 ] Apache Spark commented on SPARK-9352: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-9353) Standalone scheduling memory requirement incorrect if cores per executor is not set

2015-07-25 Thread Andrew Or (JIRA)
Andrew Or created SPARK-9353: Summary: Standalone scheduling memory requirement incorrect if cores per executor is not set Key: SPARK-9353 URL: https://issues.apache.org/jira/browse/SPARK-9353 Project: Sp

[jira] [Created] (SPARK-9352) Add tests for standalone scheduling code

2015-07-25 Thread Andrew Or (JIRA)
Andrew Or created SPARK-9352: Summary: Add tests for standalone scheduling code Key: SPARK-9352 URL: https://issues.apache.org/jira/browse/SPARK-9352 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-8881) Standalone mode scheduling fails because cores assignment is not atomic

2015-07-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8881: - Fix Version/s: 1.5.0 1.4.2 > Standalone mode scheduling fails because cores assignment

[jira] [Closed] (SPARK-8881) Standalone mode scheduling fails because cores assignment is not atomic

2015-07-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8881. Resolution: Fixed > Standalone mode scheduling fails because cores assignment is not atomic > --

[jira] [Closed] (SPARK-9260) Standalone scheduling can overflow a worker with cores

2015-07-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9260. Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Target Version/s: 1.4.2,

[jira] [Assigned] (SPARK-8828) Revert the change of SPARK-5680

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8828: --- Assignee: (was: Apache Spark) > Revert the change of SPARK-5680 > ---

[jira] [Commented] (SPARK-8828) Revert the change of SPARK-5680

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641835#comment-14641835 ] Apache Spark commented on SPARK-8828: - User 'yjshen' has created a pull request for th

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641836#comment-14641836 ] Apache Spark commented on SPARK-5680: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-8828) Revert the change of SPARK-5680

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8828: --- Assignee: Apache Spark > Revert the change of SPARK-5680 > --- >

[jira] [Assigned] (SPARK-9351) remove literals from grouping expressions in Aggregate

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9351: --- Assignee: (was: Apache Spark) > remove literals from grouping expressions in Aggregate >

[jira] [Assigned] (SPARK-9351) remove literals from grouping expressions in Aggregate

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9351: --- Assignee: Apache Spark > remove literals from grouping expressions in Aggregate > ---

[jira] [Commented] (SPARK-9351) remove literals from grouping expressions in Aggregate

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641833#comment-14641833 ] Apache Spark commented on SPARK-9351: - User 'cloud-fan' has created a pull request for

[jira] [Created] (SPARK-9351) remove literals from grouping expressions in Aggregate

2015-07-25 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9351: -- Summary: remove literals from grouping expressions in Aggregate Key: SPARK-9351 URL: https://issues.apache.org/jira/browse/SPARK-9351 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9350) Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9350: --- Assignee: Apache Spark (was: Reynold Xin) > Introduce an InternalRow generic getter that req

[jira] [Assigned] (SPARK-9350) Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9350: --- Assignee: Reynold Xin (was: Apache Spark) > Introduce an InternalRow generic getter that req

[jira] [Commented] (SPARK-9350) Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641827#comment-14641827 ] Apache Spark commented on SPARK-9350: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-9350) Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9350: -- Summary: Introduce an InternalRow generic getter that requires a DataType Key: SPARK-9350 URL: https://issues.apache.org/jira/browse/SPARK-9350 Project: Spark I

[jira] [Created] (SPARK-9349) UDAF cleanup for 1.5

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9349: -- Summary: UDAF cleanup for 1.5 Key: SPARK-9349 URL: https://issues.apache.org/jira/browse/SPARK-9349 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Resolved] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9348. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 > Remove apply method o

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-25 Thread Andrey Vykhodtsev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641787#comment-14641787 ] Andrey Vykhodtsev commented on SPARK-9277: -- btw here is the case that shows that

[jira] [Assigned] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9348: --- Assignee: (was: Apache Spark) > Remove apply method on InternalRow >

[jira] [Assigned] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9348: --- Assignee: Apache Spark > Remove apply method on InternalRow > ---

[jira] [Commented] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641786#comment-14641786 ] Apache Spark commented on SPARK-9348: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9348: --- Description: apply incurs another virtual function call. This just removes the extra method internall

[jira] [Updated] (SPARK-9348) Remove apply method on InternalRow

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9348: --- Summary: Remove apply method on InternalRow (was: Reduce InternalRow generic getter usage) > Remove

[jira] [Created] (SPARK-9348) Reduce InternalRow generic getter usage

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9348: -- Summary: Reduce InternalRow generic getter usage Key: SPARK-9348 URL: https://issues.apache.org/jira/browse/SPARK-9348 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9323) DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns

2015-07-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9323: -- Summary: DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns (was:

[jira] [Commented] (SPARK-9323) DataFrame does not properly resolve nested columns

2015-07-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641781#comment-14641781 ] Josh Rosen commented on SPARK-9323: --- I see now that a couple of my above queries might h

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-25 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641763#comment-14641763 ] Samphel Norden commented on SPARK-9347: --- Consider a top level folder with folder hie

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-25 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641762#comment-14641762 ] Samphel Norden commented on SPARK-9347: --- System info System properties: spark.logCon

[jira] [Updated] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-25 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samphel Norden updated SPARK-9347: -- Description: When spark sql shell is launched and we point it to a folder containing a large num

[jira] [Created] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-25 Thread Samphel Norden (JIRA)
Samphel Norden created SPARK-9347: - Summary: spark load of existing parquet files extremely slow if large number of files Key: SPARK-9347 URL: https://issues.apache.org/jira/browse/SPARK-9347 Project:

[jira] [Resolved] (SPARK-9192) add initialization phase for nondeterministic expression

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9192. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > add initialization ph

[jira] [Resolved] (SPARK-9291) Conversion is applied twice on partitioned data sources

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9291. Resolution: Fixed Assignee: Cheng Lian Fix Version/s: 1.5.0 > Conversion is applied

[jira] [Created] (SPARK-9346) Conversion is applied three times on partitioned data sources that require conversion

2015-07-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9346: -- Summary: Conversion is applied three times on partitioned data sources that require conversion Key: SPARK-9346 URL: https://issues.apache.org/jira/browse/SPARK-9346 Proje

[jira] [Reopened] (SPARK-4024) Remember user preferences for metrics to show in the UI

2015-07-25 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams reopened SPARK-4024: -- Only partially resolved by https://github.com/apache/spark/pull/7399 > Remember user preferences fo

[jira] [Commented] (SPARK-4024) Remember user preferences for metrics to show in the UI

2015-07-25 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641727#comment-14641727 ] Ryan Williams commented on SPARK-4024: -- Hey [~zsxwing], I don't actually think this i

[jira] [Updated] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

2015-07-25 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-9345: --- Description: When using spark-shell in local mode, I've observed the following behavior on a

[jira] [Updated] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

2015-07-25 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-9345: --- Description: When using spark-shell in local mode, I've observed the following behavior on a

[jira] [Updated] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

2015-07-25 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-9345: --- Description: When using spark-shell in local mode, I've observed the following behavior on a

[jira] [Commented] (SPARK-8125) Accelerate ParquetRelation2 metadata discovery

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641713#comment-14641713 ] Apache Spark commented on SPARK-8125: - User 'liancheng' has created a pull request for

[jira] [Created] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

2015-07-25 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-9345: -- Summary: Failure to cleanup on exceptions causes persistent I/O problems later on Key: SPARK-9345 URL: https://issues.apache.org/jira/browse/SPARK-9345 Project: S

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-07-25 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641711#comment-14641711 ] Meihua Wu commented on SPARK-8518: -- [~yanboliang] Here's my two cents :) For the Cox mod

[jira] [Created] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-07-25 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-9344: -- Summary: Spark SQL documentation does not clarify INSERT INTO behavior Key: SPARK-9344 URL: https://issues.apache.org/jira/browse/SPARK-9344 Project: Spark

[jira] [Created] (SPARK-9343) DROP TABLE ignores IF EXISTS clause

2015-07-25 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-9343: -- Summary: DROP TABLE ignores IF EXISTS clause Key: SPARK-9343 URL: https://issues.apache.org/jira/browse/SPARK-9343 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641660#comment-14641660 ] Apache Spark commented on SPARK-9335: - User 'zsxwing' has created a pull request for t

[jira] [Updated] (SPARK-9342) Spark SQL views don't work

2015-07-25 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-9342: --- Description: The Spark SQL documentation's section on Hive support claims that views are supp

[jira] [Created] (SPARK-9342) Spark SQL views don't work

2015-07-25 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-9342: -- Summary: Spark SQL views don't work Key: SPARK-9342 URL: https://issues.apache.org/jira/browse/SPARK-9342 Project: Spark Issue Type: Bug Compon

[jira] [Assigned] (SPARK-8918) Add @since tags to mllib.clustering

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8918: --- Assignee: (was: Apache Spark) > Add @since tags to mllib.clustering > ---

[jira] [Assigned] (SPARK-8918) Add @since tags to mllib.clustering

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8918: --- Assignee: Apache Spark > Add @since tags to mllib.clustering > --

[jira] [Commented] (SPARK-8918) Add @since tags to mllib.clustering

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641650#comment-14641650 ] Apache Spark commented on SPARK-8918: - User 'XiaoqingWang' has created a pull request

[jira] [Assigned] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9335: --- Assignee: Tathagata Das (was: Apache Spark) > Kinesis test hits rate limit > ---

[jira] [Commented] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641583#comment-14641583 ] Apache Spark commented on SPARK-9335: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9335: --- Assignee: Apache Spark (was: Tathagata Das) > Kinesis test hits rate limit > ---

[jira] [Commented] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641578#comment-14641578 ] Shixiong Zhu commented on SPARK-9335: - It's because https://github.com/apache/spark/pu

[jira] [Updated] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

2015-07-25 Thread Vishal John (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal John updated SPARK-9341: --- Description: I try to build spark by using the command ./build/sbt I get the following error - Attem

[jira] [Resolved] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9341. -- Resolution: Duplicate [~vishaljohn] Please read https://cwiki.apache.org/confluence/display/SPARK/Contr

[jira] [Updated] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9254: - Labels: (was: backport-needed) > sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS

[jira] [Updated] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

2015-07-25 Thread Vishal John (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal John updated SPARK-9341: --- Description: I try to build spark by using the command ./build/sbt I get the following error - Attem

[jira] [Created] (SPARK-9341) The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar

2015-07-25 Thread Vishal John (JIRA)
Vishal John created SPARK-9341: -- Summary: The curl command in sbt-launch-lib.bash doesn't download sbt-launch jar Key: SPARK-9341 URL: https://issues.apache.org/jira/browse/SPARK-9341 Project: Spark

[jira] [Updated] (SPARK-9339) Use of Class.forName(String) should be replaced with version taking classloader

2015-07-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-9339: --- Affects Version/s: 1.3.1 > Use of Class.forName(String) should be replaced with versio

[jira] [Commented] (SPARK-9339) Use of Class.forName(String) should be replaced with version taking classloader

2015-07-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641559#comment-14641559 ] Mridul Muralidharan commented on SPARK-9339: Neat ! unfortunately we wont be i

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-25 Thread Andrey Vykhodtsev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641555#comment-14641555 ] Andrey Vykhodtsev commented on SPARK-9277: -- Hi Joseph, will it be too expensive

[jira] [Updated] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-07-25 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated SPARK-9340: -- Attachment: ParquetTypesConverterTest.scala Failing test > ParquetTypeConverter incorrectly handling of

[jira] [Created] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-07-25 Thread Damian Guy (JIRA)
Damian Guy created SPARK-9340: - Summary: ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch Key: SPARK-9340 URL: https://issues.apache.org/jira/browse/SPARK-9340 Projec

[jira] [Commented] (SPARK-9339) Use of Class.forName(String) should be replaced with version taking classloader

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641537#comment-14641537 ] Sean Owen commented on SPARK-9339: -- In fact, it is disallowed altogether now: https://is

[jira] [Created] (SPARK-9339) Use of Class.forName(String) should be replaced with version taking classloader

2015-07-25 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-9339: -- Summary: Use of Class.forName(String) should be replaced with version taking classloader Key: SPARK-9339 URL: https://issues.apache.org/jira/browse/SPARK-9339

[jira] [Comment Edited] (SPARK-9323) DataFrame does not properly resolve nested columns

2015-07-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641496#comment-14641496 ] Liang-Chi Hsieh edited comment on SPARK-9323 at 7/25/15 10:15 AM: --

[jira] [Comment Edited] (SPARK-9323) DataFrame does not properly resolve nested columns

2015-07-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641496#comment-14641496 ] Liang-Chi Hsieh edited comment on SPARK-9323 at 7/25/15 10:14 AM: --

[jira] [Commented] (SPARK-9323) DataFrame does not properly resolve nested columns

2015-07-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641496#comment-14641496 ] Liang-Chi Hsieh commented on SPARK-9323: Currently we resolve "a.b" in ResolveAlia

[jira] [Assigned] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-9304: Assignee: Sean Owen (was: Michael Allman) > Improve backwards compatibility of SPARK-8401 > --

[jira] [Resolved] (SPARK-9304) Improve backwards compatibility of SPARK-8401

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9304. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7639 [https://github.com/ap

[jira] [Comment Edited] (SPARK-6898) Special chars in column names is broken

2015-07-25 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641471#comment-14641471 ] David Sabater edited comment on SPARK-6898 at 7/25/15 9:14 AM: -

[jira] [Commented] (SPARK-6898) Special chars in column names is broken

2015-07-25 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641471#comment-14641471 ] David Sabater commented on SPARK-6898: -- [~cloud_fan] I literally copy&pasted the snip

[jira] [Commented] (SPARK-9335) Kinesis test hits rate limit

2015-07-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641467#comment-14641467 ] François Garillot commented on SPARK-9335: -- Note those are shard limits enforced

[jira] [Created] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-07-25 Thread James Aley (JIRA)
James Aley created SPARK-9338: - Summary: Aliases from SELECT not available in GROUP BY Key: SPARK-9338 URL: https://issues.apache.org/jira/browse/SPARK-9338 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-9334) Remove UnsafeRowConverter in favor of UnsafeProjection

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9334. Resolution: Fixed Fix Version/s: 1.5.0 > Remove UnsafeRowConverter in favor of UnsafeProjecti

[jira] [Updated] (SPARK-9148) User-facing documentation for NaN handling semantics

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9148: --- Priority: Blocker (was: Major) > User-facing documentation for NaN handling semantics > -

[jira] [Resolved] (SPARK-9336) Remove all extra JoinedRows

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9336. Resolution: Fixed Fix Version/s: 1.5.0 > Remove all extra JoinedRows > --

[jira] [Comment Edited] (SPARK-6898) Special chars in column names is broken

2015-07-25 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641458#comment-14641458 ] David Sabater edited comment on SPARK-6898 at 7/25/15 8:09 AM: -

[jira] [Commented] (SPARK-9255) SQL codegen fails with "value < is not a member of TimestampType.this.InternalType"

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641457#comment-14641457 ] Reynold Xin commented on SPARK-9255: [~zwu@gmail.com] Does this work in master? >

[jira] [Commented] (SPARK-6898) Special chars in column names is broken

2015-07-25 Thread David Sabater (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641458#comment-14641458 ] David Sabater commented on SPARK-6898: -- [~cloud_fan] I tried from spark-shell (It wor

[jira] [Commented] (SPARK-6898) Special chars in column names is broken

2015-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641446#comment-14641446 ] Wenchen Fan commented on SPARK-6898: [~dsdinter] I tried your case on 1.4.1 {code} sql

[jira] [Resolved] (SPARK-8668) expr function to convert SQL expression into a Column

2015-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8668. Resolution: Fixed Assignee: Joseph Batchik Fix Version/s: 1.5.0 > expr function to c

[jira] [Updated] (SPARK-9255) SQL codegen fails with "value < is not a member of TimestampType.this.InternalType"

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9255: - Affects Version/s: (was: 1.4.0) Summary: SQL codegen fails with "value < is not a member

[jira] [Assigned] (SPARK-9337) Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9337: --- Assignee: (was: Apache Spark) > Add an ut for Word2Vec to verify the empty vocabulary che

[jira] [Assigned] (SPARK-9337) Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9337: --- Assignee: Apache Spark > Add an ut for Word2Vec to verify the empty vocabulary check > --

[jira] [Commented] (SPARK-9337) Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641436#comment-14641436 ] Apache Spark commented on SPARK-9337: - User 'hhbyyh' has created a pull request for th

[jira] [Updated] (SPARK-9337) Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9337: - Priority: Trivial (was: Minor) Issue Type: Improvement (was: Test) > Add an ut for Word2Vec to ver

[jira] [Created] (SPARK-9337) Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-25 Thread yuhao yang (JIRA)
yuhao yang created SPARK-9337: - Summary: Add an ut for Word2Vec to verify the empty vocabulary check Key: SPARK-9337 URL: https://issues.apache.org/jira/browse/SPARK-9337 Project: Spark Issue Ty

  1   2   >