[jira] [Updated] (SPARK-18360) default table path of tables in default database should depend on the location of default database

2016-11-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18360: Summary: default table path of tables in default database should depend on the location of default

[jira] [Resolved] (SPARK-18438) spark.mlp should support RFormula

2016-11-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18438. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.1.0 > spark.mlp should s

[jira] [Commented] (SPARK-18447) Fix `Note:`/`NOTE:`/`Note that` across Python API documentation

2016-11-16 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669896#comment-15669896 ] Jagadeesan A S commented on SPARK-18447: Started working on this > Fix `Note:`/`

[jira] [Commented] (SPARK-18447) Fix `Note:`/`NOTE:`/`Note that` across Python API documentation

2016-11-16 Thread Aditya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669905#comment-15669905 ] Aditya commented on SPARK-18447: Hi Jagadeesan, I am already working on this > Fix `Note

[jira] [Resolved] (SPARK-18433) Improve DataSource option keys to be more case-insensitive

2016-11-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18433. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15884 [https://githu

[jira] [Updated] (SPARK-18433) Improve DataSource option keys to be more case-insensitive

2016-11-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18433: Assignee: Dongjoon Hyun > Improve DataSource option keys to be more case-insensitive >

[jira] [Commented] (SPARK-18447) Fix `Note:`/`NOTE:`/`Note that` across Python API documentation

2016-11-16 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669920#comment-15669920 ] Jagadeesan A S commented on SPARK-18447: Thanks, please carry on.. :) > Fix `Not

[jira] [Commented] (SPARK-18437) Inconsistent mark-down for `Note:`/`NOTE:`/`Note that` across Scala/Java/R/Python in API documentations

2016-11-16 Thread Aditya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15669933#comment-15669933 ] Aditya commented on SPARK-18437: Yes sure. I will start work on this and refer to what ch

[jira] [Created] (SPARK-18469) Cannot make MLlib model predictions in Spark streaming with checkpointing

2016-11-16 Thread Alex Jarman (JIRA)
Alex Jarman created SPARK-18469: --- Summary: Cannot make MLlib model predictions in Spark streaming with checkpointing Key: SPARK-18469 URL: https://issues.apache.org/jira/browse/SPARK-18469 Project: Spar

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-11-16 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670007#comment-15670007 ] Lianhui Wang commented on SPARK-14560: -- Now this issue is not in Branch-1.6. You can

[jira] [Updated] (SPARK-18424) Improve Date Parsing Semantics & Functionality

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18424: -- Shepherd: Herman van Hovell Target Version/s: 2.2.0 > Improve Date Parsing

[jira] [Resolved] (SPARK-18400) NPE when resharding Kinesis Stream

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18400. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Issue resolved by pull request

[jira] [Assigned] (SPARK-18400) NPE when resharding Kinesis Stream

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18400: - Assignee: Sean Owen > NPE when resharding Kinesis Stream > -- >

[jira] [Resolved] (SPARK-18410) Add structured kafka example

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18410. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15849 [https://github.co

[jira] [Updated] (SPARK-18410) Add structured kafka example

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18410: -- Assignee: Genmao Yu > Add structured kafka example > > > K

[jira] [Commented] (SPARK-18441) Add Smote in spark mlib and ml

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670086#comment-15670086 ] Sean Owen commented on SPARK-18441: --- Can this JIRA be expanded to explain what Smote is

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670092#comment-15670092 ] Sean Owen commented on SPARK-18463: --- I don't understand what this is proposing. The exa

[jira] [Resolved] (SPARK-18434) Add missing ParamValidations for ML algos

2016-11-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18434. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.1.0 > Add missing Param

[jira] [Commented] (SPARK-18315) Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1

2016-11-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670131#comment-15670131 ] Dongjoon Hyun commented on SPARK-18315: --- Hi, [~kiranch]. Could you try 2.0.2? When

[jira] [Comment Edited] (SPARK-18315) Cannot save Solr or JDBC tables as Parquet format in Spark 2.0.1

2016-11-16 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670131#comment-15670131 ] Dongjoon Hyun edited comment on SPARK-18315 at 11/16/16 10:50 AM: -

[jira] [Resolved] (SPARK-18446) make sure all ML algos have links to API docs

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18446. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15890 [https://github.co

[jira] [Updated] (SPARK-18446) make sure all ML algos have links to API docs

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18446: -- Assignee: zhengruifeng Priority: Trivial (was: Minor) > make sure all ML algos have links to API d

[jira] [Created] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Genmao Yu (JIRA)
Genmao Yu created SPARK-18470: - Summary: Provide Spark Streaming Monitor Rest Api Key: SPARK-18470 URL: https://issues.apache.org/jira/browse/SPARK-18470 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-18470: -- Description: provide spark streaming monitor api: 1. list receiver information 2. list stream batch in

[jira] [Commented] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670151#comment-15670151 ] Apache Spark commented on SPARK-18470: -- User 'uncleGen' has created a pull request f

[jira] [Assigned] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18470: Assignee: (was: Apache Spark) > Provide Spark Streaming Monitor Rest Api > ---

[jira] [Assigned] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18470: Assignee: Apache Spark > Provide Spark Streaming Monitor Rest Api > --

[jira] [Commented] (SPARK-18470) Provide Spark Streaming Monitor Rest Api

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670172#comment-15670172 ] Sean Owen commented on SPARK-18470: --- You probably want to post a design doc in general

[jira] [Commented] (SPARK-18441) Add Smote in spark mlib and ml

2016-11-16 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670210#comment-15670210 ] Nick Pentreath commented on SPARK-18441: Yes, it would be good to understand what

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670222#comment-15670222 ] Jianfei Wang commented on SPARK-18463: -- So, maybe we can imp a sample that sample th

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670229#comment-15670229 ] Sean Owen commented on SPARK-18463: --- Sampling the pairs is exactly what zip + sample wo

[jira] [Resolved] (SPARK-18420) Fix the errors caused by lint check in Java

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18420. --- Resolution: Fixed Assignee: coneyliu Fix Version/s: 2.1.0 Resolved by https://github.

[jira] [Closed] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang closed SPARK-18463. Resolution: Invalid > I think it's necessary to have an overrided method of smaple > --

[jira] [Updated] (SPARK-18430) Returned Message Null when Hitting an Invocation Exception of Function Lookup.

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18430: -- Fix Version/s: 2.0.3 > Returned Message Null when Hitting an Invocation Exception of Fu

[jira] [Created] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Anthony Truchet (JIRA)
Anthony Truchet created SPARK-18471: --- Summary: In treeAggregate, generate (big) zeros instead of sending them. Key: SPARK-18471 URL: https://issues.apache.org/jira/browse/SPARK-18471 Project: Spark

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670504#comment-15670504 ] Jianfei Wang commented on SPARK-18463: -- ok ,what you mean is rdd1.zip(rdd2).sample()

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670511#comment-15670511 ] Sean Owen commented on SPARK-18471: --- If you send a SparseVector of zeroes, shouldn't it

[jira] [Issue Comment Deleted] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-18463: - Comment: was deleted (was: ok ,what you mean is rdd1.zip(rdd2).sample() won't use more memory to

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670513#comment-15670513 ] Sean Owen commented on SPARK-18463: --- Yes, zip doesn't use any particular memory. It's a

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670522#comment-15670522 ] Jianfei Wang commented on SPARK-18463: -- thank you very much ,some misunderstanding a

[jira] [Commented] (SPARK-18463) I think it's necessary to have an overrided method of smaple

2016-11-16 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670521#comment-15670521 ] Jianfei Wang commented on SPARK-18463: -- thank you very much ,some misunderstanding a

[jira] [Commented] (SPARK-8816) Improve Performance of Unbounded Following Window Frame Processing

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670524#comment-15670524 ] Herman van Hovell commented on SPARK-8816: -- The following paper provides a nice s

[jira] [Updated] (SPARK-9221) Support IntervalType in Range Frame

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-9221: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-7712) > Support I

[jira] [Updated] (SPARK-9221) Support IntervalType in Range Frame

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-9221: - Affects Version/s: (was: 1.4.0) Target Version/s: 2.2.0 > Support IntervalType in

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670571#comment-15670571 ] Herman van Hovell commented on SPARK-18004: --- So there seems to something going

[jira] [Updated] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18004: -- Description: DataFrame filter Predicate push-down fails for Oracle Timestamp type colum

[jira] [Updated] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18091: -- Target Version/s: 2.1.0 > Deep if expressions cause Generated SpecificUnsafeProjection

[jira] [Updated] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18004: -- Description: DataFrame filter Predicate push-down fails for Oracle Timestamp type colum

[jira] [Commented] (SPARK-17977) DataFrameReader and DataStreamReader should have an ancestor class

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670578#comment-15670578 ] Herman van Hovell commented on SPARK-17977: --- [~marmbrus] Is there any reason fo

[jira] [Updated] (SPARK-17977) DataFrameReader and DataStreamReader should have an ancestor class

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17977: -- Priority: Major (was: Critical) > DataFrameReader and DataStreamReader should have an ancestor class >

[jira] [Commented] (SPARK-16981) For CSV files nullValue is not respected for Date/Time data type

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670614#comment-15670614 ] Herman van Hovell commented on SPARK-16981: --- Could you retest this on the curre

[jira] [Closed] (SPARK-14171) UDAF aggregates argument object inspector not parsed correctly

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-14171. - Resolution: Fixed Fix Version/s: 2.1.0 Spark SQL now implements its Approx Percent

[jira] [Commented] (SPARK-14067) spark-shell WARN ObjectStore: Failed to get database default,returning NoSuchObjectException

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670644#comment-15670644 ] Herman van Hovell commented on SPARK-14067: --- This is expected behavior. We need

[jira] [Commented] (SPARK-14003) Multi-session can not work when one session is moving files for "INSERT ... SELECT" clause

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670650#comment-15670650 ] Herman van Hovell commented on SPARK-14003: --- This is a know issue. We use a sin

[jira] [Closed] (SPARK-13935) Other clients' connection hang up when someone do huge load

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-13935. - Resolution: Duplicate > Other clients' connection hang up when someone do huge load > ---

[jira] [Updated] (SPARK-14003) Multi-session can not work when one session is moving files for "INSERT ... SELECT" clause

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-14003: -- Priority: Major (was: Critical) > Multi-session can not work when one session is movin

[jira] [Created] (SPARK-18472) ALS Rating to support string product and user keys

2016-11-16 Thread chris snow (JIRA)
chris snow created SPARK-18472: -- Summary: ALS Rating to support string product and user keys Key: SPARK-18472 URL: https://issues.apache.org/jira/browse/SPARK-18472 Project: Spark Issue Type: Ne

[jira] [Updated] (SPARK-18472) ALS Rating to support string product and user keys

2016-11-16 Thread chris snow (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chris snow updated SPARK-18472: --- Component/s: MLlib > ALS Rating to support string product and user keys > ---

[jira] [Commented] (SPARK-14003) Multi-session can not work when one session is moving files for "INSERT ... SELECT" clause

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670649#comment-15670649 ] Herman van Hovell commented on SPARK-14003: --- This is a know issue. We use a sin

[jira] [Closed] (SPARK-14067) spark-shell WARN ObjectStore: Failed to get database default,returning NoSuchObjectException

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-14067. - Resolution: Not A Problem > spark-shell WARN ObjectStore: Failed to get database default,

[jira] [Closed] (SPARK-12352) Reuse the result of split in SQL

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-12352. - Resolution: Duplicate > Reuse the result of split in SQL > --

[jira] [Updated] (SPARK-12278) Move the shuffle related test case from Yarn module to Core module

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12278: -- Priority: Major (was: Critical) > Move the shuffle related test case from Yarn module

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670679#comment-15670679 ] Herman van Hovell commented on SPARK-12179: --- [~litao1990] is this still a probl

[jira] [Closed] (SPARK-12179) Spark SQL get different result with the same code

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-12179. - Resolution: Cannot Reproduce > Spark SQL get different result with the same code > --

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670679#comment-15670679 ] Herman van Hovell edited comment on SPARK-12179 at 11/16/16 3:19 PM: --

[jira] [Commented] (SPARK-12278) Move the shuffle related test case from Yarn module to Core module

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670690#comment-15670690 ] Sean Owen commented on SPARK-12278: --- Pardon, but why would YarnShuffleEncryptionSuite b

[jira] [Commented] (SPARK-11785) When deployed against remote Hive metastore with lower versions, JDBC metadata calls throws exception

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670692#comment-15670692 ] Herman van Hovell commented on SPARK-11785: --- [~lian cheng] is this still an iss

[jira] [Commented] (SPARK-11266) Peak memory tests swallow failures

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670694#comment-15670694 ] Herman van Hovell commented on SPARK-11266: --- [~andrewor14] is this an issue? >

[jira] [Resolved] (SPARK-18472) ALS Rating to support string product and user keys

2016-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18472. --- Resolution: Invalid Please ask questions on the mailing list instead, and read https://cwiki.apache.

[jira] [Closed] (SPARK-10794) Spark-SQL- select query on table column with binary Data Type displays error message- java.lang.ClassCastException: java.lang.String cannot be cast to [B

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-10794. - Resolution: Unresolved Closing this due to lack of information. > Spark-SQL- select quer

[jira] [Commented] (SPARK-8466) Bug in SQL Optimizer: Unresolved Attribute after pushing Filter below Project

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670742#comment-15670742 ] Herman van Hovell commented on SPARK-8466: -- I cannot reproduce this under Spark 1

[jira] [Closed] (SPARK-8466) Bug in SQL Optimizer: Unresolved Attribute after pushing Filter below Project

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-8466. Resolution: Not A Problem > Bug in SQL Optimizer: Unresolved Attribute after pushing Filter

[jira] [Commented] (SPARK-6482) Remove synchronization of Hive Native commands

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670750#comment-15670750 ] Herman van Hovell commented on SPARK-6482: -- The dependency on Hive commands has b

[jira] [Closed] (SPARK-6482) Remove synchronization of Hive Native commands

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-6482. Resolution: Not A Problem Fix Version/s: 2.0.0 > Remove synchronization of Hive Nativ

[jira] [Updated] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18458: -- Priority: Critical (was: Major) > core dumped running Spark SQL on large data volume (

[jira] [Commented] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670762#comment-15670762 ] Herman van Hovell commented on SPARK-18458: --- [~kiszk] Could you keep us posted

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670795#comment-15670795 ] Anthony Truchet commented on SPARK-18471: - Sure. But in our use case we do want t

[jira] [Updated] (SPARK-18455) General support for subquery processing

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18455: -- Target Version/s: 2.2.0 Description: Subquery support has been introduced in S

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670812#comment-15670812 ] Apache Spark commented on SPARK-18471: -- User 'AnthonyTruchet' has created a pull req

[jira] [Assigned] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18471: Assignee: (was: Apache Spark) > In treeAggregate, generate (big) zeros instead of send

[jira] [Updated] (SPARK-18436) isin causing SQL syntax error with JDBC

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18436: -- Target Version/s: 2.1.0 > isin causing SQL syntax error with JDBC > ---

[jira] [Assigned] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18471: Assignee: Apache Spark > In treeAggregate, generate (big) zeros instead of sending them. >

[jira] [Updated] (SPARK-18394) Executing the same query twice in a row results in CodeGenerator cache misses

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18394: -- Target Version/s: 2.1.0 > Executing the same query twice in a row results in CodeGenera

[jira] [Updated] (SPARK-18388) Running aggregation on many columns throws SOE

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18388: -- Target Version/s: 2.1.0 > Running aggregation on many columns throws SOE >

[jira] [Updated] (SPARK-18389) Disallow cyclic view reference

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18389: -- Target Version/s: 2.2.0 > Disallow cyclic view reference >

[jira] [Updated] (SPARK-18358) Multiple Aggregation Using 'countDistinct' and 'first' result in error

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18358: -- Target Version/s: 2.1.0 > Multiple Aggregation Using 'countDistinct' and 'first' result

[jira] [Commented] (SPARK-18249) Spark 2.0.1 - StackOverflowError when saving dataset to parquet

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670836#comment-15670836 ] Herman van Hovell commented on SPARK-18249: --- Could provide an example that we c

[jira] [Commented] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-16 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670828#comment-15670828 ] Kazuaki Ishizaki commented on SPARK-18458: -- I see. I will do that. > core dumpe

[jira] [Commented] (SPARK-18251) DataSet API | RuntimeException: Null value appeared in non-nullable field when holding Option Case Class

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670877#comment-15670877 ] Herman van Hovell commented on SPARK-18251: --- I cannot reproduce this on master

[jira] [Commented] (SPARK-18356) Issue + Resolution: Kmeans Spark Performances (ML package)

2016-11-16 Thread zakaria hili (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670894#comment-15670894 ] zakaria hili commented on SPARK-18356: -- [~yuhaoyan] Thank you. I will try to improve

[jira] [Resolved] (SPARK-18415) Weird Plan Output when CTE used in RunnableCommand

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18415. --- Resolution: Fixed Target Version/s: 2.1.0 > Weird Plan Output when CTE used

[jira] [Comment Edited] (SPARK-18388) Running aggregation on many columns throws SOE

2016-11-16 Thread Raviteja Lokineni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655279#comment-15655279 ] Raviteja Lokineni edited comment on SPARK-18388 at 11/16/16 4:29 PM: --

[jira] [Closed] (SPARK-18247) not rlike is not supported in DataFrame filter function

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-18247. - Resolution: Won't Fix > not rlike is not supported in DataFrame filter function > ---

[jira] [Commented] (SPARK-18247) not rlike is not supported in DataFrame filter function

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670918#comment-15670918 ] Herman van Hovell commented on SPARK-18247: --- I am going to close this since thi

[jira] [Commented] (SPARK-9591) Job failed for exception during getting Broadcast variable

2016-11-16 Thread Henrique Costa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670923#comment-15670923 ] Henrique Costa commented on SPARK-9591: --- Would it be possible to backport this to 1.

[jira] [Commented] (SPARK-12037) Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException

2016-11-16 Thread Henrique Costa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670922#comment-15670922 ] Henrique Costa commented on SPARK-12037: Would it be possible to backport this to

[jira] [Commented] (SPARK-18242) Help with spark 1.5.2 Error

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670925#comment-15670925 ] Herman van Hovell commented on SPARK-18242: --- Please ask this question on the us

[jira] [Closed] (SPARK-18242) Help with spark 1.5.2 Error

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-18242. - Resolution: Not A Problem > Help with spark 1.5.2 Error > --- > >

[jira] [Updated] (SPARK-18220) ClassCastException occurs when using select query on ORC file

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18220: -- Fix Version/s: 2.1.0 > ClassCastException occurs when using select query on ORC file >

[jira] [Updated] (SPARK-18220) ClassCastException occurs when using select query on ORC file

2016-11-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18220: -- Target Version/s: 2.1.0 Fix Version/s: (was: 2.1.0) > ClassCastException occ

  1   2   3   >