[jira] [Assigned] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

2017-12-25 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-20168: --- Assignee: Yash Sharma > Enable kinesis to start stream from Initial position specified by a

[jira] [Updated] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

2017-12-25 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-20168: Fix Version/s: 2.3.0 > Enable kinesis to start stream from Initial position specified by a timestam

[jira] [Resolved] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

2017-12-25 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-20168. - Resolution: Done Target Version/s: 2.3.0 Resolved with https://github.com/apache/spark/

[jira] [Commented] (SPARK-22897) Expose stageAttemptId in TaskContext

2017-12-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303567#comment-16303567 ] Shixiong Zhu commented on SPARK-22897: -- +1 > Expose stageAttemptId in TaskContext

[jira] [Created] (SPARK-22901) Add non-deterministic to Python UDF

2017-12-25 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22901: --- Summary: Add non-deterministic to Python UDF Key: SPARK-22901 URL: https://issues.apache.org/jira/browse/SPARK-22901 Project: Spark Issue Type: Bug Component

[jira] [Comment Edited] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-12-25 Thread Xin Yu Pan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303458#comment-16303458 ] Xin Yu Pan edited comment on SPARK-21302 at 12/26/17 5:40 AM: -

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303480#comment-16303480 ] Xiao Li commented on SPARK-22629: - The reason is we assume all the UDF are deterministic.

[jira] [Commented] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303464#comment-16303464 ] Apache Spark commented on SPARK-22833: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-12-25 Thread Xin Yu Pan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303458#comment-16303458 ] Xin Yu Pan commented on SPARK-21302: I hit same problem with Spark 2.1.1 History Serv

[jira] [Commented] (SPARK-22897) Expose stageAttemptId in TaskContext

2017-12-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303452#comment-16303452 ] Wenchen Fan commented on SPARK-22897: - https://github.com/apache/spark/pull/12248 add

[jira] [Commented] (SPARK-22897) Expose stageAttemptId in TaskContext

2017-12-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303451#comment-16303451 ] Wenchen Fan commented on SPARK-22897: - Sounds reasonable to me, but `TaskContext` is

[jira] [Assigned] (SPARK-22870) Dynamic allocation should allow 0 idle time

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22870: Assignee: (was: Apache Spark) > Dynamic allocation should allow 0 idle time >

[jira] [Assigned] (SPARK-22870) Dynamic allocation should allow 0 idle time

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22870: Assignee: Apache Spark > Dynamic allocation should allow 0 idle time > ---

[jira] [Commented] (SPARK-22870) Dynamic allocation should allow 0 idle time

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303438#comment-16303438 ] Apache Spark commented on SPARK-22870: -- User 'wangyum' has created a pull request fo

[jira] [Comment Edited] (SPARK-22793) Memory leak in Spark Thrift Server

2017-12-25 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292314#comment-16292314 ] zuotingbing edited comment on SPARK-22793 at 12/26/17 2:00 AM:

[jira] [Commented] (SPARK-22893) Unified the data type mismatch message

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303353#comment-16303353 ] Apache Spark commented on SPARK-22893: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-18115) Custom metrics Sink/Source prevent Executor from starting

2017-12-25 Thread Xudong Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303295#comment-16303295 ] Xudong Zheng commented on SPARK-18115: -- Hello everyone, Can anybody give a short st

[jira] [Commented] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Lior Chaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303284#comment-16303284 ] Lior Chaga commented on SPARK-22840: gotcha [~greenhat], thanks > Incorrect results

[jira] [Resolved] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Lior Chaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga resolved SPARK-22840. Resolution: Not A Bug > Incorrect results when using distinct on window > -

[jira] [Comment Edited] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Denys Zadorozhnyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303281#comment-16303281 ] Denys Zadorozhnyi edited comment on SPARK-22840 at 12/25/17 2:14 PM: --

[jira] [Comment Edited] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Denys Zadorozhnyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303281#comment-16303281 ] Denys Zadorozhnyi edited comment on SPARK-22840 at 12/25/17 2:14 PM: --

[jira] [Comment Edited] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Denys Zadorozhnyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303281#comment-16303281 ] Denys Zadorozhnyi edited comment on SPARK-22840 at 12/25/17 2:14 PM: --

[jira] [Commented] (SPARK-22840) Incorrect results when using distinct on window

2017-12-25 Thread Denys Zadorozhnyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303281#comment-16303281 ] Denys Zadorozhnyi commented on SPARK-22840: --- [~lio...@taboola.com] [~liorchaga]

[jira] [Commented] (SPARK-22900) remove unnecessary restrict for streaming dynamic allocation

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303277#comment-16303277 ] Apache Spark commented on SPARK-22900: -- User 'sharkdtu' has created a pull request f

[jira] [Assigned] (SPARK-22900) remove unnecessary restrict for streaming dynamic allocation

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22900: Assignee: Apache Spark > remove unnecessary restrict for streaming dynamic allocation > --

[jira] [Assigned] (SPARK-22900) remove unnecessary restrict for streaming dynamic allocation

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22900: Assignee: (was: Apache Spark) > remove unnecessary restrict for streaming dynamic allo

[jira] [Created] (SPARK-22900) remove unnecessary restrict for streaming dynamic allocation

2017-12-25 Thread sharkd tu (JIRA)
sharkd tu created SPARK-22900: - Summary: remove unnecessary restrict for streaming dynamic allocation Key: SPARK-22900 URL: https://issues.apache.org/jira/browse/SPARK-22900 Project: Spark Issue

[jira] [Assigned] (SPARK-22899) OneVsRestModel transform on streaming data failed.

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22899: Assignee: (was: Apache Spark) > OneVsRestModel transform on streaming data failed. > -

[jira] [Assigned] (SPARK-22899) OneVsRestModel transform on streaming data failed.

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22899: Assignee: Apache Spark > OneVsRestModel transform on streaming data failed. >

[jira] [Commented] (SPARK-22899) OneVsRestModel transform on streaming data failed.

2017-12-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303194#comment-16303194 ] Apache Spark commented on SPARK-22899: -- User 'WeichenXu123' has created a pull reque

[jira] [Created] (SPARK-22899) OneVsRestModel transform on streaming data failed.

2017-12-25 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-22899: -- Summary: OneVsRestModel transform on streaming data failed. Key: SPARK-22899 URL: https://issues.apache.org/jira/browse/SPARK-22899 Project: Spark Issue Type: Bu

[jira] [Resolved] (SPARK-22893) Unified the data type mismatch message

2017-12-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22893. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Unified the data type mism