[ 
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284950#comment-17284950
 ] 

Jungtaek Lim commented on SPARK-10816:
--------------------------------------

First of all, I'd like to say thanks for finding the value on this feature. I 
feel failing to persuade committers for the necessity of the feature was the 
main reason we couldn't get this in. Now that there're two committers from 
different teams finding the feature as useful, looks like we could try pushing 
this out again.

I should have reloaded my 2 years old context. I roughly remember that the 
implementations have similarity for the performance characteristic at the end. 
There're differences on the details, but I also have to spend a time to reload 
and what were those. I'll revisit the doc describing differences.

About authorship, I'm happy to see Yuanjian as main author if we decide to have 
Yuanjian's PR as baseline. I'd even OK if we decide to have mine as baseline 
but want to set Yuanjian as main author to give more credit to non-committer. 
One thing to note in Yuanjian's PR is that we might need to sort out some 
authorship issue as the Baidu's PR was collaboration of multiple authors and 
Yuanjian is now no longer in Baidu, but we could probably sort out with 
assigning multiple authors on the commit.

> EventTime based sessionization
> ------------------------------
>
>                 Key: SPARK-10816
>                 URL: https://issues.apache.org/jira/browse/SPARK-10816
>             Project: Spark
>          Issue Type: New Feature
>          Components: Structured Streaming
>            Reporter: Reynold Xin
>            Priority: Major
>         Attachments: SPARK-10816 Support session window natively.pdf, Session 
> Window Support For Structure Streaming.pdf
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to