[jira] [Updated] (BEAM-10463) Twister2 Beam Runner Documentation
[ https://issues.apache.org/jira/browse/BEAM-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe updated BEAM-10463: --- Component/s: (was: runner-core) runner-twister2 > Twister2 Beam Runner Documentation > -- > > Key: BEAM-10463 > URL: https://issues.apache.org/jira/browse/BEAM-10463 > Project: Beam > Issue Type: Task > Components: runner-twister2 >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > > Track the progress of documentation for the Twister2 Runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (BEAM-10830) Twister2 quickstarts and the runner maven archetypes
[ https://issues.apache.org/jira/browse/BEAM-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe updated BEAM-10830: --- Component/s: (was: runner-core) runner-twister2 > Twister2 quickstarts and the runner maven archetypes > > > Key: BEAM-10830 > URL: https://issues.apache.org/jira/browse/BEAM-10830 > Project: Beam > Issue Type: Task > Components: runner-twister2 >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > > Adding support for quickstarts and adding the Twister2 maven archetypes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-10830) Twister2 quickstarts and the runner maven archetypes
Pulasthi Wickramasinghe created BEAM-10830: -- Summary: Twister2 quickstarts and the runner maven archetypes Key: BEAM-10830 URL: https://issues.apache.org/jira/browse/BEAM-10830 Project: Beam Issue Type: Task Components: runner-core Reporter: Pulasthi Wickramasinghe Assignee: Pulasthi Wickramasinghe Adding support for quickstarts and adding the Twister2 maven archetypes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (BEAM-10463) Twister2 Beam Runner Documentation
[ https://issues.apache.org/jira/browse/BEAM-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe reassigned BEAM-10463: -- Assignee: Pulasthi Wickramasinghe > Twister2 Beam Runner Documentation > -- > > Key: BEAM-10463 > URL: https://issues.apache.org/jira/browse/BEAM-10463 > Project: Beam > Issue Type: Task > Components: runner-core >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > > Track the progress of documentation for the Twister2 Runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-10463) Twister2 Beam Runner Documentation
Pulasthi Wickramasinghe created BEAM-10463: -- Summary: Twister2 Beam Runner Documentation Key: BEAM-10463 URL: https://issues.apache.org/jira/browse/BEAM-10463 Project: Beam Issue Type: Task Components: runner-core Reporter: Pulasthi Wickramasinghe Assignee: Pulasthi Wickramasinghe Track the progress of documentation for the Twister2 Runner. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113696#comment-17113696 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- [~iemejia] will check with Java 11. Twister2 does support Java 11 so it should work. I Will test and let you know. So would we be able to merge this into the master for now so we can get it into 2.23.0 release?. No worries about missing the 2.22.0 cut :) > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Time Spent: 21h 20m > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113561#comment-17113561 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- [~bhulette] thanks for the update. is the option to cherry-pick this later for the 2.22.0 mentioned by [~iemejia] release still a viable option?. I am not sure how that would work with Beam release process but wanted to follow up since it was mentioned a couple times > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Time Spent: 21h 20m > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112709#comment-17112709 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- I Fixed all issue but one that Rayan pointed out in his review. I need to recheck the instances that i have used raw types, but a little hesistant to do it in an hurry, I can make a issue and fix that after the merge if that is OK with you guys. > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Fix For: 2.22.0 > > Time Spent: 21h 20m > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112621#comment-17112621 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- Thanks, Brian, I found a solution with forkEvery, i set the temp files created to delete on exit and since the JVM changes for every test class the old temp files will get deleted automatically. [~iemejia] will go through the other points mentioned by Rayan and get the fix within the day if possible. > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Fix For: 2.22.0 > > Time Spent: 19.5h > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112540#comment-17112540 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- [~iemejia] I am looking into the temp file issue that was mentioned by Rayan. One thought that came to mind was to run a small task to clean tmp files after a test class is executed. I am not that familiar with Gradle, is there a way to run a small task in between tests in the validateRunner task?. > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Fix For: 2.22.0 > > Time Spent: 19.5h > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111666#comment-17111666 ] Pulasthi Wickramasinghe commented on BEAM-7304: --- That is great to hear, let me know if anything needs to happen from my end > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: P3 > Fix For: 2.22.0 > > Time Spent: 19h 10m > Remaining Estimate: 0h > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe updated BEAM-7304: -- Description: Twister2 is a big data framework which supports both batch and stream processing [1] [2]. The goal is to develop an beam runner for Twister2. [1] [https://github.com/DSC-SPIDAL/twister2] [2] [https://twister2.org/] was: Twister2 is a big data framework which supports both batch and stream processing [1] [2]. The goal is to develop an beam runner for Twister2. [1] [https://github.com/DSC-SPIDAL/twister2] [2] [https://twister2.gitbook.io/twister2/] > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: Minor > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.org/] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe reassigned BEAM-7304: - Assignee: Pulasthi Wickramasinghe > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Assignee: Pulasthi Wickramasinghe >Priority: Minor > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.gitbook.io/twister2/] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BEAM-7304) Twister2 Beam runner
[ https://issues.apache.org/jira/browse/BEAM-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulasthi Wickramasinghe updated BEAM-7304: -- Summary: Twister2 Beam runner (was: Twister2 beam runner) > Twister2 Beam runner > > > Key: BEAM-7304 > URL: https://issues.apache.org/jira/browse/BEAM-7304 > Project: Beam > Issue Type: New Feature > Components: runner-ideas >Reporter: Pulasthi Wickramasinghe >Priority: Minor > > Twister2 is a big data framework which supports both batch and stream > processing [1] [2]. The goal is to develop an beam runner for Twister2. > [1] [https://github.com/DSC-SPIDAL/twister2] > [2] [https://twister2.gitbook.io/twister2/] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7304) Twister2 beam runner
Pulasthi Wickramasinghe created BEAM-7304: - Summary: Twister2 beam runner Key: BEAM-7304 URL: https://issues.apache.org/jira/browse/BEAM-7304 Project: Beam Issue Type: New Feature Components: runner-ideas Reporter: Pulasthi Wickramasinghe Twister2 is a big data framework which supports both batch and stream processing [1] [2]. The goal is to develop an beam runner for Twister2. [1] [https://github.com/DSC-SPIDAL/twister2] [2] [https://twister2.gitbook.io/twister2/] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
