RE: [FalconJX] Using RIATest
From: Alex Harui [mailto:aha...@adobe.com] You don't have to do the automation scripts for all of these. I was going to try to find time to do one or two myself just to force me to see how this stuff works and make sure it will work on these different flavors of JS UI layers. OK, feel free to contact me if you need help. Tigran.
RE: [FalconJX] Using RIATest
From: Alex Harui [mailto:aha...@adobe.com] Thanks for your continued efforts to make this happen. If you want a guarantee that there won't be rejection, then the project should have a vote, but before that, I think we need to the point where folks can try RIATest on FlexJS/FalconJX. I do not think there is a need for formal vote right now. If opinions are generally positive I will go ahead and work on this. Anyone willing to try RIATest can download it at http://www.cogitek.com/riatest/download.html. The trial is fully functional for 30 days. The test attached to this issue https://issues.apache.org/jira/browse/FLEX-33489 is a good starting point. In the flex-asjs repo, there are several examples. I have one more to contribute once I fix a bug in it, and I think one more is going to land soon that is based on Jquery. I have FlexJSTest, FlexJSTest_again, FlexJSTest_createjs, FlexJSTest_HTML5, StockQuote and VanillaSDK_POC in the examples dir. Are these all reasonable targets for testing? What I would like to see is a way to run RIATest on all of the examples. Then, maybe when we start the discussion leading up to the vote, folks can get the trial version of RIATest and run it so they can see what it can do. I have a couple of other items in my queue I need to deal with first, so can we pick this up again later this coming week or the week after? Sure, this can wait. Tigran.
Re: [FalconJX] Using RIATest
I have FlexJSTest, FlexJSTest_again, FlexJSTest_createjs, FlexJSTest_HTML5, StockQuote and VanillaSDK_POC in the examples dir. Are these all reasonable targets for testing? All but VanillaSDK_POC; I've suspended development on that project to give FlexJS a chance to mature. No need for testing it. EdB -- Ix Multimedia Software Jan Luykenstraat 27 3521 VB Utrecht T. 06-51952295 I. www.ixsoftware.nl
Re: [FalconJX] Using RIATest
On 5/7/13 3:41 AM, Erik de Bruin e...@ixsoftware.nl wrote: I have FlexJSTest, FlexJSTest_again, FlexJSTest_createjs, FlexJSTest_HTML5, StockQuote and VanillaSDK_POC in the examples dir. Are these all reasonable targets for testing? All but VanillaSDK_POC; I've suspended development on that project to give FlexJS a chance to mature. No need for testing it. And I believe that FlexJSTest is old and out of date, so I think the list is: FlexJSTest_again, FlexJSTest_createjs, FlexJSTest_HTML5 and StockQuote. I expect there to be a FlexJSTest_jquery arriving this week as well. You don't have to do the automation scripts for all of these. I was going to try to find time to do one or two myself just to force me to see how this stuff works and make sure it will work on these different flavors of JS UI layers. -- Alex Harui Flex SDK Team Adobe Systems, Inc. http://blogs.adobe.com/aharui
Re: [FalconJX] Using RIATest
Hi Tigran, Thanks for your continued efforts to make this happen. If you want a guarantee that there won't be rejection, then the project should have a vote, but before that, I think we need to the point where folks can try RIATest on FlexJS/FalconJX. In the flex-asjs repo, there are several examples. I have one more to contribute once I fix a bug in it, and I think one more is going to land soon that is based on Jquery. What I would like to see is a way to run RIATest on all of the examples. Then, maybe when we start the discussion leading up to the vote, folks can get the trial version of RIATest and run it so they can see what it can do. I have a couple of other items in my queue I need to deal with first, so can we pick this up again later this coming week or the week after? Thanks, -Alex On 5/3/13 11:14 PM, Tigran Najaryan tig...@gmail.com wrote: -Original Message- From: Alex Harui [mailto:aha...@adobe.com] Well, hopefully, there will be lots of committers contributing to the FlexJS framework. IMO, all of them should be writing tests. One of these days we will build out a test suite for FlexJS, probably using something like FlexUnit for unit testing. Do you expect more than 10 people write RIATest tests? I think that's the maximum number of Professional licenses my company can donate right now, probably 5 for Mac and 5 for Windows. If you expect more people to write tests then I need to find some other way. Of course anyone who already is a RIATest customer and owns a license will be able to write tests as well. Note sure if any of our customers are Apache Flex committers though. BTW, using RIATest does not exclude unit testing in any way. For best results both unit testing and UI functional testing (when there is a UI) should be used. I guess so. I still think the same person will want to run the tests against the SDK on the same machine they develop tests for the app they are building. It will be possible to have two licenses on a computer? There is no need to have 2 licenses. Anyone who has a RIATest Professional edition license will have full ability to both write and run the tests. The license that allows to develop tests includes the rights to run them as well. If everyone on Apache Flex team is OK with this I will go ahead. If there are other objections please speak now. I need to spend efforts and time to make this happen. If this is going to be rejected it better happens now. Thanks, Tigran. -- Alex Harui Flex SDK Team Adobe Systems, Inc. http://blogs.adobe.com/aharui
RE: [FalconJX] Using RIATest
-Original Message- From: Alex Harui [mailto:aha...@adobe.com] Well, hopefully, there will be lots of committers contributing to the FlexJS framework. IMO, all of them should be writing tests. One of these days we will build out a test suite for FlexJS, probably using something like FlexUnit for unit testing. Do you expect more than 10 people write RIATest tests? I think that's the maximum number of Professional licenses my company can donate right now, probably 5 for Mac and 5 for Windows. If you expect more people to write tests then I need to find some other way. Of course anyone who already is a RIATest customer and owns a license will be able to write tests as well. Note sure if any of our customers are Apache Flex committers though. BTW, using RIATest does not exclude unit testing in any way. For best results both unit testing and UI functional testing (when there is a UI) should be used. I guess so. I still think the same person will want to run the tests against the SDK on the same machine they develop tests for the app they are building. It will be possible to have two licenses on a computer? There is no need to have 2 licenses. Anyone who has a RIATest Professional edition license will have full ability to both write and run the tests. The license that allows to develop tests includes the rights to run them as well. If everyone on Apache Flex team is OK with this I will go ahead. If there are other objections please speak now. I need to spend efforts and time to make this happen. If this is going to be rejected it better happens now. Thanks, Tigran.
RE: [FalconJX] Using RIATest
From: Alex Harui aha...@adobe.com I'm wondering how this will work. In an open-source development model, both committers and non-committers should be able to get the source and run tests in order to prove that changes they make don't cause any problems. The only difference is that non-committers submit patches, but committers can check in directly. Hopefully, many of these people are going to be legitimate RIATest customers. Do they get to use the free license to test their applications? If not, how does the license checker determine whether that person is testing the Flex SDK or their application? Let us consider separately a) committers who will be creating tests, debugging them, doing actual test development using RIATest and b) the rest of the world. a) I believe there will be very few committers who will actually work with RIATest and will develop tests. For this activity my company will grant several full Professional edition licenses to Apache Flex team. I believe 5 or 10 licenses will be sufficient, I do not think there will ever be more than that number of committers who will work on RIATest tests. These will be regular licenses that we sell to our customers, the only difference will be that we will donate these free of charge to Apache Flex. Any committer who needs to write a test can grab one of those licenses and work with a copy of RIATest downloaded online. b) For the rest of the world there will be a special license. This special license for Apache Flex will simply allow anyone in the world who builds Flex SDK to use RIATest to run tests that are part of Flex SDK. This license will be granted for free to anyone who runs Flex SDK build. The license will be activated once RIATest is registered by a special master license key that we will issue for Apache Flex. I think we can even automate this registration so that a blank build of the SDK downloads RIATest (like it currently does for other external dependencies) and registers it with the special key, making RIATest ready to run tests that are part of the build. Does this make sense? 4. I will need someone's help to integrate RIATest into Flex SDK build. It would probably be best if you submit patches to build scripts and the readme. You would likely earn committer rights that way and then would be able to make changes directly going forward. Do we expect the tests to be part of FalconJX or part of FlexJS? Which repo will they go to? The FlexJSTest_again example is in flex-asjs repo. For the sample tests that I created for FlexJSTest_again I put the files in a tests directory which is sibling to src directory under FlexJSTest_again. Is this location OK? Are there any other existing Flex examples that can be compiled using FalconJX for which I can write tests? Tigran.
RE: [FalconJX] Using RIATest
From: christofer.d...@c-ware.de [mailto:christofer.d...@c-ware.de] Just to add my 50ct. Wouldn't it be good to use a tool for writing test that you can write tests in Java? As far as I remember there was only a hand-full of tools supporting this when I evaluated a lot of these tools: https://dev.c- ware.de/confluence/display/PUBLIC/Functional+Testing+Tools By all means use whatever you think is best for Apache Flex team. I am naturally biased so I will not try to argue. :-) I will only speak if you want to hear my reasoning for RIATest. Tigran.
Re: [FalconJX] Using RIATest
Chris, RiaTest does support JUnit output to integrate in a CI server On 3 May 2013 11:48, christofer.d...@c-ware.de christofer.d...@c-ware.dewrote: As I mentioned, I am just adding my 50ct to the discussion. RIATest did leave a very good impression with me when evaluating it and I think I did give the tool a good overall result. However I really liked the tools for which I was able to write my testcases in Junit or TestNG just because this way it was easy to have the test-results included in the CI build servers results. With all the others that ran tests using any wrapper usually only returned an ok or fail which no CI server could pick up the details. Chris Von: Tigran Najaryan [tig...@gmail.com] Gesendet: Freitag, 3. Mai 2013 09:45 An: dev@flex.apache.org Betreff: RE: [FalconJX] Using RIATest From: christofer.d...@c-ware.de [mailto:christofer.d...@c-ware.de] Just to add my 50ct. Wouldn't it be good to use a tool for writing test that you can write tests in Java? As far as I remember there was only a hand-full of tools supporting this when I evaluated a lot of these tools: https://dev.c- ware.de/confluence/display/PUBLIC/Functional+Testing+Tools By all means use whatever you think is best for Apache Flex team. I am naturally biased so I will not try to argue. :-) I will only speak if you want to hear my reasoning for RIATest. Tigran. -- João Fernandes
Re: [FalconJX] Using RIATest
On 5/2/13 11:30 PM, Tigran Najaryan tig...@gmail.com wrote: Hopefully, many of these people are going to be legitimate RIATest customers. Do they get to use the free license to test their applications? If not, how does the license checker determine whether that person is testing the Flex SDK or their application? Let us consider separately a) committers who will be creating tests, debugging them, doing actual test development using RIATest and b) the rest of the world. a) I believe there will be very few committers who will actually work with RIATest and will develop tests. For this activity my company will grant several full Professional edition licenses to Apache Flex team. I believe 5 or 10 licenses will be sufficient, I do not think there will ever be more than that number of committers who will work on RIATest tests. These will be regular licenses that we sell to our customers, the only difference will be that we will donate these free of charge to Apache Flex. Any committer who needs to write a test can grab one of those licenses and work with a copy of RIATest downloaded online. Well, hopefully, there will be lots of committers contributing to the FlexJS framework. IMO, all of them should be writing tests. One of these days we will build out a test suite for FlexJS, probably using something like FlexUnit for unit testing. b) For the rest of the world there will be a special license. This special license for Apache Flex will simply allow anyone in the world who builds Flex SDK to use RIATest to run tests that are part of Flex SDK. This license will be granted for free to anyone who runs Flex SDK build. The license will be activated once RIATest is registered by a special master license key that we will issue for Apache Flex. I think we can even automate this registration so that a blank build of the SDK downloads RIATest (like it currently does for other external dependencies) and registers it with the special key, making RIATest ready to run tests that are part of the build. Does this make sense? I guess so. I still think the same person will want to run the tests against the SDK on the same machine they develop tests for the app they are building. It will be possible to have two licenses on a computer? 4. I will need someone's help to integrate RIATest into Flex SDK build. It would probably be best if you submit patches to build scripts and the readme. You would likely earn committer rights that way and then would be able to make changes directly going forward. Do we expect the tests to be part of FalconJX or part of FlexJS? Which repo will they go to? The FlexJSTest_again example is in flex-asjs repo. For the sample tests that I created for FlexJSTest_again I put the files in a tests directory which is sibling to src directory under FlexJSTest_again. Is this location OK? Sounds right to me. Are there any other existing Flex examples that can be compiled using FalconJX for which I can write tests? Not right now. But hopefully there will be more example apps soon. -- Alex Harui Flex SDK Team Adobe Systems, Inc. http://blogs.adobe.com/aharui
Re: [FalconJX] Using RIATest
On 5/2/13 2:52 AM, Tigran Najaryan tig...@gmail.com wrote: Guys, is there still interest in using RIATest to test apps compiled using FalconJX? I'm still interested. And thanks for the generous offer. If there is I can go ahead and try to move this forward. I think we can do this: 1. My company will prepare a special license agreement for Apache Flex use, 2. Apache Flex team can review and help amend it to make it suitable, 3. Once the license agreement is ready we will incorporate it in RIATest so that when registered in a special way it will show the agreement and will adhere to its usage rules. I'm wondering how this will work. In an open-source development model, both committers and non-committers should be able to get the source and run tests in order to prove that changes they make don't cause any problems. The only difference is that non-committers submit patches, but committers can check in directly. Hopefully, many of these people are going to be legitimate RIATest customers. Do they get to use the free license to test their applications? If not, how does the license checker determine whether that person is testing the Flex SDK or their application? 4. I will need someone's help to integrate RIATest into Flex SDK build. It would probably be best if you submit patches to build scripts and the readme. You would likely earn committer rights that way and then would be able to make changes directly going forward. I have earlier submitted a sample test that uses RIATest to verify FlexTestAgain example. You can see it here: https://issues.apache.org/jira/browse/FLEX-33489 Thanks, Tigran. -- Alex Harui Flex SDK Team Adobe Systems, Inc. http://blogs.adobe.com/aharui
