Hi All, This is to update the Latest progress on App Manager Release testing. Currently there are following blockers and critical issues. IMHO these need to be fixed before the release.
- Oracle DB script related issues. - BAM toolbox issues/ Stats related issues - Single Logout - BPS integration issues. (Was Fixed with the latest pack (5th April Pack), yet to verify the fix) - Session Related issues. etc. Some of these issues are listed from [1] - [9]. In total(Open, Reopened, In Progress issues) there are 38 L1 and L2 isuues, 95 L3 issues and 15 L4 & L5 issues. Along the way we faced several challenges when testing APP-M apart from the blocking issues we faced, following new features were added - App Discovery - New Stats pages - Sample Deploying feature Some features also got changed - EMM integration - XACML policy UI etc. There were some configuration level changes in web-apps as well as in app-manager.xml/ user-mgt.xml which affected the Automation process. Lack of documentation was another issue we faced. Currently we are in the process of testing untested areas and bug fixed scenarios. Due to above mentioned issues IMHO I highly doubt whether we can do a proper round of testing before the planned release date. [1] - https://wso2.org/jira/browse/APPM-718 [2] - https://wso2.org/jira/browse/APPM-715 [3] - https://wso2.org/jira/browse/APPM-686 [4] - https://wso2.org/jira/browse/APPM-651 [5] - https://wso2.org/jira/browse/APPM-481 [6] - https://wso2.org/jira/browse/APPM-324 [7] - https://wso2.org/jira/browse/APPM-511 [8] - https://wso2.org/jira/browse/APPM-544 [9] - https://wso2.org/jira/browse/APPM-639 With Regards, On Thu, Mar 19, 2015 at 2:18 PM, Dinusha Senanayaka <dinu...@wso2.com> wrote: > Hi Yasassri, > > Please find the latest pack in [1]. We could find root cause for some of > the intermittent issues that you have reported. But we included some debug > logs to possible places, so that we can narrow down the issue if it > appeared on latest pack too. Please enable jaggery debug logs before you > start testing the pack. > > [1]. http://builder1.us1.wso2.org/~appm/19-03-2015/ > > Regards, > Dinusha. > > On Tue, Mar 17, 2015 at 6:39 PM, Yasassri Ratnayake <yasas...@wso2.com> > wrote: > >> Hi All, >> >> Meeting Notes >> >> - AM team will try to fix all the issues related to instability and >> share a new pack tomorrow. >> - Testing on oracle will be done based on the time available before >> the expected release date. >> - Long running test has to be run by the QA team. (on a standalone >> setup) >> - All features and UI's are currently finalized and no major changes >> will happen. >> >> With Regards, >> >> On Tue, Mar 17, 2015 at 6:14 PM, Yasassri Ratnayake <yasas...@wso2.com> >> wrote: >> >>> Hi Dinusha, >>> >>> Sorry for the ambiguity in the mail. Please see my comments in-line >>> >>> >>>>> Hi All, >>>>> >>>>> This is to update the current status of the App Manger release cycle. >>>>> >>>>> We had issues initially when testing due to following reasons >>>>> >>>>> - There was no decided permission model embedded to AM. >>>>> >>>>> This is finalized and we are not going to change the model ! There is >>>> a mail thread for this even ! >>>> >>> >>> This is an issue we had before March 6th pack, As mentioned the >>> permission model is finalized ATM. >>> >>> >>>>> - UI got changed along the way >>>>> >>>>> There were some usability improvements done after reviewing with UX >>>> team. >>>> >>>>> >>>>> - Features were not finalized. >>>>> >>>>> What you mean by features are not finalized ? >>>> >>> >>> Along the way there were some new features added, these were issues we >>> faced initially when we started testing. >>> >>> 1. Allow annonymous access >>> 2. Skip Creating Proxying WebApp >>> 3. New Dashboard was added to add Policies etc. >>> 4. Policy groups >>> 5. New statistical graphs/options, completely reverted statistics page >>> 6. Notification on App Rejection etc. >>> >>> Now, I believe all the features are finalized. >>> >>> >>> >>>>> *Current Status* >>>>> >>>>> ATM the latest pack is unstable so we are not testing the pack in the >>>>> clustered setup, hence we are doing our tests in a standalone setup. And >>>>> still the workflow process is not finalized. >>>>> >>>> AFAIK, there is a tenant specific issue relate to life-cycle loading. >>>> But, even with that we can continue super tenant scenarios in a cluster >>>> environment. Workflow process is not finalized ??? >>>> >>> >>> I'm claiming the instability based on these observation, irregular >>> behavior in some functions, Exceptions thrown intermittently, I have >>> reported most of them. [1] - [7]. These are all intermittent exceptions >>> that I observe when going through the general flow. The stability has >>> improved lot in the later packs, but there are some glitches which needs to >>> be investigated further. >>> >>> I have raised concerns regarding the workflow issue in the thread "[APP-M] >>> Workflows in App Manager". >>> >>> [1] - https://wso2.org/jira/browse/APPM-545 >>> [2] - https://wso2.org/jira/browse/APPM-554 >>> [3] - https://wso2.org/jira/browse/APPM-563 >>> [4] - https://wso2.org/jira/browse/APPM-491 >>> [5] - https://wso2.org/jira/browse/APPM-490 >>> [6] - https://wso2.org/jira/browse/APPM-439 >>> [7] - https://wso2.org/jira/browse/APPM-324 >>> >>> With Regards >>> -- >>> Yasassri Ratnayake >>> Software Engineer - QA >>> WSO2 Inc ; http://wso2.com >>> lean.enterprise.middleware >>> *Mobile : +94715933168 <%2B94715933168>* >>> *Blog : http://yasassriratnayake.blogspot.com/ >>> <http://yasassriratnayake.blogspot.com/>* >>> >> >> >> >> -- >> Yasassri Ratnayake >> Software Engineer - QA >> WSO2 Inc ; http://wso2.com >> lean.enterprise.middleware >> *Mobile : +94715933168 <%2B94715933168>* >> *Blog : http://yasassriratnayake.blogspot.com/ >> <http://yasassriratnayake.blogspot.com/>* >> > > > > -- > Dinusha Dilrukshi > Senior Software Engineer > WSO2 Inc.: http://wso2.com/ > Mobile: +94725255071 > Blog: http://dinushasblog.blogspot.com/ > -- Yasassri Ratnayake Software Engineer - QA WSO2 Inc ; http://wso2.com lean.enterprise.middleware *Mobile : +94715933168* *Blog : http://yasassriratnayake.blogspot.com/ <http://yasassriratnayake.blogspot.com/>*
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
