I found an issue with Kubernetes services where they do not configure Session Affinity. As a result requests coming to a cluster with a web UI goes to random members.
The problem was that Kubernetes set this to "None" by default. This can be now configured in the cartridge using a property: { "name": "KUBERNETES_SERVICE_SESSION_AFFINITY", "value": "ClientIP" } The fix was committed in commit revision: https://github.com/apache/stratos/commit/b00dd2d2992aba3150a183aa969b98850a17c309 Thanks On Thu, May 28, 2015 at 2:47 PM, Imesh Gunaratne <im...@apache.org> wrote: > Once more than one port mapping was defined a string processing issue > occurred: > > *Payload: * > > "PORT_MAPPINGS=PROTOCOL:http|PORT:4500|PROXY_PORT:8763:PROTOCOL:https|PORT:4501|PROXY_PORT:8443", > > *Context generated:* > {'STRATOS_WORKER_HOST_NAME': 'esb.cloud-test.wso2.com', > 'STRATOS_WKA_MEMBERS': {'127.0.1.1': '4000', '127.0.0.1': '4000'}, > 'STRATOS_HTTP_PROXY_PORT': '80', 'STRATOS_CLUSTERING': 'false', > 'STRATOS_PORT_MAPPING': {' 8243': '9443', ' 80': '8280', '8280': '9763', ' > 443': '8243'}, 'STRATOS_LOCAL_MEMBER_HOST': 'esb.cloud-test.wso2.com', > 'STRATOS_LOCAL_MEMBER_PORT': '4300', 'STRATOS_DOMAIN': 'wso2.esb.domain', > 'STRATOS_PORT_OFFSET': '0', 'STRATOS_SUB_DOMAIN': 'mgt', > 'STRATOS_HTTPS_PROXY_PORT': '443', 'STRATOS_MEMBERSHIP_SCHEME': 'wka', > 'STRATOS_MGT_HOST_NAME': 'mgt.esb.cloud-test.wso2.com'} > > *ERROR* > [2015-05-27 05:47:29,132] INFO > {cartridgeagentutils.py:wait_until_ports_active} - Waiting for ports to be > active: [ip] 'localhost' [ports] ["'9763", "9443'"] > Exception in thread Thread-1: > Traceback (most recent call last): > File "/usr/lib/python2.7/threading.py", line 552, in __bootstrap_inner > self.run() > File "agent.py", line 97, in run > cartridgeagentpublisher.publish_instance_activated_event() > File > "/opt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/publisher/cartridgeagentpublisher.py", > line 71, in publish_instance_activated_event > int(CartridgeAgentConfiguration().read_property("port.check.timeout", > critical=False)) > File > "/opt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/util/cartridgeagentutils.py", > line 81, in wait_until_ports_active > active = check_ports_active(ip_address, ports) > File > "/opt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/util/cartridgeagentutils.py", > line 110, in check_ports_active > s.connect((ip_address, int(port))) > ValueError: invalid literal for int() with base 10: "'9763" > > On Thu, May 28, 2015 at 9:58 AM, Imesh Gunaratne <im...@apache.org> wrote: > >> Hi Lahiru, >> >> I think we are not ready for RC3, we need to fix two issues found in PCA >> and test them. >> >> Thanks >> >> On Thu, May 28, 2015 at 9:12 AM, Lahiru Sandaruwan <lahi...@wso2.com> >> wrote: >> >>> Hi Lakmal, >>> >>> Will proceed. >>> >>> Thanks. >>> >>> On Thu, May 28, 2015 at 9:04 AM, Lakmal Warusawithana <lak...@wso2.com> >>> wrote: >>> >>>> Hi Lahiru/devs, >>>> >>>> Are we good to go for rc3? >>>> >>>> thanks >>>> >>>> On Wed, May 27, 2015 at 1:14 PM, Rajkumar Rajaratnam < >>>> rajkum...@wso2.com> wrote: >>>> >>>>> Noted. Sorry for that :) >>>>> >>>>> Thanks. >>>>> >>>>> On Wed, May 27, 2015 at 12:49 PM, Lakmal Warusawithana < >>>>> lak...@wso2.com> wrote: >>>>> >>>>>> Folks, we are only fixing blocking issues for the release, DON'T do >>>>>> the cleanup stuff at this stage. Please create JIRA for those and track >>>>>> with next minor releases. >>>>>> >>>>>> On Wed, May 27, 2015 at 12:39 PM, Rajkumar Rajaratnam < >>>>>> rajkum...@wso2.com> wrote: >>>>>> >>>>>>> I feel like we are bundling some unwanted jars in JCA distribution. >>>>>>> Sometimes back, I found that we bundled the following jars with JCA in >>>>>>> 4.0.0 release, even though these are not used by JCA. >>>>>>> >>>>>>> commons-httpclient-3.1.0.wso2v2.jar >>>>>>> commons-httpclient-3.1.jar >>>>>>> httpclient-4.1.1-wso2v1.jar >>>>>>> httpcore-4.1.0-wso2v1.jar >>>>>>> >>>>>>> Are we using the above jars in JCA now? If not, better to remove >>>>>>> these jars. There might be more unwanted jars. >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> On Wed, May 27, 2015 at 11:10 AM, Imesh Gunaratne <im...@apache.org> >>>>>>> wrote: >>>>>>> >>>>>>>> I found two issues and fixed: >>>>>>>> >>>>>>>> Kubernetes clean command was trying to remove Kubernetes DNS pod >>>>>>>> (with Kubernetes 0.17.0). >>>>>>>> >>>>>>>> https://github.com/apache/stratos/commit/309378ac7db973e01128dc909420483bc65d4aa7 >>>>>>>> >>>>>>>> 2015-05-27 10:57:07,781] ERROR >>>>>>>> {org.apache.stratos.autoscaler.applications.parser.DefaultApplicationParser} >>>>>>>> - Alias is not valid: [application-id] wso2esb-4.8.1-app >>>>>>>> [cartridge-type] >>>>>>>> wso2esb-4.8.1 [alias] wso2esb-4.8.1-1 >>>>>>>> >>>>>>>> The above error message does not say the valid alias patten: >>>>>>>> >>>>>>>> https://github.com/apache/stratos/commit/a4710cbfb8dd3d406126bcaa756c9e00459523b7 >>>>>>>> >>>>>>>> Thanks >>>>>>>> >>>>>>>> On Tue, May 26, 2015 at 10:50 PM, Lahiru Sandaruwan < >>>>>>>> lahi...@wso2.com> wrote: >>>>>>>> >>>>>>>>> I carried out a test in EC2 today. It seems we do not validate the >>>>>>>>> partitions(partition ids) included in the deployment policy. It would >>>>>>>>> be >>>>>>>>> better to fix this as well. >>>>>>>>> >>>>>>>>> Thanks. >>>>>>>>> >>>>>>>>> On Tue, May 26, 2015 at 3:58 PM, Pubudu Gunatilaka < >>>>>>>>> pubu...@wso2.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Devs, >>>>>>>>>> >>>>>>>>>> I have fixed the issue of removing already in used network >>>>>>>>>> partition with the diff sent by Rajkumar. >>>>>>>>>> Please review and merge the pull request in [1]. >>>>>>>>>> >>>>>>>>>> [1] - https://github.com/apache/stratos/pull/361 >>>>>>>>>> >>>>>>>>>> Thank you! >>>>>>>>>> >>>>>>>>>> On Tue, May 26, 2015 at 2:44 PM, Lahiru Sandaruwan < >>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Lakmal, >>>>>>>>>>> >>>>>>>>>>> Will do. >>>>>>>>>>> >>>>>>>>>>> Thanks. >>>>>>>>>>> >>>>>>>>>>> On Tue, May 26, 2015 at 2:42 PM, Lakmal Warusawithana < >>>>>>>>>>> lak...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> We should test RC2 pack further before cutting RC3. Let take >>>>>>>>>>>> another day or so to do more testing on RC2. >>>>>>>>>>>> >>>>>>>>>>>> On Tue, May 26, 2015 at 2:18 PM, Lahiru Sandaruwan < >>>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Guys, >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks for taking time to test and report. Let's fix these and >>>>>>>>>>>>> start a RC3. >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks. >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, May 26, 2015 at 2:12 PM, Rajkumar Rajaratnam < >>>>>>>>>>>>> rajkum...@wso2.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> I found that network partitions can be removed even if they >>>>>>>>>>>>>> are used in an application. Better to fix this. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks. >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, May 26, 2015 at 2:08 PM, Imesh Gunaratne < >>>>>>>>>>>>>> im...@apache.org> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> I did an end to end test with Kubernetes, single-cartridge >>>>>>>>>>>>>>> application and found the below error in PCA when un-deploying >>>>>>>>>>>>>>> the >>>>>>>>>>>>>>> application: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [2015-05-26 06:44:40,038] ERROR {eventsubscriber.py:run} - >>>>>>>>>>>>>>> Error processing 'ApplicationSignUpRemovedEvent' event >>>>>>>>>>>>>>> Traceback (most recent call last): >>>>>>>>>>>>>>> File >>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/subscriber/eventsubscriber.py", >>>>>>>>>>>>>>> line 103, in run >>>>>>>>>>>>>>> handler(event_msg) >>>>>>>>>>>>>>> File "agent.py", line 294, in on_application_signup_removed >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> self.__event_handler.on_application_signup_removed_event(event_obj) >>>>>>>>>>>>>>> File >>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/event/eventhandler.py", >>>>>>>>>>>>>>> line 351, in on_application_signup_removed_event >>>>>>>>>>>>>>> " [application ID] " + >>>>>>>>>>>>>>> application_signup_removal_event.applicationId >>>>>>>>>>>>>>> TypeError: cannot concatenate 'str' and 'int' objects >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Mon, May 25, 2015 at 4:10 PM, Lahiru Sandaruwan < >>>>>>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi All, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> This thread is for discussion of the second release candidate >>>>>>>>>>>>>>>> of Apache Stratos 4.1.0. Please use this thread for >>>>>>>>>>>>>>>> discussion of issues uncovered in the RC, questions you >>>>>>>>>>>>>>>> may have about the RC, etc. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *RC release packs:* >>>>>>>>>>>>>>>> *https://dist.apache.org/repos/dist/dev/stratos/4.1.0-rc2/ >>>>>>>>>>>>>>>> <https://dist.apache.org/repos/dist/dev/stratos/4.1.0-rc2/>* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *The tag to be voted upon:* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> https://git-wip-us.apache.org/repos/asf?p=stratos.git;a=commit;h=c3122516b83039552606f3baaa55fbcf95511162 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *Git tag (4.1.0-rc2) tree view:* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> https://git-wip-us.apache.org/repos/asf?p=stratos.git;a=tree;h=d1c97b1b68a04b1b7f8811034e096f0c7a95e0e4;hb=c3122516b83039552606f3baaa55fbcf95511162 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> *Stratos KEYS file containing PGP keys we use to sign the >>>>>>>>>>>>>>>> release:* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/stratos/4.1.0-rc2/KEYS >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>>>>>> email: lahi...@wso2.com blog: >>>>>>>>>>>>>>>> http://lahiruwrites.blogspot.com/ >>>>>>>>>>>>>>>> linked-in: >>>>>>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> Imesh Gunaratne >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Senior Technical Lead, WSO2 >>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Rajkumar Rajaratnam >>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos >>>>>>>>>>>>>> Software Engineer, WSO2 >>>>>>>>>>>>>> >>>>>>>>>>>>>> Mobile : +94777568639 >>>>>>>>>>>>>> Blog : rajkumarr.com >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> -- >>>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>>> >>>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>>> email: lahi...@wso2.com blog: >>>>>>>>>>>>> http://lahiruwrites.blogspot.com/ >>>>>>>>>>>>> linked-in: >>>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Lakmal Warusawithana >>>>>>>>>>>> Vice President, Apache Stratos >>>>>>>>>>>> Director - Cloud Architecture; WSO2 Inc. >>>>>>>>>>>> Mobile : +94714289692 >>>>>>>>>>>> Blog : http://lakmalsview.blogspot.com/ >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> -- >>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>> >>>>>>>>>>> phone: +94773325954 >>>>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>>>> linked-in: >>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>>> *Pubudu Gunatilaka* >>>>>>>>>> Software Engineer >>>>>>>>>> WSO2, Inc.: http://wso2.com >>>>>>>>>> lean.enterprise.middleware >>>>>>>>>> mobile: +94 77 4078049 >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> -- >>>>>>>>> Lahiru Sandaruwan >>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>> Senior Software Engineer, >>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>> lean.enterprise.middleware >>>>>>>>> >>>>>>>>> phone: +94773325954 >>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Imesh Gunaratne >>>>>>>> >>>>>>>> Senior Technical Lead, WSO2 >>>>>>>> Committer & PMC Member, Apache Stratos >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Rajkumar Rajaratnam >>>>>>> Committer & PMC Member, Apache Stratos >>>>>>> Software Engineer, WSO2 >>>>>>> >>>>>>> Mobile : +94777568639 >>>>>>> Blog : rajkumarr.com >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Lakmal Warusawithana >>>>>> Vice President, Apache Stratos >>>>>> Director - Cloud Architecture; WSO2 Inc. >>>>>> Mobile : +94714289692 >>>>>> Blog : http://lakmalsview.blogspot.com/ >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Rajkumar Rajaratnam >>>>> Committer & PMC Member, Apache Stratos >>>>> Software Engineer, WSO2 >>>>> >>>>> Mobile : +94777568639 >>>>> Blog : rajkumarr.com >>>>> >>>> >>>> >>>> >>>> -- >>>> Lakmal Warusawithana >>>> Vice President, Apache Stratos >>>> Director - Cloud Architecture; WSO2 Inc. >>>> Mobile : +94714289692 >>>> Blog : http://lakmalsview.blogspot.com/ >>>> >>>> >>> >>> >>> -- >>> -- >>> Lahiru Sandaruwan >>> Committer and PMC member, Apache Stratos, >>> Senior Software Engineer, >>> WSO2 Inc., http://wso2.com >>> lean.enterprise.middleware >>> >>> phone: +94773325954 >>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>> >>> >> >> >> -- >> Imesh Gunaratne >> >> Senior Technical Lead, WSO2 >> Committer & PMC Member, Apache Stratos >> > > > > -- > Imesh Gunaratne > > Senior Technical Lead, WSO2 > Committer & PMC Member, Apache Stratos > -- Imesh Gunaratne Senior Technical Lead, WSO2 Committer & PMC Member, Apache Stratos