Re: [Dev] Form submit with non-utf-8 characters
Hi All, Due to the dead silence on the thread, I have decided to commit, and the commit has been made to fix the above mentioned THREE issues. Thanks, Fazlan On Wed, Jun 13, 2012 at 9:07 PM, Fazlan Sabar faz...@wso2.com wrote: Hi Azeez, Do you have any concerns or objections on this? Your swift response will be highly appreciated. Thanks, Fazlan On Wed, Jun 13, 2012 at 8:38 PM, Fazlan Sabar faz...@wso2.com wrote: Should I proceed with this commit to the trunk? Also, I verified the JIRA pointed by Ajith, and it also gets resolved with this fix. Thanks, Fazlan On Wed, Jun 13, 2012 at 2:09 PM, Fazlan Sabar faz...@wso2.com wrote: On Wed, Jun 13, 2012 at 1:51 PM, Senaka Fernando sen...@wso2.comwrote: Sounds perfect. Is this something that we already have, * org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter*? Nope, I just introduced it. Thanks, Senaka. On Wed, Jun 13, 2012 at 1:47 PM, Pradeep Fernando prad...@wso2.comwrote: +1 from me. --Pradeep -- *Senaka Fernando* Member - Integration Technologies Management Committee; Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Thanks, Fazlan -- Thanks, Fazlan -- Thanks, Fazlan -- Thanks, Fazlan ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi All, There were TWO Carbon JIRA's raised pertaining to the $subject [1] [2] concerning Governance Registry being unable to browse resource with UTF-8 names and content. These were are currently being assigned to me, and I manged to fix them locally (not committed to trunk). Following is how I can break down the fixes made. The reference I used is here [3]. *Handle GET Requests:* Updated the Connector definitions in * GREG_HOME/repository/conf/tomcat/catalina-server.xml* as follows, Connector protocol=org.apache.coyote.http11.Http11NioProtocol port=9763 . . . *URIEncoding=UTF-8*/ Connector protocol=org.apache.coyote.http11.Http11NioProtocol port=9443 . . . *URIEncoding=UTF-8*/ *Handle POST Requests:* * * I overcame this by introducing a servert filter (refer to the attached org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.java) to * org.wso2.carbon.tomcat.ext* bundle, this sets the character encoding in the *GREG_HOME/repository/conf/tomcat/carbon/WEB-INF/web.xml* by configuring the servel filter in it as follows, web-app . . . . . . filter filter-name*CharsetFilter*/filter-name filter-class*org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter* /filter-class init-param *!-- specifying the encoding --* param-namerequestEncoding/param-name param-valueUTF-8/param-value /init-param /filter filter-mapping filter-name*CharsetFilter*/filter-name url-pattern*/**/url-pattern /filter-mapping . . . /web-app *Handling the JSPs:* Also, I had to update all the *.jsp pages found in * org.wso2.carbon.registry.resource.ui* bundle to add the pageEncoding attribute. %@ page contentType=text/html;charset=UTF-8 language=java * pageEncoding=UTF-8* % I haven't committed any of the above changes, I would like to know your feedback on this, since this I feel affects at Carbon level. [1] https://wso2.org/jira/browse/REGISTRY-879 [2] https://wso2.org/jira/browse/REGISTRY-882 [3] http://stackoverflow.com/questions/138948/how-to-get-utf-8-working-in-java-webapps Thanks, Fazlan On Thu, May 31, 2012 at 8:31 PM, Senaka Fernando sen...@wso2.com wrote: Hi Pradeep, I don't understand what you mean by reference model. What we explained is was working in the last release and not working in current trunk. If some fix or improvement broke it, it needs to be added back. It might be a fix in our code or Tomcat, but it needs to be fixed or its a regression issue and hence an L1. If your question was about whether the same worked in the last release if you deployed Carbon as a webapp on standalone Tomcat, Ajith can validate that for you. Thanks, Senaka. On Thu, May 31, 2012 at 2:47 PM, Pradeep Fernando prad...@wso2.comwrote: Hi, hold on!.it wasn't a blind delete. we ported some code, removed some. AFAIU, we introduced these wrapper classes to overcome Appserver specific serialization issues. Right now, our reference model is, standalone tomcat. So what is the behaviour with standalone tomcat. --Pradeep -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks, Fazlan CharacterSetFilter.java Description: Binary data ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
+1 from me. --Pradeep ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Sounds perfect. Is this something that we already have, * org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter*? Thanks, Senaka. On Wed, Jun 13, 2012 at 1:47 PM, Pradeep Fernando prad...@wso2.com wrote: +1 from me. --Pradeep -- *Senaka Fernando* Member - Integration Technologies Management Committee; Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Wed, Jun 13, 2012 at 1:40 PM, Fazlan Sabar faz...@wso2.com wrote: Hi All, There were TWO Carbon JIRA's raised pertaining to the $subject [1] [2] concerning Governance Registry being unable to browse resource with UTF-8 names and content. These were are currently being assigned to me, and I manged to fix them locally (not committed to trunk). Following is how I can break down the fixes made. The reference I used is here [3]. *Handle GET Requests:* Updated the Connector definitions in * GREG_HOME/repository/conf/tomcat/catalina-server.xml* as follows, Connector protocol=org.apache.coyote.http11.Http11NioProtocol port=9763 . . . *URIEncoding=UTF-8*/ Connector protocol=org.apache.coyote.http11.Http11NioProtocol port=9443 . . . *URIEncoding=UTF-8*/ *Handle POST Requests:* * * I overcame this by introducing a servert filter (refer to the attached org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.java) to * org.wso2.carbon.tomcat.ext* bundle, this sets the character encoding in the *GREG_HOME/repository/conf/tomcat/carbon/WEB-INF/web.xml* by configuring the servel filter in it as follows, web-app . . . . . . filter filter-name*CharsetFilter*/filter-name filter-class*org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter* /filter-class init-param *!-- specifying the encoding --* param-namerequestEncoding/param-name param-valueUTF-8/param-value /init-param /filter filter-mapping filter-name*CharsetFilter*/filter-name url-pattern*/**/url-pattern /filter-mapping . . . /web-app *Handling the JSPs:* Also, I had to update all the *.jsp pages found in * org.wso2.carbon.registry.resource.ui* bundle to add the pageEncoding attribute. %@ page contentType=text/html;charset=UTF-8 language=java * pageEncoding=UTF-8* % I haven't committed any of the above changes, I would like to know your feedback on this, since this I feel affects at Carbon level. [1] https://wso2.org/jira/browse/REGISTRY-879 [2] https://wso2.org/jira/browse/REGISTRY-882 [3] http://stackoverflow.com/questions/138948/how-to-get-utf-8-working-in-java-webapps +1 . There is another issue[3] that related to this problem. [1]https://wso2.org/jira/browse/REGISTRY-878 Thanks Ajith Thanks, Fazlan On Thu, May 31, 2012 at 8:31 PM, Senaka Fernando sen...@wso2.com wrote: Hi Pradeep, I don't understand what you mean by reference model. What we explained is was working in the last release and not working in current trunk. If some fix or improvement broke it, it needs to be added back. It might be a fix in our code or Tomcat, but it needs to be fixed or its a regression issue and hence an L1. If your question was about whether the same worked in the last release if you deployed Carbon as a webapp on standalone Tomcat, Ajith can validate that for you. Thanks, Senaka. On Thu, May 31, 2012 at 2:47 PM, Pradeep Fernando prad...@wso2.comwrote: Hi, hold on!.it wasn't a blind delete. we ported some code, removed some. AFAIU, we introduced these wrapper classes to overcome Appserver specific serialization issues. Right now, our reference model is, standalone tomcat. So what is the behaviour with standalone tomcat. --Pradeep -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks, Fazlan ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Wed, Jun 13, 2012 at 1:51 PM, Senaka Fernando sen...@wso2.com wrote: Sounds perfect. Is this something that we already have, * org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter*? Nope, I just introduced it. Thanks, Senaka. On Wed, Jun 13, 2012 at 1:47 PM, Pradeep Fernando prad...@wso2.comwrote: +1 from me. --Pradeep -- *Senaka Fernando* Member - Integration Technologies Management Committee; Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Thanks, Fazlan ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi Azeez, Do you have any concerns or objections on this? Your swift response will be highly appreciated. Thanks, Fazlan On Wed, Jun 13, 2012 at 8:38 PM, Fazlan Sabar faz...@wso2.com wrote: Should I proceed with this commit to the trunk? Also, I verified the JIRA pointed by Ajith, and it also gets resolved with this fix. Thanks, Fazlan On Wed, Jun 13, 2012 at 2:09 PM, Fazlan Sabar faz...@wso2.com wrote: On Wed, Jun 13, 2012 at 1:51 PM, Senaka Fernando sen...@wso2.com wrote: Sounds perfect. Is this something that we already have, * org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter*? Nope, I just introduced it. Thanks, Senaka. On Wed, Jun 13, 2012 at 1:47 PM, Pradeep Fernando prad...@wso2.comwrote: +1 from me. --Pradeep -- *Senaka Fernando* Member - Integration Technologies Management Committee; Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Thanks, Fazlan -- Thanks, Fazlan -- Thanks, Fazlan ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Thu, May 31, 2012 at 10:46 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 10:20 AM, Ajith Vitharana aji...@wso2.com wrote: On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.comwrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.comwrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. OK, but I think we still need to do that. I mean all JSPs not just one or two. Yes, Changed every jsp files inside registry and governance components. But doesn't work. Thanks Ajith I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); I don't think that's a good solution. We shouldn't be needing to use ISO-8859-1 to retrieve the bytes. Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 We can do that if needed. Thanks, Senaka. Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi Ajith, Ok. Point taken. We had something called, CarbonHttpServletRequest (see r112136), which dealt with this in the past. Wonder whether that no longer exists? Thanks, Senaka. On Thu, May 31, 2012 at 11:37 AM, Ajith Vitharana aji...@wso2.com wrote: On Thu, May 31, 2012 at 10:46 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 10:20 AM, Ajith Vitharana aji...@wso2.comwrote: On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.comwrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.comwrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.comwrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. OK, but I think we still need to do that. I mean all JSPs not just one or two. Yes, Changed every jsp files inside registry and governance components. But doesn't work. Thanks Ajith I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); I don't think that's a good solution. We shouldn't be needing to use ISO-8859-1 to retrieve the bytes. Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 We can do that if needed. Thanks, Senaka. Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Thu, May 31, 2012 at 12:02 PM, Ajith Vitharana aji...@wso2.com wrote: On Thu, May 31, 2012 at 11:43 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, Ok. Point taken. We had something called, CarbonHttpServletRequest (see r112136), which dealt with this in the past. Wonder whether that no longer exists? It has removed after tomcat OSGI . see r122364. In that case, this need to be fixed. Somethings in carbon bridge and other similar packages were to bridge the OSGi and non-OSGi worlds. But, everything in it was not. A blanket delete all (assuming it is unused) is not what should have been done. Pradeep/Dimuthu, please note that these are L1 issues for the Carbon Kernel and we cannot release without fixing or finding alternative solutions to issues like this. Thanks, Senaka. Thanks Ajith Thanks, Senaka. On Thu, May 31, 2012 at 11:37 AM, Ajith Vitharana aji...@wso2.comwrote: On Thu, May 31, 2012 at 10:46 AM, Senaka Fernando sen...@wso2.comwrote: Hi Ajith, On Thu, May 31, 2012 at 10:20 AM, Ajith Vitharana aji...@wso2.comwrote: On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.comwrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.comwrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.comwrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. OK, but I think we still need to do that. I mean all JSPs not just one or two. Yes, Changed every jsp files inside registry and governance components. But doesn't work. Thanks Ajith I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); I don't think that's a good solution. We shouldn't be needing to use ISO-8859-1 to retrieve the bytes. Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 We can do that if needed. Thanks, Senaka. Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean
Re: [Dev] Form submit with non-utf-8 characters
Hi, hold on!.it wasn't a blind delete. we ported some code, removed some. AFAIU, we introduced these wrapper classes to overcome Appserver specific serialization issues. Right now, our reference model is, standalone tomcat. So what is the behaviour with standalone tomcat. --Pradeep ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi Pradeep, I don't understand what you mean by reference model. What we explained is was working in the last release and not working in current trunk. If some fix or improvement broke it, it needs to be added back. It might be a fix in our code or Tomcat, but it needs to be fixed or its a regression issue and hence an L1. If your question was about whether the same worked in the last release if you deployed Carbon as a webapp on standalone Tomcat, Ajith can validate that for you. Thanks, Senaka. On Thu, May 31, 2012 at 2:47 PM, Pradeep Fernando prad...@wso2.com wrote: Hi, hold on!.it wasn't a blind delete. we ported some code, removed some. AFAIU, we introduced these wrapper classes to overcome Appserver specific serialization issues. Right now, our reference model is, standalone tomcat. So what is the behaviour with standalone tomcat. --Pradeep -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.com wrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Do we want to configure anything in tomcat level ? Appreciate any help on this . Thanks Ajith Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.com wrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.com wrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.com wrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.com wrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.com wrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
Hi Ajith, On Thu, May 31, 2012 at 10:20 AM, Ajith Vitharana aji...@wso2.com wrote: On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.com wrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.comwrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. OK, but I think we still need to do that. I mean all JSPs not just one or two. I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); I don't think that's a good solution. We shouldn't be needing to use ISO-8859-1 to retrieve the bytes. Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 We can do that if needed. Thanks, Senaka. Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando *Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Form submit with non-utf-8 characters
On Thu, May 31, 2012 at 10:20 AM, Ajith Vitharana aji...@wso2.com wrote: On Thu, May 31, 2012 at 9:47 AM, Senaka Fernando sen...@wso2.com wrote: Hi Ajith, On Thu, May 31, 2012 at 9:31 AM, Vijitha Kumara viji...@wso2.com wrote: On Wed, May 30, 2012 at 8:50 PM, Ajith Vitharana aji...@wso2.comwrote: Hi All, I'm doing a form submit after filled some text fields with non-utf-8 characters. After when I try to get values of those text fields , it doesn't return same value which I have submitted. submit : param =Overview_Provider , value=ÇÇ request.getParameter(Overview_Provider) return ÇÇÇÇÇÇ. Is the JSP used for this uses the encoding (e.g: %@ page contentType=text/html; charset=UTF-8 pageEncoding=ISO-8859-1 %) ? Can we fix the @page declaration of JSPs in the Registry and Governance components to match the following, recompile, and test, %@ page contentType=text/html;charset=UTF-8 language=java pageEncoding=UTF-8 % Hi Senaka/Vijitha, I tried this but doesn't work. We can check with request.getCharacterEncoding() to see it's actually UTF-8 that we get. I found following solution and it works fine. new String(request.getParameter(Overview_Provider).getBytes(ISO-8859-1)); Now the resource URL contain the non-utf-8 characters therefore can't open it. It can be resolve adding following property to catalina-server.xml. URIEncoding=UTF-8 This set thes encoding globally to Tomcat. Some points for that[1] [1] http://wiki.apache.org/tomcat/FAQ/CharacterEncoding#Q8 Thanks Ajith Thanks, Senaka. But same thing working fine in branch (3.2.3 branch, In G-reg 4.1.1). Thanks Ajithn -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Senaka Fernando* Product Manager - WSO2 Governance Registry; Associate Technical Lead; WSO2 Inc.; http://wso2.com* Member; Apache Software Foundation; http://apache.org E-mail: senaka AT wso2.com **P: +1 408 754 7388; ext: 51736*; *M: +94 77 322 1818 Linked-In: http://linkedin.com/in/senakafernando * Lean . Enterprise . Middleware -- Ajith Vitharana. WSO2 Inc. - http://wso2.org Email : aji...@wso2.com Mobile : +94714631794 -- Vijitha Kumara Senior Software Engineer; WSO2, Inc.; http://wso2.com/ email: viji...@wso2.com Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
