Re: [Catalyst] CSV / UTF-8 / Unicode
On 4 Jul 2013, at 10:30, Mike Whitaker wrote:
> On 4 Jul 2013, at 09:56, Craig Chant wrote:
>>
>> Yes it's NVARCHAR(max) , which I understood is MS's data-typing for uNicode
>> VARiable CHARacters, looking at some sample column data via the Windows SQL
>> Management GUI, it appears to display ok.
>
> It probably isn't UTF-8, though. UTF-8 is only one possible encoding in which
> you can store unicode character points.
Try, on the off-chance I've read the spec right
- not bothering with mysql_encode_utf8 in the DBI connect args
- passing all data from DBI through decode("UTF-16",...) or decode("UCS-2"...)
- MS's docs aren't that clear which!
- reencoding it as utf8 on the way out.
___
List: Catalyst@lists.scsys.co.uk
Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst
Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/
Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
On 4 Jul 2013, at 09:56, Craig Chant wrote: > > Yes it's NVARCHAR(max) , which I understood is MS's data-typing for uNicode > VARiable CHARacters, looking at some sample column data via the Windows SQL > Management GUI, it appears to display ok. It probably isn't UTF-8, though. UTF-8 is only one possible encoding in which you can store unicode character points. ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
On 2 Jul 2013, at 14:36, Mike Whitaker wrote: > On 2 Jul 2013, at 14:34, Craig Chant wrote: >> >> So either I refactor my SQL model wrappers under Catalyst to use >> Win32::ODBC, or I find out why DBI is corrupting my SQL data. > > Be a hero. Do the latter :D :D ..and have a read of http://juerd.nl/site.plp/perluniadvice You may also find that calling utf8::is_utf8() on the strings that come back from your DB may be revealing (this is one case in which you may use this without people screaming N!), as may http://search.cpan.org/~ilyaz/Devel-Peek-0.96/Peek.pm for peeking into the innnards of Perl strings. ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
On 2 Jul 2013, at 14:34, Craig Chant wrote: > > So either I refactor my SQL model wrappers under Catalyst to use Win32::ODBC, > or I find out why DBI is corrupting my SQL data. Be a hero. Do the latter :D :D ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
> # encode UTF8 octet
>use Encode qw(decode encode);
>my $octets = encode('UTF-8', $xls);
OUt of curiousity, where's the data in $xls come from, and what do you know
about its encoding and bytes vs characters status?
___
List: Catalyst@lists.scsys.co.uk
Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst
Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/
Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
On 2 Jul 2013, at 10:59, Craig Chant wrote:
>
>utf8::encode($xls);
>
>$iof->binmode(":encoding(UTF-8)");
...erm, haven't you now encoded twice?
Also? Don't use utf8::encode - if you can't use IO layers etc, use the general
Encode module.
___
List: Catalyst@lists.scsys.co.uk
Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst
Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/
Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] CSV / UTF-8 / Unicode
On 2 Jul 2013, at 10:38, Craig Chant wrote: > > I thought all strings in perl were Unicode ? or at least that's what the > Unicode::Encoding plugin is for isnt' it? No. Decoded strings in Perl are in a character representation which is magic and you don't need to know about. Assuming that representation is Unicode will bite you on the backside when you most want it not to. ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Re: New Catalyst Release on CPAN!
On 17 Jun 2013, at 13:37, John Napiorkowski wrote: > > Personally I have no idea what unicode perfected would look like The short and (I'll be honest) somewhat glib summary is that in Unicode perfected all interface layers to/from the outside world take and present Perl internal character strings and know about the encodings they're talking to/reading from :D Of course, this does rely on the outside world not LYING to us! :D ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Page fragment caching
> b) there is something like page fragment caching which allows me to > not cache DBIC objects but generated HTML in an elegant way (without > having to wrap each TT code snippet with cache get/set calls)? > Catalyst::Plugin::PageCache only allows the caching of whole pages > which currently is not an option because there is more dynamic stuff > (like logged-in user) added to the final page. AFAIK, page fragment > caching is quite common in other frameworks (RoR comes to mind ...). One way to acheive this is to front-end your site with the varnish proxy and use ESI. ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Shirts for YAPC::NA
On 4 Jun 2008, at 08:42, Moritz Onken wrote: CafePress sucks. The quality of the print is pretty bad. I bought a few catalyst shirts and they look like pretty bad after a few weeks... Could you find another partner? In the medium term, I believe mst's found somewhere local to him that'll do decent shirt printing in bulk. In the 'getting something to wear at YAPC::NA' term, it's going to be CafePress, methinks :) Deadline is June 5 (when CafePress' free shipping deal ends :) ) -- Mike Whitaker - [EMAIL PROTECTED] ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
[Catalyst] Shirts for YAPC::NA
I'll be placing a CafePress order later in the week to save on US- >abroad postage for myself (as I have a tame US shipping address in Chicago). If any non-US folks going to YAPC::NA want to piggyback on the order, please let me know before close of UK business Thursday: I'll take USD cash @ the conference, or PayPal. -- Mike Whitaker| Perl developer, writer, guitarist, photographer [EMAIL PROTECTED] | Board member, http://www.enlightenedperl.org/ Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
[Catalyst] Google Summer of Code reminder
If anyone out there /is/ a student, or knows someone who is, and is interested in submitting a project proposal for the Google Summer of Code - http://code.google.com/soc/2008/ - , the application deadline is this coming Monday. Some suggestions for project ideas are up at http:// www.perlfoundation.org/perl5/index.cgi?gsoc2008_projects. -- Mike Whitaker| Perl developer, writer, guitarist, photographer [EMAIL PROTECTED] | Board member, http://www.enlightenedperl.org/ Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] developer.yahoo.com
On 18 Mar 2008, at 12:29, Chisel Wright wrote: On Tue, Mar 18, 2008 at 02:13:22PM +0200, Octavian Rasnita wrote: Do you have any idea why? None at all. Have you tried asking _them_? http://developer.yahoo.com/perl/ exists, is not linked. I've set things in motion both to fix that and to get some much needed love for the subsite itself. -- Mike Whitaker| Perl developer, writer, guitarist, photographer [EMAIL PROTECTED] | Board member, http://www.enlightenedperl.org/ Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | Yahoo! UK Ltd - internal CMS team ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Catalyst and Shibboleth authentication
On 14 Mar 2008, at 19:00, Kirby Krueger wrote: Greetings, I'm writing a new web application, and have decided to jump into Catalyst (because I am smart.) One thing that Catalyst seems to do well is have a good mechanism for plugging in standard approaches to things. Here at the University of Washington, we use a project called 'Shibboleth' for authentication: http://shibboleth.internet2.edu/ I dunno exactly what Shibboleth does, but if the notes on dealing with external single sign on (http://catwiki.toeat.com/gettingstarted/ tutorialsandhowtos/sso_authentication) are any help, steal away :) (JayK did sanity check them for me, and He Should Know :) ) -- Mike Whitaker| Perl developer, writer, guitarist, photographer [EMAIL PROTECTED] | Board member, http://www.englightenedperl.org/ Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] The performance test of 6 leading frameworks
On 29 Feb 2008, at 16:21, [EMAIL PROTECTED] wrote: hi I do not know if this test has already been posted on the list Several times. Why these bad performances ? http://www.alrond.com/en/2007/jan/25/performance-test-of-6-leading- frameworks/ Yes, it's slower. But let's just look at one figure there in a real world context: Catalyst: req/s 132.96 That's: roughly 480,000 req/hour roughly 11 milion req/day roughly 330 million req/month If your site's doing that many requests a month, and you can't afford to move off one machine, your site's revenue model is seriously screwed. The last site I worked on that did a quarter billion plus a month did it on 40 servers! On top of that, of course, that presupposes all your users are accepting data as fast as you can throw it at them: rarely, if ever, is that the case. So, the question is, if the road you're on is limited to 70mph, does it matter if you're driving a car that'll do 110 or 230? Choose one that you're comfortable driving :) -- Mike Whitaker - [EMAIL PROTECTED] ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] So, what do we want in the -next- book?
On 18 Feb 2008, at 18:17, Matt S Trout wrote: Since a fair few of you will now have John's book, I figured it was time to ask what you'd want from a second book. I guess the existing one provides a pretty good tutorial style, so we should be looking at something more in-depth / intermediate to advanced. What do you guys think? Cookbook, without question. -- Mike Whitaker| Yahoo! UK Ltd - internal CMS team [EMAIL PROTECTED] | Perl developer, writer, guitarist, photographer Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Potential MojoMojo bug
Is this the CamelCode bug I saw being discussed earlier? The 'parsing code fragments in for WikiLinks' issue? Yes. I believe marcus has a fix. -- Mike Whitaker| Yahoo! UK Ltd - internal CMS team [EMAIL PROTECTED] | Perl developer, writer, guitarist, photographer Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Testing docs / Wiki migration / Mojo question
On 23 Jan 2008, at 12:37, Peter Edwards wrote: 1) I found I had to escape CamelCase words within code blocks, is this as intended? E.g. I'm assured this (and the other one) are being fixed, as I've bitched about it too :) -- Mike Whitaker| Yahoo! UK Ltd - internal CMS team [EMAIL PROTECTED] | Perl developer, writer, guitarist, photographer Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Documentation on DBIx Class
On 16 Jan 2008, at 07:54, Peter Sørensen wrote: Now I've come across Catalyst and DBIx. *cough* DBIC :) -- Mike Whitaker - [EMAIL PROTECTED] ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Documentation on DBIx Class
I need some advice on where to look for documentation specially the DBIx Class and which methods I can use in here along with Catalyst. On top of everyone else's suggestions, DO read the perldocs for SQL::Abstract, as that's how DBIC queries are defined. -- Mike Whitaker - [EMAIL PROTECTED] ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] Re: two Catalyst flaws
On 3 Jan 2008, at 18:39, J. Shirley wrote: If your project can't afford an extra $20-$40/mo, and it is a for- profit venture, then a business plan needs reevaluated. And if it costs you an additional $40/mo to get enough RAM to run your app, maybe a VPS isn't for you? You can get 1U of space in the $30-$40/ mo range, buy an eBay server for $250 and slap more RAM in it and bring your operating cost to under $70/mo with hardware you own and can upgrade as you see fit. Admittedly, I have no idea of the details of the project, this is true. But, hardware is cheap compared to the programmer time of any programmer worth his salt that could be better spent on features. This was not always the case (fond memories of recompiling kernels at midnight every night and rolling them round 40 servers during the 1999 Cricket World Cup in an attempt to make cricinfo.com run faster), but I really do fail to see how memory or disk space should be a bottleneck (except for rampant leaks) in any modern project, any more than hits/second of your chosen framework is. -- Mike Whitaker| Yahoo! UK Ltd - internal CMS team [EMAIL PROTECTED] | Perl developer, writer, guitarist, photographer Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] two Catalyst flaws
A normal "mistake" of managing web servers these days is to put tons of web applications onto one server and letting them fight over resources. Servers (and memory in particular) is a low cost factor (compared to development costs). Then why not give your lovely web application some GB's of memory? Absolutely. Memory is cheap, about 1GB / hour of programmer time at any decent rate. (Crucial, 2GB for £52.). If it takes you more than an hour to reduce the memory footprint of your app, buy your server more RAM :) -- Mike Whitaker| Yahoo! UK Ltd - internal CMS team [EMAIL PROTECTED] | Perl developer, writer, guitarist, photographer Y!: tuxservers | Blog: http://perlent.blogspot.com/ IRC: Penfold | CatSwag: http://www.cafepress.com/catalystdev ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
Re: [Catalyst] "Rails is a Ghetto"
This is a long rant I’m writing in serial form. Stay tuned for more about Ruby conferences and why they suck, and why the Pickaxe book is what killed Ruby. All I can say is… wow. I’ll be re-assessing and processing for a while. He sounds a little angry :) A little???!!! The quote I found interesting was "...Ruby on Rails means stay on the Rails. There is an established best practice way to build web applications with Rails and that's the entire point of the system." -- Mike Whitaker - [EMAIL PROTECTED] ___ List: Catalyst@lists.scsys.co.uk Listinfo: http://lists.scsys.co.uk/cgi-bin/mailman/listinfo/catalyst Searchable archive: http://www.mail-archive.com/catalyst@lists.scsys.co.uk/ Dev site: http://dev.catalyst.perl.org/
