Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On 7/1/2010 3:09 AM, Rick Root wrote: > It is, isn't it? Isn't it also a bit odd that the IBM web site you > originally pointed me to mentioned that exact character translation > issue?! and yet didn't tell you how to fix it, i guess that comes of the mentality of charging by the kblock ;-) >> let me see if i can recreate this sans mainframes. > > I wouldn't spend too much of your time on it - if any! Since much of too late, it's made me mad. if nothing else i would like to see why this is happening. i looked thru a bunch of charsets looking for ones where the "!" & "]" chars were transposed but didn't find anything. so maybe is the "!" considered a control char or something? and maybe the "typdefovr" parameter is for the client (cf) not the server? so you'd want the default encoding, UTF-8??? or leave off "typdefovr" & just use "sendUnicode". > the mainframe programmers do the extracts. conjures up visions of flintstone developers banging away on stone tablets before feeding into dinosaur powered "mainframe" which was then followed by memories of punch cards & WATFIV from my school days ;-) ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:335003 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On Wed, Jun 30, 2010 at 9:12 AM, Paul Hastings wrote: > > On 6/30/2010 7:13 PM, Rick Root wrote: >> No, I'm not sure it's an encoding error. You suggested that =) > > it's beyond odd that only the 1 char is getting changed. It is, isn't it? Isn't it also a bit odd that the IBM web site you originally pointed me to mentioned that exact character translation issue?! > it means "did you change cf's default encoding (via neo-runtime.xml) or use > cfprocessindirective to change it on that page"? Oh, no, definately not. > let me see if i can recreate this sans mainframes. I wouldn't spend too much of your time on it - if any! Since much of our data is dumped via FTP and loaded into SQL Server, this is a pretty minor issue for us. I'm actually writing some conversion programs to extract data from DB2 and produce files for loading into our new SAP CRM (ugh) and was planning on doing this via coldfusion and JDBC to the mainframe directly but I could potentially just hit the SQL Server versions of the mainframe tables, or just have one of the mainframe programmers do the extracts. Ric ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334984 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On 6/30/2010 7:13 PM, Rick Root wrote: > No, I'm not sure it's an encoding error. You suggested that =) it's beyond odd that only the 1 char is getting changed. >> is the page w/this query still using utf-8 encoding? > > I don't really know what that means. The extent of the page I'm > testing this on is a cfquery and a cfoutput. it means "did you change cf's default encoding (via neo-runtime.xml) or use cfprocessindirective to change it on that page"? let me see if i can recreate this sans mainframes. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334956 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On Tue, Jun 29, 2010 at 10:04 PM, Paul Hastings wrote: > > On 6/30/2010 12:47 AM, Rick Root wrote: >> However, setting the codepage to 500 (or 500,0,0) in the connection >> string using the typdefovr doesn't seem to help either. > > dumb question, are you sure there's actually an encoding error? No, I'm not sure it's an encoding error. You suggested that =) But what I can tell you is that if I look at the data directly in the mainframe using a 3270 emulator - or if I look at the data in files dumped from the mainframe and sent to me via FTP, the name of the company is "Yahoo!", but it is returned as "Yahoo]" via JDBC queries. > anything else getting garbaged? not a deeper driver issue? Nothing else is getting garbled. > is the page w/this query still using utf-8 encoding? I don't really know what that means. The extent of the page I'm testing this on is a cfquery and a cfoutput. Ric ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334955 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On 6/30/2010 12:47 AM, Rick Root wrote: > However, setting the codepage to 500 (or 500,0,0) in the connection > string using the typdefovr doesn't seem to help either. dumb question, are you sure there's actually an encoding error? IBM unicode 0x4F0x0021 #EXCLAMATION MARK the square brackets are 0x5B & 0x5D (i forgot which one you said you were getting). a simple encoding error (assuming that's the case, don't recall you mentioning any other issues) i would think might produce: 0xD60x004F #LATIN CAPITAL LETTER O anything else getting garbaged? not a deeper driver issue? is the page w/this query still using utf-8 encoding? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334947 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
Okay, an article I found said to run this query: SELECT ENCODING_SCHEME FROM SYSIBM.SYSTABLES WHERE NAME = 'ADVTB901' And if the result is E then it uses the parameter values of SCCID, MCCGID, and GCCID for single byte, multi-byte, and graphic character sets. So it looks like the code page were using is code page 500 (which contains all Latin 1 characters) However, setting the codepage to 500 (or 500,0,0) in the connection string using the typdefovr doesn't seem to help either. :( R ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334936 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
fwiw, I also tried code pages 437 ("MS-DOS United States, Australia,
New Zealand, South Africa") and code page 1047 ("Latin-1 character set
for EBCDIC hosts").
Cp1047 returned the same result.. Cp437 caused a null null error.
Rick
On Tue, Jun 29, 2010 at 8:06 AM, Rick Root wrote:
> On Mon, Jun 28, 2010 at 10:28 PM, Paul Hastings
> wrote:
>>
>> On 6/29/2010 2:28 AM, Rick Root wrote:
>>> wrapper is improperly translating the exclamation mark from the EBCDIC
>>> character set into ASCII - supposed to be ascii 33 but is coming
>>> through as ascii 93 instead.
>>
>> seen this? your exact problem is mentioned:
>> http://www.ibm.com/developerworks/data/library/techarticle/dm-0506chong/index.html
>>
>> does either driver support connection strings? can you add a codepage, i
>> think
>> maybe "37" (just typing that makes my skin crawl)?
>
> Thanks Paul... so far no luck. The StarSQL Driver has a connection
> string property called typdefovr that is used to define the CCSID
>
> (http://www.starquest.com/Products/starsql/ssqljava.pdf)
>
> I can save the datasource with values of "37" and "37,0,0" but neither
> has any effect.
>
> The StarSQL documentation does specifically sya it's for SENDING the
> data but doesn't specifically reference character translation for
> receiving data.
>
> I'll have to ask my mainframe guys to see what our default codepage is...
>
> Rick
~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334920
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On Mon, Jun 28, 2010 at 10:28 PM, Paul Hastings wrote: > > On 6/29/2010 2:28 AM, Rick Root wrote: >> wrapper is improperly translating the exclamation mark from the EBCDIC >> character set into ASCII - supposed to be ascii 33 but is coming >> through as ascii 93 instead. > > seen this? your exact problem is mentioned: > http://www.ibm.com/developerworks/data/library/techarticle/dm-0506chong/index.html > > does either driver support connection strings? can you add a codepage, i think > maybe "37" (just typing that makes my skin crawl)? Thanks Paul... so far no luck. The StarSQL Driver has a connection string property called typdefovr that is used to define the CCSID (http://www.starquest.com/Products/starsql/ssqljava.pdf) I can save the datasource with values of "37" and "37,0,0" but neither has any effect. The StarSQL documentation does specifically sya it's for SENDING the data but doesn't specifically reference character translation for receiving data. I'll have to ask my mainframe guys to see what our default codepage is... Rick ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334919 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: DB2 EBCDIC translation issue [spamtrap bayes][spamtrap heur]
On 6/29/2010 2:28 AM, Rick Root wrote: > wrapper is improperly translating the exclamation mark from the EBCDIC > character set into ASCII - supposed to be ascii 33 but is coming > through as ascii 93 instead. seen this? your exact problem is mentioned: http://www.ibm.com/developerworks/data/library/techarticle/dm-0506chong/index.html does either driver support connection strings? can you add a codepage, i think maybe "37" (just typing that makes my skin crawl)? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology-Michael-Dinowitz/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:334910 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
