RE: Special Encoding

To clarify what Vineesh is trying to do: the input text is in a known Windows code page (or equivalent Unix/Linux encoding), but that is not necessarily the code page/locale of the operating system or process.  The output is supposed to be UTF-8, and the code page of the input text may change at known points during the session.

	-----Original Message----- 
	From: George Rhoten [mailto:[email protected]] 
	Sent: Fri 9/5/2003 6:06 PM 
	To: Sinha, Vineesh 
	Cc: [email protected] 
	Subject: RE: Special Encoding
	
	

	It looks like you're using a char * string to get your resource.  Is that
	string in UTF-8?  Is the output in UTF-8, and did you label it as such in
	the HTML or XML?
	
	If you would like to make sure that your browser is setup correctly, try
	this page:
	http://oss.software.ibm.com/cgi-bin/icu/lx/en_US/utf-8/?locale_all&
	
	Except for Divehi and a few characters in Azerbaijani, Hawaiian and
	Kazakh, the characters appear to display correctly on my Windows 2000
	machine.  If you can display that page from LocaleExplorer, then I have a
	feeling that you are corrupting the data somewhere along the way before
	displaying the output in Internet Explorer.
	
	Just at a quick glance, you may be mixing the encodings from the two cout
	statements.  The first set of couts may be in the default codepage, and
	the second set of couts may be in UTF-8 and interpreting it as being in
	the default codepage.  I'm presuming that the default codepage isn't
	UTF-8.
	
	George Rhoten
	IBM Globalization Center of Competency/ICU  San José, CA, USA
	
	
	
	
	"Sinha, Vineesh" <[email protected]>
	Sent by: [email protected]
	09/05/2003 02:29 PM
	
	        To:     "Steven R. Loomis" <[email protected]>
	        cc:     <[email protected]>
	        Subject:        RE: Special Encoding
	
	
	Thanks a lot for the prompt response.
	
	Let me put my question more clearly. In this particular application, xml
	needs to
	be generated for all user actions. For instance, if the user creates a
	table of data,
	that table needs to go into the XML. For all user activity, I'm building a
	DOM tree
	using Xerces, and when the appropriate request comes, I serialize this DOM
	tree to
	a file.
	
	This application is localized by having key-value pair kind of set up. The
	code has keys
	in it, and depending upon the output language setting for the application,
	the corresponding
	value is picked from the appropriate language file. To cut the technical
	jargons, it can
	be assumed that if the application output language is English,
	en/MyFile.txt is used to get
	the value for key, and if German is the preference, de/MyFile.txt is read.
	The key-value
	file, MyFile.txt, exists for each supported language, and has language
	specific localized
	text for the values of the key.
	
	I tried getting the output as preformatted texts in html file as well, but
	the texts are
	not displayed appropriately in the browser. I'm working on a system with
	Microsoft
	Windows XP Prefessional Version 2002 (Service Pack 1). The browser is
	Microsoft Internet
	Explorer Version 6.0.2800. All I'm seeing in my editor (and browser) is
	garbage. I have
	the required fonts, and I can see the desired texts when typing directly
	from keyboard.
	The text written programmatically is not what I expected.
	
	
	
	
	-----Original Message-----
	From: Steven R. Loomis [mailto:[email protected]]
	Sent: Friday, September 05, 2003 4:05 PM
	To: Sinha, Vineesh
	Cc: [email protected]
	Subject: Re: Special Encoding
	
	
	I don't quite understand what's going on here, but let me see if I can
	ask some things...
	
	What is GetLocalisedString(),  what is the encoding of the std::string
	it returns?
	
	the ICU Locale::setDefault() does not affect non-ICU services.   Rather
	than changing the default locale,  I would recommend that you maintain
	a Locale parameter as a variable, and change/use that rather than
	changing the default.
	
	Other than the use of uloc_setDefault() it seems like your questions
	have more to do with Xerces than ICU.
	
	What do you mean by 'not good encoded chinese strings' at the end?
	
	If all of the data is to be UTF-8, why is there a question with the
	encoding?
	
	Regards,
	Steven
	
	On Friday, September 5, 2003, at 01:41 PM, Sinha, Vineesh wrote:
	> Hi,
	>
	> I'm struggling to get the right encoding for the localized text. ...
	
	_______________________________________________
	icu mailing list
	[email protected]
	http://oss.software.ibm.com/developerworks/oss/mailman/listinfo/icu
	
	_______________________________________________
	icu mailing list
	[email protected]
	http://oss.software.ibm.com/developerworks/oss/mailman/listinfo/icu