Unicode lexer issue?

Bulat Ziganshin bulatz at HotPOP.com
Tue Jan 10 02:39:16 EST 2006


Hello Ralf,

Tuesday, January 10, 2006, 4:58:19 AM, you wrote:

>>   This will break some source files if Latin-1 characters are being
RL> used.
>>   In most cases this should result in a UTF-8 decoding error.  Later
RL> on
>>   if we want to support more encodings (perhaps with a pragma to
RL> specify
>>   the encoding), I plan to do it by recoding into UTF-8 before
RL> parsing.

i hear that utf8 and utf16 encoded files have some special headuing
bytes to mark their encoding. but i'm not sure

at least i prefer to set the default to latin-1 because my files
contains huge portrion of Russian comments in 1251 codepage, which is
a chars > 128. so, such defaulting will break my sources and any other
written with non-english comments. i think that this is unacceptable,
especially for automatic download/build scenarios of ghc usage


-- 
Best regards,
 Bulat                            mailto:bulatz at HotPOP.com






More information about the Glasgow-haskell-bugs mailing list