Unicode lexer issue?
Bulat Ziganshin
bulatz at HotPOP.com
Tue Jan 10 02:39:16 EST 2006
Hello Ralf,
Tuesday, January 10, 2006, 4:58:19 AM, you wrote:
>> This will break some source files if Latin-1 characters are being
RL> used.
>> In most cases this should result in a UTF-8 decoding error. Later
RL> on
>> if we want to support more encodings (perhaps with a pragma to
RL> specify
>> the encoding), I plan to do it by recoding into UTF-8 before
RL> parsing.
i hear that utf8 and utf16 encoded files have some special headuing
bytes to mark their encoding. but i'm not sure
at least i prefer to set the default to latin-1 because my files
contains huge portrion of Russian comments in 1251 codepage, which is
a chars > 128. so, such defaulting will break my sources and any other
written with non-english comments. i think that this is unacceptable,
especially for automatic download/build scenarios of ghc usage
--
Best regards,
Bulat mailto:bulatz at HotPOP.com
More information about the Glasgow-haskell-bugs
mailing list