[Haskell-cafe] hxt memory useage

[Albert Y. C. Lai]

Matthew Pocock wrote:
> I've been using hxt to process xml files. Now that my files are getting a bit 
> bigger (30m) I'm finding that hxt uses inordinate amounts of memory. I have 
> 8g on my box, and it's running out. As far as I can tell, this memory is 
> getting used up while parsing the text, rather than in any down-stream 
> processing by xpickle.
> 
> Is this a known issue?

Yes, hxt calls parsec, which is not incremental.

haxml offers the choice of non-incremental parsers and incremental 
parsers. The incremental parsers offer finer control (and therefore also 
require finer control).