[Haskell-cafe] How on Earth Do You Reason about Space?

[Daniel Fischer]

On Wednesday 01 June 2011 12:28:28, John Lato wrote:
> There are a few solutions to this.  The first is to make a copy of the
> bytestring so only the required data is retained.  In my experiments
> this wasn't helpful, but it would depend on your corpus.  The second is
> to start with smaller chunks.

The third, check whether the word is already known, and *make a copy if 
not*. That should only keep the required parts (including the currently 
processed chunk) in memory.