[Haskell-cafe] How can I improve the pipes's performance with a huge file?
tom-lists-haskell-cafe-2013 at jaguarpaw.co.uk
Fri Nov 14 09:52:49 UTC 2014
On Fri, Nov 14, 2014 at 05:43:15PM +0800, zhangjun.julian wrote:
> But when I test with whole file (40M rows), it take more than 20 minutes and not finished yet.
> It take more than 9G memorys, and the disk is also busy all time.
> import qualified Data.Map as DM
At the very least you should be using
import qualified Data.Map.Strict as DM
More information about the Haskell-Cafe