[Hackage] #288: the package indexes are very slow

[Hackage]

#288: the package indexes are very slow
---------------------------------+------------------------------------------
  Reporter:  duncan              |        Owner:       
      Type:  defect              |       Status:  new  
  Priority:  normal              |    Milestone:       
 Component:  cabal-install tool  |      Version:  HEAD 
  Severity:  normal              |     Keywords:       
Difficulty:  easy (<4 hours)     |   Ghcversion:  6.8.2
  Platform:                      |  
---------------------------------+------------------------------------------

Comment(by duncan):

 The installed package index is now respectably fast. The available index
 is still slow.

 Here's one approach: instead of generating a full cache in an alternative
 format, generate an index of the tarball mapping package id to offset,
 length pairs in the uncompressed .tar file. Then we can lazily load the
 tarball. Ideally just mmap it and extract the offset,length slices and
 lazily parse. It would avoid loading the full 20+ megabytes of the full
 index.

-- 
Ticket URL: <http://hackage.haskell.org/trac/hackage/ticket/288#comment:3>
Hackage <http://haskell.org/cabal/>
Hackage: Cabal and related projects