Proposal: splitting the network package

Conrad Parker conrad at metadecks.org
Thu Jan 17 23:15:46 CET 2013


On 18 January 2013 00:50, Bryan O'Sullivan <bos at serpentine.com> wrote:
> On Thu, Jan 17, 2013 at 8:38 AM, Conrad Parker <conrad at metadecks.org> wrote:
>> c'mon, it's not like anyone needs to go parsing billions of URIs in a hurry.
>
> This is not even a bit true, I'm afraid. I have run into innumerable
> cases where libraries low in some language's stack, but on a hot code
> path, were slow enough to dramatically affect both latency and
> throughput. The URI handling code in network would be a prime instance
> of that.

Indeed. I was being a little bit facetious: the problem of parsing
billions of URIs comes up fairly often in web crawling.

Conrad.



More information about the Libraries mailing list