Parallel-Downloader
view release on metacpan or search on metacpan
DESCRIPTION
This is not a library to build a parallel downloader on top of. It is a
downloading client build on top of AnyEvent::HTTP.
Its goal is not to be better, faster, or smaller than anything else. Its
goal is to provide the user with a single function they can call with a
bunch of HTTP requests and which gives them the responses for them with
as little fuss as possible and most importantly, without downloading
them in sequence.
It handles the busywork of grouping requests by hosts and limiting the
amount of simultaneous requests per host, separate from capping the
amount of overall connections. This allows the user to maximize their
own connection without abusing remote hosts.
Of course, there are facilities to customize the exact limits employed
and to add logging and such; but "async_download" is the premier piece
of API and should be enough for most uses.
FUNCTIONS
async_download
lib/Parallel/Downloader.pm view on Meta::CPAN
=head1 DESCRIPTION
This is not a library to build a parallel downloader on top of. It is a
downloading client build on top of AnyEvent::HTTP.
Its goal is not to be better, faster, or smaller than anything else. Its goal is
to provide the user with a single function they can call with a bunch of HTTP
requests and which gives them the responses for them with as little fuss as
possible and most importantly, without downloading them in sequence.
It handles the busywork of grouping requests by hosts and limiting the amount of
simultaneous requests per host, separate from capping the amount of overall
connections. This allows the user to maximize their own connection without
abusing remote hosts.
Of course, there are facilities to customize the exact limits employed and to
add logging and such; but C<async_download> is the premier piece of API and
should be enough for most uses.
=head1 FUNCTIONS
( run in 0.254 second using v1.01-cache-2.11-cpan-3cd7ad12f66 )