view release on metacpan or  search on metacpan

lib/BuzzSaw/Importer.pm  view on Meta::CPAN

code which attempts to avoid re-reading previously seen files will not
be used. The default value is C<false> (i.e. a value of 0 -
zero). When this value is set to true it will be set to true for all
the data sources, this makes it easier to override globally. When it
is false then the specific setting for the data source will be used.

=back

=head1 SUBROUTINES/METHODS

This class has the following methods:

=over

=item $importer = BuzzSaw::Importer->new()

This will create a new BuzzSaw::Importer object. You will need to
specify, at least, a data source.

=item $importer = BuzzSaw::Importer->new_with_config()

This will create a new BuzzSaw::Impoter object using the attribute
values stored in the configuration file. A filename maybe be
specified, if not the default value will be used. The value for any
attribute can be overridden.

=item $importer->import_events

This is the method which does all the work. It works through the
streams of entries from each data source. Firstly the SHA-256 digest
is calculated for each event, any event which has previously been seen
will then be ignored. For new events they are parsed into their
constituent parts using the relevant L<BuzzSaw::Parser>. The parsed
event is then passed through all the specified L<BuzzSaw::Filter>
objects. If the event is of interest it is then stored using the
L<BuzzSaw::DB> object.

=back

=head1 DEPENDENCIES

This module is powered by L<Moose>. You will also need
L<MooseX::Types>, L<MooseX::Log::Log4perl> and
L<MooseX::SimpleConfig>.

This module also requires the L<DateTime> and L<Readonly> modules.

=head1 SEE ALSO

L<BuzzSaw>, L<BuzzSaw::DB>, L<BuzzSaw::DataSource>,
L<BuzzSaw::Parser>, L<BuzzSaw::Filter>

=head1 PLATFORMS

This is the list of platforms on which we have tested this
software. We expect this software to work on any Unix-like platform
which is supported by Perl.

ScientificLinux6

=head1 BUGS AND LIMITATIONS

Please report any bugs or problems (or praise!) to bugs@lcfg.org,
feedback and patches are also always very welcome.

=head1 AUTHOR

    Stephen Quinney <squinney@inf.ed.ac.uk>

=head1 LICENSE AND COPYRIGHT

    Copyright (C) 2012-2013 University of Edinburgh. All rights reserved.

This library is free software; you can redistribute it and/or modify
it under the terms of the GPL, version 2 or later.

=cut