view release on metacpan or search on metacpan
lib/Net/Amazon/EMR.pm view on Meta::CPAN
$emr->add_job_flow_steps(JobFlowId => $job_id,
Steps => [{
ActionOnFailure => 'CANCEL_AND_WAIT',
Name => "Example",
HadoopJarStep => {
Jar => '/home/hadoop/contrib/streaming/hadoop-streaming.jar',
Args => [ '-input', 's3://my-bucket/my-input',
'-output', 's3://my-bucket/my-output',
'-mapper', '/path/to/mapper-script',
'-reducer', '/path/to/reducer-script',
],
lib/Net/Amazon/EMR.pm view on Meta::CPAN
=back
=head2 Mappers and Reducers
Assuming the reader is familiar with the basic principles of map-reduce, in terms of implementation in Perl with hadoop-streaming.jar, a mapper/reducer is simply a script that reads from STDIN and writes to STDOUT, typically line by line using a tab-...
while (my $line = <>) {
chomp $line;
my ($key, $value) = split(/\t/, @line);
... do something with key and value
print "$newkey\t$newvalue\n";
}
Scripts can be uploaded to S3 using the web interface, or placed in the bootstrap bundle described above, or uploaded to the master instance using scp and distributed using the hadoop-streaming.jar -file option, or no doubt by many other mechanisms. ...
Args => [ '-mapper', '"perl -e MyClass->new->mapper"', ... ]
=head1 AUTHOR
view release on metacpan or search on metacpan
lib/Net/Amazon/Glacier.pm view on Meta::CPAN
$tree_hash_array_ref must be an ordered list (same order as final assembled online
archive, as opposed to upload order) of partial tree hashes as returned by
multipart_upload_upload_part
$archive_size is provided at completion to check all parts make up an archive an
not before hand to allow for archive streaming a.k.a. upload archives of unknown
size. Beware of dead ends when choosing part size. Use
calculate_multipart_upload_partsize to select a part size that will work.
Returns an archive id that can be used to request a job to retrieve the archive
at a later time on success and 0 on failure.
view release on metacpan or search on metacpan
lib/Net/Amazon/HadoopEC2/Cluster.pm view on Meta::CPAN
-file reduce.pl
)
);
my $result = $cluster->execute(
{
command => "$hadoop jar $streaming $option",
}
);
=head1 DESCRIPTION
view release on metacpan or search on metacpan
(thanks to snappy for reporting + providing a test case for tracing).
0.028 2015-04-15 23:31:34+01:00 Europe/London
Features:
* Supports messages which have been split into multiple frames - currently
there's no streaming support, but this should now handle arbitrarily-large
messages as long as you have the memory available.
Bugs fixed:
* Better channel close detection and handling - we now also record when
a ::Channel instance has been closed, so we know to report an error if any
view release on metacpan or search on metacpan
lib/Net/Async/FastCGI.pm view on Meta::CPAN
Sets the default encoding used by all new requests. If not supplied then
C<UTF-8> will apply.
=item stream_stdin => BOOL
If true, requests will expect to handling streaming of stdin data. In this
mode, the C<on_request> event handler will be invoked once parameters for a
new request have been received, even if the stdin stream is not yet complete.
=back
view release on metacpan or search on metacpan
lib/Net/Async/HTTP/Server.pm view on Meta::CPAN
Don't use L<HTTP::Message> objects as underlying implementation
=item *
Consider how to do streaming request inbound
=item *
Lots more testing
view release on metacpan or search on metacpan
the same connection initially (RT66189)
* When serialising a request, handle a full protocol://authority URI
by splitting protocol/authority parts out of it
0.11 BUGFIXES:
* Fix stalling t/12request-streaming.t test script that causes lots
of FAILs at test time
0.10 CHANGES:
* Support streaming of request body content
* Support HTTP::Cookies object as a cookie jar
* Allow proxy_host and proxy_port as ->configure parameters, to set
defaults for requests
0.09 CHANGES:
* Use IO::Async::Protocol->connect from 0.34
0.08 CHANGES:
* Support streaming of response body content
* Support SSL if IO::Async::SSL is installed
0.07 CHANGES:
* base on IO::Async::Protocol::Stream
view release on metacpan or search on metacpan
lib/Net/Async/Pusher.pm view on Meta::CPAN
use parent qw(IO::Async::Notifier);
=head1 NAME
Net::Async::Pusher - support for pusher.com streaming event API
=head1 SYNOPSIS
#!/usr/bin/env perl
use strict;
view release on metacpan or search on metacpan
lib/Net/Async/Spotify/Scope.pm view on Meta::CPAN
use Exporter 'import';
our @EXPORT_OK = qw(scopes images listening_history spotify_connect playback playlists follow library users);
our %EXPORT_TAGS = ( all => \@EXPORT_OK );
my %scopes = map { $_ =~ s/-/_/gr => $_ } qw(ugc-image-upload user-read-recently-played user-read-playback-state user-top-read app-remote-control playlist-modify-public user-modify-playback-state playlist-modify-private user-follow-modify user-read-...
# TODO: Add support for endpoints allowed for each Scope.
=head1 METHODS
lib/Net/Async/Spotify/Scope.pm view on Meta::CPAN
Returns list of Spotify Scopes for Playback
=cut
sub playback { @scopes{qw(app_remote_control streaming)} }
=head2 playlists
Returns list of Spotify Scopes for Playlists
view release on metacpan or search on metacpan
lib/Net/Async/Webservice/S3.pm view on Meta::CPAN
my $if_match = $args{if_match};
my $byte_range = $args{byte_range};
# TODO: This doesn't handle retries correctly
# But that said neither does the rest of this module, wrt: on_chunk streaming
my $on_chunk = delete $args{on_chunk};
my $header;
my $head_future = $self->loop->new_future;
view release on metacpan or search on metacpan
lib/Net/Camera/Edimax/IC1500.pm view on Meta::CPAN
Returns the device's MAC address.
=item statusVideoPort
Returns the TCP port used by the video streaming applet.
=item statusHTTPPort
Returns the TCP port used for the web front end.
view release on metacpan or search on metacpan
lib/Net/DAAP/Server/MythTV.pm view on Meta::CPAN
$sth->execute($intid);
my ($filename) = $sth->fetchrow_array;
open $response->{handle}, '<', $filename;
$response->streaming(1);
}
__END__
=head1 NAME
view release on metacpan or search on metacpan
lib/Net/Docker.pm view on Meta::CPAN
my $url = $self->_uri('/containers/'.$container.'/attach');
my $res = $self->ua->post($url, \%params);
return $res->content;
}
sub streaming_logs {
my ($self, $container, %options) = @_;
*STDOUT->autoflush(1);
my $input = delete $options{in_fh};
lib/Net/Docker.pm view on Meta::CPAN
);
say $id;
$api->start($id);
my $cv = $api->streaming_logs($id,
stream => 1, logs => 1,
stdin => 1, stderr => 1, stdout => 1,
in_fh => \*STDIN, out_fh => \*STDOUT,
);
$cv->recv;
view release on metacpan or search on metacpan
dropbear/libtomcrypt/doc/crypt.tex view on Meta::CPAN
The \textit{header} data is meant to be meta--data associated with a stream that isn't private (e.g., protocol messages). It can
be added at anytime during an EAX stream, and is part of the authentication tag. That is, changes in the meta-data can be detected by changes in the output tag.
The mode can then process plaintext producing ciphertext as well as compute a partial checksum. The actual checksum
called a \textit{tag} is only emitted when the message is finished. In the interim, the user can process any arbitrary
sized message block to send to the recipient as ciphertext. This makes the EAX mode especially suited for streaming modes
of operation.
The mode is initialized with the following function.
\index{eax\_init()}
\begin{verbatim}
dropbear/libtomcrypt/doc/crypt.tex view on Meta::CPAN
message of length \textit{headerlen} octets.
When this function completes, the \textit{eax} state will be initialized such that you can now either have data decrypted or
encrypted in EAX mode. Note: if \textit{headerlen} is zero you may pass \textit{header} as \textbf{NULL} to indicate there is no initial header data.
To encrypt or decrypt data in a streaming mode use the following.
\index{eax\_encrypt()} \index{eax\_decrypt()}
\begin{verbatim}
int eax_encrypt( eax_state *eax,
const unsigned char *pt,
unsigned char *ct,
dropbear/libtomcrypt/doc/crypt.tex view on Meta::CPAN
}
\end{verbatim}
\end{small}
\mysection{GCM Mode}
Galois counter mode is an IEEE proposal for authenticated encryption (also it is a planned NIST standard). Like EAX and OCB mode, it can be used in a streaming capacity
however, unlike EAX it cannot accept \textit{additional authentication data} (meta--data) after plaintext has been processed. This mode also only works with
block ciphers with a 16--byte block.
A GCM stream is meant to be processed in three modes, one after another. First, the initialization vector (per session) data is processed. This should be
unique to every session. Next, the the optional additional authentication data is processed, and finally the plaintext (or ciphertext depending on the direction).
view release on metacpan or search on metacpan
lib/Net/Etcd.pm view on Meta::CPAN
my @users = $range->all
# delete single key
$etcd->deleterange({ key => 'test0' });
# watch key range, streaming.
$watch = $etcd->watch( { key => 'foo', range_end => 'fop'}, sub {
my ($result) = @_;
print STDERR Dumper($result);
})->create;
view release on metacpan or search on metacpan
* Add mapping from backends to directors and directors to origins
0.8 2011-11-03
* Add list_* to all objects
* Add Healthchecks and Syslog endpoint streaming
0.7 2011-11-02
* Fix stupid bug in fastly_upload_vcl
view release on metacpan or search on metacpan
lib/Net/Flowdock/Stream.pm view on Meta::CPAN
}
}
=head1 DESCRIPTION
This module implements the streaming api for
L<Flowdock|https://www.flowdock.com/>. It provides a non-blocking method which
you can call to get the next available event in the stream. You can then
integrate this method into your existing event-driven app.
=head1 ATTRIBUTES
view release on metacpan or search on metacpan
lib/Net/FullAuto/FA_Core.pm view on Meta::CPAN
spl => 'application/futuresplash',
spr => 'application/x-sprite',
sprite => 'application/x-sprite',
src => 'application/x-wais-source',
ssi => 'text/x-server-parsed-html',
ssm => 'application/streamingmedia',
sst => 'application/vnd.ms-pki.certstore',
step => 'application/step',
stl => 'application/sla',
#stl => 'application/vnd.ms-pki.stl',
#stl => 'application/x-navistyle',
view release on metacpan or search on metacpan
lib/Net/IANA/Services.pm view on Meta::CPAN
our $IANA_REGEX_PORTS = qr{\b(?<!-)(?:1(?:1(?:1(?:[234589]|0[345689]?|6[12345]?|7[12345]?|1[012]?)?|3(?:[034589]|2[01]?|19?|67?|71?)?|7(?:[0134678]|2[03]?|51?|96?)?|2(?:[23456789]|0[128]?|1?1)?|9(?:[01234578]|9[789]?|67?)?|0(?:[1234678]|0[01]?|9?5)?|...
our $IANA_REGEX_SERVICES = qr{\b(?<![-])(?:s(?:e(?:[pt]|r(?:v(?:e(?:r(?:view(?:-(?:asn?|icc|gf|rm)|dbms)|-find|graph|start|wsd2)|xec)|i(?:ce(?:-ctrl|meter|tags)|staitsm)|s(?:erv|tat))|comm-(?:scadmin|wlink)|ialgateway|aph)|c(?:-(?:t4net-(?:clt|srv)|p...
our $IANA_REGEX_PORTS_DCCP = qr{\b(?<!-)(?:1(?:02[12]|113)|500[45]|4556|6514|9)\b}i; ## no critic(RegularExpressions)
lib/Net/IANA/Services.pm view on Meta::CPAN
our $IANA_REGEX_SERVICES_SCTP = qr{\b(?<![-])(?:a(?:sap-sctp(?:-tls)?|(?:hs|mq)p|25-fap-fgw|urora|ds-c)|s(?:i(?:mco|ps?)|(?:bc|gs)ap|1-control|mbdirect|sh|ua)|i(?:u(?:hsctpassoc|a)|tu-bicc-stc|pfixs?)|m(?:2(?:[pu]a|ap)|3(?:ap|ua)|egaco-h248)|wme(?:re...
our $IANA_REGEX_SERVICES_TCP = qr{\b(?<![-])(?:s(?:e(?:[pt]|r(?:v(?:e(?:r(?:view(?:-(?:asn?|icc|gf|rm)|dbms)|-find|graph|start|wsd2)|xec)|i(?:ce(?:-ctrl|meter|tags)|staitsm)|stat)|comm-(?:scadmin|wlink)|ialgateway|aph)|c(?:-(?:t4net-(?:clt|srv)|pc2fa...
our $IANA_REGEX_SERVICES_UDP = qr{\b(?<![-])(?:s(?:u(?:[am]|n(?:-(?:s(?:r-(?:iiop(?:-aut|s)?|https?|jm[sx]|admin)|ea-port)|as-(?:j(?:mxrmi|pda)|iiops(?:-ca)?|nodeagt)|user-https|mc-grp|dr|lm)|c(?:acao-(?:(?:jmx|sn)mp|websvc|csa|rmi)|luster(?:geo|mgr)...
####################
view release on metacpan or search on metacpan
lib/Net/IMP/HTTP.pm view on Meta::CPAN
our @EXPORT;
# create and export NET_IMP_HTTP* constants
push @EXPORT, IMP_DATA( 'http',
'header' => +1,
'body' => -2, # message body: streaming
'chkhdr' => +3,
'chktrailer' => +4,
'data' => -5, # encapsulated data (websocket etc): streaming
'junk' => -6, # junk data (leading empty lines..): streaming
);
push @EXPORT, IMP_DATA( 'httprq[http+10]',
'header' => +1,
'content' => -2, # unchunked, uncompressed content: streaming
'data' => -3, # encapsulated data (websocket etc): streaming
);
__END__
view release on metacpan or search on metacpan
lib/Net/IMP.pm view on Meta::CPAN
our %EXPORT_TAGS = ( log => \@log_levels );
# data types/protocols
# These two are the basic types, more application specific types might
# be defined somewhere else and be mapped to a number within supported_dtypes.
# The only important thing is, that streaming data should be <0, while
# packetized data (like HTTP header or UDP datagrams) should be > 0
# If no explicit type is given in sub data, it will assume IMP_DATA_STREAM.
use constant IMP_DATA_STREAM => dualvar(-1,'imp.data.stream');
use constant IMP_DATA_PACKET => dualvar(+1,'imp.data.packet');
lib/Net/IMP.pm view on Meta::CPAN
package Net::IMP::HTTP;
use Net::IMP 'IMP_DATA';
use Exporter 'import';
our @EXPORT = IMP_DATA('http',
'header' => +1, # packet type
'body' => -2, # streaming type
...
);
=head1 DESCRIPTION
lib/Net/IMP.pm view on Meta::CPAN
=over 4
=item IMP_DATA_STREAM (-1)
This is for generic streaming data, e.g. chunks from these datatypes can be
concatenated and analyzed together, parts can be replaced etc.
=item IMP_DATA_PACKET (+1)
This is for generic packetized data, where each chunk (e.g. call to C<data>)
lib/Net/IMP.pm view on Meta::CPAN
=back
All other data types are considered either subtypes of IMP_DATA_PACKET
(value >0) or of IMP_DATA_STREAM (value<0) and share their restrictions.
Also only streaming data of the same type can be concatenated and
analyzed together.
Results will be delivered through the callback or via C<poll_results>.
=item $analyzer->poll_results => @results
lib/Net/IMP.pm view on Meta::CPAN
The function C<IMP_DATA> is provided to simplify definition of new data types,
for example:
our @EXPORT = IMP_DATA('http',
'header' => +1, # packet type
'body' => -2, # streaming type
...
);
push @EXPORT = IMP_DATA('httprq[http+10]',
'header' => +1, # packet type
'content' => -2, # streaming type
...
);
This call of IMP_DATA is equivalent to the following perl declaration:
view release on metacpan or search on metacpan
lib/Net/Icecast/Source.pm view on Meta::CPAN
######################
=head1 NAME
Net::Icecast::Source - Icecast streaming source
=head1 SYNOPSIS
use Net::Icecast::Source;
my $source = new Net::Icecast::Source(
lib/Net/Icecast/Source.pm view on Meta::CPAN
aim => 'lindenstacker',
url => 'http://icecast.org',
},
);
# attempt to connect to the streaming server
$source->connect
or die "Unable to connect to server: $!\n";
# attempt to log in to the specified mountpoint
$source->login
view release on metacpan or search on metacpan
lib/Net/NATS/Streaming/Client.pm view on Meta::CPAN
# Close stream
$client->close_stream();
=head1 REPOSITORY
L<https://github.com/sergeykolychev/perl-nats-streaming>
=head1 SEE ALSO
L<https://github.com/carwynmoore/perl-nats>
Net::NATS::Client
view release on metacpan or search on metacpan
lib/Net/NATS/Streaming/PB.pm view on Meta::CPAN
=cut
=head1 REPOSITORY
L<https://github.com/sergeykolychev/perl-nats-streaming>
=head1 COPYRIGHT & LICENSE
Copyright (C) 2017 by Sergey Kolychev <sergeykolychev.github@gmail.com>
view release on metacpan or search on metacpan
lib/Net/OpenSSH/More.pm view on Meta::CPAN
Submodule of Net::OpenSSH that contains many methods that were
otherwise left "as an exercise to the reader" in the parent module.
Highlights:
* Persistent terminal via expect for very fast execution, less forking.
* Usage of File::Temp and auto-cleanup to prevent lingering ctl_path cruft.
* Ability to manipulate incoming text while streaming the output of commands.
* Run perl subroutine refs you write locally but execute remotely.
* Many shortcut methods for common system administration tasks
* Registration method for commands to run upon DESTROY/before disconnect.
* Automatic reconnection ability upon connection loss
lib/Net/OpenSSH/More.pm view on Meta::CPAN
* expect_timeout - When the above is active, how long should we wait before your program prints something
before bailing out?
* no_agent - Pass in a truthy value to disable the SSH agent. By default the agent is enabled.
* die_on_drop - If, for some reason, the connection drops, just die instead of attempting reconnection.
* output_prefix - If given, is what we will tack onto the beginning of any output via diag method.
useful for streaming output to say, a TAP consumer (test) via passing in '# ' as prefix.
* debug - Pass in a truthy value to enable certain diag statements I've added in the module and pass -v to ssh.
* home - STRING corresponding to an absolute path to something that "looks like" a homedir. Defaults to the user's homedir.
useful in cases where you say, want to load SSH keys from a different path without changing assumptions about where
keys exist in a homedir on your average OpenSSH using system.
* no_cache - Pass in a truthy value to disable caching the connection and object, indexed by host string.
view release on metacpan or search on metacpan
share/fixed_amqp0-8.xml view on Meta::CPAN
<!--
======================================================
== STREAMING
======================================================
-->
work with streaming content
<doc>
The stream class provides methods that support multimedia streaming.
The stream class uses the following semantics: one message is one
packet of data; delivery is unacknowleged and unreliable; the consumer
can specify quality of service parameters that the server can try to
adhere to; lower-priority messages may be discarded in favour of high
priority messages.
share/fixed_amqp0-8.xml view on Meta::CPAN
<field name = "consume rate" type = "long">
transfer rate in octets/second
<doc>
Specifies a desired transfer rate in octets per second. This is
usually determined by the application that uses the streaming
data. A value of zero means "no limit", i.e. as rapidly as
possible.
</doc>
<doc name = "rule">
The server MAY ignore the prefetch values and consume rates,
share/fixed_amqp0-8.xml view on Meta::CPAN
the queue was declared as private, and ideally, impose no limit
except as defined by available resources.
</doc>
<doc name = "rule">
Streaming applications SHOULD use different channels to select
different streaming resolutions. AMQP makes no provision for
filtering and/or transforming streams except on the basis of
priority-based selective delivery of individual messages.
</doc>
<chassis name = "server" implement = "MUST" />
<response name = "consume-ok" />
view release on metacpan or search on metacpan
lib/Net/Riak/Bucket.pm view on Meta::CPAN
my $keys = $bucket->get_keys;
my $keys = $bucket->get_keys($args);
Return an arrayref of the list of keys for a bucket.
Note for the PBC interface: you will need a separate instance of the client (i.e separate connection) if you want to preform actions on the keys whilst streaming them.
Optionally takes a hashref of named parameters. Supported parameters are:
=over 4
=item stream => 1
Uses key streaming mode to fetch the list of keys, which may be faster for large keyspaces.
=item cb => sub { }
A callback subroutine to be called for each key found (passed in as the only parameter). get_keys() returns nothing in callback mode.
lib/Net/Riak/Bucket.pm view on Meta::CPAN
Whether to return bucket properties. Defaults to 'true' if no parameters are given.
=item keys => 'true'|'false'|'stream'
Whether to return bucket keys. If set to 'stream', uses key streaming mode, which may be faster for large keyspaces.
=item cb => sub { }
A callback subroutine to be called for each key found (passed in as the only parameter). Implies keys => 'stream'. Keys are omitted from the results hashref in callback mode.
view release on metacpan or search on metacpan
lib/Net/Rovio.pm view on Meta::CPAN
Use Net::Rovio to control your Rovio robot from Perl. Uses basic Rovio API commands.
The Rovio L<http://www.wowwee.com/en/products/tech/telepresence/rovio/rovio> is a
Wi-Fi enabled mobile webcam that lets you view and interact with its environment
through streaming video and audio.
=head1 FUNCTIONS
Functions usually return "OK" upon success, unless otherwise noted per function.
lib/Net/Rovio.pm view on Meta::CPAN
=back
=head2 $rovio->getdata()
Enables streaming video. Incomplete at this time.
=head2 $rovio->getddns()
Gets the Dynamic DNS settings within the Rovio. Returns
view release on metacpan or search on metacpan
lib/Net/SCTP.pm view on Meta::CPAN
=head1 DESCRIPTION
An SCTP (Stream Control Transport Protocol) module created for Perl using XS
with the Net extension because it is a net module.
SCTP is a streaming protocol of things like UDP and TCP. It is used in new
technologies like LTE for phones. It streams data from multiple or one source
to multiple or one source. If one connection is lost the data is not lost because
it will continue to buffer until it gets the connection back and gets the rest of
the message. It is also backwards compatible with TCP.
view release on metacpan or search on metacpan
examples/kwax.sdp view on Meta::CPAN
v=0
o=- 31177 13 IN IP4 128.223.230.19
s=KWAX Classical Radio (PCM)
i=Live streaming radio from the University of Oregon's own KWAX Classical radio station.
u=http://www.kwax.com/
e=<multicast@lists.uoregon.edu>
p=(541) 346-1758
b=AS:64
t=0 0