view release on metacpan or  search on metacpan

corpus/alien_build_plugin_fetch_wget/record/old.yml  view on Meta::CPAN

           --ftps-implicit                 use implicit FTPS (default port is 990)
           --ftps-resume-ssl               resume the SSL/TLS session started in the control connection when
                                             opening a data connection
           --ftps-clear-data-connection    cipher the control channel only; all the data will be in plaintext
           --ftps-fallback-to-ftp          fall back to FTP if FTPS is not supported in the target server
    WARC options:
           --warc-file=FILENAME        save request/response data to a .warc.gz file
           --warc-header=STRING        insert STRING into the warcinfo record
           --warc-max-size=NUMBER      set maximum size of WARC files to NUMBER
           --warc-cdx                  write CDX index files
           --warc-dedup=FILENAME       do not store records listed in this CDX file
           --no-warc-compression       do not compress WARC files with GZIP
           --no-warc-digests           do not calculate SHA1 digests
           --no-warc-keep-log          do not store the log file in a WARC record
           --warc-tempdir=DIRECTORY    location for temporary files created by the
                                         WARC writer
    
    Recursive download:
      -r,  --recursive                 specify recursive download
      -l,  --level=NUMBER              maximum recursion depth (inf or 0 for infinite)
           --delete-after              delete files locally after downloading them
      -k,  --convert-links             make links in downloaded HTML or CSS point to
                                         local files
           --convert-file-only         convert the file part of the URLs only (usually known as the basename)
           --backups=N                 before writing file X, rotate up to N backup files
      -K,  --backup-converted          before converting file X, back up as X.orig
      -m,  --mirror                    shortcut for -N -r -l inf --no-remove-listing
      -p,  --page-requisites           get all images, etc. needed to display HTML page
           --strict-comments           turn on strict (SGML) handling of HTML comments
    
    Recursive accept/reject:
      -A,  --accept=LIST               comma-separated list of accepted extensions
      -R,  --reject=LIST               comma-separated list of rejected extensions
           --accept-regex=REGEX        regex matching accepted URLs
           --reject-regex=REGEX        regex matching rejected URLs
           --regex-type=TYPE           regex type (posix|pcre)
      -D,  --domains=LIST              comma-separated list of accepted domains
           --exclude-domains=LIST      comma-separated list of rejected domains
           --follow-ftp                follow FTP links from HTML documents
           --follow-tags=LIST          comma-separated list of followed HTML tags
           --ignore-tags=LIST          comma-separated list of ignored HTML tags
      -H,  --span-hosts                go to foreign hosts when recursive
      -L,  --relative                  follow relative links only
      -I,  --include-directories=LIST  list of allowed directories
           --trust-server-names        use the name specified by the redirection
                                         URL's last component
      -X,  --exclude-directories=LIST  list of excluded directories
      -np, --no-parent                 don't ascend to the parent directory
    
    Email bug reports, questions, discussions to <bug-wget@gnu.org>
    and/or open issues at https://savannah.gnu.org/bugs/?func=additem&group=wget.
-k --content-disposition -S http://localhost/corpus/alien_build_plugin_fetch_wget/dir/bogus.html:
  exit: 8
  files: {}
  stderr: |
    --2021-05-12 00:10:35--  http://localhost/corpus/alien_build_plugin_fetch_wget/dir/bogus.html
    Resolving localhost (localhost)... ::1, 127.0.0.1
    Connecting to localhost (localhost)|::1|:42643... failed: Connection refused.
    Connecting to localhost (localhost)|127.0.0.1|:42643... connected.
    HTTP request sent, awaiting response... 
      HTTP/1.0 404 Not Found
      Date: Wed, 12 May 2021 06:10:35 GMT
      Server: HTTP::Server::PSGI
      Content-Type: text/plain
      Content-Length: 9
    2021-05-12 00:10:35 ERROR 404: Not Found.
    
    Converted links in 0 files in 0 seconds.
  stdout: ''
-k --content-disposition -S http://localhost/corpus/alien_build_plugin_fetch_wget/dir/foo-1.01.tar:
  exit: 0
  files:
    foo-1.01.tar: "content:foo-1.01\n"
  stderr: |
    --2021-05-12 00:10:35--  http://localhost/corpus/alien_build_plugin_fetch_wget/dir/foo-1.01.tar
    Resolving localhost (localhost)... ::1, 127.0.0.1
    Connecting to localhost (localhost)|::1|:42643... failed: Connection refused.
    Connecting to localhost (localhost)|127.0.0.1|:42643... connected.
    HTTP request sent, awaiting response... 
      HTTP/1.0 200 OK
      Date: Wed, 12 May 2021 06:10:35 GMT
      Server: HTTP::Server::PSGI
      Content-Type: application/x-tar
      Content-Length: 17
      Last-Modified: Sun, 02 May 2021 15:41:03 GMT
    Length: 17 [application/x-tar]
    Saving to: ‘foo-1.01.tar’
    
         0K                                                       100% 1.65M=0s
    
    2021-05-12 00:10:35 (1.65 MB/s) - ‘foo-1.01.tar’ saved [17/17]
    
    Converted links in 0 files in 0 seconds.
  stdout: ''
-k --content-disposition -S http://localhost/corpus/alien_build_plugin_fetch_wget/dir/html_test.html:
  exit: 0
  files:
    html_test.html: "<html><head><title>Hello World</title></head><body><p>Hello World</p></body></html>\n"
  stderr: |
    --2021-05-12 00:10:35--  http://localhost/corpus/alien_build_plugin_fetch_wget/dir/html_test.html
    Resolving localhost (localhost)... ::1, 127.0.0.1
    Connecting to localhost (localhost)|::1|:42643... failed: Connection refused.
    Connecting to localhost (localhost)|127.0.0.1|:42643... connected.
    HTTP request sent, awaiting response... 
      HTTP/1.0 200 OK
      Date: Wed, 12 May 2021 06:10:35 GMT
      Server: HTTP::Server::PSGI
      Content-Type: text/html; charset=utf-8
      Content-Length: 84
      Last-Modified: Wed, 12 May 2021 04:39:27 GMT
    Length: 84 [text/html]
    Saving to: ‘html_test.html’
    
         0K                                                       100% 9.79M=0s
    
    2021-05-12 00:10:35 (9.79 MB/s) - ‘html_test.html’ saved [84/84]
    
    Converting links in html_test.html... nothing to do.
    Converted links in 1 files in 0 seconds.
  stdout: ''