@hackage / urlcheck

Parallel link checker

Latest0.1.1

About

Metadata

  • Last updated , by DonaldStewart
  • License BSD-3-Clause
  • Categories Network Development

  • Maintained by: <dons@cse.unsw.edu.au>

  • Lottery factor: 0

Links

Installation

Package Flags

Use the -f option with cabal commands to enable flags

    small_base (on by default)

    Choose the new smaller, split-up base package.

Readme

        urlcheck: a multithreaded, parallel url checker

Features:

urlcheck is lightweight, concurrent url checker. It uses minimal resources,
and is multicore-capable.

In contrast to popular link checkers, it uses few resources, will readily
take advantage of multiple cores, and is easily killable.

An example:

$ urlcheck content.wiki
Found 0 broken links. Checked 31 links (31 unique) in 1 file.
Search time: 30 secs

Building: runhaskell Setup.lhs configure --prefix=/home/dons runhaskell Setup.lhs build runhaskell Setup.lhs install

Use:

$ urlcheck --help
Usage: checkuri [-h] [-n n] [file ...]
  -h    --help  Show this help message
  -n N          Number of concurrent connections (default 16)

urlcheck takes a list of files to check on the command line. It uses 16 concurrent threads by default. You can configure these threads to use multiple cores, with GHC 6.6, by setting:

+RTS -N 16 -RTS

on the command line arguments to urlcheck.