Uses of Package
org.apache.nutch.net

Packages that use org.apache.nutch.net

Package	Description
org.apache.nutch.collection	Subcollection is a subset of an index.
org.apache.nutch.hostdb
org.apache.nutch.indexer	Index content, configure and run indexing and cleaning jobs to add, update, and delete documents from an index.
org.apache.nutch.net	Web-related interfaces: URL filters and normalizers.
org.apache.nutch.net.urlnormalizer.ajax
org.apache.nutch.net.urlnormalizer.basic	URL normalizer performing basic normalizations: remove default ports, e.g., port 80 for http:// URLs remove needless slashes and dot segments in the path component remove anchors use percent-encoding (only) where needed E.g., https://www.example.org/a/../b//./select%2Dlang.php?lang=español#anchor is normalized to https://www.example.org/b/select-lang.php?lang=espa%C3%B1ol Optional and configurable normalizations are: convert Internationalized Domain Names (IDNs) uniquely either to the ASCII (Punycode) or Unicode representation, see property urlnormalizer.basic.host.idn remove a trailing dot from host names, see property urlnormalizer.basic.host.trim-trailing-dot
org.apache.nutch.net.urlnormalizer.host	URL normalizer renaming hosts to a canonical form listed in the configuration file.
org.apache.nutch.net.urlnormalizer.pass	URL normalizer dummy which does not change URLs.
org.apache.nutch.net.urlnormalizer.protocol	URL normalizer to normalize the protocol for all URLs of a given host or domain.
org.apache.nutch.net.urlnormalizer.querystring	URL normalizer which sort the elements in the query part to avoid duplicates by permutations.
org.apache.nutch.net.urlnormalizer.regex	URL normalizer with configurable rules based on regular expressions (Pattern).
org.apache.nutch.net.urlnormalizer.slash
org.apache.nutch.parse	The Parse interface and related classes.
org.apache.nutch.urlfilter.api	Generic URL filter library, abstracting away from regular expression implementations.
org.apache.nutch.urlfilter.automaton	URL filter plugin based on dk.brics.automaton Finite-State Automata for JavaTM.
org.apache.nutch.urlfilter.domain	URL filter plugin to include only URLs which match an element in a given list of domain suffixes, domain names, and/or host names.
org.apache.nutch.urlfilter.domaindenylist	URL filter plugin to exclude URLs by domain suffixes, domain names, and/or host names.
org.apache.nutch.urlfilter.fast	URL filter plugin that first does fast exact suffix matches on host/domain names before applying regular expressions to the path component of a URL.
org.apache.nutch.urlfilter.ignoreexempt	URL filter plugin which identifies exemptions to external urls when when external urls are set to ignore.
org.apache.nutch.urlfilter.prefix	URL filter plugin to include only URLs which match one of a given list of URL prefixes.
org.apache.nutch.urlfilter.regex	URL filter plugin to include and/or exclude URLs matching Java regular expressions.
org.apache.nutch.urlfilter.suffix	URL filter plugin to either exclude or include only URLs which match one of the given (path) suffixes.
org.apache.nutch.urlfilter.validator	URL filter plugin that validates given urls.

Classes in org.apache.nutch.net used by org.apache.nutch.collection

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.hostdb

Class	Description
URLFilters	Creates and caches plugins implementing URLFilter.
URLNormalizers	This class uses a "chained filter" pattern to run defined normalizers.

Classes in org.apache.nutch.net used by org.apache.nutch.indexer

Class	Description
URLNormalizers	This class uses a "chained filter" pattern to run defined normalizers.

Classes in org.apache.nutch.net used by org.apache.nutch.net

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.
URLFilterException

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.ajax

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.basic

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.host

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.pass

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.protocol

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.querystring

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.regex

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.net.urlnormalizer.slash

Class	Description
URLNormalizer	Interface used to convert URLs to normal form and optionally perform substitutions

Classes in org.apache.nutch.net used by org.apache.nutch.parse

Class	Description
URLExemptionFilters	Creates and caches URLExemptionFilter implementing plugins.
URLFilters	Creates and caches plugins implementing URLFilter.
URLNormalizers	This class uses a "chained filter" pattern to run defined normalizers.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.api

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.automaton

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.domain

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.domaindenylist

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.fast

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.ignoreexempt

Class	Description
URLExemptionFilter	Interface used to allow exemptions to external domain resources by overriding db.ignore.external.links.
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.prefix

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.regex

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.suffix

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.

Classes in org.apache.nutch.net used by org.apache.nutch.urlfilter.validator

Class	Description
URLFilter	Interface used to limit which URLs enter Nutch.