Package org.apache.nutch.indexer

Class CleaningJob

java.lang.Object

org.apache.nutch.indexer.CleaningJob

All Implemented Interfaces:

Configurable, Tool

public class CleaningJob
extends Object
implements Tool

The class scans CrawlDB looking for entries with status DB_GONE (404) or DB_DUPLICATE and sends delete requests to indexers for those documents.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	CleaningJob.DBFilter
static class	CleaningJob.DeleterReducer

Constructor Summary

Constructors

Constructor	Description
CleaningJob()

Method Summary

Modifier and Type	Method	Description
void	delete(String crawldb, boolean noCommit)
Configuration	getConf()
static void	main(String[] args)
int	run(String[] args)
void	setConf(Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CleaningJob

public CleaningJob()

Method Details

getConf

public Configuration getConf()

Specified by:

getConf in interface Configurable

setConf

public void setConf(Configuration conf)

Specified by:

setConf in interface Configurable

delete

public void delete(String crawldb,
 boolean noCommit)
            throws IOException,
InterruptedException,
ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException

run

public int run(String[] args)
        throws IOException

Specified by:

run in interface Tool

Throws:

IOException

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception