public static class FetcherJob.FetcherMapper extends org.apache.gora.mapreduce.GoraMapper<String,WebPage,IntWritable,FetchEntry>
Mapper class for Fetcher.
This approach (combined with the use of
sure that Fetcher is still polite while also randomizing the key order. If
one host has a huge number of URLs in your table while other hosts have
FetcherReducer will not be stuck on one host but process URLs
from other hosts as well.
|Constructor and Description|
|Modifier and Type||Method and Description|
initMapperJob, initMapperJob, initMapperJob, initMapperJob, initMapperJob
protected void setup(Mapper.Context context)
Copyright © 2015 The Apache Software Foundation