Class Http
java.lang.Object
org.apache.nutch.protocol.http.api.HttpBase
org.apache.nutch.protocol.interactiveselenium.Http
- All Implemented Interfaces:
Configurable,Pluggable,Protocol
-
Field Summary
FieldsFields inherited from class org.apache.nutch.protocol.http.api.HttpBase
accept, acceptCharset, acceptLanguage, BUFFER_SIZE, COOKIE, enableCookieHeader, enableIfModifiedsinceHeader, maxContent, maxCrawlDelay, maxDuration, partialAsTruncated, proxyException, proxyHost, proxyPort, proxyType, RESPONSE_TIME, responseTime, storeHttpHeaders, storeHttpRequest, storeIPAddress, storeProtocolVersions, timeout, tlsCheckCertificate, tlsPreferredCipherSuites, tlsPreferredProtocols, useHttp11, useHttp2, useProxy, userAgentFields inherited from interface org.apache.nutch.protocol.Protocol
X_POINT_ID -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected ResponsegetResponse(URL url, CrawlDatum datum, boolean redirect) static voidvoidsetConf(Configuration conf) Methods inherited from class org.apache.nutch.protocol.http.api.HttpBase
getAccept, getAcceptCharset, getAcceptLanguage, getConf, getCookie, getMaxContent, getMaxDuration, getProtocolOutput, getProxyHost, getProxyPort, getRobotRules, getRobotRules, getTimeout, getTlsPreferredCipherSuites, getTlsPreferredProtocols, getUseHttp11, getUserAgent, isCookieEnabled, isIfModifiedSinceEnabled, isProxyException, isStoreHttpHeaders, isStoreHttpRequest, isStoreIPAddress, isStorePartialAsTruncated, isTlsCheckCertificates, logConf, main, processDeflateEncoded, processGzipEncoded, useProxy, useProxy, useProxyMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface org.apache.nutch.protocol.Protocol
resolveUrl
-
Field Details
-
LOG
protected static final org.slf4j.Logger LOG
-
-
Constructor Details
-
Http
public Http()
-
-
Method Details
-
setConf
- Specified by:
setConfin interfaceConfigurable- Overrides:
setConfin classHttpBase
-
main
- Throws:
Exception
-
getResponse
protected Response getResponse(URL url, CrawlDatum datum, boolean redirect) throws ProtocolException, IOException - Specified by:
getResponsein classHttpBase- Throws:
ProtocolExceptionIOException
-