org.archive.access.nutch.mapred
Class TaskLogMapRunner

java.lang.Object
  org.archive.access.nutch.mapred.TaskLogMapRunner

All Implemented Interfaces:

org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.MapRunnable

public class TaskLogMapRunner
extends java.lang.Object
implements org.apache.hadoop.mapred.MapRunnable

Calls a map for every line in a hadoop userlog directory.

Author:

stack

Field Summary

org.apache.commons.logging.Log

LOG

Constructor Summary

TaskLogMapRunner()

Method Summary

void	configure(org.apache.hadoop.mapred.JobConf job)
protected void	doLog(java.lang.String key, java.lang.String logurl, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)
void	run(org.apache.hadoop.mapred.RecordReader input, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public final org.apache.commons.logging.Log LOG

Constructor Detail

TaskLogMapRunner

public TaskLogMapRunner()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf job)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

run

public void run(org.apache.hadoop.mapred.RecordReader input,
                org.apache.hadoop.mapred.OutputCollector output,
                org.apache.hadoop.mapred.Reporter reporter)
         throws java.io.IOException

Specified by:

run in interface org.apache.hadoop.mapred.MapRunnable

Throws:

java.io.IOException

doLog

protected void doLog(java.lang.String key,
                     java.lang.String logurl,
                     org.apache.hadoop.mapred.OutputCollector output,
                     org.apache.hadoop.mapred.Reporter reporter)
              throws java.io.IOException

Throws:

java.io.IOException