org.archive.access.nutch.mapred
Class TaskLogMapRunner

java.lang.Object
  extended by org.archive.access.nutch.mapred.TaskLogMapRunner
All Implemented Interfaces:
org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.MapRunnable

public class TaskLogMapRunner
extends java.lang.Object
implements org.apache.hadoop.mapred.MapRunnable

Calls a map for every line in a hadoop userlog directory.

Author:
stack

Field Summary
 org.apache.commons.logging.Log LOG
           
 
Constructor Summary
TaskLogMapRunner()
           
 
Method Summary
 void configure(org.apache.hadoop.mapred.JobConf job)
           
protected  void doLog(java.lang.String key, java.lang.String logurl, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)
           
 void run(org.apache.hadoop.mapred.RecordReader input, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

LOG

public final org.apache.commons.logging.Log LOG
Constructor Detail

TaskLogMapRunner

public TaskLogMapRunner()
Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf job)
Specified by:
configure in interface org.apache.hadoop.mapred.JobConfigurable

run

public void run(org.apache.hadoop.mapred.RecordReader input,
                org.apache.hadoop.mapred.OutputCollector output,
                org.apache.hadoop.mapred.Reporter reporter)
         throws java.io.IOException
Specified by:
run in interface org.apache.hadoop.mapred.MapRunnable
Throws:
java.io.IOException

doLog

protected void doLog(java.lang.String key,
                     java.lang.String logurl,
                     org.apache.hadoop.mapred.OutputCollector output,
                     org.apache.hadoop.mapred.Reporter reporter)
              throws java.io.IOException
Throws:
java.io.IOException


Copyright © 2005-2007 Internet Archive. All Rights Reserved.