org.archive.wayback.hadoop
Class CDXSortDriver

java.lang.Object
  extended by org.archive.wayback.hadoop.CDXSortDriver
All Implemented Interfaces:
org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class CDXSortDriver
extends Object
implements org.apache.hadoop.util.Tool

Author:
brad

Field Summary
static String TEXT_OUTPUT_DELIM_CONFIG
          As hard-coded into the Text RecordWriter
 
Constructor Summary
CDXSortDriver()
           
 
Method Summary
 org.apache.hadoop.conf.Configuration getConf()
           
static void main(String[] args)
           
 int run(String[] args)
          The main driver for sort program.
 void setConf(org.apache.hadoop.conf.Configuration conf)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

TEXT_OUTPUT_DELIM_CONFIG

public static String TEXT_OUTPUT_DELIM_CONFIG
As hard-coded into the Text RecordWriter

Constructor Detail

CDXSortDriver

public CDXSortDriver()
Method Detail

run

public int run(String[] args)
        throws Exception
The main driver for sort program. Invoke this method to submit the map/reduce job.

Specified by:
run in interface org.apache.hadoop.util.Tool
Throws:
IOException - When there is communication problems with the job tracker.
Exception

main

public static void main(String[] args)
                 throws Exception
Parameters:
args -
Throws:
Exception

getConf

public org.apache.hadoop.conf.Configuration getConf()
Specified by:
getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)
Specified by:
setConf in interface org.apache.hadoop.conf.Configurable


Copyright © 2005-2011 Internet Archive. All Rights Reserved.