org.archive.wayback.hadoop
Class CDXSortDriver
java.lang.Object
org.archive.wayback.hadoop.CDXSortDriver
- All Implemented Interfaces:
- org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool
public class CDXSortDriver
- extends Object
- implements org.apache.hadoop.util.Tool
- Author:
- brad
|
Method Summary |
org.apache.hadoop.conf.Configuration |
getConf()
|
static void |
main(String[] args)
|
int |
run(String[] args)
The main driver for sort program. |
void |
setConf(org.apache.hadoop.conf.Configuration conf)
|
| Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
TEXT_OUTPUT_DELIM_CONFIG
public static String TEXT_OUTPUT_DELIM_CONFIG
- As hard-coded into the Text RecordWriter
CDXSortDriver
public CDXSortDriver()
run
public int run(String[] args)
throws Exception
- The main driver for sort program. Invoke this method to submit the
map/reduce job.
- Specified by:
run in interface org.apache.hadoop.util.Tool
- Throws:
IOException - When there is communication problems with the job tracker.
Exception
main
public static void main(String[] args)
throws Exception
- Parameters:
args -
- Throws:
Exception
getConf
public org.apache.hadoop.conf.Configuration getConf()
- Specified by:
getConf in interface org.apache.hadoop.conf.Configurable
setConf
public void setConf(org.apache.hadoop.conf.Configuration conf)
- Specified by:
setConf in interface org.apache.hadoop.conf.Configurable
Copyright © 2005-2011 Internet Archive. All Rights Reserved.