org.archive.wayback.hadoop
Class AlphaPartitioner

java.lang.Object
  org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
      org.archive.wayback.hadoop.AlphaPartitioner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class AlphaPartitioner
extends org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
implements org.apache.hadoop.conf.Configurable

Version:

$Date: 2010-09-29 05:28:38 +0700 (Wed, 29 Sep 2010) $, $Revision: 3262 $

Author:

brad

Constructor Summary

AlphaPartitioner()

Method Summary

org.apache.hadoop.conf.Configuration	getConf()
int	getPartition(org.apache.hadoop.io.Text key, org.apache.hadoop.io.Text value, int numPartitions)
static String	getPartitionPath(org.apache.hadoop.conf.Configuration conf)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setPartitionPath(org.apache.hadoop.conf.Configuration conf, String path)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AlphaPartitioner

public AlphaPartitioner()

Method Detail

getPartition

public int getPartition(org.apache.hadoop.io.Text key,
                        org.apache.hadoop.io.Text value,
                        int numPartitions)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

setPartitionPath

public static void setPartitionPath(org.apache.hadoop.conf.Configuration conf,
                                    String path)

Parameters:

conf - Configuration for the Job

path - hdfs:// URI pointing to the split file

getPartitionPath

public static String getPartitionPath(org.apache.hadoop.conf.Configuration conf)

Parameters:

conf - Configuration for the Job

Returns:

the hdfs:// URI for the split file configured for this job