org.apache.spark.mapreduce

Interface SparkHadoopMapReduceUtil

All Known Implementing Classes:

BinaryFileRDD, InsertIntoParquetTable, NewHadoopRDD, PairRDDFunctions, WholeTextFileRDD

public interface SparkHadoopMapReduceUtil

Method Summary

Methods

Modifier and Type	Method and Description
Class<?>	firstAvailableClass(String first, String second)
org.apache.hadoop.mapreduce.JobContext	newJobContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.JobID jobId)
org.apache.hadoop.mapreduce.TaskAttemptContext	newTaskAttemptContext(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.mapreduce.TaskAttemptID attemptId)
org.apache.hadoop.mapreduce.TaskAttemptID	newTaskAttemptID(String jtIdentifier, int jobId, boolean isMap, int taskId, int attemptId)

Method Detail

newJobContext

org.apache.hadoop.mapreduce.JobContext newJobContext(org.apache.hadoop.conf.Configuration conf,
                                                   org.apache.hadoop.mapreduce.JobID jobId)

newTaskAttemptContext

org.apache.hadoop.mapreduce.TaskAttemptContext newTaskAttemptContext(org.apache.hadoop.conf.Configuration conf,
                                                                   org.apache.hadoop.mapreduce.TaskAttemptID attemptId)

newTaskAttemptID

org.apache.hadoop.mapreduce.TaskAttemptID newTaskAttemptID(String jtIdentifier,
                                                         int jobId,
                                                         boolean isMap,
                                                         int taskId,
                                                         int attemptId)

firstAvailableClass

Class<?> firstAvailableClass(String first,
                           String second)