org.apache.spark

Class ShuffleDependency<K,V>

Object

org.apache.spark.Dependency<scala.Product2<K,V>>

org.apache.spark.ShuffleDependency<K,V>

All Implemented Interfaces:

java.io.Serializable

public class ShuffleDependency<K,V>
extends Dependency<scala.Product2<K,V>>

:: DeveloperApi :: Represents a dependency on the output of a shuffle stage.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ShuffleDependency(RDD<? extends scala.Product2<K,V>> rdd, Partitioner partitioner, Serializer serializer)

Method Summary

Methods

Modifier and Type	Method and Description
Partitioner	partitioner()
Serializer	serializer()
int	shuffleId()

Methods inherited from class org.apache.spark.Dependency

rdd

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ShuffleDependency

public ShuffleDependency(RDD<? extends scala.Product2<K,V>> rdd,
                 Partitioner partitioner,
                 Serializer serializer)

Method Detail

partitioner

public Partitioner partitioner()

serializer

public Serializer serializer()

shuffleId

public int shuffleId()