org.apache.spark

Class RangeDependency<T>

java.lang.Object

org.apache.spark.Dependency<T>

org.apache.spark.NarrowDependency<T>

org.apache.spark.RangeDependency<T>

All Implemented Interfaces:

java.io.Serializable

public class RangeDependency<T>
extends NarrowDependency<T>

:: DeveloperApi :: Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs. param: rdd the parent RDD param: inStart the start of the range in the parent RDD param: outStart the start of the range in the child RDD param: length the length of the range

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RangeDependency(RDD<T> rdd, int inStart, int outStart, int length)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.immutable.List<java.lang.Object>	getParents(int partitionId) Get the parent partitions for a child partition.

Methods inherited from class org.apache.spark.NarrowDependency

rdd

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RangeDependency

public RangeDependency(RDD<T> rdd,
               int inStart,
               int outStart,
               int length)

Method Detail

getParents

public scala.collection.immutable.List<java.lang.Object> getParents(int partitionId)

Description copied from class: NarrowDependency

Get the parent partitions for a child partition.

Specified by:

getParents in class NarrowDependency<T>

Parameters:

partitionId - a partition of the child RDD

Returns:

the partitions of the parent RDD that the child partition depends upon