org.apache.spark.graphx.impl

Class ShippableVertexPartition<VD>

Object

org.apache.spark.graphx.impl.VertexPartitionBase<VD>

org.apache.spark.graphx.impl.ShippableVertexPartition<VD>

All Implemented Interfaces:

java.io.Serializable

public class ShippableVertexPartition<VD>
extends VertexPartitionBase<VD>

A map from vertex id to vertex attribute that additionally stores edge partition join sites for each vertex attribute, enabling joining with an EdgeRDD.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ShippableVertexPartition.ShippableVertexPartitionOpsConstructor$ Implicit evidence that ShippableVertexPartition is a member of the VertexPartitionBaseOpsConstructor typeclass.

Constructor Summary

Constructors

Constructor and Description
ShippableVertexPartition(org.apache.spark.util.collection.OpenHashSet<Object> index, Object values, org.apache.spark.util.collection.BitSet mask, RoutingTablePartition routingTable, scala.reflect.ClassTag<VD> evidence$7)

Method Summary

Methods

Modifier and Type	Method and Description
static <VD> ShippableVertexPartition<VD>	apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter, scala.reflect.ClassTag<VD> evidence$2) Construct a `ShippableVertexPartition` from the given vertices without any routing table.
static <VD> ShippableVertexPartition<VD>	apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter, RoutingTablePartition routingTable, VD defaultVal, scala.reflect.ClassTag<VD> evidence$3) Construct a ShippableVertexPartition from the given vertices with the specified routing table, filling in missing vertices mentioned in the routing table using defaultVal.
static <VD> ShippableVertexPartition<VD>	apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter, RoutingTablePartition routingTable, VD defaultVal, scala.Function2<VD,VD,VD> mergeFunc, scala.reflect.ClassTag<VD> evidence$4) Construct a ShippableVertexPartition from the given vertices with the specified routing table, filling in missing vertices mentioned in the routing table using defaultVal, and merging duplicate vertex atrribute with mergeFunc.
org.apache.spark.util.collection.OpenHashSet<Object>	index()
org.apache.spark.util.collection.BitSet	mask()
RoutingTablePartition	routingTable()
static <VD> ShippableVertexPartitionOps<VD>	shippablePartitionToOps(ShippableVertexPartition<VD> partition, scala.reflect.ClassTag<VD> evidence$5) Implicit conversion to allow invoking VertexPartitionBase operations directly on a ShippableVertexPartition.
scala.collection.Iterator<scala.Tuple2<Object,VertexAttributeBlock<VD>>>	shipVertexAttributes(boolean shipSrc, boolean shipDst) Generate a VertexAttributeBlock for each edge partition keyed on the edge partition ID.
scala.collection.Iterator<scala.Tuple2<Object,long[]>>	shipVertexIds() Generate a VertexId array for each edge partition keyed on the edge partition ID.
Object	values()
ShippableVertexPartition<VD>	withRoutingTable(RoutingTablePartition routingTable_) Return a new ShippableVertexPartition with the specified routing table.

Methods inherited from class org.apache.spark.graphx.impl.VertexPartitionBase

apply, capacity, initFrom, initFrom, isDefined, iterator, size

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ShippableVertexPartition

public ShippableVertexPartition(org.apache.spark.util.collection.OpenHashSet<Object> index,
                        Object values,
                        org.apache.spark.util.collection.BitSet mask,
                        RoutingTablePartition routingTable,
                        scala.reflect.ClassTag<VD> evidence$7)

Method Detail

apply

public static <VD> ShippableVertexPartition<VD> apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter,
                                      scala.reflect.ClassTag<VD> evidence$2)

Construct a `ShippableVertexPartition` from the given vertices without any routing table.

apply

public static <VD> ShippableVertexPartition<VD> apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter,
                                      RoutingTablePartition routingTable,
                                      VD defaultVal,
                                      scala.reflect.ClassTag<VD> evidence$3)

Construct a ShippableVertexPartition from the given vertices with the specified routing table, filling in missing vertices mentioned in the routing table using defaultVal.

apply

public static <VD> ShippableVertexPartition<VD> apply(scala.collection.Iterator<scala.Tuple2<Object,VD>> iter,
                                      RoutingTablePartition routingTable,
                                      VD defaultVal,
                                      scala.Function2<VD,VD,VD> mergeFunc,
                                      scala.reflect.ClassTag<VD> evidence$4)

Construct a ShippableVertexPartition from the given vertices with the specified routing table, filling in missing vertices mentioned in the routing table using defaultVal, and merging duplicate vertex atrribute with mergeFunc.

shippablePartitionToOps

public static <VD> ShippableVertexPartitionOps<VD> shippablePartitionToOps(ShippableVertexPartition<VD> partition,
                                                           scala.reflect.ClassTag<VD> evidence$5)

Implicit conversion to allow invoking VertexPartitionBase operations directly on a ShippableVertexPartition.

index

public org.apache.spark.util.collection.OpenHashSet<Object> index()

Specified by:

index in class VertexPartitionBase<VD>

values

public Object values()

Specified by:

values in class VertexPartitionBase<VD>

mask

public org.apache.spark.util.collection.BitSet mask()

Specified by:

mask in class VertexPartitionBase<VD>

routingTable

public RoutingTablePartition routingTable()

withRoutingTable

public ShippableVertexPartition<VD> withRoutingTable(RoutingTablePartition routingTable_)

Return a new ShippableVertexPartition with the specified routing table.

shipVertexAttributes

public scala.collection.Iterator<scala.Tuple2<Object,VertexAttributeBlock<VD>>> shipVertexAttributes(boolean shipSrc,
                                                                                            boolean shipDst)

Generate a VertexAttributeBlock for each edge partition keyed on the edge partition ID. The VertexAttributeBlock contains the vertex attributes from the current partition that are referenced in the specified positions in the edge partition.

shipVertexIds

public scala.collection.Iterator<scala.Tuple2<Object,long[]>> shipVertexIds()

Generate a VertexId array for each edge partition keyed on the edge partition ID. The array contains the visible vertex ids from the current partition that are referenced in the edge partition.