public class RandomRDD<T> extends RDD<T>
| Constructor and Description |
|---|
RandomRDD(SparkContext sc,
long size,
int numPartitions,
RandomDataGenerator<T> rng,
long seed,
scala.reflect.ClassTag<T> evidence$1) |
| Modifier and Type | Method and Description |
|---|---|
scala.collection.Iterator<T> |
compute(Partition splitIn,
TaskContext context)
:: DeveloperApi ::
Implemented by subclasses to compute a given partition.
|
Partition[] |
getPartitions()
Implemented by subclasses to return the set of partitions in this RDD.
|
static <T> scala.collection.Iterator<T> |
getPointIterator(RandomRDDPartition<T> partition,
scala.reflect.ClassTag<T> evidence$2) |
static scala.collection.Iterator<Vector> |
getVectorIterator(RandomRDDPartition<Object> partition,
int vectorSize) |
aggregate, cache, cartesian, checkpoint, checkpointData, coalesce, collect, collect, collectPartitions, computeOrReadCheckpoint, conf, context, count, countApprox, countApproxDistinct, countApproxDistinct, countByValue, countByValueApprox, creationSite, dependencies, distinct, distinct, doCheckpoint, doubleRDDToDoubleRDDFunctions, elementClassTag, filter, filterWith, first, flatMap, flatMapWith, fold, foreach, foreachPartition, foreachWith, getCheckpointFile, getCreationSite, getNarrowAncestors, getStorageLevel, glom, groupBy, groupBy, groupBy, id, intersection, intersection, intersection, isCheckpointed, isEmpty, iterator, keyBy, map, mapPartitions, mapPartitionsWithContext, mapPartitionsWithIndex, mapPartitionsWithSplit, mapWith, markCheckpointed, max, min, name, numericRDDToDoubleRDDFunctions, partitioner, partitions, persist, persist, pipe, pipe, pipe, preferredLocations, randomSplit, rddToAsyncRDDActions, rddToOrderedRDDFunctions, rddToPairRDDFunctions, rddToSequenceFileRDDFunctions, reduce, repartition, retag, retag, sample, saveAsObjectFile, saveAsTextFile, saveAsTextFile, setName, sortBy, sparkContext, subtract, subtract, subtract, take, takeOrdered, takeSample, toArray, toDebugString, toJavaRDD, toLocalIterator, top, toString, treeAggregate, treeReduce, union, unpersist, zip, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipWithIndex, zipWithUniqueIdinitializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarningpublic RandomRDD(SparkContext sc, long size, int numPartitions, RandomDataGenerator<T> rng, long seed, scala.reflect.ClassTag<T> evidence$1)
public static <T> scala.collection.Iterator<T> getPointIterator(RandomRDDPartition<T> partition, scala.reflect.ClassTag<T> evidence$2)
public static scala.collection.Iterator<Vector> getVectorIterator(RandomRDDPartition<Object> partition, int vectorSize)
public scala.collection.Iterator<T> compute(Partition splitIn, TaskContext context)
RDD