org.apache.spark.scheduler

Interface MapStatus

All Known Implementing Classes:

CompressedMapStatus, HighlyCompressedMapStatus

public interface MapStatus

Result returned by a ShuffleMapTask to a scheduler. Includes the block manager address that the task ran on as well as the sizes of outputs for each reducer, for passing on to the reduce tasks.

Method Summary

Methods

Modifier and Type	Method and Description
long	getSizeForBlock(int reduceId) Estimated size for the reduce block, in bytes.
BlockManagerId	location() Location where this task was run.

Method Detail

location

BlockManagerId location()

Location where this task was run.

getSizeForBlock

long getSizeForBlock(int reduceId)

Estimated size for the reduce block, in bytes.

If a block is non-empty, then this method MUST return a non-zero size. This invariant is necessary for correctness, since block fetchers are allowed to skip zero-size blocks.