org.apache.spark.streaming

Class CheckpointWriter

Object

org.apache.spark.streaming.CheckpointWriter

All Implemented Interfaces:

Logging

public class CheckpointWriter
extends Object
implements Logging

Convenience class to handle the writing of graph checkpoint to file

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	CheckpointWriter.CheckpointWriteHandler

Constructor Summary

Constructors

Constructor and Description
CheckpointWriter(JobGenerator jobGenerator, SparkConf conf, String checkpointDir, org.apache.hadoop.conf.Configuration hadoopConf)

Method Summary

Methods

Modifier and Type	Method and Description
CompressionCodec	compressionCodec()
java.util.concurrent.ExecutorService	executor()
int	MAX_ATTEMPTS()
void	stop()
void	write(Checkpoint checkpoint, boolean clearCheckpointDataLater)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

CheckpointWriter

public CheckpointWriter(JobGenerator jobGenerator,
                SparkConf conf,
                String checkpointDir,
                org.apache.hadoop.conf.Configuration hadoopConf)

Method Detail

MAX_ATTEMPTS

public int MAX_ATTEMPTS()

executor

public java.util.concurrent.ExecutorService executor()

compressionCodec

public CompressionCodec compressionCodec()

write

public void write(Checkpoint checkpoint,
         boolean clearCheckpointDataLater)

stop

public void stop()