org.apache.spark.io

Interface CompressionCodec

All Known Implementing Classes:

LZFCompressionCodec, SnappyCompressionCodec

public interface CompressionCodec

:: DeveloperApi :: CompressionCodec allows the customization of choosing different compression implementations to be used in block storage.

Note: The wire protocol for a codec is not guaranteed compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

Method Summary

Methods

Modifier and Type	Method and Description
java.io.InputStream	compressedInputStream(java.io.InputStream s)
java.io.OutputStream	compressedOutputStream(java.io.OutputStream s)
CompressionCodec	createCodec(SparkConf conf)
CompressionCodec	createCodec(SparkConf conf, String codecName)
String	DEFAULT_COMPRESSION_CODEC()

Method Detail

createCodec

CompressionCodec createCodec(SparkConf conf)

createCodec

CompressionCodec createCodec(SparkConf conf,
                           String codecName)

DEFAULT_COMPRESSION_CODEC

String DEFAULT_COMPRESSION_CODEC()

compressedOutputStream

java.io.OutputStream compressedOutputStream(java.io.OutputStream s)

compressedInputStream

java.io.InputStream compressedInputStream(java.io.InputStream s)