org.apache.spark.streaming.kinesis

Class KinesisUtilsPythonHelper

Object

org.apache.spark.streaming.kinesis.KinesisUtilsPythonHelper

public class KinesisUtilsPythonHelper
extends Object

This is a helper class that wraps the methods in KinesisUtils into more Python-friendly class and function so that it can be easily instantiated and called from Python's KinesisUtils.

Constructor Summary

Constructors

Constructor and Description
KinesisUtilsPythonHelper()

Method Summary

Modifier and Type	Method and Description
JavaReceiverInputDStream<byte[]>	createStream(JavaStreamingContext jssc, String kinesisAppName, String streamName, String endpointUrl, String regionName, int initialPositionInStream, Duration checkpointInterval, StorageLevel storageLevel, String awsAccessKeyId, String awsSecretKey, String stsAssumeRoleArn, String stsSessionName, String stsExternalId)
com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStream	getInitialPositionInStream(int initialPositionInStream)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisUtilsPythonHelper

public KinesisUtilsPythonHelper()

Method Detail

getInitialPositionInStream

public com.amazonaws.services.kinesis.clientlibrary.lib.worker.InitialPositionInStream getInitialPositionInStream(int initialPositionInStream)

createStream

public JavaReceiverInputDStream<byte[]> createStream(JavaStreamingContext jssc,
                                                     String kinesisAppName,
                                                     String streamName,
                                                     String endpointUrl,
                                                     String regionName,
                                                     int initialPositionInStream,
                                                     Duration checkpointInterval,
                                                     StorageLevel storageLevel,
                                                     String awsAccessKeyId,
                                                     String awsSecretKey,
                                                     String stsAssumeRoleArn,
                                                     String stsSessionName,
                                                     String stsExternalId)