org.apache.spark.streaming.kafka

Class KafkaCluster.SimpleConsumerConfig

Object

kafka.utils.ZKConfig

kafka.consumer.ConsumerConfig

org.apache.spark.streaming.kafka.KafkaCluster.SimpleConsumerConfig

Enclosing class:

KafkaCluster

public static class KafkaCluster.SimpleConsumerConfig
extends kafka.consumer.ConsumerConfig

High-level kafka consumers connect to ZK. ConsumerConfig assumes this use case. Simple consumers connect directly to brokers, but need many of the same configs. This subclass won't warn about missing ZK params, or presence of broker params.

Method Summary

Methods

Modifier and Type	Method and Description
scala.Tuple2<String,Object>[]	seedBrokers()

Methods inherited from class kafka.consumer.ConsumerConfig

AutoCommit, autoCommitEnable, AutoCommitInterval, autoCommitIntervalMs, autoOffsetReset, AutoOffsetReset, clientId, consumerId, consumerTimeoutMs, ConsumerTimeoutMs, debug, debug, debug, DefaultClientId, DefaultFetcherBackoffMs, DefaultPartitionAssignmentStrategy, dualCommitEnabled, error, error, error, excludeInternalTopics, ExcludeInternalTopics, fatal, fatal, fatal, fetchMessageMaxBytes, fetchMinBytes, FetchSize, fetchWaitMaxMs, groupId, info, info, info, kafka$utils$Logging$_setter_$loggerName_$eq, logger, loggerName, logIdent_$eq, logIdent, MaxFetchSize, MaxFetchWaitMs, MaxQueuedChunks, MaxRebalanceRetries, MinFetchBytes, MirrorConsumerNumThreads, MirrorConsumerNumThreadsProp, MirrorTopicsBlacklist, MirrorTopicsBlacklistProp, MirrorTopicsWhitelist, MirrorTopicsWhitelistProp, numConsumerFetchers, NumConsumerFetchers, offsetsChannelBackoffMs, OffsetsChannelBackoffMs, offsetsChannelSocketTimeoutMs, OffsetsChannelSocketTimeoutMs, offsetsCommitMaxRetries, OffsetsCommitMaxRetries, offsetsStorage, OffsetsStorage, partitionAssignmentStrategy, props, queuedMaxMessages, rebalanceBackoffMs, rebalanceMaxRetries, refreshLeaderBackoffMs, RefreshMetadataBackoffMs, SocketBufferSize, socketReceiveBufferBytes, SocketTimeout, socketTimeoutMs, swallow, swallowDebug, swallowError, swallowInfo, swallowTrace, swallowWarn, trace, trace, trace, validate, validateAutoOffsetReset, validateChars, validateClientId, validateGroupId, validateOffsetsStorage, warn, warn, warn

Methods inherited from class kafka.utils.ZKConfig

zkConnect, zkConnectionTimeoutMs, zkSessionTimeoutMs, zkSyncTimeMs

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

seedBrokers

public scala.Tuple2<String,Object>[] seedBrokers()