Interface | Description |
---|---|
BatchWrite |
An interface that defines how to write the data to data source for batch processing.
|
DataWriter<T> |
A data writer returned by
DataWriterFactory.createWriter(int, long) and is
responsible for writing data for an input RDD partition. |
DataWriterFactory |
A factory of
DataWriter returned by
BatchWrite.createBatchWriterFactory(PhysicalWriteInfo) , which is responsible for
creating and initializing the actual data writer at executor side. |
LogicalWriteInfo |
This interface contains logical write information that data sources can use when generating a
WriteBuilder . |
PhysicalWriteInfo |
This interface contains physical write information that data sources can use when
generating a
DataWriterFactory or a StreamingDataWriterFactory . |
SupportsDynamicOverwrite |
Write builder trait for tables that support dynamic partition overwrite.
|
SupportsOverwrite |
Write builder trait for tables that support overwrite by filter.
|
SupportsTruncate |
Write builder trait for tables that support truncation.
|
V1WriteBuilder |
A trait that should be implemented by V1 DataSources that would like to leverage the DataSource
V2 write code paths.
|
WriteBuilder |
An interface for building the
BatchWrite . |
WriterCommitMessage |
A commit message returned by
DataWriter.commit() and will be sent back to the driver side
as the input parameter of BatchWrite.commit(WriterCommitMessage[]) or
StreamingWrite.commit(long, WriterCommitMessage[]) . |