Interface | Description |
---|---|
CatalystScan |
::Experimental::
An interface for experimenting with a more direct connection to the query planner.
|
CreatableRelationProvider | |
DataSourceRegister |
::DeveloperApi::
Data sources should implement this trait so that they can register an alias to their data source.
|
HadoopFsRelationProvider |
::Experimental::
Implemented by objects that produce relations for a specific kind of data source
with a given schema and partitioned columns.
|
InsertableRelation |
::DeveloperApi::
A BaseRelation that can be used to insert data into it through the insert method.
|
PrunedFilteredScan |
::DeveloperApi::
A BaseRelation that can eliminate unneeded columns and filter using selected
predicates before producing an RDD containing all matching tuples as Row objects.
|
PrunedScan |
::DeveloperApi::
A BaseRelation that can eliminate unneeded columns before producing an RDD
containing all of its tuples as Row objects.
|
RelationProvider |
::DeveloperApi::
Implemented by objects that produce relations for a specific kind of data source.
|
SchemaRelationProvider |
::DeveloperApi::
Implemented by objects that produce relations for a specific kind of data source
with a given schema.
|
TableScan |
::DeveloperApi::
A BaseRelation that can produce all of its tuples as an RDD of Row objects.
|
Class | Description |
---|---|
And |
A filter that evaluates to
true iff both left or right evaluate to true . |
BaseRelation |
::DeveloperApi::
Represents a collection of tuples with a known schema.
|
EqualNullSafe |
Performs equality comparison, similar to
EqualTo . |
EqualTo |
A filter that evaluates to
true iff the attribute evaluates to a value
equal to value . |
Filter |
A filter predicate for data sources.
|
GreaterThan |
A filter that evaluates to
true iff the attribute evaluates to a value
greater than value . |
GreaterThanOrEqual |
A filter that evaluates to
true iff the attribute evaluates to a value
greater than or equal to value . |
HadoopFsRelation |
::Experimental::
A
BaseRelation that provides much of the common code required for formats that store their
data to an HDFS compatible filesystem. |
HadoopFsRelation.FakeFileStatus | |
HadoopFsRelation.FakeFileStatus$ | |
In |
A filter that evaluates to
true iff the attribute evaluates to one of the values in the array. |
IsNotNull |
A filter that evaluates to
true iff the attribute evaluates to a non-null value. |
IsNull |
A filter that evaluates to
true iff the attribute evaluates to null. |
LessThan |
A filter that evaluates to
true iff the attribute evaluates to a value
less than value . |
LessThanOrEqual |
A filter that evaluates to
true iff the attribute evaluates to a value
less than or equal to value . |
Not |
A filter that evaluates to
true iff child is evaluated to false . |
Or |
A filter that evaluates to
true iff at least one of left or right evaluates to true . |
OutputWriter |
::Experimental::
OutputWriter is used together with HadoopFsRelation for persisting rows to the
underlying file system. |
OutputWriterFactory |
::Experimental::
A factory that produces
OutputWriter s. |
StringContains |
A filter that evaluates to
true iff the attribute evaluates to
a string that contains the string value . |
StringEndsWith |
A filter that evaluates to
true iff the attribute evaluates to
a string that starts with value . |
StringStartsWith |
A filter that evaluates to
true iff the attribute evaluates to
a string that starts with value . |