org.apache.spark.sql

sources

package sources

A set of APIs for adding data sources to Spark SQL.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. sources
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. case class And(left: Filter, right: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff both left or right evaluate to true.

  2. abstract class BaseRelation extends AnyRef

    ::DeveloperApi:: Represents a collection of tuples with a known schema.

  3. class CaseInsensitiveMap extends Map[String, String] with Serializable

    Builds a map in which keys are case insensitive

  4. trait CatalystScan extends AnyRef

    ::Experimental:: An interface for experimenting with a more direct connection to the query planner.

  5. trait CreatableRelationProvider extends AnyRef

    Annotations
    @DeveloperApi()
  6. class DDLException extends Exception

    The exception thrown from the DDL parser.

  7. case class EqualTo(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value equal to value.

  8. abstract class Filter extends AnyRef

    A filter predicate for data sources.

  9. case class GreaterThan(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value greater than value.

  10. case class GreaterThanOrEqual(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value greater than or equal to value.

  11. case class In(attribute: String, values: Array[Any]) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to one of the values in the array.

  12. trait InsertableRelation extends AnyRef

    ::DeveloperApi:: A BaseRelation that can be used to insert data into it through the insert method.

  13. case class IsNotNull(attribute: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a non-null value.

  14. case class IsNull(attribute: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to null.

  15. case class LessThan(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value less than value.

  16. case class LessThanOrEqual(attribute: String, value: Any) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a value less than or equal to value.

  17. case class Not(child: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff child is evaluated to false.

  18. case class Or(left: Filter, right: Filter) extends Filter with Product with Serializable

    A filter that evaluates to true iff at least one of left or right evaluates to true.

  19. trait PrunedFilteredScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

  20. trait PrunedScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can eliminate unneeded columns before producing an RDD containing all of its tuples as Row objects.

  21. trait RelationProvider extends AnyRef

    ::DeveloperApi:: Implemented by objects that produce relations for a specific kind of data source.

  22. trait SchemaRelationProvider extends AnyRef

    ::DeveloperApi:: Implemented by objects that produce relations for a specific kind of data source with a given schema.

  23. case class StringContains(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that contains the string value.

  24. case class StringEndsWith(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that starts with value.

  25. case class StringStartsWith(attribute: String, value: String) extends Filter with Product with Serializable

    A filter that evaluates to true iff the attribute evaluates to a string that starts with value.

  26. trait TableScan extends AnyRef

    ::DeveloperApi:: A BaseRelation that can produce all of its tuples as an RDD of Row objects.

Inherited from AnyRef

Inherited from Any

Ungrouped