pyspark.sql.Catalog.createExternalTable

Catalog.createExternalTable(tableName: str, path: Optional[str] = None, source: Optional[str] = None, schema: Optional[pyspark.sql.types.StructType] = None, **options: str) → pyspark.sql.dataframe.DataFrame

Creates a table based on the dataset in a data source.

It returns the DataFrame associated with the external table.

The data source is specified by the source and a set of options. If source is not specified, the default data source configured by spark.sql.sources.default will be used.

Optionally, a schema can be provided as the schema of the returned DataFrame and created external table.

New in version 2.0.0.

Returns

DataFrame

pyspark.sql.Catalog.clearCache pyspark.sql.Catalog.createTable