org.apache.spark.sql.hive

Class HiveUtils

Object

org.apache.spark.sql.hive.HiveUtils

public class HiveUtils
extends Object

Constructor Summary

Constructors

Constructor and Description
HiveUtils()

Method Summary

Modifier and Type	Method and Description
static String	builtinHiveVersion() The version of hive used internally by Spark SQL.
static <any>	CONVERT_METASTORE_CTAS()
static <any>	CONVERT_METASTORE_ORC()
static <any>	CONVERT_METASTORE_PARQUET_WITH_SCHEMA_MERGING()
static <any>	CONVERT_METASTORE_PARQUET()
static <any>	FAKE_HIVE_VERSION()
static <any>	HIVE_METASTORE_BARRIER_PREFIXES()
static <any>	HIVE_METASTORE_JARS()
static <any>	HIVE_METASTORE_SHARED_PREFIXES()
static <any>	HIVE_METASTORE_VERSION()
static <any>	HIVE_THRIFT_SERVER_ASYNC()
static org.apache.spark.sql.catalyst.catalog.CatalogTable	inferSchema(org.apache.spark.sql.catalyst.catalog.CatalogTable table) Infers the schema for Hive serde tables and returns the CatalogTable with the inferred schema.
static boolean	isCliSessionState() Check current Thread's SessionState type
static scala.collection.immutable.Map<String,String>	newTemporaryConfiguration(boolean useInMemoryDerby) Constructs a configuration for hive, where the metastore is located in a temp directory.
static SparkContext	withHiveExternalCatalog(SparkContext sc)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveUtils

public HiveUtils()

Method Detail

withHiveExternalCatalog

public static SparkContext withHiveExternalCatalog(SparkContext sc)

builtinHiveVersion

public static String builtinHiveVersion()

The version of hive used internally by Spark SQL.

HIVE_METASTORE_VERSION

public static <any> HIVE_METASTORE_VERSION()

FAKE_HIVE_VERSION

public static <any> FAKE_HIVE_VERSION()

HIVE_METASTORE_JARS

public static <any> HIVE_METASTORE_JARS()

CONVERT_METASTORE_PARQUET

public static <any> CONVERT_METASTORE_PARQUET()

CONVERT_METASTORE_PARQUET_WITH_SCHEMA_MERGING

public static <any> CONVERT_METASTORE_PARQUET_WITH_SCHEMA_MERGING()

CONVERT_METASTORE_ORC

public static <any> CONVERT_METASTORE_ORC()

CONVERT_METASTORE_CTAS

public static <any> CONVERT_METASTORE_CTAS()

HIVE_METASTORE_SHARED_PREFIXES

public static <any> HIVE_METASTORE_SHARED_PREFIXES()

HIVE_METASTORE_BARRIER_PREFIXES

public static <any> HIVE_METASTORE_BARRIER_PREFIXES()

HIVE_THRIFT_SERVER_ASYNC

public static <any> HIVE_THRIFT_SERVER_ASYNC()

isCliSessionState

public static boolean isCliSessionState()

Check current Thread's SessionState type

Returns:

true when SessionState.get returns an instance of CliSessionState, false when it gets non-CliSessionState instance or null

newTemporaryConfiguration

public static scala.collection.immutable.Map<String,String> newTemporaryConfiguration(boolean useInMemoryDerby)

Constructs a configuration for hive, where the metastore is located in a temp directory.

inferSchema

public static org.apache.spark.sql.catalyst.catalog.CatalogTable inferSchema(org.apache.spark.sql.catalyst.catalog.CatalogTable table)

Infers the schema for Hive serde tables and returns the CatalogTable with the inferred schema. When the tables are data source tables or the schema already exists, returns the original CatalogTable.

Parameters:

table - (undocumented)

Returns:

(undocumented)