org.apache.spark.sql.hive

Class HiveStrategies.ParquetConversion

Object

org.apache.spark.sql.catalyst.planning.GenericStrategy<org.apache.spark.sql.execution.SparkPlan>

org.apache.spark.sql.hive.HiveStrategies.ParquetConversion

All Implemented Interfaces:

Logging

Enclosing interface:

HiveStrategies

public static class HiveStrategies.ParquetConversion
extends org.apache.spark.sql.catalyst.planning.GenericStrategy<org.apache.spark.sql.execution.SparkPlan>

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	HiveStrategies.ParquetConversion.LogicalPlanHacks
class	HiveStrategies.ParquetConversion.PhysicalPlanHacks

Constructor Summary

Constructors

Constructor and Description
HiveStrategies.ParquetConversion() :: Experimental :: Finds table scans that would use the Hive SerDe and replaces them with our own native parquet table scan operator.

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.execution.SparkPlan>	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Methods inherited from class org.apache.spark.sql.catalyst.planning.GenericStrategy

isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

HiveStrategies.ParquetConversion

public HiveStrategies.ParquetConversion()

:: Experimental :: Finds table scans that would use the Hive SerDe and replaces them with our own native parquet table scan operator.

TODO: Much of this logic is duplicated in HiveTableScan. Ideally we would do some refactoring but since this is after the code freeze for 1.1 all logic is here to minimize disruption.

Other issues: - Much of this logic assumes case insensitive resolution.

Method Detail

apply

public scala.collection.Seq<org.apache.spark.sql.execution.SparkPlan> apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Specified by:

apply in class org.apache.spark.sql.catalyst.planning.GenericStrategy<org.apache.spark.sql.execution.SparkPlan>