org.apache.spark.sql.hive

Class MetastoreRelation

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

org.apache.spark.sql.catalyst.plans.logical.LeafNode

org.apache.spark.sql.hive.MetastoreRelation

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.LeafNode<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>, scala.Equals, scala.Product

public class MetastoreRelation
extends org.apache.spark.sql.catalyst.plans.logical.LeafNode
implements scala.Product, scala.Serializable

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	MetastoreRelation.SchemaAttribute

Constructor Summary

Constructors

Constructor and Description
MetastoreRelation(String databaseName, String tableName, scala.Option<String> alias, org.apache.hadoop.hive.metastore.api.Table table, scala.collection.Seq<org.apache.hadoop.hive.metastore.api.Partition> partitions, SQLContext sqlContext)

Method Summary

Methods

Modifier and Type	Method and Description
scala.Option<String>	alias()
org.apache.spark.sql.catalyst.expressions.AttributeMap<org.apache.spark.sql.catalyst.expressions.AttributeReference>	attributeMap() An attribute map that can be used to lookup original attributes based on expression id.
scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference>	attributes() Non-partitionKey attributes
org.apache.spark.sql.catalyst.expressions.AttributeMap<Object>	columnOrdinals() An attribute map for determining the ordinal for non-partition columns.
String	databaseName()
scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition>	hiveQlPartitions()
org.apache.hadoop.hive.ql.metadata.Table	hiveQlTable()
scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference>	output()
scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference>	partitionKeys()
scala.collection.Seq<org.apache.hadoop.hive.metastore.api.Partition>	partitions()
boolean	sameResult(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan) Only compare database and tablename, not alias.
org.apache.spark.sql.catalyst.plans.logical.Statistics	statistics()
org.apache.hadoop.hive.metastore.api.Table	table()
org.apache.hadoop.hive.ql.plan.TableDesc	tableDesc()
String	tableName()

Methods inherited from class org.apache.spark.sql.catalyst.plans.logical.LeafNode

children

Methods inherited from class org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

childrenResolved, cleanArgs, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_, org$apache$spark$sql$catalyst$plans$logical$LogicalPlan$$resolveAsColumn, org$apache$spark$sql$catalyst$plans$logical$LogicalPlan$$resolveAsTableColumn, resolve, resolve, resolveChildren, resolved, statePrefix

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, collect, fastEquals, flatMap, foreach, foreachUp, generateTreeString, getNodeNumbered, makeCopy, map, mapChildren, nodeName, numberedTreeString, origin, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

MetastoreRelation

public MetastoreRelation(String databaseName,
                 String tableName,
                 scala.Option<String> alias,
                 org.apache.hadoop.hive.metastore.api.Table table,
                 scala.collection.Seq<org.apache.hadoop.hive.metastore.api.Partition> partitions,
                 SQLContext sqlContext)

Method Detail

databaseName

public String databaseName()

tableName

public String tableName()

alias

public scala.Option<String> alias()

table

public org.apache.hadoop.hive.metastore.api.Table table()

partitions

public scala.collection.Seq<org.apache.hadoop.hive.metastore.api.Partition> partitions()

hiveQlTable

public org.apache.hadoop.hive.ql.metadata.Table hiveQlTable()

hiveQlPartitions

public scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> hiveQlPartitions()

statistics

public org.apache.spark.sql.catalyst.plans.logical.Statistics statistics()

Overrides:

statistics in class org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

sameResult

public boolean sameResult(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Only compare database and tablename, not alias.

Overrides:

sameResult in class org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

tableDesc

public org.apache.hadoop.hive.ql.plan.TableDesc tableDesc()

partitionKeys

public scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference> partitionKeys()

attributes

public scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference> attributes()

Non-partitionKey attributes

output

public scala.collection.mutable.Buffer<org.apache.spark.sql.catalyst.expressions.AttributeReference> output()

attributeMap

public org.apache.spark.sql.catalyst.expressions.AttributeMap<org.apache.spark.sql.catalyst.expressions.AttributeReference> attributeMap()

An attribute map that can be used to lookup original attributes based on expression id.

columnOrdinals

public org.apache.spark.sql.catalyst.expressions.AttributeMap<Object> columnOrdinals()

An attribute map for determining the ordinal for non-partition columns.