org.apache.spark.sql.hive.execution

Class HiveTableScan

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.hive.execution.HiveTableScan

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.LeafNode<SparkPlan>, scala.Equals, scala.Product

public class HiveTableScan
extends SparkPlan
implements LeafNode, scala.Product, scala.Serializable

:: DeveloperApi :: The Hive table scan operator. Column and partition pruning are both handled.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes, MetastoreRelation relation, scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred, HiveContext context)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference>	attributes()
HiveContext	context()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference>	output()
scala.Option<org.apache.spark.sql.catalyst.expressions.Expression>	partitionPruningPred()
scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition>	prunePartitions(scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> partitions) Prunes partitions not involve the query plan.
MetastoreRelation	relation()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	requestedAttributes()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy, outputPartitioning, requiredChildDistribution

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.LeafNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

HiveTableScan

public HiveTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes,
             MetastoreRelation relation,
             scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred,
             HiveContext context)

Method Detail

requestedAttributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> requestedAttributes()

relation

public MetastoreRelation relation()

partitionPruningPred

public scala.Option<org.apache.spark.sql.catalyst.expressions.Expression> partitionPruningPred()

context

public HiveContext context()

attributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference> attributes()

prunePartitions

public scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> prunePartitions(scala.collection.Seq<org.apache.hadoop.hive.ql.metadata.Partition> partitions)

Prunes partitions not involve the query plan.

Parameters:

partitions - All partitions of the relation.

Returns:

Partitions that are involved in the query plan.

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.AttributeReference> output()