VertexRDDImpl (Spark 1.2.1 JavaDoc)

Object
- org.apache.spark.rdd.RDD<scala.Tuple2<Object,VD>>
- - org.apache.spark.graphx.VertexRDD<VD>
  - - org.apache.spark.graphx.impl.VertexRDDImpl<VD>

All Implemented Interfaces:

java.io.Serializable, Logging
```
public class VertexRDDImpl<VD>
extends VertexRDD<VD>
```
See Also:
Serialized Form

Constructor Summary

Constructors
Constructor and Description
`VertexRDDImpl(RDD<ShippableVertexPartition<VD>> partitionsRDD, StorageLevel targetStorageLevel, scala.reflect.ClassTag<VD> vdTag)`

Method Summary

Methods
Modifier and Type	Method and Description
`<VD2> VertexRDD<VD2>`	`aggregateUsingIndex(RDD<scala.Tuple2<Object,VD2>> messages, scala.Function2<VD2,VD2,VD2> reduceFunc, scala.reflect.ClassTag<VD2> evidence$12)` Aggregates vertices in `messages` that have the same ids using `reduceFunc`, returning a VertexRDD co-indexed with `this`.
`VertexRDDImpl<VD>`	`cache()` Persists the vertex partitions at `targetStorageLevel`, which defaults to MEMORY_ONLY.
`void`	`checkpoint()` Mark this RDD for checkpointing.
`long`	`count()` The number of vertices in the RDD.
`VertexRDD<VD>`	`diff(VertexRDD<VD> other)` Hides vertices that are the same between `this` and `other`; for vertices that are different, keeps the values from `other`.
`<U,VD2> VertexRDD<VD2>`	`innerJoin(RDD<scala.Tuple2<Object,U>> other, scala.Function3<Object,VD,U,VD2> f, scala.reflect.ClassTag<U> evidence$10, scala.reflect.ClassTag<VD2> evidence$11)` Inner joins this VertexRDD with an RDD containing vertex attribute pairs.
`<U,VD2> VertexRDD<VD2>`	`innerZipJoin(VertexRDD<U> other, scala.Function3<Object,VD,U,VD2> f, scala.reflect.ClassTag<U> evidence$8, scala.reflect.ClassTag<VD2> evidence$9)` Efficiently inner joins this VertexRDD with another VertexRDD sharing the same index.
`<VD2,VD3> VertexRDD<VD3>`	`leftJoin(RDD<scala.Tuple2<Object,VD2>> other, scala.Function3<Object,VD,scala.Option<VD2>,VD3> f, scala.reflect.ClassTag<VD2> evidence$6, scala.reflect.ClassTag<VD3> evidence$7)` Left joins this VertexRDD with an RDD containing vertex attribute pairs.
`<VD2,VD3> VertexRDD<VD3>`	`leftZipJoin(VertexRDD<VD2> other, scala.Function3<Object,VD,scala.Option<VD2>,VD3> f, scala.reflect.ClassTag<VD2> evidence$4, scala.reflect.ClassTag<VD3> evidence$5)` Left joins this RDD with another VertexRDD with the same index.
`<VD2> VertexRDD<VD2>`	`mapValues(scala.Function1<VD,VD2> f, scala.reflect.ClassTag<VD2> evidence$2)` Maps each vertex attribute, preserving the index.
`<VD2> VertexRDD<VD2>`	`mapValues(scala.Function2<Object,VD,VD2> f, scala.reflect.ClassTag<VD2> evidence$3)` Maps each vertex attribute, additionally supplying the vertex ID.
`<VD2> VertexRDD<VD2>`	`mapVertexPartitions(scala.Function1<ShippableVertexPartition<VD>,ShippableVertexPartition<VD2>> f, scala.reflect.ClassTag<VD2> evidence$1)` Applies a function to each `VertexPartition` of this RDD and returns a new VertexRDD.
`scala.Option<Partitioner>`	`partitioner()` Optionally overridden by subclasses to specify how they are partitioned.
`RDD<ShippableVertexPartition<VD>>`	`partitionsRDD()`
`VertexRDDImpl<VD>`	`persist(StorageLevel newLevel)` Persists the vertex partitions at the specified storage level, ignoring any existing target storage level.
`VertexRDD<VD>`	`reindex()` Construct a new VertexRDD that is indexed by only the visible vertices.
`VertexRDD<VD>`	`reverseRoutingTables()` Returns a new `VertexRDD` reflecting a reversal of all edge directions in the corresponding `EdgeRDD`.
`VertexRDDImpl<VD>`	`setName(String _name)` Assign a name to this RDD
`RDD<scala.Tuple2<Object,VertexAttributeBlock<VD>>>`	`shipVertexAttributes(boolean shipSrc, boolean shipDst)` Generates an RDD of vertex attributes suitable for shipping to the edge partitions.
`RDD<scala.Tuple2<Object,long[]>>`	`shipVertexIds()` Generates an RDD of vertex IDs suitable for shipping to the edge partitions.
`StorageLevel`	`targetStorageLevel()`
`VertexRDDImpl<VD>`	`unpersist(boolean blocking)` Mark the RDD as non-persistent, and remove all blocks for it from memory and disk.
`VertexRDD<VD>`	`withEdges(EdgeRDD<?> edges)` Prepares this VertexRDD for efficient joins with the given EdgeRDD.
`<VD2> VertexRDD<VD2>`	`withPartitionsRDD(RDD<ShippableVertexPartition<VD2>> partitionsRDD, scala.reflect.ClassTag<VD2> evidence$13)` Replaces the vertex partitions while preserving all other properties of the VertexRDD.
`VertexRDD<VD>`	`withTargetStorageLevel(StorageLevel targetStorageLevel)` Changes the target storage level while preserving all other properties of the VertexRDD.

Methods inherited from class org.apache.spark.graphx.VertexRDD
apply, apply, apply, compute, createRoutingTables, filter, fromEdges

Methods inherited from class org.apache.spark.rdd.RDD
aggregate, cartesian, checkpointData, coalesce, collect, collect, collectPartitions, computeOrReadCheckpoint, conf, context, countApprox, countApproxDistinct, countApproxDistinct, countByValue, countByValueApprox, creationSite, dependencies, distinct, distinct, doCheckpoint, elementClassTag, filterWith, first, flatMap, flatMapWith, fold, foreach, foreachPartition, foreachWith, getCheckpointFile, getCreationSite, getNarrowAncestors, getStorageLevel, glom, groupBy, groupBy, groupBy, id, intersection, intersection, intersection, isCheckpointed, iterator, keyBy, map, mapPartitions, mapPartitionsWithContext, mapPartitionsWithIndex, mapPartitionsWithSplit, mapWith, markCheckpointed, max, min, name, partitions, persist, pipe, pipe, pipe, preferredLocations, randomSplit, reduce, repartition, retag, retag, sample, saveAsObjectFile, saveAsTextFile, saveAsTextFile, sortBy, sparkContext, subtract, subtract, subtract, take, takeOrdered, takeSample, toArray, toDebugString, toJavaRDD, toLocalIterator, top, toString, union, zip, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipPartitions, zipWithIndex, zipWithUniqueId

Methods inherited from class Object
equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

- Constructor Detail
  - VertexRDDImpl
```
public VertexRDDImpl(RDD<ShippableVertexPartition<VD>> partitionsRDD,
             StorageLevel targetStorageLevel,
             scala.reflect.ClassTag<VD> vdTag)
```
- Method Detail
  - partitionsRDD
```
public RDD<ShippableVertexPartition<VD>> partitionsRDD()
```
    Specified by:
    
    partitionsRDD in class VertexRDD<VD>
  - targetStorageLevel
```
public StorageLevel targetStorageLevel()
```
  - reindex
```
public VertexRDD<VD> reindex()
```
    Description copied from class: VertexRDD
    
    Construct a new VertexRDD that is indexed by only the visible vertices. The resulting VertexRDD will be based on a different index and can no longer be quickly joined with this RDD.
    
    Specified by:
    
    reindex in class VertexRDD<VD>
  - partitioner
```
public scala.Option<Partitioner> partitioner()
```
    Description copied from class: RDD
    
    Optionally overridden by subclasses to specify how they are partitioned.
    
    Overrides:
    
    partitioner in class RDD<scala.Tuple2<Object,VD>>
  - setName
```
public VertexRDDImpl<VD> setName(String _name)
```
    Description copied from class: RDD
    
    Assign a name to this RDD
    
    Overrides:
    
    setName in class RDD<scala.Tuple2<Object,VD>>
  - persist
```
public VertexRDDImpl<VD> persist(StorageLevel newLevel)
```
    Persists the vertex partitions at the specified storage level, ignoring any existing target storage level.
    
    Overrides:
    
    persist in class RDD<scala.Tuple2<Object,VD>>
  - unpersist
```
public VertexRDDImpl<VD> unpersist(boolean blocking)
```
    Description copied from class: RDD
    
    Mark the RDD as non-persistent, and remove all blocks for it from memory and disk.
    
    Overrides:
    
    unpersist in class RDD<scala.Tuple2<Object,VD>>
    
    Parameters:
    blocking - Whether to block until all blocks are deleted.
    
    Returns:
    This RDD.
  - cache
```
public VertexRDDImpl<VD> cache()
```
    Persists the vertex partitions at `targetStorageLevel`, which defaults to MEMORY_ONLY.
    
    Overrides:
    
    cache in class RDD<scala.Tuple2<Object,VD>>
  - checkpoint
```
public void checkpoint()
```
    Description copied from class: RDD
    
    Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint directory set with SparkContext.setCheckpointDir() and all references to its parent RDDs will be removed. This function must be called before any job has been executed on this RDD. It is strongly recommended that this RDD is persisted in memory, otherwise saving it on a file will require recomputation.
    
    Overrides:
    
    checkpoint in class RDD<scala.Tuple2<Object,VD>>
  - count
```
public long count()
```
    The number of vertices in the RDD.
    
    Overrides:
    
    count in class RDD<scala.Tuple2<Object,VD>>
  - mapVertexPartitions
```
public <VD2> VertexRDD<VD2> mapVertexPartitions(scala.Function1<ShippableVertexPartition<VD>,ShippableVertexPartition<VD2>> f,
                                       scala.reflect.ClassTag<VD2> evidence$1)
```
    Description copied from class: VertexRDD
    
    Applies a function to each VertexPartition of this RDD and returns a new VertexRDD.
    
    Specified by:
    
    mapVertexPartitions in class VertexRDD<VD>
  - mapValues
```
public <VD2> VertexRDD<VD2> mapValues(scala.Function1<VD,VD2> f,
                             scala.reflect.ClassTag<VD2> evidence$2)
```
    Description copied from class: VertexRDD
    
    Maps each vertex attribute, preserving the index.
    
    Specified by:
    
    mapValues in class VertexRDD<VD>
    
    Parameters:
    f - the function applied to each value in the RDD
    
    Returns:
    a new VertexRDD with values obtained by applying f to each of the entries in the original VertexRDD
  - mapValues
```
public <VD2> VertexRDD<VD2> mapValues(scala.Function2<Object,VD,VD2> f,
                             scala.reflect.ClassTag<VD2> evidence$3)
```
    Description copied from class: VertexRDD
    
    Maps each vertex attribute, additionally supplying the vertex ID.
    
    Specified by:
    
    mapValues in class VertexRDD<VD>
    
    Parameters:
    f - the function applied to each ID-value pair in the RDD
    
    Returns:
    a new VertexRDD with values obtained by applying f to each of the entries in the original VertexRDD. The resulting VertexRDD retains the same index.
  - diff
```
public VertexRDD<VD> diff(VertexRDD<VD> other)
```
    Description copied from class: VertexRDD
    
    Hides vertices that are the same between this and other; for vertices that are different, keeps the values from other.
    
    Specified by:
    
    diff in class VertexRDD<VD>
  - leftZipJoin
```
public <VD2,VD3> VertexRDD<VD3> leftZipJoin(VertexRDD<VD2> other,
                                   scala.Function3<Object,VD,scala.Option<VD2>,VD3> f,
                                   scala.reflect.ClassTag<VD2> evidence$4,
                                   scala.reflect.ClassTag<VD3> evidence$5)
```
    Description copied from class: VertexRDD
    
    Left joins this RDD with another VertexRDD with the same index. This function will fail if both VertexRDDs do not share the same index. The resulting vertex set contains an entry for each vertex in this. If other is missing any vertex in this VertexRDD, f is passed None.
    
    Specified by:
    
    leftZipJoin in class VertexRDD<VD>
    
    Parameters:
    other - the other VertexRDD with which to join.
    f - the function mapping a vertex id and its attributes in this and the other vertex set to a new vertex attribute.
    
    Returns:
    a VertexRDD containing the results of f
  - leftJoin
```
public <VD2,VD3> VertexRDD<VD3> leftJoin(RDD<scala.Tuple2<Object,VD2>> other,
                                scala.Function3<Object,VD,scala.Option<VD2>,VD3> f,
                                scala.reflect.ClassTag<VD2> evidence$6,
                                scala.reflect.ClassTag<VD3> evidence$7)
```
    Description copied from class: VertexRDD
    
    Left joins this VertexRDD with an RDD containing vertex attribute pairs. If the other RDD is backed by a VertexRDD with the same index then the efficient leftZipJoin implementation is used. The resulting VertexRDD contains an entry for each vertex in this. If other is missing any vertex in this VertexRDD, f is passed None. If there are duplicates, the vertex is picked arbitrarily.
    
    Specified by:
    
    leftJoin in class VertexRDD<VD>
    
    Parameters:
    other - the other VertexRDD with which to join
    f - the function mapping a vertex id and its attributes in this and the other vertex set to a new vertex attribute.
    
    Returns:
    a VertexRDD containing all the vertices in this VertexRDD with the attributes emitted by f.
  - innerZipJoin
```
public <U,VD2> VertexRDD<VD2> innerZipJoin(VertexRDD<U> other,
                                  scala.Function3<Object,VD,U,VD2> f,
                                  scala.reflect.ClassTag<U> evidence$8,
                                  scala.reflect.ClassTag<VD2> evidence$9)
```
    Description copied from class: VertexRDD
    
    Efficiently inner joins this VertexRDD with another VertexRDD sharing the same index. See innerJoin for the behavior of the join.
    
    Specified by:
    
    innerZipJoin in class VertexRDD<VD>
  - innerJoin
```
public <U,VD2> VertexRDD<VD2> innerJoin(RDD<scala.Tuple2<Object,U>> other,
                               scala.Function3<Object,VD,U,VD2> f,
                               scala.reflect.ClassTag<U> evidence$10,
                               scala.reflect.ClassTag<VD2> evidence$11)
```
    Description copied from class: VertexRDD
    
    Inner joins this VertexRDD with an RDD containing vertex attribute pairs. If the other RDD is backed by a VertexRDD with the same index then the efficient innerZipJoin implementation is used.
    
    Specified by:
    
    innerJoin in class VertexRDD<VD>
    
    Parameters:
    other - an RDD containing vertices to join. If there are multiple entries for the same vertex, one is picked arbitrarily. Use aggregateUsingIndex to merge multiple entries.
    f - the join function applied to corresponding values of this and other
    
    Returns:
    a VertexRDD co-indexed with this, containing only vertices that appear in both this and other, with values supplied by f
  - aggregateUsingIndex
```
public <VD2> VertexRDD<VD2> aggregateUsingIndex(RDD<scala.Tuple2<Object,VD2>> messages,
                                       scala.Function2<VD2,VD2,VD2> reduceFunc,
                                       scala.reflect.ClassTag<VD2> evidence$12)
```
    Description copied from class: VertexRDD
    
    Aggregates vertices in messages that have the same ids using reduceFunc, returning a VertexRDD co-indexed with this.
    
    Specified by:
    
    aggregateUsingIndex in class VertexRDD<VD>
    
    Parameters:
    messages - an RDD containing messages to aggregate, where each message is a pair of its target vertex ID and the message data
    reduceFunc - the associative aggregation function for merging messages to the same vertex
    
    Returns:
    a VertexRDD co-indexed with this, containing only vertices that received messages. For those vertices, their values are the result of applying reduceFunc to all received messages.
  - reverseRoutingTables
```
public VertexRDD<VD> reverseRoutingTables()
```
    Description copied from class: VertexRDD
    
    Returns a new VertexRDD reflecting a reversal of all edge directions in the corresponding EdgeRDD.
    
    Specified by:
    
    reverseRoutingTables in class VertexRDD<VD>
  - withEdges
```
public VertexRDD<VD> withEdges(EdgeRDD<?> edges)
```
    Description copied from class: VertexRDD
    
    Prepares this VertexRDD for efficient joins with the given EdgeRDD.
    
    Specified by:
    
    withEdges in class VertexRDD<VD>
  - withPartitionsRDD
```
public <VD2> VertexRDD<VD2> withPartitionsRDD(RDD<ShippableVertexPartition<VD2>> partitionsRDD,
                                     scala.reflect.ClassTag<VD2> evidence$13)
```
    Description copied from class: VertexRDD
    
    Replaces the vertex partitions while preserving all other properties of the VertexRDD.
    
    Specified by:
    
    withPartitionsRDD in class VertexRDD<VD>
  - withTargetStorageLevel
```
public VertexRDD<VD> withTargetStorageLevel(StorageLevel targetStorageLevel)
```
    Description copied from class: VertexRDD
    
    Changes the target storage level while preserving all other properties of the VertexRDD. Operations on the returned VertexRDD will preserve this storage level.
    This does not actually trigger a cache; to do this, call RDD.cache() on the returned VertexRDD.
    
    Specified by:
    
    withTargetStorageLevel in class VertexRDD<VD>
  - shipVertexAttributes
```
public RDD<scala.Tuple2<Object,VertexAttributeBlock<VD>>> shipVertexAttributes(boolean shipSrc,
                                                                      boolean shipDst)
```
    Description copied from class: VertexRDD
    
    Generates an RDD of vertex attributes suitable for shipping to the edge partitions.
    
    Specified by:
    
    shipVertexAttributes in class VertexRDD<VD>
  - shipVertexIds
```
public RDD<scala.Tuple2<Object,long[]>> shipVertexIds()
```
    Description copied from class: VertexRDD
    
    Generates an RDD of vertex IDs suitable for shipping to the edge partitions.
    
    Specified by:
    
    shipVertexIds in class VertexRDD<VD>

Class VertexRDDImpl<VD>

Constructor Summary

Method Summary

Methods inherited from class org.apache.spark.graphx.VertexRDD

Methods inherited from class org.apache.spark.rdd.RDD

Methods inherited from class Object

Methods inherited from interface org.apache.spark.Logging

Constructor Detail

VertexRDDImpl

Method Detail

partitionsRDD

targetStorageLevel

reindex

partitioner

setName

persist

unpersist

cache

checkpoint

count

mapVertexPartitions

mapValues

mapValues

diff

leftZipJoin

leftJoin

innerZipJoin

innerJoin

aggregateUsingIndex

reverseRoutingTables

withEdges

withPartitionsRDD

withTargetStorageLevel

shipVertexAttributes

shipVertexIds