org.apache.spark.ml.util

Class GeneralMLWriter

Object

org.apache.spark.ml.util.MLWriter

org.apache.spark.ml.util.GeneralMLWriter

All Implemented Interfaces:

Logging

public class GeneralMLWriter
extends MLWriter
implements Logging

A ML Writer which delegates based on the requested format.

Constructor Summary

Constructors

Constructor and Description
GeneralMLWriter(PipelineStage stage)

Method Summary

Modifier and Type	Method and Description
GeneralMLWriter	context(SQLContext sqlContext) Sets the Spark SQLContext to use for saving/loading.
GeneralMLWriter	format(String source) Specifies the format of ML export (e.g.
scala.Option<SparkSession>	optionSparkSession()
SparkContext	sc() Returns the underlying `SparkContext`.
GeneralMLWriter	session(SparkSession sparkSession) Sets the Spark Session to use for saving/loading.
SparkSession	sparkSession() Returns the user-specified Spark Session or the default.
SQLContext	sqlContext() Returns the user-specified SQL context or the default.

Methods inherited from class org.apache.spark.ml.util.MLWriter

option, overwrite, save

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.internal.Logging

initializeLogging, initializeLogIfNecessary, initializeLogIfNecessary, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

GeneralMLWriter

public GeneralMLWriter(PipelineStage stage)

Method Detail

context

public GeneralMLWriter context(SQLContext sqlContext)

Sets the Spark SQLContext to use for saving/loading.

Overrides:

context in class MLWriter

Parameters:

sqlContext - (undocumented)

Returns:

(undocumented)

format

public GeneralMLWriter format(String source)

Specifies the format of ML export (e.g. "pmml", "internal", or the fully qualified class name for export).

Parameters:

source - (undocumented)

Returns:

(undocumented)

session

public GeneralMLWriter session(SparkSession sparkSession)

Sets the Spark Session to use for saving/loading.

Overrides:

session in class MLWriter

Parameters:

sparkSession - (undocumented)

Returns:

(undocumented)

optionSparkSession

public scala.Option<SparkSession> optionSparkSession()

sc

public SparkContext sc()

Returns the underlying `SparkContext`.

sparkSession

public SparkSession sparkSession()

Returns the user-specified Spark Session or the default.

Returns:

(undocumented)

sqlContext

public SQLContext sqlContext()

Returns the user-specified SQL context or the default.

Returns:

(undocumented)