pyspark.ml.util.
GeneralMLWriter
Utility class that can save ML instances in different formats.
New in version 2.4.0.
Methods
format(source)
format
Specifies the format of ML export (“pmml”, “internal”, or the fully qualified class name for export).
option(key, value)
option
Adds an option to the underlying MLWriter.
overwrite()
overwrite
Overwrites if the output path already exists.
save(path)
save
Save the ML instance to the input path.
saveImpl(path)
saveImpl
save() handles overwriting and then calls this method.
session(sparkSession)
session
Sets the Spark Session to use for saving/loading.
Attributes
sc
Returns the underlying SparkContext.
sparkSession
Returns the user-specified Spark Session or the default.
Methods Documentation
Adds an option to the underlying MLWriter. See the documentation for the specific model’s writer for possible options. The option name (key) is case-insensitive.
save() handles overwriting and then calls this method. Subclasses should override this method to implement the actual saving of the instance.
Attributes Documentation