When writing to a HadoopFsRelation, this method gets called by each task on executor side to instantiate new OutputWriters.
When writing to a HadoopFsRelation, this method gets called by each task on executor side to instantiate new OutputWriters.
Path of the file to which this OutputWriter is supposed to write. Note that
this may not point to the final output file. For example, FileOutputFormat writes to
temporary directories and then merge written files back to the final destination. In
this case, path points to a temporary output file under the temporary directory.
Schema of the rows to be written. Partition columns are not included in the schema if the relation being written is partitioned.
The Hadoop MapReduce task context.
1.4.0
::Experimental:: A factory that produces OutputWriters. A new OutputWriterFactory is created on driver side for each write job issued when writing to a HadoopFsRelation, and then gets serialized to executor side to create actual OutputWriters on the fly.
1.4.0