pyspark.streaming.DStream.transformWith¶

DStream.transformWith(func, other, keepSerializer=False)[source]¶

Return a new DStream in which each RDD is generated by applying a function on each RDD of this DStream and ‘other’ DStream.

func can have two arguments of (rdd_a, rdd_b) or have three arguments of (time, rdd_a, rdd_b)

pyspark.streaming.DStream.transform

pyspark.streaming.DStream.union