pyspark.sql.functions.regr_sxx#

pyspark.sql.functions.regr_sxx(y, x)[source]#

Aggregate function: returns REGR_COUNT(y, x) * VAR_POP(x) for non-null pairs in a group, where y is the dependent variable and x is the independent variable.

New in version 3.5.0.

Parameters

yColumn or str: the dependent variable.
xColumn or str: the independent variable.

Returns

Column: REGR_COUNT(y, x) * VAR_POP(x) for non-null pairs in a group.

Examples

>>> from pyspark.sql import functions as sf
>>> x = (sf.col("id") % 3).alias("x")
>>> y = (sf.randn(42) + x * 10).alias("y")
>>> spark.range(0, 1000, 1, 1).select(x, y).select(
...     sf.regr_sxx("y", "x")
... ).show()
+-----------------+
|   regr_sxx(y, x)|
+-----------------+
|666.9989999999...|
+-----------------+