The Lakeflow pipelines Python interface is defined in the pyspark.pipelines module, imported as dp. Apache Spark includes declarative pipelines beginning in Spark 4.1, available through the ...