Spark v2.0 and beyond