Dataset and DataFrame API explode deprecated

Dataset and DataFrame API explode has been deprecated.

Type of change: Syntactic/Spark SQL change

Spark 1.6

Dataset and DataFrame API explode are supported.

Spark 2.4

Dataset and DataFrame API explode have been deprecated. If explode is used, for example dataframe.explode(), the following warning is thrown:

warning: method explode in class Dataset is deprecated: use flatMap() or select() with functions.explode() instead

Action Required

Use functions.explode() or flatMap (import org.apache.spark.sql.functions.explode).