Spark

You must be aware of the known issues and limitations, the areas of impact, and workaround for Spark in 7.3.1.100.

Known issues identified in Cloudera Runtime 7.3.1.100 Cumulative Hotfix 1 (CHF 1)

The following known issues were identified in this release:

Known issues identified before Cloudera Runtime 7.3.1.100 Cumulative Hotfix 1 (CHF 1)

Spark 3: RAPIDS Accelerator is not available

The RAPIDS Accelerator for Apache Spark is currently not available in 7.3.1.0.

Workaround: None

The CHAR(n) type handled inconsistently, depending on whether the table is partitioned or not.

In upstream Spark 3 the spark.sql.legacy.charVarcharAsString configuration was introduced, but it does not solve all incompatibilities with Spark 2.

Workaround: None. A new configuration spark.cloudera.legacy.charVarcharLegacyPadding will be introduced in a future version to keep compatibility with Spark 2, but it isn't available in 7.3.1.

Apache Jira: SPARK-33480