Upgrading Spark applications from previous versions of DSE

Information on upgrading to the Spark applications from a previous version of DataStax Enterprise.

Upgrading DataStax Enterprise sometimes requires changes to Spark applications based on upgrades to the underlying Spark version.

Upgrading to Spark 1.5/1.6

  • The Row class was automatically imported up to Spark 1.4, but starting in 1.5 it no longer is implicit, and moved packages. You must manually import org.apache.spark.sql._ or use the full package name of org.apache.spark.sql.Row in Spark SQL applications.