Release notes

Apache Solr™ 6.0.1.0.2785

Apache Spark™ 2.0.2.35

Apache TinkerPop™ 3.2.11-20200603-0524f70f

Apache Tomcat® 8.0.53

DSE Java Driver 1.2.8

Netty 4.0.54.1.dse

Spark JobServer 0.6.2.240

Python 2.7.x and 3.6+ are supported for cqlsh. (DB-4151)

Fixed the NullPointerException issue described in CASSANDRA-14200: NPE when dumping sstable with null value for timestamp column. (DB-4512)

Fixed an issue that was causing excessive contention during encryption/decryption operations. The fix resulted in an encryption/decryption performance improvement. (DB-4419)

Fixed the problem with unrepairable digest mismatch between nodes running DSE 5.0.x and DSE 5.1+ (during upgrade) where the query includes a subset of columns. (DB-4399)

Fixed a problem where a partial 5.0 -> 5.1 upgrade can cause excessive read repairs and digest mismatches. (DB-4511)

Fixed a CVE-2019-20444 issue in which HttpObjectDecoder.java in Netty, before 4.1.44, allowed an HTTP header that lacked a colon. (DB-4068)

A new configuration option in cassandra.yaml was added: snapshot_before_dropping_column which is false by default. When enabled, every time the user drops a column/columns from a table, a snapshot is created on each node in the cluster before the change in schema is applied. Those snapshots have the same name on each node - for example -auto-snapshot_drop-column-columnname_20200515143511000 - it includes the name of the dropped column and the timestamp (UTC) when the column was dropped (DB-2690)

Fixed an issue where the bloom filter false-positive rate calculation did not properly take into account true negatives, meaning cases where read operations were attempted on non-existing rows. (DB-3246)

Fixed an issue to prevent an unbounded number of flushing tasks for memtables that are almost empty. (DB-4376)

Global BloomFilterFalseRatio is now calculated in the same way as table BloomFilterFalseRatio. Now both types of metrics include true negatives, the formula is ratio = falsePositiveCount / (truePositiveCount + falsePositiveCount + trueNegativeCount) (DB-4439)

Added entries to jvm.options to assist with capturing thread dumps. (DSP-20778)

The frequency of range queries performed by lease manager is now configurable via dse.lease.refresh.interval.seconds system property, JMX and the dsetool command. (DSP-20696)

Fixed a problem related to digest calculation when static column values are null. (DSP-21033)

Fixed memory leak occurring when disk_access_mode: standard is set and sstables use compression (DSP-21039)

Systemd units are included for DSE packages for CentOS and compatible OSes. (DSP-7603)

LDAP servers can handle multiple, comma separated addresses, with or without a port. If the port is not provided, the port parameter will be used (as a default). This way, there is no change in configuration for existing users who have LDAP configured. (DSP-13086)

Systemd units are now included for CentOS 7 and other compatible OSes. (DSP-19056)

ldap_options_server_host in dse.yaml now handles mutiple, comma separated LDAP server addresses. (DSP-20833)

Recording a slow CQL query to the log no longer blocks the thread. (DSP-20894)

Jackson Databind upgraded to 2.9.10.4 (DSP-20981)

Security updates:

Fixed IllegalArgumentException: requirement failed: input refCnt must be > 0 when writing from Spark to DSEFS (DSP-21047)

Backported fix DSP-15762: optimize remove-recursive implementation (to lower the tombstone impact on Spark jobs). (DSP-20750)

Fixed an issue where an excessive number of connections are created to port 5599 when using DSEFS. (DSP-21021)

Fixed a bug where the incorrect rack name could be reported to metrics collector. (DSP-21081)

See notes in TP-CHANGES.txt (DSP-21066)

Significantly reduced the time to (re)load encrypted search cores. (DSP-20692)

Search-related latency metrics now decay in time like other metrics. Named queries (using query.name parameter) now have separate latency metrics. New mbean atributes are available for search latency metrics: TotalLatency (us), Min, Max, Mean, StdDev, DurationUnit, MeanRate, OneMinuteRate, FiveMinuteRate, FifteenMinuteRate, RateUnit, 98th, 999th. (DSP-19612)

Fixed some security vulnerabilities for Solr HTTP REST API when authorization is enabled. Now, users with no appropriate permissions can perform search operations. Resources can be deleted when authorization is enabled, given the correct permissions. (DSP-20749)

Fixed a bug where a decryption block cache occasionally was not operational (SOLR-14498). (DSP-20987)

Fixed an issue where, after an LCM upgrade from DSE 6.8.0 to 6.8.1, the Solr http API was broken either through curl or the Solr UI. (DSP-21115)

Fixed a bug where after several months of up time an encrypted index wouldn’t accept more writes unless the core is reloaded. (DSP-21234)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Apache Solr 6.0.1.0.2715

Apache Spark 2.0.2.35

Apache TinkerPop 3.2.11-20191203-64ed9caf

Apache Tomcat 8.0.53

DataStax Spark Cassandra Connector 2.0.11

DSE Java Driver 1.2.8

Netty 4.0.5.Final

Spark Jobserver 0.6.2.240 requires compatible API

Select Hadoop libraries

Remove Jodd Core dependency that created vulnerability to Arbitrary File Writes. (DSP-19206)

During Spark Application startup, Exception: java.lang.ExceptionInInitializerError thrown from the UncaughtExceptionHandler in thread "main" was logged, sometimes instead of a meaningful error. (DSP-20474)

Patched hive with HIVE-13390 to fix CVE-2016-3083. (DSP-20612)

Fixed a bug to avoid multiple disposals of Solr filter cache DocSet objects. (DSP-15765)

Improve performance, logging, and add options for using the Solr timeAllowed parameter in all queries. The Solr timeAllowed option in queries is now enforced by default to prevent long-running shard queries. (DSP-19781, DSP-19790)

DSE version now appears as a comment in all configuration files. (DB-1022)

The diff logic used by the secondary index does not always pick the latest schema and results in ERROR [CoreThread-8] errors on batch writes. (DB-3838)

Prevent accepting streamed SSTables or loading SSTables when the clustering order does not match. (DB-3530)

Dropping and re-adding the same column with incompatible types is not supported. This change prevents unreadable SSTables. (DB-3586)

A new system property, -Ddse.ldap.retry_interval.ms, allows you to set the time in milliseconds between subsequent retries when authenticating via an LDAP server. Can be set on the dse command line at startup or in the jvm.options file. Default: 10 ms. (DSP-20298)

The frequency of range queries performed by lease manager is now configurable via JMX and dsetool command. (DSP-20696)

Added hostname_verification to ldap_options in dse.yaml. (DSP-20302)

Remove Jodd Core dependency that created vulnerability to Arbitrary File Writes. (DSP-19206)

Added a new JMX attribute of ConnectionSearchPassword for LdapAuthenticator bean has been added, which updates the LDAP search password without the need to restart DSE. (DSP-18928)

Using SELECT JSON for empty BLOB values incorrectly returns an empty string instead of the expected 0x. (DSP-20022)

dsetool ring shows in-progress search index building during bootstrap. (DSP-15281)

Remove Jodd Core dependency that created vulnerability to Arbitrary File Writes. (DSP-19206)

Make the search reference visible in the error message for LDAP connections. (DSP-20578)

Add functionality to query role_stats when stats is enabled under role_management_options in dse.yaml. (DB-4283)

Prevent accepting streamed SSTables or loading SSTables when the clustering order does not match. (DB-3530)

Improved the estimated values of histogram percentiles reported via JMX. In some cases, the percentiles may go slightly down for DSE 5.1. (DB-4275)

Added anticompaction to nodetool stop command help menu. (DB-3821)

Added --disable-history option to cqlsh that disables saving history to disk for current execution. Added history section to cqlshrc which is called with boolean parameter disabled that is set to False by default. (DB-3843)

Improved error messaging for enabled internode SSL encryption in Cassandra Tools test suite. (DB-3957)

Security updates:

Error retrieving expired columns with secondary index on key components. (DB-3764)

Using SELECT JSON for empty BLOB values incorrectly returns an empty string instead of the expected 0x. (DSP-20022)

RoleManager cache keeps invalid values if the LDAP connectivity is down. (DSP-20098)

LDAP user login fails due to parsing failure on user DN with parentheses. (DSP-20106)

Error retrieving expired columns with secondary index on key components. (DB-3764)

Read inconsistencies. (CASSANDRA-12126) (DB-3873)

LDAP cursors leak. (DSP-20623)

Duplicate records with same partition+clustering key after upgrading from DSE 4.8 to 5.1.14. (DB-3552)

Advanced Replication’s OutOfMemoryErrors caused by roaring bitmap deserialization. (DSP-15675)

Upgrade spray-json to prevent Denial Of Service (DoS) vulnerability CVE-2018-18854 and CVE-2018-18853. (DSP-19208)

When creating a file through WebHDFS API, DSEFS does not verify WX permissions of parent’s parent when the parent exists. (DSP-20355)

Restores ability of DSEFS to use Mixed Case keyspaces, which was broken by DSP-16825. (DSP-20354)

Support iterate() as a first class step to ensure DataStax driver compatibility. (DSP-20198)

Enhanced usability on search index creation operations run with dsetool and CQL commands. Command completion feedback now confirms operation scope and provides guidance on additional required actions. (DSP-17994)

The Solr timeAllowed option in queries is now enforced by default to prevent long-running shard queries. This change prevents complex facets and boolean queries from using system resources after the DSE Search coordinator considers the queries to have timed out. For all queries, the default for the timeAllowed value uses the value of client_request_timeout_seconds setting in dse.yaml. (DSP-19781, DSP-19790)

dsetool ring shows in-progress search index building during bootstrap. (DSP-15281)

Error messages related to Solr errors contain better description of the root cause. (DSP-13792)

The dsetool stop_core_reindex command now mentions the node in the output message. (DSP-17090)

Added indexing reason to output of dsetool core_indexing_status command. (DSP-17672)

Improved guidance with warnings when index rebuild is required for ALTER SEARCH INDEX, RELOAD SEARCH INDEX, and dsetool reload_core commands. (DSP-19347)

Upgrade Apache Solr to address CVE-2018-8026. (DSP-16653)

Improved real-time search to fix a docValues bug. (DSP-20300)

suggest request handler requires select permission. Previously, suggest request handler returned forbidden response when authorization was on, regardless of the user permissions. (DSP-20697)

Error on disposals of Solr filter cache DocSet objects. (DSP-15765)

Filter cache warming doesn’t warm parent-only filter correctly when RF=n. (DSP-19802)

Issues in filter cache usage and warming. (DSP-19800, DSP-19802)

Memory allocation issue causes performance degradation at query time. (DSP-19805)

Validate value sizes in LegacyLayout. (CASSANDRA-15373)

Handle paging states serialized with a different version than the session. (CASSANDRA-15176)

Toughen up column drop and recreate type validations. (CASSANDRA-15204)

Use bounds instead of range for SSTables in anti-compaction. (CASSANDRA-14411)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Improved handling of failed Authenticator initializations. (TINKERPOP-2144)

Release dropped response frames in Gremlin Server protocol. (TINKERPOP-2005)

Made iterate() a first class step supporting none(). (TINKERPOP-1834, TINKERPOP-1869)

New options to select cipher suite and protocol to configure KMIP encryption when connecting to a KMIP server. (DSP-17294)

Standalone cqlsh client tool provides an interface for developers to interact with the database and issue CQL commands without having to install the database software. From DataStax Labs, download the version of CQLSH that corresponds to your DataStax database version. (DSP-18694)

Fixed an issue where T values get hidden by property keys of the same name in valueMap(). (DSP-19261)

Unbounded facet searches are no longer allowed. (DSP-18693)

Improved troubleshooting. A log entry is now created when autocompaction is disabled or enabled for a table. (DB-1635)

Reformatted StatusLogger output to reduce details in the INFO level system.log. The detailed output is still present in the debug.log. (DB-2552)

Prevent changing the replication strategy of system keyspaces. (DB-2960)

New nodetool commands to get current values: getcachecapacity, getcachekeystosave, and gethintedhandoffthrottlekb. (DB-3618)

New options to select cipher suite and protocol to configure KMIP encryption when connecting to a KMIP server. (DSP-17294)

Upgrade Jackson Databind to address CVE-2018-11307 and CVE-2018-19361. (DB-2911, DSP-18099, DSP-19319)

Standalone cqlsh client. (DSP-18694)

Update Jackson Databind to 2.9.9.1 for all components except DataStax Bulk Loader. (DSP-19441)

Fix to prevent NPE during repair in mixed-version clusters. (DB-1985)

Tarball installs to create two instances on the same physical server with remote JMX access with binding the separated IPs to port 7199 causes JMX error of Address already in use (Bind failed) because com.sun.management.jmxremote.host is ignored. (DB-2483)

DSE fails to start with ERROR Attempted serializing to buffer exceeded maximum of 65535 bytes. Improved error to identify a workaround for commitlog corruption. (DB-3162)

sstablepartitions incorrectly handles -k and -x options. (DB-3442)

After upgrades from DSE 4.8 to DSE 5.0 or DSE 5.1, deleted data might be resurrected when rows were deleted on DSE 4.8 tables with multiple collection columns. (DB-3492)

Reads against older version ma and mc SSTables hit more SSTables than necessary due to the bug fixed by CASSANDRA-14861. (DB-3691)

Upgraded Apache MINA Core library to 2.0.21 to prevent a security issue where Apache MINA Core was vulnerable to information disclosure. (DSP-19213)

Error in custom provider prevents DSE node startup. With this fix, the node starts up but insights is not active. See the DataStax Support Knowledge Base for steps to resolve existing missing or incorrect keyspace replication problems. (DSP-19521)

Latency metrics, like dse_client_request_latency_bucket, are not present. (DSP-19549)

On Oracle Linux 7.x, StorageService.java:4970 exception occurs with DSE package installation. (DSP-19625)

New graph truncate command to remove all data from graph. (DSP-17609)

Support for ifExists() before truncate(), like system.graph("foo").ifExists().truncate(), in DSE Graph (classic graph) API. (DSP-19357)

T values are hidden by property keys of the same name in valueMap(). (DSP-19261)

Credentials are not masked in the debug level logs for Spark Jobserver and Spark submitted jobs. (DSP-19490)

Unbounded facet searches are no longer allowed. (DSP-18693)

For token ranges dictated by distribution, filter cache warming occurs when a node is restarted, a search index is rebuilt, or when node health score is up to 0.9. New per-core metrics for metric type WarmupMetrics and other improvements. (DSP-8621)

Solr CQL count query incorrectly returns the count as all data count but should return all data count minus start offset. (DSP-16153)

If types do not allow docValues, validation error does not get returned when docValues are applied. (DSP-16884)

While using live indexing, also known as RT or real-time indexing, a race condition can be triggered when concurrently indexing and running heavy facet queries. The race condition fails an assertion that, in turn, fails searcher opening and leaves the index in an inconsistent state. (DSP-18786)

When driver uses paging, CQL query fails when using a Solr index to query with a sort on a field that contains the primary key name in the field: InvalidRequest: Error from server: code=2200 [Invalid query] message="Cursor functionality requires a sort containing a uniqueKey field tie breaker". (DSP-19210)

The count() query with Solr enabled can be inaccurate or inconsistent. (DSP-19401)

Apache Solr 6.0.1.0.2463 *

Apache Spark 2.0.2.25

Apache TinkerPop 3.2.11

Apache Tomcat 8.0.53

DataStax Spark Cassandra Connector 2.0.11

DSE Java Driver 1.2.7

Netty 4.0.54.Final

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

Fixed possible data loss when using DSE Tiered Storage. (DB-3404)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Apache Solr 6.0.1.0.2463 *

Apache Spark 2.0.2.25

Apache TinkerPop 3.2.11

Apache Tomcat 8.0.53

DataStax Spark Cassandra Connector 2.0.11

DSE Java Driver 1.2.7

Netty 4.0.54.Final

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

When DSE authentication is enabled, Spark security is forced to be enabled. (DSP-17274)

DseGraphFrame cannot directly copy graph from one cluster to another. You can now dynamically pass cluster and connection configuration for different graph objects. (DSP-18605)

UnsatisfiedLinkError when insert multi edge with DseGraphFrame in BYOS (Bring Your Own Spark). (DSP-18916)

Performance improvements to Solr deletes that correspond to Cassandra rows. (DSP-17419)

Changes to correct uneven distribution of shard requests with the STATIC set cover finder. (DSP-18197)

New recommended method for case-insensitive text search, faceting, grouping, and sorting with new LowerCaseStrField Solr field type. This type sets field values as lowercase and stores them as lowercase in docValues. (DSP-18763)

The queryExecutorThreads and timeAllowed Solr parameters can be used together. (DSP-18717)

Improved logging identifies which client, keyspace, table, and partition key is rejected when mutation exceeds size threshold. (DB-1051)

Nodes in a cluster continue trying to connect to a decommissioned node. (DB-2886)

Bootstrap should fail if the node is not able to fetch the schema from other nodes in the cluster. (DB-3186)

Slow startup or node hangs when encryption is used. (DB-3050)

Possible data loss when using DSE Tiered Storage. (DB-3404)

A warning message is displayed when DSE authentication is enabled, but Spark security is not enabled. (DSP-17273)

When DSE authentication is enabled, Spark security is forced to be enabled. (DSP-17274)

When the Spark security options are not configured in dse.yaml, the native CQL protocol authentication can be sidestepped with direct access to the Netty RPC client. Although this access should fail to run Spark applications, the CQL authentication can be bypassed on systems with an open Netty port 7077 using Spark RPC. (DSP-17271)

spark_shared_secret_bit_length: 256
spark_security_enabled: true
spark_security_encryption_enabled: true

DseGraphFrame cannot directly copy graph from one cluster to another. You can now dynamically pass cluster and connection configuration for different graph objects. (DSP-18605)

UnsatisfiedLinkError when insert multi edge with DseGraphFrame in BYOS (Bring Your Own Spark). (DSP-18916)

DSE Graph does not use primary key predicate in Search/.has() predicate. (DSP-18993)

Changes to correct uneven distribution of shard requests with the STATIC set cover finder. (DSP-18197)

New recommended method for case-insensitive text search, faceting, grouping, and sorting with new LowerCaseStrField custom Solr field type. This type sets field values as lowercase and stores them as lowercase in docValues. (DSP-18763)

SASI queries don’t work on tables with row level access control (RLAC). (DB-3082)

Documents might not be removed from the index if a key element has value equal to a Solr reserved word. (DSP-17419)

FQ broken with queryExecutorThreads and timeAllowed set. (DSP-18717)

Search should error out, rather than timeout, on Solr query with non-existing field list (fl) fields. (DSP-18218)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Added case in StringConverter to properly output InetAddress. (SPARKC-559)

Added java.time.Instant -> java.util.Data conversion. (SPARKC-560)

RegularStatements not cached by SessionProxy. (SPARKC-558)

Fix CassandraSourceRelation option Parsing in Spark 2.0. (SPARKC-551)

Graph OLAP: secret tokens are redacted in log files.

Masked sensitive configuration options in the logs of KryoShimServiceLoader.

Changes to the SSL configuration in Gremlin Server. See the TinkerPop SSL Security documentation.

Apache Solr 6.0.1.0.2414 *

Apache Spark 2.0.2.25 *

Apache TinkerPop 3.2.11 *

Apache Tomcat 8.0.53

DataStax Spark Cassandra Connector 2.0.11 *

DSE Java Driver 1.2.7

Netty 4.0.54.Final

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

5.1.14 DSE

5.1.14 DSE Analytics

5.1.14 DSE Graph

5.1.14 DSE Search

DSE highlights

DSE Analytics and DSEFS

DSE Graph

DSE Search

DataStax Enterprise Metrics Collector aggregates DSE metrics and integrates with existing monitoring solutions to facilitate problem resolution and remediation. (DSP-17869)

Fixed anti-compaction transaction for atomicity and index building. (DB-3016)

Remedy deadlock during node startup when calculating disk boundaries. (DB-3028)

Correct handling of dropped UDT columns in SSTables. (DB-3031)

Fixed an issue where properties unattached to vertex show up with null values. (DSP-12300)

DSEFS auth demo is fixed. (DSP-17700)

Fixed a leak in BulkTableWriter. (DSP-18513)

Time, date, inet, and duration data types are now supported in graph search indexes. (DSP-17694)

Data caching improvements during DSE GraphFrame operations. (DSP-17870)

DseGraphFrame supports properties with symbols, like period (.), in names. (DSP-17818)

Improved graph robustness in resource-constrained environments. (DSP-18005)

Graph OLAP: secret tokens are redacted in log files. (DSP-18074)

Some minor DSE GraphFrame code fixes. (DSP-18215)

Fixed a class of SSTable reference leaks. (DSP-17975)

Indexing rows that contain frozen maps is supported. (DSP-18073)

Fixed timestamp PK routing with solr_query. (DSP-18223)

Fixed facets and stats queries when using queryExecutorThreads. (DSP-18237, DSP-18665)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE Analytics: Spark application Web UI: When TLS is enabled and a driver is submitted in cluster mode, the driver starts on port 4040 and is not secured. (DSP-16926)

dse spark-submit --conf spark.ssl.ui.enabled=true
--conf spark.ssl.ui.keyPassword=ctool_keystore
--conf spark.ssl.ui.keyStore=/home/automaton/ctool_security/ctool_keystore

Native server Message.Dispatcher.Flusher task stalls under heavy load. (DB-1814)

Reference leak in SSTableRewriter in sstableupgrade when keepOriginals is true. (DB-2944)

Anti-compaction transaction causes temporary data loss. (DB-3016)

Check of two versions of metadata for a column fails on upgrade from DSE 5.0.x when type is not of same class. Loosen the check from CASSANDRA-13776 to prevent Trying to compare 2 different types ERROR on upgrades. (DB-3021)

Deadlock during node startup when calculating disk boundaries. (DB-3028)

Correct handling of dropped UDT columns in SSTables. (DB-3031)

Mishandling of frozen in complex nested types. (DB-3081)

cqlsh EXECUTE AS command does not work. (DB-3098)

Security: java-xmlbuilder is vulnerable to XML external entities (XXE). (DSP-13962)

Timestamp PK routing on solr_query fails. (DSP-18223)

Leak in BulkTableWriter. (DSP-18513)

dse client-tool configuration byos-export does not export required Spark properties. (DSP-15938)

CVE-2018-1334 Apache Spark local privilege escalation vulnerability. (DSP-16715)

Downloaded Spark JAR files are executable for all users. (DSP-17692)

Spark Cassandra Connector does properly cache manually prepared RegularStatements, see SPARKC-558. (DSP-18075)

Invalid options show for dse spark-submit command line help. (DSP-18293)

DSEFS demo does not work. (DSP-17700)

Change dsefs:// default port when the DSEFS setting public_port is changed in dse.yaml. (DSP-17962)

SparkContext closing is faulty with significantly increased shutdown time. (DSP-17699)

DSEFS WebHDFS API GETFILESTATUS op returns AccessDeniedException for the file even when user has correct permission. (DSP-18044)

Do not report errors for leases when a DC is removed. (DSP-16801)

Properties unattached to vertex show up with null values. (DSP-12300)

g.V().repeat(...).until(...).path() returns incomplete path without edges. (DSP-17933)

DseGraphFrame fail to read properties with symbols, like period (.), in names. (DSP-17818)

DSE GraphFrame operations cache but do not explicitly uncache. (DSP-17870)

Inconsistent results when using gremlin on static data. (DSP-18005)

Graph OLAP: secret tokens are unmasked in log files. (DSP-18074)

Unexpected gossip failure. java.lang.NullPointerException: null. (DSP-18194)

OLAP traversal duplicates the partition key properties: OLAP g.V().properties() prints first vertex n times with custom ids. (DSP-15688)

Time, date, inet, and duration data types are not supported in graph search indexes. (DSP-17694)

java.lang.AssertionError: rtDocValues.maxDoc=5230 maxDoc=4488 error is thrown in the system.log during indexing and reindexing. (DSP-17529)

Strong self-ref loop detected after reindex is finished. (DSP-17975)

Loading frozen map columns fails during search read-before-write. (DSP-18073)

Avoid interrupting request threads when an internode handshake fails so that the Lucene file channel lock cannot be interrupted. (DSP-18211)

Facets and stats queries broken when using queryExecutorThreads. (DSP-18237, DSP-18665)

Severe concurrency issues in STCS,DTCS,TWCS,TMD.Topology,TypeParser (CASSANDRA-14781)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Added case in StringConverter to properly output InetAddress (SPARKC-559)

Added java.time.Instant -> java.util.Data conversion (SPARKC-560)

RegularStatements not Cached by SessionProxy (SPARKC-558)

Fix CassandraSourceRelation option Parsing in Spark 2.0 (SPARKC-551)

Graph OLAP: secret tokens are redacted in log files.

Masked sensitive configuration options in the logs of KryoShimServiceLoader.

Changes to the SSL configuration in Gremlin Server. See the TinkerPop SSL Security documentation.

Apache Solr 6.0.1.0.2370

Apache Spark 2.0.2.22

Apache TinkerPop 3.2.9-20181026-f24c1d4b

Apache Tomcat 8.0.53

DataStax Spark Cassandra Connector 2.0.10

DSE Java Driver 1.2.7

Netty 4.0.54.Final

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Possible data loss when using DSE Tiered Storage. (DB-3404)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

SSTables for tables using with a frozen UDT written by DSE 5.0 or Cassandra 3.0 appear as corrupted. See DB-2954, CASSANDRA-15035 in the DSE resolved issues release notes.

Apache Solr 6.0.1.0.2370 *

Apache Spark 2.0.2.22 *

Apache TinkerPop 3.2.9-20181026-f24c1d4b *

Apache Tomcat 8.0.53 *

DataStax Spark Cassandra Connector 2.0.10

DSE Java Driver 1.2.7 *

Netty 4.0.54.Final

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

DSE

DSE Analytics and DSEFS

DSE Graph

DSE Search

Skip fetching streamed range in repair during consistent-replace. (DB-2596)

Fixed user-defined aggregates (UDAs) that instantiate user-defined types (UDTs) break after restart. (DB-2771)

Fixed NullPointerException that can occur during compaction if users use TWCS and allow_unsafe_aggressive_sstable_expiration. (DB-2472)

Fixed resource leak related to streaming operations that affects tiered storage users. Excessive number of TieredRowWriter threads causing java.lang.OutOfMemoryError. (DB-2463)

General stability improvements:

Upgrade improvements:

Operational improvements:

Jetty 9.4.1 upgrade addresses security vulnerabilities in Spark dependencies packaged with DSE. (DSP-16893)

DSE 5.0.x DSEFS client is now able to list files when connected to DSE 5.1.x and later DSEFS server. (DSP-17600)

Fix unresponsive nodes following Gremlin timeouts. (DSP-16544)

Graph/Search escaping fixes. (DSP-17216, DSP-17277, DSP-17816)

Security fixes. (DSP-17029, DSP-17303)

Critical memory leak and corruption fixes for encrypted indexes. (DSP-17111)

Change to the default merge scheduler configuration. See config option MaxMergeCount. (DSP-17597)

CQL timestamp field can be part of a Solr unique key. (DSP-17761)

Minor query memory usage improvements. (DSP-17147)

New DSE start-up parameter -Ddse.consistent_replace improves LOCAL_QUORUM and QUORUM consistency on new node after node replacement. (DB-1577)

New nodetool listendpointspendinghints command prints hint information about the endpoints this node has hints for. (DB-1674)

New sstablepartitions tool to identify large partitions. (DB-803)

New JMX operations for graph MBeans. (DSP-15928)

Improved encryption key error reporting. (DSP-17723)

New -Dcassandra.range_tombstone_bound_check_chance start-up parameter checks for bad range tombstones on a percentage of queries. (DSP-17969)

Custom HeapDumpPath is overwritten. (DB-714)

Deleting a static column and adding it back as a non-static column introduces corruption. (DB-1630)

Rebuild should not fail when a keyspace is not replicated to other datacenters. (DB-2301)

Corrupted static collection deletions for dropped collections in mixed-version clusters. (DB-2341)

Repair may skip some ranges due to received range cache. (DB-2432)

Excessive number of TieredRowWriter threads causing java.lang.OutOfMemoryError (DB-2463)

NullPointerException during compaction on table with TimeWindowCompactionStrategy (TWCS). (DB-2472)

Prevent potential SSTable corruption with nodetool refresh. (DB-2594)

The nodetool gcstats command output incorrectly reports the GC reclaimed metric in bytes, instead of the expected MB. (DB-2598)

TypeParser is not thread safe. (DB-2602)

STCS, DTCS, TWCS, TMD aren’t thread-safe. (DB-2609)

Incorrect order of application of nodetool garbagecollect leaves tombstones that should be deleted. (DB-2658)

User-defined aggregates (UDAs) that instantiate user-defined types (UDTs) break after restart. (DB-2771)

Fix sstableloader error when internode encryption, client_encryption, and config encryption are enabled. (DSP-17536)

EverywhereStrategy picks non-token-owning nodes as endpoints. (DSP-16951)

Improved error handling: only submission-related error exceptions from Spark submitted applications are wrapped in a Dse Spark Submit Bootstrapper Failed to Submit error. (DSP-16359)

Jetty 9.4.1 upgrade addresses security vulnerabilities in Spark dependencies packaged with DSE. (DSP-16893)

dse spark-submit kill and status commands support optionally explicit master address. (DSP-16910, DSP-16991)

Redirect to cluster mode for Spark applications whose public DNS is set. (DSP-15705)

Race condition allows Spark Executor working directories to be removed before stopping those executors. (DSP-15769)

Restore DseGraphFrame support in BYOS and spark-dependencies artifacts. Include graph frames python library in graphframe.jar. (DSP-16383)

Search optimizations for search analytics Spark SQL queries are applied to a datacenter that no longer has search enabled. Queries launched from a search-enabled datacenter cause search optimizations even when the target datacenter does not have search enabled. (DSP-16465)

DSE 5.0.x DSEFS client is not able to list files when connected to 5.1.x (and up) DSEFS server. (DSP-17600)

dse spark-sql-metastore-migrate does not work with DSE Unified Authentication and internal authentication. (DSP-17632)

Improved error message when no available chunks are found. (DSP-16623)

DSEFS throws exceptions and cannot initialize when listen_address is left blank. (DSP-16296)

Timeout issues in DSEFS startup. (DSP-16875)

com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried)

DSEFS exit code not set in some cases (DSP-17266)

DSEFS does not support listen_on_broadcast_address as configured in cassandra.yaml. (DSP-17363)

Moving a directory under itself causes data loss and orphan data structures. (DSP-17347)

Graph OLAP KryoException for geometry types. (DSP-16955)

A Gremlin query with search predicate containing \u2028 or \u2029 characters fails. (DSP-17227)

Geo.inside predicate with Polygon no longer works on secondary index if JTS is not installed. (DSP-17284)

Search indexes on key fields work only with non-tokenized queries. (DSP-17386)

If a client executes a query that results in a shard attempting to send an internode frame larger than the size specified in frame_length_in_mb, the client receive an error message with a message like this:

Attempted to write a frame of <n> bytes with a maximum frame size of <n> bytes

Avoid unnecessary exception and error creation in the Solr query parser. (DSP-17147)

In earlier releases, CQL search queries failed with UTFDataFormatException on very large SELECT clauses and when tables have a very large number of columns. (DSP-17220)

Requesting a core reindex with dsetool reload_core or REBUILD SEARCH INDEX no longer builds up a queue of reindexing tasks on a node. Instead, a single starting reindexing task handles all reindex requests that are already submitted to that node. (DSP-17045, DSP-13030)

Security improvements:

The calculated value for maxMergeCount is changed to improve indexing performance. (DSP-17597)

max(max(<maxThreadCount * 2>, <num_tokens * 8>), <maxThreadCount + 5>)

Memory leak and corruption for encrypted indexes. (DSP-17111)

Solr parsing error on Gremlin statement that contains OR, AND, or NOT and uses a search index. (DSP-17216)

CQL search queries failed with UTFDataFormatException on very large SELECT clauses and when tables have a very large number of columns. (DSP-17220)

CQL timestamp field can be part of a Solr unique key. (DSP-17761)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Upgrades from DSE 5.0.x to DSE 5.1.x on RHEL-based systems incorrectly install DSE 6.x when demos are installed. (DSP-15937)

sudo yum install dse-full-5.1-1 dse-demos-5.1-1

If the wrong DSE version was incorrectly installed:

Spark shutdown stops executors but does not wait for everything else to close, causing CoarseGrainedScheduler errors on app termination: org.apache.spark.SparkException: Could not find CoarseGrainedScheduler or it has been stopped. (DSP-16751)

Legacy sstables with multi block range tombstones create invalid bound sequences (CASSANDRA-14823)

Expand range tombstone validation checks to multiple interim request stages (CASSANDRA-14824)

Reverse order reads can return incomplete results (CASSANDRA-14803)

Avoid calling iter.next() in a loop when notifying indexers about range tombstones (CASSANDRA-14794)

Fix purging semi-expired RT boundaries in reversed iterators (CASSANDRA-14672)

DESC order reads can fail to return the last Unfiltered in the partition (CASSANDRA-14766)

Fix corrupted collection deletions for dropped columns in 3.0 \<→ 2.{1,2} messages (CASSANDRA-14568)

Handle failures in parallelAllSSTableOperation (cleanup/upgradesstables/etc) (CASSANDRA-14657)

Improve TokenMetaData cache populating performance avoid long locking (CASSANDRA-14660)

Fix static column order for SELECT * wildcard queries (CASSANDRA-14638)

sstableloader should use discovered broadcast address to connect intra-cluster (CASSANDRA-14522)

Fix reading columns with non-UTF names from schema (CASSANDRA-14468)

Fix incorrect cqlsh results when selecting same columns multiple times (CASSANDRA-13262)

Returns null instead of NaN or Infinity in JSON strings (CASSANDRA-14377)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

A new property cassandra.range_tombstone_bound_check_chance checks for bad range tombstone on a percentage of queries. The default is 0.01 (can be set in range of 0.0 - 1.0).

Gremlin materializes snapshots lazily. (DSP-17576, TINKERPOP-2081)

Apache Solr 6.0.1.0.2304 *

Apache Spark 2.0.2.21 *

Apache TinkerPop 3.2.9-20180507-f6ead8b2

Apache Tomcat 8.0.47

DataStax Spark Cassandra Connector 2.0.10 *

DSE Java Driver 1.2.6

Netty 4.0.54.Final *

Spark Jobserver 0.6.2.238 requires compatible API

Select Hadoop libraries

DSE Analytics and DSEFS

DSE Graph

DSE Search

Improved security with Spark user isolation. (DSP-16093)

Client and internode connection improvements. Configurable connections and pools. (DSP-14284, DSP-16065)

Improved security: DSEFS uses an isolated native memory pool for file data and metadata sent between nodes. This isolation makes it harder to exploit potential memory management bugs. (DSP-16492)

Fix for duration type in a keyspace that prevented DSEFS from starting. (DSP-16825)

Fix for failures in Spark when wrong type of exceptions occur on file not found. (DSP-16933)

Fix unresponsive nodes following Gremlin timeouts. (DSP-16544)

Fixes NoSuchMethodError or NoClassDefFoundError exceptions when attempting to use a Snowball-generated stemmer. (DSP-16116)

DSE does not start without appropriate Tomcat JAR scanning exclusions. (DSP-16841)

Connections on non-serialization errors are not dropped. (DB-2233)

Create a log message when DDL statements are executed. (DB-2383)

Improved error handling and logging for TDE encryption key management. (DSP-15314)

sstableloader supports custom config file locations. (DSP-16092)

DataStax does more extensive testing on OpenJDK 8 due to the end of public updates for Oracle JRE/JDK 8. (DSP-16179)

Set MX4J_ADDRESS to 127.0.0.1 if not explicitly set. (DB-1950)

Digest mismatch for same data between nodes with flushed memtables and nodes with non-flushed memtables. (DB-1980)

Fix handling of start bound in legacy paged queries. (DB-1984)

Move TWCS message "No compaction necessary for bucket size" to Trace level or NoSpam. (DB-2022)

Limit max cached direct buffer on NIO to 1 MB. (DB-2028)

Compaction strategy instantiation errors don’t generate meaningful error messages, instead return only InvocationTargetException. (DB-2404)

Non-portable syntax (MX4J bash-isms) in cassandra-env.sh broke service scripts. (DB-2123)

nodetool describecluster incorrectly shows DseDelegateSnitch instead of the snitch configured in cassandra.yaml. (DSP-16158)

nodetool upgradesstables fails with 20-year TTL. After upgrade to 5.1.11, take required action. (DB-2109)

Add missing equality sign to SASI schema snapshot. (DB-2129)

For tables using DSE Tiered Storage, nodetool cleanup places cleaned SSTables in the wrong tier. (DB-2173)

sstableloader options assume the RPC/native (client) interface is the same as the internode (node-to-node) interface. (DB-2184)

Audit events for CREATE ROLE and ALTER ROLE with incorrect spacing exposes PASSWORD in plain text. (DB-2285)

Client warnings are not always propagated via LocalSessionWrapper. (DB-2304)

Timestamps inserted with ISO 8601 format are saved with wrong millisecond value. (DB-2312)

Compaction fails with IllegalArgumentException: null. (DB-2329)

BulkLoader class exits without printing the stack trace for throwable error. (DB-2377)

sstableloader does not decrypt passwords using config encryption in DSE. (DSP-13492)

Support creating system keys before the output directory is configured in dse.yaml. (DSP-15380)

Using geo types does not work when memtable allocation type is set to offheap_objects. (DSP-16302)

Improved compatibility with external tables stored in the DSE Metastore in remote systems. (DSP-16561)

Heap-size calculation is incorrect for RpcCallStatement + SearchIndexStatement. (DSP-16731)

Non-internal users are unable to use permissions granted on CREATE. (DSP-16824)

The -graph option for the cassandra-stress tool failed on generating the target output html in the JAR file. (DSP-17046)

DSE client applications, like Spark, hard stop if user home is not defined, does not exist, or the current user does not have write permissions. (DSP-15476)

A Spark application can be registered twice in rare instances. (DSP-15247)

Java driver in Spark Connector uses daemon threads to prevent shutdown hooks from being blocked by driver thread pools. (DSP-16051)

dse client-tool spark sql-schema --all exports definitions for solr_admin keyspace. (DSP-16073)

Improved security prevents run_as runner for Spark from running a malicious program. (DSP-16093)

DSEFS silently fails when TCP port 5599 is not open between nodes. (DSP-16101)

cassandra nonsuperuser gets dsefs AccessDeniedException due to Insufficient permissions. (DSP-16713)

Unable to get available memory before Spark Workers are registered. (DSP-16790)

DSEFS operations: chown, chgrp, and chmod support recursive (-R) and verbose (-v) flag. (DSP-14238)

Client and internode connection improvements. (DSP-14284, DSP-16065)

Improved error message when performing an operation on a corrupted path. (DSP-16340)

Security improvements:

DSEFS fails to start when there is a table with duration type or other type DSEFS that can’t understand. (DSP-16825)

Under high loads, DSEFS reports temporary incorrect state for various files/directories. (DSP-17178)

IllegalStateException during plugin shutdown causes Failed to abort request body error. (DSP-17003)

Improved Gremlin console authentication configuration. (DSP-9905)

Maximum evaluation timeout is 1094 days. (DSP-16709)

Default write consistency level (CL) for Graph is LOCAL_QUORUM. (DSP-17140)

Added convenience methods for reading graph configuration: getEffectiveAllowScan and getEffectiveSchemaMode. (DSP-16650)

The hardcoded default schema_mode is changed from Development to Production. (DSP-16650)

Search indexes are broken for multi cardinality properties. (DSP-14802)

Changing search index schema using a gremlin script might fail with the message: Search index may not be modified while it is being reindexed. Please wait until reindexing has finished. (DSP-15831)

Align query behavior using geo.inside() predicate for polygon search with and without search indexes. (DSP-16108)

Classpath conflict between Lucene and SASI versions of Snowball. (DSP-16116)

Avoid looping indefinitely when a thread making internode requests is interrupted while trying to acquire a connection. (DSP-16544)

Setting graph.traversal_sources.g.evaluation_timeout breaks graph. (DSP-16709)

Deleting a search index that was defined inside a graph fails. (DSP-16765)

DSEFS Hadoop layer doesn’t properly translate DSEFS exceptions to Hadoop exceptions in some methods. (DSP-16933)

Log fewer messages at INFO level in TTLIndexRebuildTask. (DSP-15600)

Search index permissions can be applied at keyspace level. (DSP-15385)

CQL solr_query supports Solr facet heatmaps. (DSP-16404)

Drop operations (ALTER SEARCH INDEX SCHEMA DROP) on the schema now require including at least one attribute on the element being dropped and support dropping only one element at a time. (DSP-15947)

Avoid accumulating redundant router state updates during schema disagreement. (DSP-15615)

Servlet container shutdown (Tomcat) prematurely stops logback context. (DSP-15807)

DSE should not start without appropriate Tomcat JAR scanning exclusions. (DSP-16841)

Node health score of 1 is not obtainable. Search node gets stuck at 0.00 node health score after replacing a node in a cluster. (DSP-17107)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Fix static column order for SELECT * wildcard queries (CASSANDRA-14638)

sstableloader should use discovered broadcast address to connect intra-cluster (CASSANDRA-14522)

Fix reading columns with non-UTF names from schema (CASSANDRA-14468)

Validate supported column type with SASI analyzer (CASSANDRA-13669)

Remove BTree.Builder Recycler to reduce memory usage (CASSANDRA-13929)

Reduce nodetool GC thread count (CASSANDRA-14475)

Fix New SASI view creation during Index Redistribution (CASSANDRA-14055)

Remove string formatting lines from BufferPool hot path (CASSANDRA-14416)

Update metrics to 3.1.5 (CASSANDRA-12924)

Detect OpenJDK jvm type and architecture (CASSANDRA-12793)

Don’t use guava collections in the non-system keyspace jmx attributes (CASSANDRA-12271)

Fix corrupted static collection deletions in 3.0 -> 2.{1,2} messages (CASSANDRA-14568)

Fix potential IndexOutOfBoundsException with counters (CASSANDRA-14167)

Always close RT markers returned by ReadCommand#executeLocally() (CASSANDRA-14515)

Reverse order queries with range tombstones can cause data loss (CASSANDRA-14513)

Fix regression of lagging commitlog flush log message (CASSANDRA-14451)

Add Missing dependencies in pom-all (CASSANDRA-14422)

Cleanup StartupClusterConnectivityChecker and PING Verb (CASSANDRA-14447)

Fix deprecated repair error notifications from 3.x clusters to legacy JMX clients (CASSANDRA-13121)

Cassandra not starting when using enhanced startup scripts in windows (CASSANDRA-14418)

Fix progress stats and units in compactionstats (CASSANDRA-12244)

Better handle missing partition columns in system_schema.columns (CASSANDRA-14379)

Delay hints store excise by write timeout to avoid race with decommission (CASSANDRA-13740)

Incorrect counting of pending messages in OutboundTcpConnection (CASSANDRA-11551)

Fix compaction failure caused by reading un-flushed data (CASSANDRA-12743)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

All updates to 1.6.1

Allow non-cluster prefixed options in sqlConf (SPARKC-531)

Change Str Literal Match to Be Greedy (SPARKC-532)

Restore support for various timezone formats to TimestampParser (SPARKC-533)

UDT converters optimization (SPARKC-536)

Apache Cassandra 3.11.0.2323 *

Apache Solr 6.0.1.0.2284 *

Apache Spark 2.0.2.19 *

Apache TinkerPop 3.2.9-20180507-f6ead8b2 *

Apache Tomcat 8.0.47

DataStax Spark Cassandra Connector 2.0.7

DSE Java Driver 1.2.6 *

Netty 4.0.42.Final

Spark Jobserver 0.6.2.238 requires compatible API *

Select Hadoop libraries

DSE Analytics and DSEFS

DSE Graph

DSE Search

Resolved an issue with reading corrupted data from DSEFS caused by incorrect handling of file offsets, if requested offset does not align exactly at the file block boundary. This critical issue was triggered by some Spark usages. (DSP-15907)

Rare problems with multiple Spark Masters are resolved. Improved Spark Master and Spark Worker stability. (DSP-15636, DSP-15906, DSP-14405, DSP-15801)

Resolved the missing /tmp directory in DSEFS after fresh cluster installation. (DSP-16058)

Parquet files with partitions is improved. (DSP-16067)

Improved performance with DSE Graph fluent API. (DSP-15686)

Support for non-text IDs when using graph frames for bulk loading data. (DSP-15614)

Search index TTL Expiration thread loops without effect with live indexing (RT indexing). (DSP-16038)

Solr 6.0.1 security upgrades. (DSP-15978)

CVE-2016-1000031: Security vulnerability in Apache Commons FileUpload. (DSP-15908)

Configuration parameters for LDAP tuning allow all connection pool options to be set. (DSP-15948)

Solr security upgrades bundle. (DSP-15978)

CVE-2017-7525: FasterXML Jackson-databind is prone to a remote-code execution vulnerability. (DSP-14784)

Fix legacy complex range tombstone serialization+deserialization for static and regular columns. (DSP-15878)

Fix error in MVs referencing a function with uppercase letters on its name. (DSP-15878)

Ignore empty Counter cells on digest calculation (DSP-16096)

Upgrade netty to 4.0.54. Ignore log spam for unclean client shutdown. (DSP-16096)

Avoid log spam for unclean client shutdown. (DSP-16096)

Reusing table ID with CREATE TABLE causes failure on restart. (DSP-16096)

Add getConcurrentCompactors to JMX to avoid loading DatabaseDescriptor to check its value in nodetool. (DSP-16096)

Fix binding JMX to any address. (DSP-16192)

dse client-tool help doesn’t work if ~/.dserc file exists. (DSP-15869)

Decreased the number of exceptions logged during master move from node to node. (DSP-14405)

Spark Master REST API is disabled. If enabled in spark-defaults.conf, the following error is logged: ERROR Spark Master REST API is not available in DSE. (DSP-15491)

DSEFS fetching a file from an offset returns empty content. (DSP-15907)

In Portfolio demo, pricer is no longer required to be run with sudo. (DSP-15970)

Running Spark processes as separate users does not work. (DSP-15723)

Multiple Spark masters can be started on the same machine. (DSP-15636)

DSE client tool returns wrong Spark Master address. (DSP-15801)

Unnecessary Spark Worker restarts. (DSP-15906)

Portfolio demo does not work on package installs. (DSP-15970)

During misconfigured cluster bootstrap, the AlwaysOn SqlServer does not start due to missing /tmp/hive directory in DSEFS. (DSP-16058)

CassandraHiveMetastore is prevented from adding multiple partitions for File based datasources. Fixes MSCK REPAIR TABLE command. (DSP-16067)

DseGraphFrame performance improvement reduces number of joins for count() and other id-only queries. (DSP-15554)

Performance improvements for traversal execution with Fluent API and script-based executions. (DSP-15686)

GraphSON parsing error prevents proper type detection under certain conditions. (DSP-14066)

When using graph frames, cannot upload edges when ids for vertices are complex non-text ids. (DSP-15614)

DseGraphFrame fails with StackOverflowError if property is meta-property. (DSP-15939)

Solr 6.0.1 security upgrades. (DSP-15978)

Output Solr foreign filter cache warning only on classes other than DSE classes. (DSP-15625)

A shard request timeout caused an assertion error from Lucene getNumericDocValues in the log. (DSP-14216)

Offline sstable tools fail is DSE Search index is present on a table. (DSP-15628)

HTTP read on solr_stress doesn’t inject random data into placeholders. (DSP-15727)

ERROR 500 on distributed http json.facet with non-zero offset. (DSP-15946)

Search index TTL Expiration thread loops without effect with live indexing (RT indexing). (DSP-16038)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

The Spark Jobserver demo has an incorrect version for the Spark Jobserver API. (DSP-15832)

If manually deleted, the DSEFS keyspace (dsefs) is not automatically recreated by a node restart. DSE does not start if the DSEFS keyspace was dropped in a datacenter that was removed and then added back to a cluster as a new datacenter. (DSP-16785)

Allow existing nodes to use all peers in shadow round (CASSANDRA-13851)

Fix cqlsh to read connection.ssl cqlshrc option again (CASSANDRA-14299)

Downgrade log level to trace for CommitLogSegmentManager (CASSANDRA-14370)

CQL fromJson(null) throws NullPointerException (CASSANDRA-13891)

Serialize empty buffer as empty string for json output format (CASSANDRA-14245)

Deprecate background repair and probablistic read_repair_chance table options (CASSANDRA-13910)

Add missed CQL keywords to documentation (CASSANDRA-14359)

Avoid deadlock when running nodetool refresh before node is fully up (CASSANDRA-14310)

Handle all exceptions when opening sstables (CASSANDRA-14202)

Handle incompletely written hint descriptors during startup (CASSANDRA-14080)

Handle repeat open bound from SRP in read repair (CASSANDRA-14330)

Fix JSON queries with IN restrictions and ORDER BY clause (CASSANDRA-14286)

Check checksum before decompressing data (CASSANDRA-14284)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Performance enhancement to Bytecode deserialization. (TINKERPOP-1936)

Path history isn’t preserved for keys in mutations. (TINKERPOP-1947)

Traversal construction performance enhancements (TINKERPOP-1950)

Bump to Groovy 2.4.15 - resolves a Groovy bug preventing Lambda creation in GLVs in some cases. (TINKERPOP-1953)

Apache Cassandra 3.11.0.2261

Apache Solr 6.0.1.0.2224

Apache Spark 2.0.2.17

Apache TinkerPop 3.2.8-20180327-292ccbfd

Apache Tomcat 8.0.47

DataStax Spark Cassandra Connector 2.0.7

DSE Java Driver 1.2.6 *

Netty 4.0.42.Final

Spark Jobserver 0.6.2.237 requires compatible API

Select Hadoop libraries

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

DSE Search: Search index TTL Expiration thread loops without effect with live indexing (RT indexing). (DSP-16038)

DSE Graph: LIMIT clause does not work in a graph traversal with search predicate TOKEN. (DSP-16292)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Apache Cassandra 3.11.0.2261 *

Apache Solr 6.0.1.0.2224 *

Apache Spark 2.0.2.17 *

Apache TinkerPop 3.2.8-20180327-292ccbfd *

Apache Tomcat 8.0.47 *

DataStax Spark Cassandra Connector 2.0.7

DSE Java Driver 1.2.6 *

Netty 4.0.42.Final

Spark Jobserver 0.6.2.237 requires compatible API *

Select Hadoop libraries

DSE Advanced Replication

DSE Analytics and DSEFS

DSE Search

Fixed misleading warning messages about a non-replicating cluster in a multi-datacenter source cluster. (DSP-15808)

Fixed a permissions issue affecting Spark History Server results visibility through the web UI. (DSP-15693)

Fixed a permission issue affecting non-superusers and DSEFS. (DSP-15276)

Fixed reindexing and query performance regression for delete heavy workload. (DSP-15653, DSP-15667)

Automatic fallback of GossipingPropertyFileSnitch to PropertyFileSnitch (cassandra-topology.properties) is disabled by default and can be enabled by using the -Dcassandra.gpfs.enable_pfs_compatibility_mode=true startup flag. (DB-1663)

Improved security: Decimals with a scale > 100 are no longer converted to a plain string to prevent DecimalSerializer.toString() being used as an attack vector. (DB-1848)

DSE demos use Jetty Runner 9.4.8. (DSP-14772)

ANY, SUBMISSION, and WORKPOOL are unreserved keywords and can be used as keyspace, table, and column identifiers. (DSP-15353)

Improve replace fail messages when a replace is retried before QUARANTINE_DELAY. (DSP-15824)

Harden txn log files against exceptions when adding records and improve log messages. (DSP-15824)

The JVM version check in conf/cassandra-env.sh does not work. (DB-1882)

Enabling and disabling dbsummary and clustersummary performance objects through dsetool does not work. (DSP-15539)

Delay closing connection when nodes are removed to allow inflight commands to complete. (DSP-15824)

JVM startup check not working. (DSP-15824)

Materialized view schema file for snapshots is created as tables. (DSP-15486)

Init timestamp with Long.MIN_VALUE instead of -1. (DSP-15486)

AssertionError in ThrottledUnfilteredIterator due to empty UnfilteredRowIterator. (DSP-15486)

Make sstableloader use cassandra.config.loader instead of hard-coded YamlConfigurationLoader. (DSP-15486)

Backport CASSANDRA-9241, fix nodetool toppartitions. (DSP-15486)

Ignore lost+found directory on startup checks. (DSP-15486)

Protect against BigDecimals with large scale. (DSP-15486)

To ensure tombstones are removed often by compaction, the default value for gc_grace_seconds is reduced from 86400 (10 days) to 600 (10 minutes) for the dse_advrep.transmissions_crc table. (DSP-15749)

Replog count never goes down to zero in a multi-node source cluster. (DSP-15060)

Plugin error during shutdown: Error while fetching mutations. (DSP-15342)

Add support again for empty quoted name ("") as selectable to select SuperColumns. (DSP-15486)

Read connection ssl option from cqlshrc. (DSP-15486)

SASI AND/OR semantics are incorrect for StandardAnalyzer. (DSP-15486)

NPE Error whilst purging staled mutation files. (DSP-15502)

Channel creation fails with NPE when using mixed case destination name. (DSP-15538)

Unable to recover metadata from block file error due to NoSuchFileException. (DSP-15627)

Errors during shutdown. (DSP-15637)

advrep replog count command does not work with mixed case keyspace or table names. (DSP-15641)

AdvRep CommitLogConsumer logging NoSuchFileException. (DSP-15753)

Incorrect status that CDC was active when only a single advrep channel was defined in the datacenter. (DSP-15808)

Improve logging on unsupported operation failure and remove the failed mutation from replog. (DSP-15043)

Spark Master REST API is disabled. If enabled in spark-defaults.conf, the following error is logged: ERROR Spark Master REST API is not available in DSE. (DSP-15491)

JSch is susceptible to a path traversal vulnerability. (DSP-13961)

Worker UI does not display the actual class name of driver application running in cluster mode. (DSP-15028)

DSEFS transactions not always replayed at startup. (DSP-15462)

Running Spark processes as separate users does not work. (DSP-15723)

Improved security with default file permissions -770 for event log files. Change permissions with spark.eventLog.permissions. (DSP-15693)

DSEFS programmatic access demos are available. (DSP-13799)

InvalidTypeException is thrown while running DSEFS commands on node upgraded from 5.0.x to 5.1.x. (DSP-15266)

Timeout when trying to umount a dsefs location. (DSP-15453)

Exception is thrown by DseFsPlugin during shutdown and is not reported. (DSP-15474)

DSE might not shutdown properly when DSEFS encounters a problem, and exceptions are not logged. (DSP-15482)

DSEFS programmatic access demo project is available. (DSP-13799)

SPARK/DSEFS non-super users are unable to run SQL queries in secured DSEFS. Spark SQL applications utilize a scratch directory in DSEFS. This scratch directory is automatically created in DSE 5.1.7 and later. (DSP-15276)

Insufficient permissions to path / error when putting a file with the dse hadoop -put command on secured DSEFS cluster. (DSP-15480)

Small probability of duplicated predefined directories (/tmp/hive) when bootstrapping cluster with multiple datacenters and incorrect NetworkTopologyStrategy (SimpleStrategy). (DSP-15639)

Improved performance of anonymous traversals and bytecode-based traversals that made use of withStrategy() configurations. (DSP-15673)

0 (zero) is not treated as unlimited abort of max num errors. (DGL-307)

Synchronization hurts graph OLAP on multi-core executors. Improve scalability of OLAP queries with remote traverses. (DSP-15068)

Failures reported from CassandraPersistenceEngine during upgrade, especially in Graph Analytics workloads. (DSP-15130)

DseGRaphFrame timestamp base query do not work for bot java.sql.Timestamp and String representations. (DSP-15146)

graph solr phrase() predicate shows IndexOutofBound error. (DSP-15408)

DseGraphFrames throws InvalidQueryException when search index is enabled. (DSP-15411)

g.V().hasId([]) and g.V().has(id, []) query results are incorrect in DseGraphFrames. (DSP-15501)

toJSON() does not always work with geo types. (DSP-15650)

ObjectMapper contention for fluent API requests. (DSP-15732)

Reduce the overhead of DeleteByQueryWrapper used by Solr deleteByQuery(). (DSP-15667)

Streamline misleading Solr filter cache eviction logging. (DSP-15741)

Support for specifying different Solr field types for each CQL map key. (DSP-15622)

NPE during loading data with RT geonames. (DSP-12361)

Solr resource reading failure on init after copying data from another cluster. (DSP-15419)

Prohibit Solr timeAllowed use with partial results and allow it with deep paging. (DSP-15475)

deleteById and deleteByQuery overflow prepared statement cache. (DSP-15620)

ERROR 500 on distributed http json.facet with non-zero offset. (DSP-15633)

Reindex with tombstones in the data performs slower than earlier DSE versions. (DSP-15653)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

DSE Analytics: Additional configuration is required when enabling context-per-jvm in the Spark Jobserver. (DSP-15163)

DSE Analytics: Spark Master does not launch successfully after upgrade from DSE 5.1.x to DSE 5.1.8. (DSP-15679)

dsetool sparkmaster cleanup

dsetool sparkworker restart

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

DSE Search: Search index TTL Expiration thread loops without effect with live indexing (RT indexing). (DSP-16038)

SASI tokenizer for simple delimiter based entries (CASSANDRA-14247)

Fix Loss of digits when doing CAST from varint/bigint to decimal (CASSANDRA-14170)

SASI tokenizer for simple delimiter based entries (CASSANDRA-14247)

Fix Loss of digits when doing CAST from varint/bigint to decimal (CASSANDRA-14170)

RateBasedBackPressure unnecessarily invokes a lock on the Guava RateLimiter (CASSANDRA-14163)

Fix wildcard GROUP BY queries (CASSANDRA-14209)

Use zero as default score in DynamicEndpointSnitch (CASSANDRA-14252)

Respect max hint window when hinting for LWT (CASSANDRA-14215)

Adding missing WriteType enum values to v3, v4, and v5 spec (CASSANDRA-13697)

Don’t regenerate bloomfilter and summaries on startup (CASSANDRA-11163)

Fix NPE when performing comparison against a null frozen in LWT (CASSANDRA-14087)

Log when SSTables are deleted (CASSANDRA-14302)

Fix batch commitlog sync regression (CASSANDRA-14292)

Write to pending endpoint when view replica is also base replica (CASSANDRA-14251)

Chain commit log marker potential performance regression in batch commit mode (CASSANDRA-14194)

Fully utilize specified compaction threads (CASSANDRA-14210)

Pre-create deletion log records to finish compactions quicker (CASSANDRA-12763)

Backport circleci yaml (CASSANDRA-14240)

CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt (CASSANDRA-14183)

Fix ReadCommandTest (CASSANDRA-14234)

Remove trailing period from latency reports at keyspace level (CASSANDRA-14233)

Correctly count range tombstones in traces and tombstone thresholds (CASSANDRA-8527)

Add MinGW uname check to start scripts (CASSANDRA-12840)

Use the correct digest file and reload sstable metadata in nodetool verify (CASSANDRA-14217)

Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)

Protect against overflow of local expiration time (CASSANDRA-14092)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Fixed a bug in NumberHelper that led to wrong min/max results if numbers exceeded the Integer limits. (TINKERPOP-1873)

Improved error messaging for failed serialization and deserialization of request/response messages.

Fixed bug in handling of Direction.BOTH in Messenger implementations to pass the message to the opposite side of the StarGraph in VertexPrograms for OLAP traversals. (TINKERPOP-1862)

Fixed a bug in Gremlin Console which prevented handling of gremlin.sh flags that had an equal sign (=) between the flag and its arguments. (TINKERPOP-1879)

Fixed a bug where SparkMessenger was not applying the edgeFunction from MessageScope in VertexPrograms for OLAP-based traversals. (TINKERPOP-1872)

TinkerPop drivers prior to 3.2.4 won’t authenticate with Kerberos anymore. This option is deprecated.

Apache Cassandra 3.11.0.2130 *

Apache Solr 6.0.1.0.2139 *

Apache Spark 2.0.2.16 *

Apache TinkerPop 3.2.8-20180125-cd910875 *

Apache Tomcat 8.0.47 *

DataStax Spark Cassandra Connector 2.0.7 *

DSE Java Driver 1.2.2

Netty 4.0.42.Final

Spark Jobserver 0.6.2.234 (requires compatible API)

Select Hadoop libraries

DataStax Enterprise core

DSE Search

Fix for the possible data loss scenario caused by the TTL expiration timestamps susceptible to the year 2038 problem. (DSP-15412)

Better defaults when using JTS for polygon queries. (DSP-15182)

More responsive shutdown and index unloading while index rebuild is in progress. (DSP-12452)

Custom index and iTrigger implementations are not supported. Use only implementations bundled with DSE.

Default number of threads used by performance objects is increased from 1 to 4; configure threads with new dse.yaml performance_core_threads parameter. (DSP-14643)

New nodetool getseeds and reloadseeds commands. (DSP-15412)

dbsummary does not work with default performance_core_threads. (DSP-14643)

CVE-2017-15095 jackson-databind is vulnerable to remote code execution (RCE) attacks. (DSP-15096)

Fix for possible data loss scenario caused by the TTL expiration timestamps susceptible to the year 2038 problem. (DSP-15412)

Remove invalid path from compaction-stress script, populate data base on initial size. (DSP-15412)

Fix infinite loop when replaying a truncated commit log file and truncation is tolerated. (DSP-15412)

Kerberos protocol and QoP parameters are not correctly propagated. (DSP-15455)

Fetch/query no columns in priming connections to avoid errors if system.local columns are changed. (DSP-15484)

Upgrade from DSE 5.0.11 to DSE 5.1.6 fails with deserialization exception on column "workloads". (DSP-15484)

Fix connections per host in nodetool getstreamthroughput. (DSP-15412)

Avoid hibernate on startup for boostrap node to avoid WTE due to not being marked alive. (DSP-15412)

Prevent received SSTables with tombstones during repair from being compacted. (DSP-15412)

Non-disruptive seed node list reload. (DSP-15412)

Make ReservedKeywords mutable. (DSP-15412)

Fix tpc connection being reset due to dc compression and flush socket before reset. (DSP-15412)

Skip legacy range tombstones if only their clustering is corrupted. (DSP-15412)

Fix AssertionError in ReadResponse$Serializer.serializedSize. (DSP-15412)

Allow ALTER of system_distributed keyspace tables. (DSP-15412)

Improve live-node-replacement. (DSP-15412)

Allow skipping commit log replay does not fail on descriptor errors. (DSP-15435)

Fix for possible scenario where newly-added nodes can have a schema mismatch for system keyspaces. (DSP-11787)

Message is not consistently displayed when SparkContext is created with different configuration. (DSP-14758)

Spark SQL applications with DSE authentication enabled throws errors if the DSEFS scratch directory doesn’t exist. (DSP-15276)

DSEFS does not use ssl_native_port for internal connections between DSEFS node and Cassandra when client encryption is enabled. (DSP-15029)

SPARK/DSEFS non-super users are unable to run sql queries in secured DSEFS. (DSP-15276)

Rare NullPointerException during DSEFS startup. (DSP-15289)

Occasional NoHostAvailable exceptions when shutting down DSE with DSEFS enabled. (DSP-15404)

Setting permissions/owner on a file in DSEFS through Hadoop’s interfaces does not take effect. (DSP-15255)

Do not log or send back full Groovy script when the script is too large. (DSP-14410)

Retryable failures have severity DEBUG. Only terminal failures have severity ERROR or WARN. (DSP-15045)

Wikipedia demo path error. (DSP-11327)

DeleteById is deprecated. (DSP-13436)

dsetool search commands should return non-zero if operation was not successful. (DSP-9631)

Add warnings to DSE Search reload and reindex that reloads impact entire datacenter and reindex is asynchronous. (DSP-9820)

CQL solr queries with JSON clause miss singlePass optimizations. (DSP-11407)

Inconsistent behavior from dsetool when SSL is enabled. (DSP-15171)

Default useJtsMulti to false to avoid performance issues with JTS multipolygon handling. (DSP-15182)

Incorrect connection limiter scheduler shutdown order for internode transport clients. (DSP-14256)

Avoid potentially indefinite shutdown delay with active reindexing. (DSP-12452)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

CVE-2017-15095 jackson-databind is vulnerable to remote code execution (RCE) attacks. Applies only to workloads using --framework spark-2.0 spark-submit. (DSP-15441)

Potential data loss for inserts with very large TTLs. TTL expiration timestamps are susceptible to the year 2038 problem. (DSP-15412)

Spark Master might not recover after upgrades from DSE 5.1.0 through 5.1.5 to DSE 5.1.6 or 5.1.7. (DSP-15679)

dsetool sparkmaster cleanup

dsetool sparkworker restart

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Add DEFAULT, UNSET, MBEAN and MBEANS to ReservedKeywords (CASSANDRA-14205)

Add Unittest for schema migration fix (CASSANDRA-14140)

Print correct snitch info from nodetool describecluster (CASSANDRA-13528)

Close socket on error during connect on OutboundTcpConnection (CASSANDRA-9630)

Enable CDC unittest (CASSANDRA-14141)

Acquire read lock before accessing CompactionStrategyManager fields (CASSANDRA-14139)

Split CommitLogStressTest to avoid timeout (CASSANDRA-14143)

Set encoding for javadoc generation (CASSANDRA-14154)

RPM package spec: fix permissions for installed jars and config files (CASSANDRA-14181)

More PEP8 compliance for cqlsh (CASSANDRA-14021)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Adds Timestamp, Improve Conversion Perf (SPARKC-522)

Allow setting spark.cassandra.concurrent.reads (SPARKC-520)

Allow splitCount to be set for Dataframes (SPARKC-527)

Performance enhancement for OLAP: n^2 synchronious operation in OLAP WorkerExecutor.execute() method. (TINKERPOP-1870)

union() can produce extra traversers. (TINKERPOP-1867)

Apache Cassandra 3.11.0.2070 *

Apache Solr 6.0.1.0.2123 *

Apache Spark 2.0.2.6

Apache TinkerPop 3.2.7-20171213-77c0c764 *

Apache Tomcat 8.0.44

DataStax Spark Cassandra Connector 2.0.6 *

DSE Java Driver 1.2.2

Netty 4.0.42.Final

Spark Jobserver 0.6.2.234 (requires compatible API)

Select Hadoop libraries

DataStax Enterprise core

DSE Advanced Replication

DSE Analytics

DSE Graph

DSE Search

Commands to support migrating from compact storage. These commands are required to upgrade to DSE 6.0. (DSP-14966)

Improved handling and bug fixes in scenarios where the source cluster has multiple logical data centers. (DSP-14767, DSP-14515, DSP-15121)

Fixed a DSEFS issue that could prevent upgrades from 5.0.x to 5.1.5. (DSP-15237)

Fixed a bug in DSEFS that in rare circumstances could cause a live lock on the server when reading files, manifesting with high CPU usage and timeouts. (DSP-15107)

Fixed an infrequent bug where Spark worker directories could be deleted while the job is running. (DSP-15076, SPARK-22976).

Graph loader supports GraphSON V2.

Resolved issue of retrieving multiple edges by ID. (DSP-14580)

Allow vertex lookup through index on id property keys. (DSP-9028)

Performance and corruption issues with encrypted indexes are addressed with a full reindex after upgrade. (DSP-14943, DSP-14485, DSP-15265).

All installations from DSE 5.0.x or earlier versions of DSE 5.1.x should upgrade to DSE 5.1.6 to avoid potentially incorrect queries while nodes are at different versions during upgrade. (DSP-14898, DSP-14993)

Improved protection against abusing the Solr filter cache with too many entries. (DSP-14534)

Performance improvements with RF=(# nodes) DCs. (DSP-12962)

New seed_gossip_probability property in cassandra.yaml reduces the time for gossip changes to propagate across the cluster. (DB-671)

New metric for replayed batchlogs and trace-level logging include the age of the replayed batchlog. (DB-1314)

By default, enable heap histogram logging on OutOfMemoryError. To disable, set the cassandra.printHeapHistogramOnOutOfMemoryError system property to false. (DB-1498)

Generate Kerberos debug output. (DSP-12430)

JMX SSL is supported for use with dsetool and dse advrep. See Setting up SSL for nodetool, dsetool, and dse advrep. (DSP-14200)

New skip-read-validation flag for stress test error handling. (DSP-14775)

Ensure that the list and set selectors elements are all of the same type. (DSP-14775)

Do not leak body buffer in case of protocol exceptions and upgrade Netty to 4.0.52. (DSP-14775)

Added -Dcassandra.native_transport_startup_delay_seconds start-up parameter to delay startup of native transport. (DSP-14839)

Add nodetool rebuild mode reset-no-snapshot option. (DSP-14827)

Add nodetool abortrebuild command. (DSP-14827)

Add metrics on coordination of read commands; see type=ReadCoordination. (DSP-14775)

Add cross_dc_rtt_in_ms to cross dc requests, default 0. (DSP-14775)

New metrics for batchlog-replays. (DSP-14839)

New CQL ALTER TABLE DROP COMPACT STORAGE option to remove Thrift-compatibility from tables. (DSP-14839)

Handle continuous paging state for empty partitions with static rows. (DSP-14959)

Skip building views during base table streams on range movements. (DSP-14959)

Allow DiskBoundaryManager to cache different directories. (DSP-15024)

Do not apply read timeouts to aggregated queries and use a minimum internal page size. New cassandra.yaml aggregated_request_timeout_in_ms setting. (DSP-15024)

Only MODIFY permission is required on base when updating table with MV. (DSP-15087).

Generate LDAP debug output. (DSP-15176)

Audit logging does not support UNSET values from prepared statements. (DSP-13043)

dsetool does not work with JMX SSL. To use, follow steps in Setting up SSL for nodetool, dsetool, and dse advrep. (DSP-14200)

DataStax Installer upgrades within 5.1.x prevent Spark shell from working. (DSP-14637)

Memory leak causes executor descriptions to accumulate in DSE process. (DSP-14868)

Handle continuous paging state for empty partitions with static rows. (DSP-14959)

Skip building views during base table streams on range movements. (DSP-14959)

Add invalid-sstable-root JVM argument to all relevant test entries in build.xml. (DSP-14827)

Do not leak body buffer in case of protocol exceptions and upgrade Netty to 4.0.52 (DSP-14775)

Ensure that the list and set selectors elements are all of the same type. (DSP-14775)

nodetool arguments with spaces print script errors. (DSP-14959)

Change token allocation to use RF=1 method when RF equals rack count. (DSP-14959)

Failed bootstrap streaming leaves auth uninitialized. (DSP-14839)

Eliminate thread roundtrip for version handshake. (DSP-14827)

Make nodetool assassinate more resilient to missing tokens. (DSP-14827)

Throttle base partitions during MV repair streaming to prevent OOM. (DSP-14775)

Register SizeEstimatesRecorder earlier and enable cleanup of invalid entries. (DSP-15024)

Only serialize failed batchlog replay mutations to hints. (DSP-15024)

Allow selecting static column only when querying static index. (DSP-15087)

Force sstableloader exit to prevent hanging due to non-daemon threads running. (DSP-15087)

Add autoclosable to CompressionMetadata and fix leaks in SSTableMetadataViewer. (DSP-15087)

Use all columns to calculate estimatedRowSize for aggregation internal query. (DSP-15087)

Prevent continuous schema exchange between DSE 5.0 and DSE 5.1 nodes. (DSP-15087)

Separate commit log replay and commit throwable inspection and policy handling. (DSP-15087)

Fix for local DC when connections are compressed despite internode_compression: dc. (DSP-15087)

Expanded hinted handoff instrumentation. (DSP-15087)

Improve gossip dissemination time. (DSP-15087)

Use more intelligent level picking for non-l0 file. (DSP-15087)

LCS levels are not respected for nodetool refresh and replacing a node. (DSP-15087)

Keep SSTable level for decommission, remove, and move operations. (DSP-15087)

More quickly detect down nodes for batchlogs using the incoming connections. (DSP-15087)

Fixes for waitForGossiper. (DSP-15087

Print heap histogram on OOM errors by default. (DSP-15087)

Support frozen collection list and set in stress. (DSP-15087)

Improved streams logging. (DSP-15087)

Make migration-delay configurable. (DSP-15087)

Improved schema migration logging. (DSP-15087)

Switch RMIExporter to dynamic proxy. (DSP-15277).

Do not fetch columns that are not in the filter fetched set. (DSP-15277)

DataStax Enterprise will not run with Java 1.8u161 or later. (DSP-15277)

Gremlin Console command line options for connecting to host. (DSP-12726)

--ssl-enabled true is the same as the new --ssl option for JMX SSL support. See Setting up SSL for nodetool, dsetool, and dse advrep. (DSP-14200)

Datacenter not consistently passed into TokenService causes multi-datacenter replication errors. (DSP-14767)

Incompatibility with durable_writes=false, but no warning/error. (DSP-15205)

CDC on a table should be disabled only when no channels are enabled for that source table. (DSP-15121)

CDC files are left in a DC that’s not collecting. (DSP-15105)

Default logging level for org.apache.spark.rpc has been changed to ERROR. (DSP-14651)

Improved Spark shell startup time. (DSP-14704)

Spark executors are not restarted if the driver port is closed or unreachable. (DSP-14824)

Notebooks and other third-party tool integration with Spark. (DSP-14489)

dse client-tool configuration export/import incorrectly uses cfs as the default file system. (DSP-14535)

Spark shuffle service fails to update secret on application re-attempts. (DSP-15038)

Need a dedicated user to run Graph OLAP Spark Driver. (DSP-14869)

Logs from Spark Jobserver job are missing. (DSP-14981)

Poor handling of task notifications in Spark Driver, including possible memory leak. (DSP-15044)

Cluster-deployed drivers are not cleaned up by the Spark Worker cleanup service. (DSP-15076)

ERROR: Request body rejected, ConnectionClosedException message is not logged in system.log if the client disconnects in the middle of the request. (DSP-14597)

Added getScheme, getDefaultPort, and concat method implementations to DseFileSystem Hadoop API. (DSP-14605)

Reads incorrectly show Response body rejected errors. (DSP-14615)

DSEFS authorization is enabled when DSE authorization is enabled. DSEFS supports DseAuthorizer transitional mode. (DSP-14616)

DSEFS does not retry queries. (DSP-14649)

Incorrect return of 0 exit code for failed command execution. (DSP-14652)

Performing cat operation on a directory is prohibited and causes a Not a regular file <path> message. (DSP-14696)

User name/password was not provided warning is in the DSEFS shell log when security is not enabled. (DSP-14708)

DSEFS fsck command does not fix File not found: / problem which can occur in rare cases after new cluster nodes are started in parallel. (DSP-15048)

A live lock on the server when reading files manifests with high CPU usage and timeouts. (DSP-15107)

DSEFS files created through Hadoop API do not properly inherit RF and block size from the parent directory. (DSP-15139)

"Promise already completed" error in DSEFS connection pool. (DSP-15122)

No check if parent element of a given target path is a directory for mkdir, put, move operations. (DSP-15100)

Gremlin console plugins.txt is read-only by default. (DSP-13372)

Traversal does not timeout with the Fluent API. (DSP-13156)

Graph traversals over a vertex-centric index with an ordering and result limit are more efficient. (DSP-15191)

CQL Statement latency metrics. (DSP-15124)

Improve error messaging on failed bytecode translation. Long forms of e and -i are working. (DSP-15091)

Whitelist org.apache.tinkerpop.gremlin.spark.structure.Spark in sandbox so that Apache TinkerPop Spark-Gremlin application can be stopped programmatically. (DSP-14678)

Queries with multiple conditions using heterogeneous operators that cover the same property value cause an error. (DSP-14623)

Error when retrieving multiple edges by edge IDs when the list of IDs is greater than 3. (DSP-14580)

Unlabelled index queries occur even when labels were indexed by the appropriate key. (DSP-14579)

graph.io read does not work with custom IDs. Limitations apply, intended for use with small graphs only. (DSP-14568)

Setting a TraversalSource option from the DSE Driver isn’t effective. (DSP-14713)

QueryStrategy illegally moves HasStep condition across edge traversal. (DSP-15081)

Date, Time, Duration, Timestamp, Blob Graph types are represented by incorrect java types in OLAP. Converters were added to have the same types as in OLTP. (DSP-15104)

Avoid token filtering on single-node CQL solr_query. (DSP-12962)

Maximum number of entries in SolrFilterCache is limited to 32K. (DSP-14534)

CREATE SEARCH INDEX indexed true|false option for more performant indexes. (DSP-14364)

Eliminate delay for scheduled snapshot collection for DSE Search performance objects. (DSP-14561)

Added log message for filter cache evictions. (DSP-14944)

After compact storage is dropped from a table that also has a search index, HTTP writes and deletes-by-ID on the search index are disabled. (DSP-14966)

NPE when dropping the Solr core while indexing is in progress. (DSP-13252)

dsetool upgrade_index_files does not work with authentication enabled. (DSP-14114)

UpdateMetrics::Latency::Mean is "unavailable" when writes are in progress. (DSP-14392)

When executing CQL search queries with a keyspace RF=(number of nodes), then the token filter is no longer created resulting in faster queries. (DSP-14468)

EncryptedFSDirectory#outputLengthCache corruption makes encrypted index files unreadable. (DSP-14485)

Solr filter cache fails after restart. (DSP-14608)

CREATE SEARCH INDEX does not have direct control over tuple and UDT fields. (DSP-14639)

Remove code execution vulnerability: CVE-2016-6809. (DSP-14747)

Infinite parsing loop possible with Extended DisMax (eDisMax) query parser and local parameters. (DSP-14748)

Internal server error 500 on solr/admin/cores?action=STATUS&memory=true. (DSP-14783)

ExtendedDismaxQParser (edismax) ignores Boolean OR when q.op=AND and mm is not explicitly set. (DSP-14799)

Grouping by TrieDateField and DatePointField fails. (DSP-14808)

Token filtering might be missed on mixed versions clusters. (DSP-14898)

Support the json.facet parameter in Solr UI. (DSP-14893)

Excessive time spent reading unencrypted segment sizes during search index (Solr core) loading. Slow startup on nodes with large encrypted indexes is resolved after upgrade to DSE 5.1.6 is completed with a full reindex for all search indexes using encryption. (DSP-14943, DSP-14485, DSP-15265)

Shutdown order in SolrCore causes RejectedExecutionExceptions around CommitTracker. (DSP-15040)

Cannot create core using HTTP due to missing create permission. (DSP-15046)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Potential data loss for inserts with very large TTLs. TTL expiration timestamps are susceptible to the year 2038 problem. (DSP-15412)

Spark SQL applications with DSE authentication enabled throws errors if the DSEFS scratch directory doesn’t exist. (DSP-15276)

dse fs 'mkdir -p -m 733 /tmp/hive'

Spark Master might not recover after upgrades from DSE 5.1.0 through 5.1.5 to DSE 5.1.6 or 5.1.7. (DSP-15679)

dsetool sparkmaster cleanup

dsetool sparkworker restart

Switch RMIExporter to dynamic proxy. (DSP-15277)

Do not fetch columns that are not in the filter fetched set. (DSP-15277)

Allow selecting static column only when querying static index. (DSP-15087)

Require only MODIFY permission on base when updating table with MV. (DSP-15087)

Force sstableloader exit to prevent hanging due to non-daemon threads running. (DSP-15087)

Add autoclosable to CompressionMetadata and fix leaks in SSTableMetadataViewer. (DSP-15087)

Use all columns to calculate estimatedRowSize for aggregation internal query. (DSP-15087)

Prevent continuous schema exchange between DSE 5.0 and DSE 5.1 nodes (DSP-15087)

Allow DiskBoundaryManager to cache different Directories (DSP-15024)

Do not apply read timeouts to aggregated queries and use a minimum internal page size. (DSP-15024)

Handle cont paging state for empty partitions with static rows (DSP-14959)

Skip building views during base table streams on range movements. (DSP-14959)

Add invalid-sstable-root JVM argument to all relevant test entries in build.xml. (DSP-14827)

Do not leak body buffer in case of protocol exceptions and upgrade Netty to 4.0.52. (DSP-14775)

Ensure that the list and set selectors elements are all of the same type. (DSP-14775)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Upgrades from DSE 5.0 might have produced unnecessary schema migrations while there was at least one DSE 5.0 node in the cluster. It is therefore highly recommended to upgrade from DSE 5.0 to at least DSE 5.1.6. The root cause of this schema mismatch was a difference in the way how schema digests were computed in DSE 5.0 and DSE 5.1. To mitigate this issue, DSE 5.1.6 and newer announce DSE 5.0 compatible digests as long as there is at least one DSE 5.0 node in the cluster. Once all nodes have been upgraded, the "real" schema version is announced.

DSE is now relying on the JVM options to properly shutdown on OutOfMemoryError. By default it relies on the OnOutOfMemoryError option as the ExitOnOutOfMemoryError and CrashOnOutOfMemoryError options are not supported by the older 1.7 and 1.8 JVMs. A warning is logged at startup if none of those JVM options are used. See CASSANDRA-13006 for more details

Improved gossip settling added. On startup DSE waits till all nodes are seen before fully joining the cluster. This improves latency spikes when restarting nodes.

TotalHintsReplayed: how many hints were successfully replayed on the target node.

HintsOnDisk: how many hints are currently persistent on disk on this node. Metric is updated for the amount of hints contained in the hints file when hints file is written or removed. Values is restored on node startup.

Statistics file component was added to Hint Store in order to provide information about amount of hints contained in the hints file without replaying it. Stats component is completely backward-compatible; hint files without this component are not counted. All new hint files are created with this component. See DB-853 for more details.

All patches up to 1.6.10

Improve type-safety in Gremlin.Net methods. (TINKERPOP-1752)

Fix for problems with hasId() fails for empty collections. (TINKERPOP-1802)

Python supports GraphSON types g:Date, g:Timestamp and g:UUID. (TINKERPOP-1807)

Improve error messaging on failed bytecode translation. (TINKERPOP-1811)

Graph API removed from usage in the process test suite. (TINKERPOP-1813/TINKERPOP-1814)

Consistent behavior of self-referencing edges. (TINKERPOP-1821)

Improve flexibility of detachment for EventStrategy. (TINKERPOP-1829)

Race condition in TinkerGraph index creation. (TINKERPOP-1830)

Bug fix in TraversalHelper.replaceStep. (TINKERPOP-1832)

API fix for DetachedEdge.Builder#setInV and setOutV doesn’t return the builder. (TINKERPOP-1833)

Long forms of e and -i are now working. (TINKERPOP-1851)

Apache Cassandra 3.11.0.1900

Apache Solr 6.0.1.0.1984 *

Apache Spark 2.0.2.6

Apache TinkerPop 3.2.7-20170926-2e5c13b7

Apache Tomcat 8.0.44

DataStax Spark Cassandra Connector 2.0.5

DSE Java Driver 1.2.2

Netty 4.0.42.Final

Spark Jobserver 0.6.2.234 (requires compatible API)

Select Hadoop libraries

Due to CVE-2017-12629, added Solr XMLParser protection from XML External Entity (XXE) attacks and removed Solr RunExecutableListener to harden security for DSE Search enabled clusters. (DSP-14618)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DataStax Enterprise does not run with Java 1.8u161 or later. (DSP-15277)

Spark SQL applications with DSE authentication enabled throws errors if the DSEFS scratch directory doesn’t exist. (DSP-15276)

dse fs 'mkdir -p -m 733 /tmp/hive'

Potential data loss for inserts with very large TTLs. TTL expiration timestamps are susceptible to the year 2038 problem. (DSP-15412)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Apache Cassandra 3.11.0.1900 *

Apache Solr 6.0.1.0.1949 *

Apache Spark 2.0.2.6

Apache TinkerPop 3.2.7-20170926-2e5c13b7 *

Apache Tomcat 8.0.44

DataStax Spark Cassandra Connector 2.0.5

DSE Java Driver 1.2.2

DSEFS 5.1.2 *

Netty 4.0.42.Final

Spark Jobserver 0.6.2.234 (requires compatible API)

Select Hadoop libraries

DSE Graph

DSE Search

Security: Graph Sandbox is enabled and configured by default. (DSP-11679)

Vertices with custom IDs return ID components as properties. (DSP-14262)

Improved stability and performance when dealing with non-indexed fields. (DSP-6501)

Fixed the search performance objection regression issues. (DSP-14241)

Fixed the memory leak issue when encrypting the index. (DSP-13826)

Scrub validates the partition key. Validation is added to schema mutation creation. (DSP-14366)

Always define execution_profiles in cqlsh.py. (DSP-14494)

Issue warning before running full repair when increasing replication factor. (DSP-14494)

Add anti-compaction metrics and warn users when incremental repair is inefficient. (DSP-14494)

Node does not start with unable to activate HistogramInfoPlugin message after upgrade to DSE 5.1. (DSP-13301)

Apache HttpClient directory traversal through malformed URI. (DSP-13580)

Token create, cancel, and renew security needs tightening. (DSP-14311)

stress-tool does not output rows. (DSP-14494)

Command line interface should use non-zero exit code for unknown commands. (DSP-13590)

Session management in Hive metastore is broken. (DSP-12363)

When an application is submitted by a user without submit permission, exception message does not identify problem. (DSP-13234)

Spark shell not usable after standalone installation with services option. (DSP-14361)

Port setting not respected in DseCassandraConnectionFactory. (DSP-14442)

Spark Master/Worker Web UI should bind to RPC listen address and advertise RPC broadcast address by default. (DSP-14433)

Improved error message for DSEFS shell commands. (DSP-14157)

Improved error messages are passed to the DSEFS clients, including DSEFS shell, if error occurs while reading a file. (DSP-14371)

Improved error message when Spark fails to connect to DSEFS server. (DSP-14388)

HTTP communication logging level changed from DEBUG to TRACE to improve filtering. (DSP-14400)

Improve DSEFS stability on large workloads: DSEFS is less likely to overload Java Cassandra driver and cause BusyPoolException. Fixed edge-cases that might cause StackOverflowException and DSEFS lockup. (DSP-14408)

The service dse stop command does not wait for the process to be completely stopped. (DSP-14014)

DSEFS does not support symlink for data directories. (DSP-14110)

DSEFS fsck always prints number of blocks processed, even if file system is empty. (DSP-14235)

Enable and configure the graph sandbox by default to improve security. (DSP-11679)

GraphFrame 0.5 fixes graph frame algorithms. (DSP-14271)

Gremlin console uses the default plugins.txt in the DSE distribution. If a user home is specified with bin/dse gremlin-console ~/gremlin-console then extra checks are performed to ensure that plugins.txt is populated. (DSP-14286)

Prevent multi-properties for the partition/clustering key. (DSP-14300)

graph.tx().commit(); call is not allowed on graph.tx().commit(); graph.tx().config().option("allow_scan", true).open(); g.V().count(). Instead, use graph.tx().config().option("allow_scan", true).open(); g.V().count(). (DSP-14482)

Vertex index on id property keys doesn’t work. (DSP-9208)

Unnecessary INSERT and DELETE to dse_security.digest_tokens for every graph statement executed over native protocol. (DSP-13670)

Streamline configuration for gremlin-console connection to cluster with Kerberos authentication enabled. (DSP-14164)

DataFrames deletes do not leverage range or partition level tombstones. (DSP-14249)

Vertices with custom IDs do not return ID components as properties (as in g.V().properties() or g.V().values() for OLTP, OLAP, and GraphFrames. (DSP-14262)

DseResourceManager warning message when shutting down Spark+Graph nodes. (DSP-14276)

Graph sandbox should have org.apache.tinkerpop.gremlin.structure.io whitelisted by default. (DSP-14540)

Full validation on all schema fields might result in validation failures after upgrade. (DSP-6501)

Allow dynamic multi-valued fields without a corresponding CQL column. (DSP-13277)

Non-indexed frozen map column produces unexpected results without error message. (DSP-13997)

Non-indexed field prevents data from being indexed. (DSP-14001)

Single-pass CQL Solr queries cannot select some data types. (DSP-14022)

Text field does not work for group by operations; unexpected docvalues type SORTED_SET error message for text fields. (DSP-14106)

Parsing error on cleanup of Solr secondary index with empty string in partition ID. (DSP-14234)

Solr indexing statistics are not collected for solr_index_stats_options. (DSP-14241)

CPU layout assertions on startup should show in log file instead of stopping startup. (DSP-14281)

Cannot turn tracing off after running queries with tracing on. (DSP-14439)

Indexing wiki demo fails when solrslowlog is enabled. (DSP-14521)

Search performance objects are not working. (DSP-14241)

Memory leak during index encryption. (DSP-13826)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DataStax Enterprise does not run with Java 1.8u161 or later. (DSP-15277)

Spark SQL applications with DSE authentication enabled throws errors if the DSEFS scratch directory doesn’t exist. (DSP-15276)

dse fs 'mkdir -p -m 733 /tmp/hive'

Potential data loss for inserts with very large TTLs. TTL expiration timestamps are susceptible to the year 2038 problem. (DSP-15412)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Handle limit correctly on tables with strict liveness (CASSANDRA-13883)

AbstractTokenTreeBuilder#serializedSize returns wrong value when there is a single leaf and overflow collisions (CASSANDRA-13869)

BTree.Builder memory leak (CASSANDRA-13754)

Revert CASSANDRA-10368 of supporting non-pk column filtering due to correctness (CASSANDRA-13798)

Fix cassandra-stress hang issues when an error during cluster connection happens (CASSANDRA-12938)

Better bootstrap failure message when blocked by (potential) range movement (CASSANDRA-13744)

"ignore" option is ignored in sstableloader (CASSANDRA-13721)

Deadlock in AbstractCommitLogSegmentManager (CASSANDRA-13652)

Duplicate the buffer before passing it to analyser in SASI operation (CASSANDRA-13512)

Properly evict pstmts from prepared statements cache (CASSANDRA-13641)

Fix support for SuperColumn tables (CASSANDRA-12373)

Remove non-rpc-ready nodes from counter leader candidates (CASSANDRA-13043)

Improve short read protection performance (CASSANDRA-13794)

Fix sstable reader to support range-tombstone-marker for multi-slices (CASSANDRA-13787)

Fix short read protection for tables with no clustering columns (CASSANDRA-13880)

Make isBuilt volatile in PartitionUpdate (CASSANDRA-13619)

Prevent integer overflow of timestamps in CellTest and RowsTest (CASSANDRA-13866)

Fix counter application order in short read protection (CASSANDRA-12872)

Don’t block RepairJob execution on validation futures (CASSANDRA-13797)

Wait for all management tasks to complete before shutting down CLSM (CASSANDRA-13123)

INSERT statement fails when Tuple type is used as clustering column with default DESC order (CASSANDRA-13717)

Fix pending view mutations handling and cleanup batchlog when there are local and remote paired mutations (CASSANDRA-13069)

Improve config validation and documentation on overflow and NPE (CASSANDRA-13622)

Range deletes in a CAS batch are ignored (CASSANDRA-13655)

Avoid assertion error when IndexSummary > 2G (CASSANDRA-12014)

Change repair midpoint logging for tiny ranges (CASSANDRA-13603)

Better handle corrupt final commitlog segment (CASSANDRA-11995)

StreamingHistogram is not thread safe (CASSANDRA-13756)

Fix MV timestamp issues (CASSANDRA-11500)

Better tolerate improperly formatted bcrypt hashes (CASSANDRA-13626)

Fix race condition in read command serialization (CASSANDRA-13363)

Fix AssertionError in short read protection (CASSANDRA-13747)

Don’t skip corrupted sstables on startup (CASSANDRA-13620)

Fix the merging of cells with different user type versions (CASSANDRA-13776)

Copy session properties on cqlsh.py do_login (CASSANDRA-13640)

Potential AssertionError during ReadRepair of range tombstone and partition deletions (CASSANDRA-13719)

Don’t let stress write warmup data if n=0 (CASSANDRA-13773)

Gossip thread slows down when using batch commit log (CASSANDRA-12966)

Randomize batchlog endpoint selection with only 1 or 2 racks (CASSANDRA-12884)

Fix digest calculation for counter cells (CASSANDRA-13750)

Fix ColumnDefinition.cellValueType() for non-frozen collection and change SSTabledump to use type.toJSONString() (CASSANDRA-13573)

Skip materialized view addition if the base table doesn’t exist (CASSANDRA-13737)

Drop table should remove corresponding entries in dropped_columns table (CASSANDRA-13730)

Log warn message until legacy auth tables have been migrated (CASSANDRA-13371)

Fix incorrect [2.1 <- 3.0] serialization of counter cells created in 2.0 (CASSANDRA-13691)

Fix invalid writetime for null cells (CASSANDRA-13711)

Fix ALTER TABLE statement to atomically propagate changes to the table and its MVs (CASSANDRA-12952)

Fix Digest mismatch Exception if hints file has UnknownColumnFamily (CASSANDRA-13696)

Fixed ambiguous output of nodetool tablestats command (CASSANDRA-13722)

Purge tombstones created by expired cells (CASSANDRA-13643)

Make concat work with iterators that have different subsets of columns (CASSANDRA-13482)

Set test.runners based on cores and memory size (CASSANDRA-13078)

Allow different NUMACTL_ARGS to be passed in (CASSANDRA-13557)

Fix secondary index queries on COMPACT tables (CASSANDRA-13627)

Nodetool listsnapshots output is missing a newline, if there are no snapshots (CASSANDRA-13568)

sstabledump reports incorrect usage for argument order (CASSANDRA-13532)

Safely handle empty buffers when outputting to JSON (CASSANDRA-13868)

Copy session properties on cqlsh.py do_login (CASSANDRA-13847)

Fix load over calculated issue in IndexSummaryRedistribution (CASSANDRA-13738)

Fix compaction and flush exception not captured (CASSANDRA-13833)

Uncaught exceptions in Netty pipeline (CASSANDRA-13649)

Prevent integer overflow on exabyte filesystems (CASSANDRA-13067)

Fix queries with LIMIT and filtering on clustering columns (CASSANDRA-11223)

Fix potential NPE when resume bootstrap fails (CASSANDRA-13272)

Fix toJSONString for the UDT, tuple and collection types (CASSANDRA-13592)

Fix nested Tuples/UDTs validation (CASSANDRA-13646)

Clone HeartBeatState when building gossip messages. Make its generation/version volatile (CASSANDRA-13700)

Allow native function calls in CQLSSTableWriter (CASSANDRA-12606)

Replace string comparison with regex/number checks in MessagingService test (CASSANDRA-13216)

Fix formatting of duration columns in CQLSH (CASSANDRA-13549)

Fix the problem with duplicated rows when using paging with SASI (CASSANDRA-13302)

Allow CONTAINS statements filtering on the partition key and its parts (CASSANDRA-13275)

Fall back to even ranges calculation in clusters with vnodes when tokens are distributed unevenly (CASSANDRA-13229)

Fix duration type validation to prevent overflow (CASSANDRA-13218)

Forbid unsupported creation of SASI indexes over partition key columns (CASSANDRA-13228)

Reject multiple values for a key in CQL grammar. (CASSANDRA-13369)

UDA fails without input rows (CASSANDRA-13399)

Fix compaction-stress by using daemonInitialization (CASSANDRA-13188)

V5 protocol flags decoding broken (CASSANDRA-13443)

Use write lock not read lock for removing sstables from compaction strategies. (CASSANDRA-13422)

Use corePoolSize equal to maxPoolSize in JMXEnabledThreadPoolExecutors (CASSANDRA-13329)

Avoid rebuilding SASI indexes containing no values (CASSANDRA-12962)

Add charset to Analyser input stream (CASSANDRA-13151)

Delete illegal character from StandardTokenizerImpl.jflex (CASSANDRA-13417)

Fix cqlsh automatic protocol downgrade regression (CASSANDRA-13307)

Tracing payload not passed from QueryMessage to tracing session (CASSANDRA-12835)

Ensure int overflow doesn’t occur when calculating large partition warning size (CASSANDRA-13172)

Ensure consistent view of partition columns between coordinator and replica in ColumnFilter (CASSANDRA-13004)

Failed unregistering mbean during drop keyspace (CASSANDRA-13346)

nodetool scrub/cleanup/upgradesstables exit code is wrong (CASSANDRA-13542)

Fix the reported number of sstable data files accessed per read (CASSANDRA-13120)

Fix schema digest mismatch during rolling upgrades from versions before 3.0.12 (CASSANDRA-13559)

Upgrade JNA version to 4.4.0 (CASSANDRA-13072)

Interned ColumnIdentifiers should use minimal ByteBuffers (CASSANDRA-13533)

ReverseIndexedReader may drop rows during 2.1 to 3.0 upgrade (CASSANDRA-13525)

Fix repair process violating start/end token limits for small ranges (CASSANDRA-13052)

Add storage port options to sstableloader (CASSANDRA-13518)

Properly handle quoted index names in cqlsh DESCRIBE output (CASSANDRA-12847)

Avoid reading static row twice from old format sstables (CASSANDRA-13236)

Fix NPE in StorageService.excise() (CASSANDRA-13163)

Expire OutboundTcpConnection messages by a single Thread (CASSANDRA-13265)

Fail repair if insufficient responses received (CASSANDRA-13397)

Fix b fail when the loaded table contains dropped columns (CASSANDRA-13276)

Avoid name clashes in CassandraIndexTest (CASSANDRA-13427)

Handling partially written hint files (CASSANDRA-12728)

Interrupt replaying hints on decommission (CASSANDRA-13308)

Handling partially written hint files (CASSANDRA-12728)

Fix NPE issue in StorageService (CASSANDRA-13060)

Make reading of range tombstones more reliable (CASSANDRA-12811)

Fix startup problems due to schema tables not completely flushed (CASSANDRA-12213)

Fix view builder bug that can filter out data on restart (CASSANDRA-13405)

Fix 2i page size calculation when there are no regular columns (CASSANDRA-13400)

Fix the conversion of 2.X expired rows without regular column data (CASSANDRA-13395)

Fix hint delivery when using ext+internal IPs with prefer_local enabled (CASSANDRA-13020)

Nodetool upgradesstables/scrub/compact ignores system tables (CASSANDRA-13410)

Fix schema version calculation for rolling upgrades (CASSANDRA-13441)

Nodes started with join_ring=False should be able to serve requests when authentication is enabled (CASSANDRA-11381)

cqlsh COPY FROM: increment error count only for failures, not for attempts (CASSANDRA-13209)

Avoid starting gossiper in RemoveTest (CASSANDRA-13407)

Fix weightedSize() for row-cache reported by JMX and NodeTool (CASSANDRA-13393)

Fix JVM metric names (CASSANDRA-13103)

Coalescing strategy sleeps too much (CASSANDRA-13090)

Fix 2ndary index queries on partition keys for tables with static columns (CASSANDRA-13147)

Fix ParseError unhashable type list in cqlsh copy from (CASSANDRA-13364)

General upgrading advice for any version and new features for Apache Cassandra are in NEWS.txt. Be sure to read the NEWS.txt all the way back to your current version.

See also the Apache Cassandra changes in CHANGES.txt.

Apache Cassandra 3.11.0.1855 *

Apache Solr 6.0.1.0.1833 *

Apache Spark 2.0.2.6

Apache TinkerPop 3.2.6-20170821-ac1bbb27 *

Apache Tomcat 8.0.44 *

DataStax Spark Cassandra Connector 2.0.5 *

DSE Java Driver 1.2.2

DSEFS 5.1.2 *

Netty 4.0.42.Final

Spark Jobserver 0.6.2.234 (requires compatible API)

Select Hadoop libraries

DataStax Enterprise core

DSE Analytics

DSE Graph

DSE Search

Incremental repairs are no longer the default for nodetool repair. Even with nodetool repair -full or nodetool repair -pr, DSE 5.1.0-5.1.2 were run as incremental and marked sstables as repaired causing anti-compaction. (DSP-14464)

New -framework option for dse spark commands to accommodate applications that were originally written for open source Apache Spark. Specify which classpath is used, either the DSE version (default) or a similar path to open source Spark 2.0. (DSP-12954)

DSEFS includes several important stability fixes and performance improvements. To use DSEFS in production, DataStax strongly recommends upgrading to DSE 5.1.3 to leverage these improvements.

Significantly improved graph query performance. (DSP-11534)

Domain specific language support. (DSP-13545)

Graph custom id support for multiple keyed vertices. (DGL-258)

Extend TieredMergePolicy to support automatic removal of deletes. (DSP-13626)

nodetool rebuild and nodetool bootstrap improvements. (DSP-13870, DB-581)

Simplify role-permissions handling. (DSP-14159)

New nodetool nodetool mark_unrepaired command unifies repaired and unrepaired compaction buckets. (DSP-14255)

Changes to nodetool repair. (DSP-14464)

Adjust and check directory ownership when starting DSE. (DSP-13245)

CVE-2017-7957 xstream-core is vulnerable to Denial of Service (DoS) attacks. (DSP-13419)

After restore, data cannot be queried after streaming SSTables with sstableloader to tiered storage. (DSP-14188)

MemoryOnlyStrategy regions not immediately loaded into physical memory with new kernels. (DSP-14169)

Make full repair default and disallow incremental repair on MV/CDC tables. (DSP-14255)

Revert CASSANDRA-11223 behavior in AbstractReadCommandBuilder. (DSP-14135)

Prevent marking remote SSTables shadowing compacted data as repaired. (DSP-14141)

Rebuild logging always says 0 bytes. (DSP-13870)

Allow aggressive expiration of fully expired sstables without timestamp/key overlap checks. (DSP-13870)

SSTable index files can become corrupted due to StreamingHistogram bug. (DSP-14279)

DataStax installer does not set up DSE Advanced Replication correctly. (DSP-13472)

Ingestion might miss or drop data at higher insertion rates. CDC log file might be deleted even if not processed. (DSP-14043)

DSEFS clients unnecessarily switch between remote nodes. (DSP-14108)

Race condition under heavy load sent confusing exceptions to the log file. (DSP-14180)

Improved error on Spark:// Master URLs. (DSP-13366)

New -framework option for dse spark commands to accommodate applications that were originally written for open source Apache Spark. Specify which classpath is used, either the DSE version (default) or a similar path to open source Spark 2.0. (DSP-12954)

Improved error messages when no target datacenter provided for Spark application. (DSP-13236)

Decrease logging level for RPC methods failures. (DSP-13282)

JoinWithCassandra and SaveToCassandra blocked on adding to requests to the async execute pool. (DSP-14178)

Expand DSEFS repair capability. DSEFS fsck checks if data blocks exist on the remote node that claims to have them. Mixed versions during upgrades are not supported. Upgrade all nodes in the cluster before using DSEFS fsck. (DSP-13081)

DSEFS read performance is improved. (DSP-13309)

Launch DSEFS shell with precedence given to the specified hosts. (DSP-14108)

Connection reuse is improved. Closing idle connections is disabled by default. New idle_connection_timeout_ms option in dse.yaml defines how long to wait before an idle client-server connection is closed. (DSP-14010)

Protocol change improves efficiency of passing JSON arrays between DSEFS server and client. Mixed versions during upgrades are not supported. Upgrade all nodes in the cluster before using the DSEFS shell. (DSP-14107)

DataStax installer does not set up DSEFS correctly for No Services installations. (DSP-13473)

NullPointerException: Unexpected null value of column valid_from in <dse keyspace>.inodes while running fsck. (DSP-12615)

Memory leak occurs with incorrect use of WebHDFS API. (DSP-13813)

Rare client-side ParsingException. (DSP-14000)

Incorrect FileNotFound errors when using Spark with DSEFS. (DSP-14105)

Improved and simplified data batch loading of pre-formatted data. (DGL-235)

Schema discovery and schema generation are deprecated. (DGL-246)

Graph custom id support for multiple keyed vertices. (DGL-258)

Query engine significantly improved to allow more queries to be satisfied by using indexes. In particular, AND and OR queries are now handled and translate transparently to multiple backend queries or, if possible, single search queries. (DSP-11534)

Allow for indexes to be used with ORDER BY clause. (DSP-11931)

Checking for edge connectedness no longer performs an unnecessary backend query. (DSP-12863)

Edge queries using between predicate now use an index, if available. (DSP-13541)

Improved support for domain-specific languages (DSL) in Gremlin enables the DataStax driver to specify TraversalSource. (DSP-13545)

cache=false at the transaction level now includes disabling AdjacencyListStoreImpl and IndexStoreImpl. (DSP-13560)

Vertices without multi-properties fetch all properties in a single query, rather than requesting properties one at a time. Using multi-properties as vertices is not recommended, because multiple cardinality (multi-properties) are retrieved in graph traversals more slowly than single cardinality properties. Vertices with multi-properties default to the previous behavior of requesting properties individually. (DSP-13646)

More Gremlin APIs are supported in DSEGraphFrames: dedup, sort, limit, filter, + as()/select(), or(). (DSP-13649)

Do partition deletes for the property/edge table entries if possible. (DSP-13671)

Timeouts for graph traversals now start from the time the request is received. Earlier releases started timeouts for graph traversals at processing start time. Timeouts appear more readily on an overloaded server. (DSP-13828)

Numeric sack values no longer need to be explicitly typed (for example, 3.0D). You can still provide for greater specificity in the expected return type. (DSP-14026)

Lambdas provided to the sack() step are now recognized by the LambdaRestrictionStrategy. You must disable the restrict_lambda setting to call this method. (DSP-14118)

Support user-supplied IDs for edges and properties. ID must be Java UUID. (DSP-12932)

-help prints help twice. (DGL-257)

DGL prints warning excessively. (DGL-262)

The number of vertex labels is limited to 200 per graph. (DSP-11078)

Graph frames error if meta-property is not populated. (DSP-13063)

Gremlin server log directory setting doesn’t work if default log location is moved. Use dse-env.sh to change log locations. (DSP-13508)

DseGraphFrame throws UnsupportedOperationException for graph with empty schema. (DSP-13858)

DseGraphRpc.getSchemaBlob should request EXECUTE permissions instead of SELECT. (DSP-13888)

Single cardinality edge updates work incorrectly. (DSP-14185)

DseGraphFrames.updateVertices() requires unnecessary ID columns. (DSP-14175)

The within predicate is not working for unindexed edges. (DSP-13209)

OffheapPostings is present by default in demo and auto-generated solrconfig.xml files. (DSP-10088)

The default filter cache settings are changed. (DSP-13153)

Streamlined autoSolrConfig.xml template for auto-generated search indexes. CQL ALTER SEARCH INDEX CONFIG, ALTER SEARCH INDEX Schema, and CREATE SEARCH INDEX shortcuts for TieredMergePolicyFactory. (DSP-13229)

DeleteById is deprecated. (DSP-13988)

Extend TieredMergePolicy to support automatic removal of deletes. (DSP-13626)

DSE Search indexing optimizes for SSDs by default. Spinning disk detection logic is removed. (DSP-13924)

Improved error messages on invalid solr_query are more descriptive for invalid queries and syntax errors. (DSP-14003)

Shard request exceptions are not logged at the replica level. (DSP-12691)

Unnecessary double segment flushing on hard commit. (DSP-13971)

Reintroduce provisioning/dropping states for backward compatibility. Issue a warning when a graph is found. (DSP-14111)

Search permissions cannot be managed on non-search nodes in the cluster. (DSP-14242)

Possible data loss when using DSE Tiered Storage. (DB-3404)

DataStax Enterprise does not run with Java 1.8u161 or later. (DSP-15277)

Potential data loss for inserts with very large TTLs. TTL expiration timestamps are susceptible to the year 2038 problem. (DSP-15412)

DSE 5.0 SSTables with UDTs are corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)

Fix cassandra-stress hang issues when an error during cluster connection happens (CASSANDRA-12938)

Better bootstrap failure message when blocked by (potential) range movement (CASSANDRA-13744)

"ignore" option is ignored in sstableloader (CASSANDRA-13721)

Deadlock in AbstractCommitLogSegmentManager (CASSANDRA-13652)

Duplicate the buffer before passing it to analyser in SASI operation (CASSANDRA-13512)