DataStax Enterprise 6.0 release notes

26 August 2020

DSE 6.0.13 Components

DSE 6.0.13 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements if any.

6.0.13 DSE core

Changes and enhancements:

• Fixed StackOverflowError thrown during read repairs (only large clusters or clusters with enabled vnodes are affected). (DB-4350)
• Increased default direct_reads_size_in_mb value. Previously it was 2M per core + 2M shared. It is now 4M per core + 4M shared. (DB-4348)
• Slow indexing at bootstrap time due to early TPC boundaries computation when node is replaced by a node with the same IP (DB-4049)
• Fixed a problem with the treatment of zeroes in the type decimal that could cause assertion errors, or not being able to find some rows if their key is 0 written using different precisions, or both. (DB-4472)
• CQLSH can be run with Python 2 or 3. (DB-4151)
• Fixed the NullPointerException issue described in CASSANDRA-14200: NPE when dumping an SSTable with null value for timestamp column. (DB-4512)
• Fix an issue that was causing excessive contention during encryption/decryption operations. The fix results in an encryption/decryption performance improvement. (DB-4419)
• A new configuration option in cassandra.yaml was added: snapshot_before_dropping_column which is false by default. When enabled, every time the user drops a column/columns from a table, a snapshot will be created on each node in the cluster before the change in schema is applied.
• Fixed an issue to prevent an unbounded number of flushing tasks for memtables that are almost empty. (DB-4376)
• Global BloomFilterFalseRatio is now calculated in the same way as table BloomFilterFalseRatio. Now both types of metrics include true negatives, the formula is ratio = falsePositiveCount / (truePositiveCount + falsePositiveCount + trueNegativeCount). (DB-4439)
• Fixed a bug whereby after a node replacement procedure. the bootstrap indexing in DSE Search was happening only on one TPC core. (DB-4049)
• DNS Service Discovery is now a part of the DSE/LDAP integration. (DSP-11450)
• Systemd units are included for DSE packages for CentOS and compatible OSes. (DSP-7603)
• The server_host option in dse.yaml now handles mutiple, comma separated LDAP server addresses. (DSP-20833)
• Cassandra tools now work on encrypted SSTables when security is configured. (DSP-20940)
• Workaround for LOGBACK-1194 - explicit scanPeriod added to logback.xml. (DSP-17911)
• Recording a slow CQL query to the log will no longer block the thread. (DSP-20894)
• Added entries to jvm.options to assist with capturing thread dumps. (DSP-20778)
• The frequency of range queries performed by lease manager is now configurable via dse.lease.refresh.interval.seconds system property (an addition to JMX and dsetool command) (DSP-20696)
• Security updates:
  • Fixed a CVE-2019-20444 issue in which HttpObjectDecoder.java in Netty, before 4.1.44, allowed an HTTP header that lacked a colon. (DB-4068)
  • The jackson-databind library has been upgraded to 2.9.10.4 to address a Jackson databind vulnerability (CVE-2020-8840) (DSP-20981)
  • DNS Service Discovery is now a part of the DSE/LDAP integration. (DSP-11450)
  • Fixed some security vulnerabilities for Solr HTTP REST API when authorization is enabled. Now, users with no appropriate permissions can perform search operations. Resources can be deleted when authorization is enabled, given the correct permissions. (DSP-20749)
  • Fixed an issue where the audit logging did not capture search queries. (DSP-21058)
  • There are two new LDAP options in dse.yaml - extra_user_search_bases and extra_group_search_bases where the user can define additional search bases for users and groups respectively. For users, if the user is not found in one search base all other bases are searched. For groups, groups found in all defined search bases are merged. (DSP-12612)
  • While there is no change in default behavior, there is a new render_cql_literals option in dse.yaml under the audit logging section, which is false by default. When enabled, bound variables for logged statements will be rendered as CQL literals, which means there will be additional quotation marks and escaping, as well as values of all complex types (collections, tuples, udts) will be in human readable format. (DSP-17032)
  • Fixed LDAP settings to properly handle nested groups so that LDAP enumerates all ancestors of a user's distinguishedName. Inherited groups retrieval with directory_search and members_search types. Fixed fetching parent groups of a role that's mapped to an LDAP group. See new dse.yaml options, all_groups_xxx in ldap_options, to configure optimized retrieval of parent groups, including inherited ones, in a single roundtrip. (DSP-20107)
  • When DSE tries one authentication scheme and finds that the password is invalid, DSE now tries another scheme, but only if the user has a scheme permission for that other scheme. (DSP-20903)
  • Raised the upper bound limit on DSE LDAP caches. The upper limit for ldap_options.credentials_validity_in_ms has been increased to 864,000,000 ms, which is 10 days. The upper limit for ldap_options.search_validity_in_seconds has been increased to 864,000 seconds, which is 10 days. (DSP-21072)
  • Fixed an error condition when DSE failed to get the LDAP roles while refreshing a database schema. (DSP-21075)

6.0.13 DSE Advanced Replication

Changes and enhancements:

• Advanced Replication's OutOfMemoryErrors caused by Roaring bitmap deserialization. (DSP-15675)

6.0.13 DSEFS

Changes and enhancements:

• To minimize fsck impact on overloaded clusters, throttling is possible via -p or --parallelism arguments.
• Backported DSP-15762: optimize remove-recursive implementation, lowering the tombstone impact on Spark jobs. (DSP-20750)
• The byos-export command exports dsefs configuration for AbstractFileSystem (DSP-20906)
• Fixed an issue where an excessive number of connections are created to port 5599 when using DSEFS. (DSP-21021)
• Fixed excessive allocation when running fsck on DSEFS volumes. (DSP-21246)

6.0.13 DSE Search

Changes and enhancements:

• Search-related latency metrics will now decay in time like other metrics. Named queries (using query.name parameter) will now have separate latency metrics. New mbean atributes are available for search latency metrics: TotalLatency (us), Min, Max, Mean, StdDev, DurationUnit, MeanRate, OneMinuteRate, FiveMinuteRate, FifteenMinuteRate, RateUnit, 98th, 999th. (DSP-19612)
• Significantly reduced the time to (re)load encrypted search cores. (DSP-20692)
• Fixed some security vulnerabilities for Solr HTTP REST API when authorization is enabled. Now, users with no appropriate permissions can perform search operations. Resources can be deleted when authorization is enabled, given the correct permissions. (DSP-20749)
• Fixed a bug where a decryption block cache occasionally was not operational (SOLR-14498). (DSP-20987)
• Fixed an issue where the audit logging did not capture search queries. (DSP-21058)
• Fixed a bug where after several months of up time an encrypted index wouldn't accept more writes unless the core is reloaded. (DSP-21234)

4 May 2020

DSE 6.0.12 Components

For a full list, see DataStax Enterprise 6.0.12 third-party software.

DSE 6.0.12 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

6.0.12 DSE core

Changes and enhancements:

• Added hostname_verification to ldap_options in dse.yaml. (DSP-20302)
• The frequency of range queries performed by lease manager is now configurable via JMX and dsetool command. (DSP-20696)
• Added dse.ldap.retry_interval.ms system property, which sets the time between subsequent retries when trying authentication using LDAP server. (DSP-20298)
• Removed Jodd Core dependency that created vulnerability to Arbitrary File Writes. (DSP-19206)
• Added a new JMX attribute of ConnectionSearchPassword for LdapAuthenticator bean has been added, which updates the LDAP search password without the need to restart DSE. (DSP-18928)
• dsetool ring shows in-progress search index building during bootstrap. (DSP-15281)
• Made the search reference visible in the error message for LDAP connections. (DSP-20578)
• DecayingEstimatedHistogram now decays even when there are no updates so invalid metric values do not linger. (DSP-20674)
• Added functionality to query role_stats when stats is enabled under role_management_options in dse.yaml. (DB-4283)
• The replica side filtering dtests test_update_on_wide_table and test_complementary_update_with_limit_on_static_column_with_not_empty_partitions are more reliable. (DB-4043)
• Nodesync can now be enabled on all system distributed and protected tables. (DB-3241)
• Improved the estimated values of histogram percentiles reported via JMX. In some cases, the percentiles may go slightly up. (DB-4275)
• Added anticompaction to nodetool stop command help menu. (DB-3821)
• Added --disable-history option to cqlsh that disables saving history to disk for current execution. Added history section to cqlshrc which is called with boolean parameter disabled that is set to False by default. (DB-3843)
• Improved error messaging for enabled internode SSL encryption in Cassandra Tools test suite. (DB-3957)
• Removed the serialization header partition/clustering key validation (DB-4111)
• Security updates:
  • Upgraded Jackson Core and Jackson Mapper to address CVE-2019-10172. (DSP-20073)

Resolved issues:

• LDAP cursors leak. (DSP-20623)
• Bug that prevented LIST ROLES and LIST USERS to work with system-keyspace-filtering enabled. (DB-4221)
• Continuous paging sessions could leak if the continuous result sets on the driver side were not exhausted or cancelled. (DB-4313)
• Potentially incorrect dropped messages in case of time drifts on a machine. (DB-3891)
• Read inconsistencies. (CASSANDRA-12126) (DB-3873)
• Error that caused nodetool viewbuildstatus to return an incorrect error message. (DB-2397)

6.0.12 DSE Advanced Replication

Resolved issues:

• Advanced Replication's OutOfMemoryErrors caused by Roaring bitmap deserialization. (DSP-15675)

6.0.12 DSE Analytics

6.0.12 DSEFS

Changes and enhancements:

• DSEFS local file system implementation returns alphabetically sorted directories and files when using wildcards and listing command. (DSP-20057)
• When creating a file through WebHDFS API, DSEFS does not verify WX permissions of parent's parent when the parent exists. (DSP-20355)
• DSEFS internode encrypted communication doesn't fail when server_encryption_options.require_endpoint_verification is enabled. (DSP-20689)

Resolved issues:

• DSEFS cannot use Mixed Case keyspaces, which was broken by DSP-16825. (DSP-20354)

6.0.12 DSE Graph

Changes and enhancements:

• Exposed configuration and metrics for Gremlin query cache. (DSP-20240)
• Changed classic Graph query so vertices are read from _p tables in Cassandra using SELECT ... WHERE <vertex primary key columns> statement. The search predicate is applied in memory. (DSP-20230)

6.0.12 DSE Search

Changes and enhancements:

• Error messages related to Solr errors contain better description of the root cause. (DSP-13792)
• The dsetool stop_core_reindex command now mentions the node in the output message. (DSP-17090)
• Added indexing reason to output of dsetool core_indexing_status command. (DSP-17672)
• Improved warnings for search index creation via dsetool or CQL. (DSP-17994)
• Improved guidance with warnings when index rebuild is required for ALTER SEARCH INDEX, RELOAD SEARCH INDEX, and dsetool reload_core commands. (DSP-19347)
• Improved real-time search to fix a docValues bug. (DSP-20300)
• suggest request handler requires select permission. Previously, suggest request handler returned forbidden response when authorization was on, regardless of the user permissions. (DSP-20697)
• Security update:
  • Upgraded Apache Solr to address CVE-2018-8026. (DSP-16653)

10 December 2019

DSE 6.0.11 Components

For a full list, see DataStax Enterprise 6.0.11 third-party software.

DSE 6.0.11 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

DSE 6.0.11 Highlights

High-value benefits of upgrading to DSE 6.0.11:

DSE Search highlights

• Fixed a bug to avoid multiple disposals of Solr filter cache DocSet objects. (DSP-15765)
• Improve performance, logging, and add options for using the Solr timeAllowed parameter in all queries. The Solr timeAllowed option in queries is now enforced by default to prevent long-running shard queries. (DSP-19781, DSP-19790)

6.0.11 DSE core

Changes and enhancements:

• Add support for nodesync command to specify different IP addresses for JMX and CQL. (DB-2969)
• Enhancements to the offline sstablescrub utility. (DB-3510, DB-3511)
  • Specify which SSTables to scrub.
  • Scrub multiple tables of the same keyspace.
  • Specify the number of threads to simultaneously scrub SSTables within a table.
• Prevent accepting streamed SSTables or loading SSTables when the clustering order does not match. (DB-3530)
• Dropping and re-adding the same column with incompatible types is not supported. This change prevents unreadable SSTables. (DB-3586)

Resolved issues:

• Background compactions block SSTable operations too long. (DB-3682)
• Post-bootstrap indexing is executed by only a single CPU core. (DB-3692)
• Reads against ma and mc SSTables hit more SSTables than necessary due to the bug fixed by CASSANDRA-14861. (DB-3691)
• Error retrieving expired columns with secondary index on key components. (DB-3764)
• The diff logic used by the secondary index does not always pick the latest schema and results in ERROR [CoreThread-8] errors on batch writes. (DB-3838)
• Unexpected CoreThread error thrown by LWT.PROPOSE. (DB-3858)
• Fixed concurrency factor calculation for distributed range read with a maximum 10 times the number of cores. Configurable maximum concurrency factor with new JVM argument -Ddse.max_concurrent_range_requests. (DB-3859)
• Prevent continuous triggers with read defragmentation. (DB-3866)
• Cached serialized mutations can cause G1 GC humongous objects. (DB-3867)
• AIO and DSE Metrics Collector are not available on REHL/Centos 6.x because GLIBC_2.14 is not present. (DSP-18603)
• Upgrade Jackson Databind to address CVE-2019-14540 and CVE-2019-16942. (DSP-19764, DSP-19896)
• Using SELECT JSON for empty BLOB values incorrectly returns an empty string instead of the expected 0x. (DSP-20022)
• RoleManager cache keeps invalid values if the LDAP connectivity is down. (DSP-20098)
• LDAP user login fails due to parsing failure on user DN with parentheses. (DSP-20106)

6.0.11 DSE Analytics

6.0.11 DSE Search

19 September 2019

DSE 6.0.10 Components

DSE 6.0.10 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

DSE 6.0.10 Highlights

High-value benefits of upgrading to DSE 6.0.10 include these highlights:

DSE Database (DSE core) highlights

DSE Analytics highlights

• Storing and revoking permissions for the application owner is removed. The application owner is explicitly assumed to have these permissions. (DSP-19393)

DSE Graph highlights

• Fixed an issue where T values are hidden by property keys of the same name in valueMap(). (DSP-19261)

DSE Search highlights

• Improved search query latency. (DSP-18677)
• Unbounded facet searches are no longer allowed. (DSP-18693)
  • facet.limit < 0 is no longer supported. Override the default facet.limit of 20000 with the -Dsolr.max.facet.limit.size system property.
  • This change adds guardrails that can cause misconfigured faceting queries to fail. Before upgrading, set an explicit facet.limit.

6.0.10 DSE core

Changes and enhancements:

• DSE version now appears as a comment in all configuration files. (DB-1022)
• Improved troubleshooting. A log entry is now created when autocompaction is disabled or enabled for a table. (DB-1635)
• Enhanced DroppedMessages logging output adds the size percentiles of the dropped messages, their most common destinations, and the most common tables targeted for read requests or mutations. (DB-1250)
• Reformatted StatusLogger output to reduce details in the INFO level system.log. The detailed output is still present in the debug.log. (DB-2552)
• For nodetool tpstats -F json and nodetool tpstats -F yaml, wait latencies (in ms) appear in the output. Although not labeled, the wait latencies are included in the following order: 50%, 75%, 95%, 98%, 99%, Min, and Max. (DB-3401)
• New resources improve debugging leaked chunks before the cache evicts them and provide more meaningful call stack and stack trace. (DB-3504)
  • RandomAccessReader/RandomAccessReader
  • AsyncPartitionReader/FlowSource
  • AsyncSSTableScanner/FlowSource
• Allocate large buffers directly in the chunk cache. (DB-3506)
• Buffers should return to the pool if a chunk is leaked. (DB-3512)
• New nodetool commands to get current values: getcachecapacity, getcachekeystosave, and gethintedhandoffthrottlekb. (DB-3618)
• New options to select cipher suite and protocol to configure KMIP encryption when connecting to a KMIP server. (DSP-17294)
• Standalone cqlsh client tool provides an interface for developers to interact with the database and issue CQL commands without having to install the database software. From DataStax Labs, download the version of CQLSH that corresponds to your DataStax database version. (DSP-18694)
• Upgraded Apache MINA Core library to 2.0.21 to prevent a security issue where Apache MINA Core was vulnerable to information disclosure. (DSP-19213)
• Update Jackson Databind to 2.9.9.1 for all components except DataStax Bulk Loader. (DSP-19441)

Resolved issues:

• Fix to prevent NPE during repair in mixed-version clusters. (DB-1985)
• Tarball installs to create two instances on the same physical server with remote JMX access with binding the separated IPs to port 7199 causes JMX error of Address already in use (Bind failed) because com.sun.management.jmxremote.host is ignored. (DB-2483)
• Prevent changing the replication strategy of system keyspaces. (DB-2960)
• Upgrade Jackson Databind to address CVE-2018-11307 and CVE-2018-19361. (DB-2911, DSP-18099, DSP-19319)
• Slow startup or node hangs when encryption is used. (DB-3050)
• Incorrect handling of frozen type issues: valid CQL statements are not accepted and invalid CQL statements are not property rejected. (DB-3084)
• DSE fails to start with ERROR Attempted serializing to buffer exceeded maximum of 65535 bytes. Improved error to identify a workaround for commitlog corruption. (DB-3162)
• sstabledowngrade needs write access to the snapshot folder for a different output location. (DB-3231)
• The number of pending compactions reported by nodetool compactionstats was incorrect (off by one) for Time Window Compaction Strategy (TWCS). (DB-3284)
• Invalid JSON output for nodetool tpstats -F json. (DB-3401)
• When unable to send mutations to replicas due to overloading, hints are mistakenly created against the local node. (DB-3421)
• When a non-frozen UDT column is dropped and the table is later re-created from the schema that was created as part of a snapshot, the dropped column record is invalid and may lead to failure loading some SSTables. (DB-3434)
• sstablepartitions incorrectly handles -k and -x options. (DB-3442)

  Workaround: To specify multiple keys, repeat the -k or -x option for each key.

• Memory leaks when updating tables with materialized views. (DB-3504)
• Error in custom provider prevents DSE node startup. With this fix, the node will start up but insights is not active. See the DataStax Support Knowledge Base for steps to resolve existing missing or incorrect keyspace replication problems. (DSP-19521)

6.0.10 DSE Analytics

6.0.10 DSE Graph

Changes and enhancements:

• New graph truncate command to remove all data from graph. (DSP-17609)
• Support for ifExists() before truncate(), like system.graph("foo").ifExists().truncate(), in DSE Graph (classic graph) API. (DSP-19357)

6.0.10 DSE Search

9 July 2019

6.0.9 Components

DSE 6.0.9 is compatible with Apache Cassandra™ 3.11 and includes all DataStax enhancements from earlier versions.

DSE 6.0.9 Important bug fix

• Fixed possible data loss when using DSE Tiered Storage. (DB-3404)
  Warning: If using DSE Tiered Storage, you must immediately upgrade to at least DSE 5.1.16, DSE 6.0.9, or DSE 6.7.4. Be sure to follow the upgrade instructions.

11 June 2019

6.0.8 Components

DSE 6.0.8 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

DSE 6.0.8 Highlights

High-value benefits of upgrading to DSE 6.0.8 include these highlights:

DSE Database (DSE core) highlights

DSE Analytics highlights

• When DSE authentication is enabled, Spark security is forced to be enabled. (DSP-17274)
• Spark security is turned on in dse.yaml configuration file. (DSP-17271)

DSEFS highlights

• Fix handling of path alternatives in DSEFS shell to provide wildcard support for mkdir and ls commands. (DSP-17768)

DSE Graph highlights

• Operations through gremlin-console run with anonymous permissions. (DSP-18471)
• You can now dynamically pass cluster and connection configuration for different graph objects. Fixes the issue where DseGraphFrame cannot directly copy graph from one cluster to another. (DSP-18605)

DSE Search highlights

Changes and improvements:

• Performance improvements and overload protection for search queries. (DSP-15875)
• New configurable memory leak tracking: new nodetool leaksdetection command and Memory leak detection settings options in cassandra.yaml. (DB-3123)
• Performance improvements to Solr deletes that correspond to Cassandra rows. (DSP-17419)
• Changes to correct uneven distribution of shard requests with the STATIC set cover finder. (DSP-18197)
• New recommended method for case-insensitive text search, faceting, grouping, and sorting with new LowerCaseStrField Solr field type. This type sets field values as lowercase and stores them as lowercase in docValues. (DSP-18763)

6.0.8 DSE core

Changes and enhancements:

• Improved lightweight transactions (LWT) handling:
  • Improved lightweight transactions (LWT) performance. New cassandra.yaml LWT configuration options. (DB-3018)
  • Optimized memory usage for direct reads pool when using a high number of LWTs. (DB-3124)

    When not set in cassandra.yaml, the default calculated size of direct_reads_size_in_mb changed from 128 MB to 2 MB per TPC core thread, plus 2 MB shared by non-TPC threads, with a maximum value of 128 MB.

• Improved logging identifies which client, keyspace, table, and partition key is rejected when mutation exceeds size threshold. (DB-1051)
• Improve status reporting for nodesync validation list. (DB-2707)
• Enable upgrading and downgrading SSTables using a CQL file that contains DDL statements to recreate the schema. (DB-2951)
• Configurable memory leak tracking. (DB-3123)
  • New nodetool leaksdetection command

Resolved issues:

• Nodes in a cluster continue trying to connect to a decommissioned node. (DB-2886)
• 32-bit integer overflow in StreamingTombstoneHistogramBuilder during compaction. (DB-3108)
• Possible direct memory leak when part of bulk allocation fails. (DB-3125)
• Counters in memtable allocators and buffer pool metrics can be incorrect when out of memory (OOM) failures occur. (DB-3126)
• Memory leak occurs when a read from disk times out. (DB-3127)
• AssertionError in temporary buffer pool causes CorruptSSTableException. (DB-3172)
• Memory leak on errors when reading. (DB-3175)
• Bootstrap should fail when the node can't fetch the schema from other nodes in the cluster. (DB-3186)
• Increment pending echos when sending gossip echo requests. (DB-3187)
• Deadlock when replaying schema mutations from commit log during DSE startup. (DB-3190)
• Make the remote host visible in the error message for failed magic number verification. (DSP-18645)

Known issue:

6.0.8 DSE Analytics

6.0.8 DSEFS

Resolved issues:

• Fix handling of path alternatives in DSEFS shell to provide wildcard support for mkdir and ls commands. (DSP-17768)
  For example, to make several subdirectories with a single command:

  dse fs mkdir -p /datastax/demos/weather_sensors/{byos-daily,byos-monthly,byos-station}

  dse fs mkdir -p {path1,path2}/dir

6.0.8 DSE Graph

Changes and enhancements:

• The graph configuration and gremlin_server sections in DSE Graph system-level options are now correctly commented out at the top level. (DSP-18477)

6.0.8 DSE Search

Changes and enhancements:

• Reject requests from the TPC backpressure queue when requests are on the queue for too long. (DSP-15875)
• Changes to correct uneven distribution of shard requests with the STATIC set cover finder. (DSP-18197)

  A new inertia parameter for dsetool set_core_property supports fine tuning. The default value of 1 can be adjusted for environments with vnodes and more than 10 vnodes.

• New recommended method for case-insensitive text search, faceting, grouping, and sorting with new LowerCaseStrField custom Solr field type. This type sets field values as lowercase and stores them as lowercase in docValues. (DSP-18763)
  Note: DataStax does not support using the TextField Solr field type with solr.KeywordTokenizer and solr.LowerCaseFilterFactory to achieve single-token, case-insensitive indexing on a CQL text field.

1 April 2019

6.0.7 Components

DSE 6.0.7 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

DSE 6.0.7 Highlights

High-value benefits of upgrading to DSE 6.0.7 include these highlights:

DSE Database (DSE core) highlights

DSE Analytics highlights

• Authorization to AlwaysOn SQL web UI is supported. (DSP-18236)
• Handle quote in cache query of AlwaysOn SQL (AOSS). (DSP-18418)
• Fix leakage in BulkTableWriter. (DSP-18513)

DSE Graph highlights

DSE Search highlights

• Fixed facets and stats queries when using queryExecutorThreads. (DSP-18237)
• Fixed timestamp PK routing with solr_query. (DSP-18223)
• Search/Solr HTTP request for CSV output is fixed. (DSP-18029)

6.0.7 DSE core

Changes and enhancements:

• Compaction performance improvement with new cassandra.yaml pick_level_on_streaming option. (DB-1658)

  Streamed-in SSTables of tables using LCS (leveled compaction strategy) are placed in the same level as the source node, with possible up-leveling. Set pick_level_on_streaming to true to save compaction work for operations like nodetool refresh and replacing a node.

• The sstableloader downgrade from DSE to OSS Apache Cassandra is supported with new sstabledowngrade tool. (DB-2756)
  Important: The sstabledowngrade command cannot be used to downgrade system tables or downgrade DSE versions.
• TupleType values with null fields NPE when being made byte-comparable. (DB-2872)
• Support for using sstableloader to stream OSS Cassandra 3.x and DSE 5.x data to DSE 6.0 and later. (DB-2909)
• Memory improvements with these supported changes:
  • Configurable memory is supported for offline sstable tools. (DB-2955)

    You can use these environment variables tools:

    • MAX_HEAP_SIZE - defaults to 256 MB
    • MAX_DIRECT_MEMORY - defaults to ((system_memory - heap_size) / 4) with a minimum of 1 GB and a max of 8 GB.

    To specify memory on the command line:

    MAX_HEAP_SIZE=2g MAX_DIRECT_MEMORY=10g sstabledowngrade keyspace table

    Important: The sstabledowngrade command cannot be used to downgrade system tables or downgrade DSE versions.
  • Buffer pool, and metrics for the buffer pool, are now in two pools. In cassandra.yaml, file_cache_size_in_mb option sets the file cache (or chunk cache) and new direct_reads_size_in_mb option for all other short-lived read operations. (DB-2958)

    To retrieve the buffer pool metrics:

    nodetool sjk mxdump -q "org.apache.cassandra.metrics:type=CachedReadsBufferPool,name=*"

    nodetool sjk mxdump -q "org.apache.cassandra.metrics:type=DirectReadsBufferPool,name=*"

    For legacy compatibility, org.apache.cassandra.metrics:type=BufferPool still exists and is the same as org.apache.cassandra.metrics:type=CachedReadsBufferPool.

  • cassandra-env.sh respect heap and direct memory values set in jvm.options or as environment variables. (DB-2973)
    The precedence for heap and direct memory is:

    • Environment variables
    • jvm.options
    • calculations in cassandra-env.sh
  • AIO is automatically disabled if the chunk cache size is small enough: less or equal to system RAM / 8. (DB-2997)
  • Limit off-heap frame queues by configurable number of frames and total number of bytes. (DB-3047)

Resolved issues:

• Native server Message.Dispatcher.Flusher task stalls under heavy load. (DB-1814)
• Race in CommitLog can cause failed force-flush-all. (DB-2542)
• Unclosed range tombstones in read response. (DB-2601)
• The sstableloader downgrade from DSE to OSS Apache Cassandra is not supported. New sstabledowngrade tool is required. (DB-2756)
• Unused memory in buffer pool. (DB-2788)
• nodesync fails when validating MV row with empty partition key. (DB-2823)
• TupleType values with null fields NPE when being made byte-comparable. (DB-2872)
• The memory in use in the buffer pool is not identical to the memory allocated. (DB-2904)
• Reference leak in SSTableRewriter in sstableupgrade when keepOriginals is true. (DB-2944)
• Hint-dispatcher file-channel not closed, if open() fails with OOM. (DB-2947)
• Offline sstable tools fail with Out of Direct Memory error. (DB-2955)
• Hints and metadata should not use buffer pool. (DB-2958)
• Lightweight transactions contention may cause IO thread exhaustion. (DB-2965)
• DIRECT_MEMORY is being calculated using 25% of total system memory if -Xmx is set in jvm.options. (DB-2973)
• Netty direct buffers can potentially double the -XX:MaxDirectMemorySize limit. (DB-2993)
• Increased NIO direct memory because the buffers are not cleaned until GC is run. (DB-2996)
• nodesync cannot be enabled on materialized views (MV). (DB-3008)
• Mishandling of frozen in complex nested types. (DB-3081)
• Check of two versions of metadata for a column fails on upgrade from DSE 5.0.x when type is not of same class. Loosen the check from CASSANDRA-13776 to prevent Trying to compare 2 different types ERROR on upgrades. (DB-3021)
• Deadlock during node startup when calculating disk boundaries. (DB-3028)
• cqlsh EXECUTE AS command does not work. (DB-3098)
• Dropped UDT columns in SSTables deserialization are broken after upgrading from DSE 5.0. (DB-3031)
• Kerberos protocol and QoP parameters are not correctly propagated. (DSP-15455)
• RpcExecutionException does not print the user who is not authorized to perform a certain action. (DSP-15895)
• Leak in BulkTableWriter. (DSP-18513)

Known issue:

6.0.7 DSE Analytics

Changes and enhancements:

• Support configuration to connect to multiple hosts from BYOS connector. (DSP-18231)

Resolved issues:

• After client-to-node SSL is enabled, all Spark nodes must also listen on port 7480. (DSP-15744)
• dse client-tool configuration byos-export does not export required Spark properties. (DSP-15938)
• Downloaded Spark JAR files are executable for all users. (DSP-17692)
• Issue with viewing information for completed jobs when authentication is enabled. (DSP-17854)
• Spark Cassandra Connector does properly cache manually prepared RegularStatements, see SPARKC-558. (DSP-18075)
• Unexpected gossip failure. java.lang.NullPointerException: null. (DSP-18194)
• Apache Spark local privilege escalation vulnerability: CVE-2018-11760. (DB-18225)
• Invalid options show for dse spark-submit command line help. (DSP-18293)
• Can't access AlwaysOn SQL (AOSS) UI when authorization is enabled. (DSP-18236)
• Spark SQL function concat_ws results in a compilation error when an array column is included in the column list and when the number of columns to be concatenated exceeds 8. (DSP-18383)
• Improved error messaging for AlwaysOn SQL (AOSS) client tool. (DSP-18409)
• CQL syntax error when single quote is not correctly escaped before including in save cache query to AOSS cache table. (DSP-18418)
• Remove class DGFCleanerInterceptor from byos.jar. (DSP-18445)
• GBTClassifier in Spark ML fails when periodic checkpointing is on. (DSP-18450)

Known issue:

• DSE 6.0.7 is not compatible with Zeppelin in SparkR and PySpark 0.8.1. (DSP-18777)

  The Apache Spark™ 2.2.3.4 that is included with DSE 6.0.7 contains the patched protocol and all versions of DSE are compatible with the Scala interpreter.

  However, SparkR and PySpark use only a separate channel for communication with Zeppelin. This protocol was vulnerable to attack from other users on the system and was secured in CVE-2018-11760. Zeppelin in SparkR and PySpark 0.8.1 fails because it does not recognize that Spark 2.2.2 and later contain this patched protocol and attempts to use the old protocol. The Zeppelin patch to recognize this protocol is not available in a released Zeppelin build.

  Solution: Do not upgrade to DSE 6.0.7 if you use SparkR or PySpark. Wait for the Zeppelin release later than 0.8.1 that will recognize that DSE-packaged Spark can use the secured protocol.

• Submitting many Spark apps will reach the default tombstone_failure_threshold before the default 90 days gc_grace_seconds defined for the system_auth.role_permissions table. (DSP-19098)
  Workaround for use cases where a large number of Spark jobs are submitted:

  1. Before the user starts the Spark jobs, manually grant permissions to the user:

     GRANT AUTHORIZE, DESCRIBE, MODIFY ON ANY SUBMISSION IN WORKPOOL 'datacenter_name.workpool' TO role_name;

  2. Start Spark jobs for this user.
  3. After this user completes all the Spark jobs, revoke permissions for the user:

     REVOKE AUTHORIZE, DESCRIBE, MODIFY ON ANY SUBMISSION IN WORKPOOL 'datacenter_name.workpool' FROM role_name;

6.0.7 DSEFS

Resolved issues:

• Change dsefs:// default port when the DSEFS setting public_port is changed in dse.yaml. (DSP-17962)

  The shortcut dsefs:/// now automatically resolves to broadcastaddress:dsefs.public_port, instead of incorrectly using broadcastaddress:5598 regardless of the configured port.

• DSEFS WebHDFS API GETFILESTATUS op returns AccessDeniedException for the file even when user has correct permission. (DSP-18044)
• Problem with change group ownership of files using the fileSystem.setOwner method. (DSP-18052)

6.0.7 DSE Graph

Resolved issues:

• OLAP traversal duplicates the partition key properties: OLAP g.V().properties() prints 'first' vertex n times with custom ids. (DSP-15688)
• Edges are inserted with tombstone values set when inserting a recursive edge with multiple cardinality. (DSP-17377)
• AND operator is ignored in combination with OR operator in graph searches. (DSP-18061)

6.0.7 DSE Search

Resolved issues:

• SASI should discard stale static row. (DB-2956)
• Anti-compaction transaction causes temporary data loss. (DB-3016)
• Solr HTTP request for CSV output is blank. The CSVResponseWriter returns only stored fields if a field list is not provided in the URL. (DSP-18029)
  To workaround, specify a field list with the URL:

  /select?q=*%3A*&sort=lst_updt_gdttm+desc&rows=10&fl=field1,field2&wt=csv&indent=true

• Timestamp PK routing on solr_query fails. (DSP-18223)
• Facets and stats queries broken when using queryExecutorThreads. (DSP-18237)

27 February 2019

DSE 6.0.6 Components

All components from DSE 6.0.6 are listed. Components that are updated for DSE 6.0.6 are indicated with an asterisk (*).

DSE 6.0.6 is compatible with Apache Cassandra™ 3.11 and includes all production-certified changes from earlier versions.

DSE 6.0.6 Important bug fix

DSE 6.0.6 Known issue:

7 February 2019

DSE 6.0.5 Components

DSE 6.0.5 is compatible with Apache Cassandra™ 3.11 and adds production-certified enhancements.

DSE 6.0.5 Highlights

High-value benefits of upgrading to DSE 6.0.5 include these highlights:

DSE Database (DSE core) highlights

Improvements:

• DSE Metrics Collector aggregates DSE metrics and integrates with existing monitoring solutions to facilitate problem resolution and remediation. (DSP-17319)
  See:

  • Enable DSE Metrics Collector
  • Configuring data and log directories for DSE Metrics Collector

Important bug fixes:

• Fixed resource leak related to streaming operations that affects tiered storage users. Excessive number of TieredRowWriter threads causing java.lang.OutOfMemoryError. (DB-2463)
• Exception now occurs when user with no permissions returns no rows on restricted table. (DB-2668)
• Upgraded nodes that still have big-format SSTables from DSE 5.x caused errors during read. (DB-2801)
• Fixed an issue where heap memory usage seems higher with default file cache settings. (DB-2865)
• Fixed prepared statement cache issues when using row-level access control (RLAC) permissions. Existing prepared statements were not correctly invalidated. (DB-2867)

DSE Analytics highlights

• DSEFS or AOSS fail to start.
• You use BYOS with Spark 2.3 or 2.4.
• You are getting OOM or authentication errors.
• You use scripts that invoke DSEFS commands and need to handle failures properly.
• You use dse spark-sql-metastore-migrate with DSE Unified Authentication and internal authentication. (DSP-17632)
• You want to run the DSEFS auth demo. (DSP-17700)
• You have DSE 5.0.x with DSEFS client connected to DSE 5.1.x and later DSEFS server. (DSP-17600)
• You experienced a memory leak in Spark Thrift Server. (DSP-17433)
• You use DSEFS with listen_on_broadcast_address is true in cassandra.yaml. (DSP-17363)
• You use DSEFS and listen_address is blank in cassandra.yaml. (DSP-16296)
• You are moving directories in DSEFS. (DSP-17347)
• Improve memory handling in AlwaysOn SQL (AOSS) by enabling spark.sql.thriftServer.incrementalCollect to prevent OOM on large result sets. (DSP-17428)

DSE Graph highlights

DSE Search highlights

• You want security improvements:
  • Upgrade Apache Commons Compress to prevent Denial Of Service (DoS) vulnerability present in Commons Compress 1.16.1, CVE-2018-11771. (DSP-17019)
  • Critical memory leak and corruption fixes for encrypted indexes. (DSP-17111)
  • Upgrade Apache Tomcat to prevent Denial Of Service (DoS), CVE-2018-1336. (DSP-17303)
• You index timestamp partition keys. (DSP-17761)
• You do a lot of reindexing. (DSP-17975)

DSE 6.0.5 Known issue:

• Possible data loss when using DSE Tiered Storage. (DB-3404)
  Warning: If using DSE Tiered Storage, you must immediately upgrade to at least DSE 5.1.16, DSE 6.0.9, or DSE 6.7.4. Be sure to follow the upgrade instructions.
• DSE 5.0 SSTables with UDTs will be corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)
  Important: If the DSE 5.0.x schema contains user-defined types (UDTs), upgrade to at least DSE 5.1.13, DSE 6.0.6, or DSE 6.7.2. The SSTable serialization headers are fixed when DSE is started with the upgraded versions.

DSE 6.0.5 core

6.0.5 DSE Analytics

Changes and enhancements:

• Improved error handling: only submission-related error exceptions from Spark submitted applications are wrapped in a Dse Spark Submit Bootstrapper Failed to Submit error. (DSP-16359)
• Improved error message for dse client-tool when DSE Analytics is not correctly configured. (DSP-17322)
• AlwaysOn SQL (AOSS) improvements:
  • Provide a way for clients to determine if AlwaysOn SQL (AOSS) is enabled in DSE. (DSP-17180)
  • Improved logging messages with recommended resolutions for AlwaysOn SQL (AOSS). (DSP-17326, DSP-17533)
  • Improved error message for AlwaysOn SQL (AOSS) when the role specified by auth_user does not exist. (DSP-17358)
  • Set default for spark.sql.thriftServer.incrementalCollect to true for AlwaysOn SQL (AOSS). (DSP-17428)
  • Structured Streaming support for (Bring Your Own Spark) BYOS Spark 2.3. (DSP-17593)

6.0.5 DSEFS

6.0.5 DSE Graph

Resolved issues:

• Properties unattached to vertex show up with null values. (DSP-12300)
• DSEGF label drop hang with a lot of edges, both ended the same label. (DSP-17096)
• Graph/Search escaping fixes. (DSP-17216, DSP-17277, DSP-17816)
• A Gremlin query with search predicate containing \u2028 or \u2029 characters fails. (DSP-17227)
• Geo.inside predicate with Polygon no longer works on secondary index if JTS is not installed. (DSP-17284)
• Search indexes on key fields work only with non-tokenized queries. (DSP-17386)
• g.V().repeat(...).until(...).path() returns incomplete path without edges. (DSP-17933)
• Graph OLTP: Potential ThreadLocal resource leak. (DSP-17808)
• Graph OLTP: Slow gremlin script compilation times. (DSP-14132)
• DseGraphFrame fail to read properties with symbols, like period (.), in names. (DSP-17818)
• DSE GraphFrame operations cache but do not explicitly uncache. (DSP-17870)
• Inconsistent results when using gremlin on static data. (DSP-18005)
• Graph OLAP: secret tokens are unmasked in log files. (DSP-18074)

6.0.5 DSE Search

8 October 2018

DSE 6.0.4 Important bug fix

DSE 6.0.4 Known issue:

6.0.4 Components

DSE 6.0.4 is compatible with Apache Cassandra™ 3.11 and includes all production-certified enhancements from earlier DSE versions.

20 September 2018

6.0.3 Components

DataStax Enterprise 6.0.3 is compatible with Apache Cassandra™ 3.11 and includes all production-certified enhancements from earlier DSE versions.

DSE 6.0.3 Highlights

High-value benefits of upgrading to DSE 6.0.3 include these highlights:

DSE Database (DSE core) highlights

DSE Analytics highlights

DSEFS highlights

DSE Graph highlights

DSE Search highlights

DSE 6.0.3 Known issues:

6.0.3 DSE core

Known issue:

• Upgraded nodes that still have big-format SSTables from DSE 5.x can cause errors during read. (DB-2801)

  Workaround for upgrades from DSE 5.x to DSE versions before 6.0.5 and DSE 6.7.0: Run offline sstableupgrade before starting the upgraded node.

6.0.3 DSE Analytics

6.0.3 DSEFS

6.0.3 DSE Graph

6.0.3 DSE Search

19 July 2018

6.0.2 Components

DataStax Enterprise 6.0.2 is compatible with Apache Cassandra™ 3.11 and includes all production-certified enhancements from earlier DSE versions.

DSE 6.0.2 Highlights

High-value benefits of upgrading to DSE 6.0.2 include these highlights:

DSE Analytics and DSEFS

• Fixed issue where CassandraConnectionConf creates excessive database connections and reports too many HashedWheelTimer instances. (DSP-16365)

DSE Graph

• Fixed several edge cases of using search indexes. (DSP-14802, DSP-16292)

DSE Search

• Search index permissions can be applied at the keyspace level. (DSP-15385)
• Schemas with stored=true work because stored=true is ignored. The workaround for 6.0.x upgrades with schema.xml fields with “indexed=false, stored=true, docValues=true” is no longer required. (DSP-16392)
• Minor bug fixes and error handling improvements. (DSP-16435, DSP-16061, DSP-16078)

6.0.2 DSE core

DSE 6.0.2 Known issue:

• Possible data loss when using DSE Tiered Storage. (DB-3404)
  Warning: If using DSE Tiered Storage, you must immediately upgrade to at least DSE 5.1.16, DSE 6.0.9, or DSE 6.7.4. Be sure to follow the upgrade instructions.
• DSE 5.0 SSTables with UDTs will be corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)
  Important: If the DSE 5.0.x schema contains user-defined types (UDTs), upgrade to at least DSE 5.1.13, DSE 6.0.6, or DSE 6.7.2. The SSTable serialization headers are fixed when DSE is started with the upgraded versions.

6.0.2 DSE Analytics

Changes and enhancements:

• Apache Hadoop Azure libraries for Hadoop 2.7.1 have been added to the Spark classpath to simplify integration with Microsoft Azure and Microsoft Azure Blob Storage. (DSP-15943)
• AlwaysOn SQL (AOSS) improvements:
  • AlwaysOn SQL (AOSS) support for enabling Kerberos and SSL at the same time. (DSP-16087)
  • Add 120 seconds wait time so that Spark Master recovery process completes before status check of AlwaysOn SQL (AOSS) app. (DSP-16249)
  • AlwaysOn SQL (AOSS) driver continually runs on a node even when DSE is down. (DSP-16297)
  • AlwaysOn SQL (AOSS) binds to native_transport_address. (DSP-16469)
  • Improved defaults and errors for AlwaysOn SQL (AOSS) workpool. (DSP-16343)

6.0.2 DSEFS

Changes and enhancements:

• DSEFS operations: chown, chgrp, and chmod support recursive (-R) and verbose (-v) flag. (DSP-14238)
• Client and internode connection improvements. (DSP-14284, DSP-16065)
  • DSEFS clients close idle connections after 60 seconds, configurable in dse.yaml.
  • Idle DSEFS internode connections are closed after 120 seconds. Configurable with new dse.yaml option internode_idle_connection_timeout_ms.
  • Configurable connection pool with core_max_concurrent_connections_per_host.
• DSEFS clients close idle connections after 60 seconds, configurable in dse.yaml. (DSP-14284)
• Improvements to DataSourceInputStream remove possible lockup. (DSP-16409)
  • If the second read is issued after a failed read, it is not blocked forever. The stream is automatically closed on errors, and subsequent reads will fail with IllegalStateException.
  • The timeout message includes information about the underlying DataSource object.
  • No more reads are issued to the underlying DataSource after it reports hasMoreData = false.
  • The read loop has been simplified to properly move to the next buffer if the requested number of bytes hasn't been delivered yet.
  • Empty buffer returned from the DataSource when hasMoreData = true is not treated as an EOF. The read method validates offset and length arguments.
• Security improvement: DSEFS uses an isolated native memory pool for file data and metadata sent between nodes. This isolation makes it harder to exploit potential memory management bugs. (DSP-16492)

Resolved issues:

• DSEFS silently fails when TCP port 5599 is not open between nodes. (DSP-16101)

6.0.2 DSE Graph

6.0.2 DSE Search

Changes and enhancements:

• The node health option uptime_ramp_up_period_seconds default value in dse.yaml is reduced to 3 hours (10800 seconds). (DSP-15752)
• CQL solr_query supports Solr facet heatmaps. (DSP-16404)
• Improved handling of asynchronous I/O timeouts during search read-before-write. (DSP-16061)
• Schemas with stored=true work because stored=true is ignored. (DSP-16392)
• Use monotonically increasing time source for search query execution latency calculation. (DSP-16435)

Resolved issues:

• Search index permissions can be applied at keyspace level. (DSP-15835)
• The encryptors thread cache in ThreadLocalIndexEncryptionConfiguration leaves entries in the cache. (DSP-16078)
• Classpath conflict between Lucene and SASI versions of Snowball. (DSP-16116)
• Indexing fails if fields have 'indexed=false', 'stored=true', and `docValues=true'. (DSP-16392)

DataStax Bulk Loader 1.1.0

5 June 2018

• 6.0.1 Components
• 6.0.1 Highlights
• DSE 6.0.1 Known issues
• Cassandra enhancements for DSE 6.0.1
• General upgrade advice DSE 6.0.1
• TinkerPop changes for 6.0.1

6.0.1 Components

DSE 6.0.1 is compatible with Apache Cassandra™ 3.11 and adds additional production-certified enhancements.

DSE 6.0.1 Highlights

High-value benefits of upgrading to DSE 6.0.1 include these highlights:

DataStax Enterprise core

• Fix binding JMX to any address. (DB-2081)
• DataStax Bulk Loader 1.0.2 is bundled with DSE 6.0.1. (DSP-16206)

DSE Analytics and DSEFS

• Upgrade to Spark 2.2.1 for bug fixes.
• Fixed issue where multiple Spark Masters can be started on the same machine. (DSP-15636)
• Improved Spark Master discovery and reliability. (DSP-15801, DSP-14405)
• Improved AlwaysOn SQL (AOSS) startup reliability. (DSP-15871, DSP-15468, DSP-15695, DSP-15839)
• Resolved the missing /tmp directory in DSEFS after fresh cluster installation. (DSP-16058)
• Fixed handling of Parquet files with partitions. (DSP-16067)
• Fixed the HashedWheelTimer leak in Spark Connector that affected BYOS. (DSP-15569)

DSE Search

• Fix for the known issue that prevented using TTL (time-to-live) with DSE Search live indexing (RT indexing). (DSP-16038, DSP-14216)
• Addresses security vulnerabilities in libraries packaged with DSE. (DSP-15978)
• Fix for using faceting with non-zero offsets. (DSP-15946)
• Fix for ORDER BY clauses in native CQL syntax. (DSP-16064)

DSE 6.0.1 Known issues:

• Possible data loss when using DSE Tiered Storage. (DB-3404)
  Warning: If using DSE Tiered Storage, you must immediately upgrade to at least DSE 5.1.16, DSE 6.0.9, or DSE 6.7.4. Be sure to follow the upgrade instructions.
• DSE 5.0 SSTables with UDTs will be corrupted after migrating to DSE 5.1, DSE 6.0, and DSE 6.7. (DB-2954, CASSANDRA-15035)
  Important: If the DSE 5.0.x schema contains user-defined types (UDTs), upgrade to at least DSE 5.1.13, DSE 6.0.6, or DSE 6.7.2. The SSTable serialization headers are fixed when DSE is started with the upgraded versions.
• dsetool does not work when native_transport_interface is set in cassandra.yaml. (DSP-16796)

  To workaround: Use native_transport_interface_prefer_ipv6 instead.

6.0.1 DSE core

6.0.1 DSE Analytics

• The Spark Jobserver demo has an incorrect version for the Spark Jobserver API. (DSP-15832)

  Workaround: In the demo's gradle.properties file, change the version from 0.6.2 to 0.6.2.238.

6.0.1 DSEFS

6.0.1 DSE Graph

6.0.1 DSE Search

DataStax Bulk Loader 1.0.2

17 April 2018

6.0.0 Components

DSE 6.0 is compatible with Apache Cassandra™ 3.11 and adds additional production-certified enhancements.

6.0 New features

See DataStax Enterprise 6.0 new features.

6.0.0 DSE core

Changes and enhancements:

6.0.0 DSE Advanced Replication

6.0.0 DSE Analytics

6.0.0 DSEFS

6.0.0 DSE Graph

6.0.0 DSE Search

DataStax Studio 6.0.0

• For use with DSE 6.0.x, DataStax Studio 6.0.0 is installed as a standalone tool. (DSP-13999, DSP-15623)

For details, see .

DataStax Bulk Loader 1.0.1

• DataStax Bulk Loader (dsbulk) version 1.0.1 is automatically installed with DataStax Enterprise 6.0.0, and can also be installed as a standalone tool. (DSP-13999, DSP-15623)