Configuring the data and log directories for DSE Metrics Collector

You can change the directories where DSE Metrics Collector stores metrics and logs.

The default directories for DSE Metrics Collector are:

  • /var/lib/cassandra/insights_data

  • /var/log/cassandra/

Procedure

  1. To make changes, uncomment the insights_options section in dse.yaml and the options under that heading.

    # insights_options:
      # data_dir: /var/lib/cassandra/insights_data
      # log_dir: /var/log/cassandra/
    insights_options

    Options for DSE Metrics Collector.

    data_dir

    Directory to store collected metrics.

    When data_dir is not explicitly set, the insights_data directory is stored in the same parent directory as the commitlog_directory as defined in cassandra.yaml. If the commitlog_directory uses the package default of /var/lib/cassandra/commitlog, data_dir will default to /var/lib/cassandra/insights_data.

    Default: /var/lib/cassandra/insights_data

    log_dir

    Directory to store logs for collected metrics. The log file is dse-collectd.log. The file with the collectd PID is dse-collectd.pid.

    Default: /var/log/cassandra/

    See dse.yaml configuration file for DataStax Enterprise (DSE) 6.8 | 6.7 | 6.0 | 5.1.

    Where is the dse.yaml file?

    The location of the dse.yaml file depends on the type of installation:

    Installation Type Location

    Package installations + Installer-Services installations

    /etc/dse/dse.yaml

    Tarball installations + Installer-No Services installations

    <installation_location>/resources/dse/conf/dse.yaml

    Where is the cassandra.yaml file?

    The location of the cassandra.yaml file depends on the type of installation:

    Installation Type Location

    Package installations + Installer-Services installations

    /etc/dse/cassandra/cassandra.yaml

    Tarball installations + Installer-No Services installations

    <installation_location>/resources/cassandra/conf/cassandra.yaml

  2. To change the location of the data directory for local storage, adjust the file path in data_dir.

    When metrics collection is enabled with local storage, DataStax recommends explicitly setting data_dir to the DSE Metrics Collector local data directory.

  3. To change the limit on how much DSE Metrics Collector data will be stored on disk, set --data_dir_max_size_in_mb with the dsetool insights_config command.

    The default size of the data directory is 1 GB. The maximum size of the data directory must not exceed 2 GB.

    For example, to configure 1.5 GB maximum size for the local storage data directory:

    dsetool insights_config --data_dir_max_size_in_mb 1500
  4. To change the location of the log directory, adjust the file path in log_dir.

  5. After you make configuration changes with dsetool insights_config, disable and then re-enable DSE Metrics Collector to read the configuration file again.

Was this helpful?

Give Feedback

How can we improve the documentation?

© 2024 DataStax | Privacy policy | Terms of use

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries. Kubernetes is the registered trademark of the Linux Foundation.

General Inquiries: +1 (650) 389-6000, info@datastax.com