Changing the Hadoop log directory (deprecated)

Add the HADOOP_LOG_DIR environment variable to the dse-env.sh file to recognize changes to the default log directory used by DSE Hadoop (the Hadoop component that is integrated into DataStax Enterprise).

You must add the HADOOP_LOG_DIR environment variable to the dse-env.sh file to enable DataStax Enterpriseto recognize changes to the default log directory used by DSE Hadoop. Hadoop is deprecated for use with DataStax Enterprise. DSE Hadoop and BYOH (Bring Your Own Hadoop) are also deprecated.

Note: If you change the default Hadoop log directory environment variable in hadoop-env.sh and restart DataStax Enterprise, the change is not recognized.

Procedure

  1. In the dse-env.sh file, comments describe where to add the command to configure the environment variable. For example:
    The default location of the dse-env.sh file depends on the type of installation:
    Installer-Services and Package installations /etc/dse/dse-env.sh
    Installer-No Services and Tarball installations install_location/bin/dse-env.sh
    #!/bin/sh
    
    # Add any environment overrides you need here. This is where users
    # may set third-party variables such as HADOOP_LOG_DIR
    
    export HADOOP_LOG_DIR=/var/log/hadoop/new_log_location
    
    # ==================================
    # don't change after this.
    if [ -r "`dirname "$0"`/dse.in.sh" ]; then
    . . .
  2. Restart DataStax Enterprise after configuring the new log location.

    In a packaged installation, DataStax Enterprise loads the environment variable change using /usr/share/dse/dse.in.sh after you restart the node.