hadoop_add_array_param

• Synopsis

hadoop_add_array_param envvar appendstring

• Description

Add the appendstring if checkstring is not present in the given array

• Returns

Nothing

hadoop_add_classpath

• Synopsis

hadoop_add_classpath object [before|after]

• Description

Add a file system object (directory, file, wildcard, …) to the classpath. Optionally provide a hint as to where in the classpath it should go.

• Returns

0 = success (added or duplicate) 1 = failure (doesn’t exist or some other reason)

hadoop_add_client_opts

• Synopsis

hadoop_add_client_opts 

• Description

Adds the HADOOP_CLIENT_OPTS variable to HADOOP_OPTS if HADOOP_SUBCMD_SUPPORTDAEMONIZATION is false

• Returns

Nothing

hadoop_add_colonpath

• Synopsis

hadoop_add_colonpath envvar object [before|after]

• Description

Add a file system object (directory, file, wildcard, …) to the colonpath. Optionally provide a hint as to where in the colonpath it should go. Prior to adding, objects are checked for duplication and check for existence. Many other functions use this function as their base implementation including hadoop_add_javalibpath and hadoop_add_ldlibpath.

• Returns

0 = success (added or duplicate) 1 = failure (doesn’t exist or some other reason)

hadoop_add_javalibpath

• Synopsis

hadoop_add_javalibpath object [before|after]

• Description

Add a file system object (directory, file, wildcard, …) to the Java JNI path. Optionally provide a hint as to where in the Java JNI path it should go.

• Returns

0 = success (added or duplicate) 1 = failure (doesn’t exist or some other reason)

hadoop_add_ldlibpath

• Synopsis

hadoop_add_ldlibpath object [before|after]

• Description

Add a file system object (directory, file, wildcard, …) to the LD_LIBRARY_PATH. Optionally provide a hint as to where in the LD_LIBRARY_PATH it should go.

• Returns

0 = success (added or duplicate) 1 = failure (doesn’t exist or some other reason)

hadoop_add_param

• Synopsis

hadoop_add_param envvar checkstring appendstring

• Description

Append the appendstring if checkstring is not present in the given envvar

• Returns

Nothing

hadoop_add_profile

• Synopsis

hadoop_add_profile shellprofile

• Description

Register the given shellprofile to the Hadoop shell subsystem

• Returns

Nothing

hadoop_array_contains

• Synopsis

hadoop_array_contains element array

• Description

Check if an array has a given value

• Returns

hadoop_build_custom_subcmd_var

• Synopsis

hadoop_build_custom_subcmd_var command subcommand customid

• Description

Build custom subcommand var

• Returns

string

hadoop_deprecate_envvar

• Synopsis

hadoop_deprecate_envvar oldvar newvar

• Description

Replace oldvar with newvar if oldvar exists.

• Returns

Nothing

hadoop_detect_priv_subcmd

• Synopsis

hadoop_detect_priv_subcmd command subcommand

• Description

autodetect whether this is a priv subcmd by whether or not a priv user var exists and if HADOOP_SECURE_CLASSNAME is defined

• Returns

1 = not priv 0 = priv

hadoop_java_exec

• Synopsis

hadoop_java_exec command class [options]

• Description

Execute the Java class, passing along any options. Additionally, set the Java property -Dproc_command.

• Returns

Nothing

hadoop_java_setup

• Synopsis

hadoop_java_setup 

• Description

Configure/verify ${JAVA_HOME}

• Returns

may exit on failure conditions

hadoop_mkdir

• Synopsis

hadoop_mkdir dir

• Description

Create the directory ‘dir’.

• Returns

Nothing

hadoop_need_reexec

• Synopsis

hadoop_need_reexec subcommand

• Description

Verify that ${USER} is allowed to execute the given subcommand.

• Returns

1 on no re-exec needed 0 on need to re-exec

hadoop_os_tricks

• Synopsis

hadoop_os_tricks 

• Description

Routine to configure any OS-specific settings.

• Returns

may exit on failure conditions

hadoop_sort_array

• Synopsis

hadoop_sort_array arrayvar

• Description

Sort an array (must not contain regexps) present in the given array

• Returns

Nothing

hadoop_status_daemon

• Synopsis

hadoop_status_daemon pidfile

• Description

Determine the status of the daemon referenced by pidfile

• Returns

(mostly) LSB 4.1.0 compatible status

hadoop_stop_daemon

• Synopsis

hadoop_stop_daemon command pidfile

• Description

Stop the non-privileged command daemon with that that is running at pidfile.

• Returns

Nothing

hadoop_stop_secure_daemon

• Synopsis

hadoop_stop_secure_daemon command daemonpidfile wrapperpidfile

• Description

Stop the privileged command daemon with that that is running at daemonpidfile and launched with the wrapper at wrapperpidfile.

• Returns

Nothing

hadoop_subcommand_secure_opts

• Synopsis

hadoop_subcommand_secure_opts program subcommand

• Description

Add custom (program)_(command)_SECURE_EXTRA_OPTS to HADOOP_OPTS. This does not handle the pre-3.x deprecated cases

• Returns

will exit on failure conditions

hadoop_translate_cygwin_path

• Synopsis

hadoop_translate_cygwin_path varnameref [true]

• Description

Converts the contents of the variable name varnameref into the equivalent Windows path. If the second parameter is true, then varnameref is treated as though it was a path list.

• Returns

Nothing

hadoop_using_envvar

• Synopsis

hadoop_using_envvar var

• Description

Declare var being used and print its value.

• Returns

Nothing

hadoop_validate_classname

• Synopsis

hadoop_validate_classname classname

• Description

Verify that a shell command was passed a valid class name

• Returns

0 = success 1 = failure w/user message

hadoop_verify_confdir

• Synopsis

hadoop_verify_confdir 

• Description

Validate ${HADOOP_CONF_DIR}

• Returns

will exit on failure conditions

hadoop_verify_user_perm

• Synopsis

hadoop_verify_user_perm command subcommand

• Description

Verify that ${USER} is allowed to execute the given subcommand.

• Returns

return 0 on success exit 1 on failure

hadoop_verify_user_resolves

• Synopsis

hadoop_verify_user_resolves userstring

• Description

Verify that username in a var converts to user id

• Returns

0 for success 1 for failure

hadoop_abs

• Synopsis

hadoop_abs fsobj

• Description

Given a filename or dir, return the absolute version of it This works as an alternative to readlink, which isn’t portable.

• Returns

0 success 1 failure stdout abspath

hadoop_add_entry

• Synopsis

hadoop_add_entry 

• Description

Given variable $1 add $2 to it

• Returns

Nothing

hadoop_debug

• Synopsis

hadoop_debug string

• Description

Print a message to stderr if –debug is turned on

• Returns

Nothing

hadoop_delete_entry

• Synopsis

hadoop_delete_entry 

• Description

Given variable $1 delete $2 from it

• Returns

Nothing

hadoop_error

• Synopsis

hadoop_error string

• Description

Print a message to stderr

• Returns

Nothing

hadoop_exit_with_usage

• Synopsis

hadoop_exit_with_usage exitcode

• Description

Print usage information and exit with the passed exitcode

• Returns

This function will always exit.

hadoop_populate_workers_file

• Synopsis

hadoop_populate_workers_file filename

• Description

Set the worker support information to the contents of filename

• Returns

will exit if file does not exist

hadoop_rotate_log

• Synopsis

hadoop_rotate_log filename [number]

• Description

Rotates the given file until number of files exist.

• Returns

$? will contain last mv’s return value

hadoop_verify_entry

• Synopsis

hadoop_verify_entry 

• Description

Given variable $1 determine if $2 is in it

• Returns

0 = yes, 1 = no

hadoop_subcommand_opts

• Synopsis

hadoop_subcommand_opts program subcommand

• Description

Add custom (program)_(command)_OPTS to HADOOP_OPTS. Also handles the deprecated cases from pre-3.x.

• Returns

will exit on failure conditions

hadoop_actual_ssh

• Synopsis

hadoop_actual_ssh hostname command [...]

• Description

Via ssh, log into hostname and run command

• Returns

Nothing

hadoop_add_common_to_classpath

• Synopsis

hadoop_add_common_to_classpath 

• Description

Add the common/core Hadoop components to the environment

• Returns

hadoop_add_to_classpath_tools

• Synopsis

hadoop_add_to_classpath_tools module

• Description

Run libexec/tools/module.sh to add to the classpath environment

• Returns

Nothing

hadoop_add_to_classpath_userpath

• Synopsis

hadoop_add_to_classpath_userpath 

• Description

Add the user’s custom classpath settings to the environment

• Returns

Nothing

hadoop_common_worker_mode_execute

• Synopsis

hadoop_common_worker_mode_execute commandarray

• Description

Utility routine to handle –workers mode

• Returns

Nothing

hadoop_connect_to_hosts

• Synopsis

hadoop_connect_to_hosts command [...]

• Description

Connect to ${HADOOP_WORKERS} or ${HADOOP_WORKER_NAMES} and execute command.

• Returns

Nothing

hadoop_connect_to_hosts_without_pdsh

• Synopsis

hadoop_connect_to_hosts_without_pdsh command [...]

• Description

Connect to ${HADOOP_WORKER_NAMES} and execute command under the environment which does not support pdsh.

• Returns

Nothing

hadoop_daemon_handler

• Synopsis

hadoop_daemon_handler [start|stop|status|default] command class daemonpidfile daemonoutfile [options]

• Description

Manage a non-privileged daemon.

• Returns

Nothing

hadoop_do_classpath_subcommand

• Synopsis

hadoop_do_classpath_subcommand [parameters]

• Description

Perform the ‘hadoop classpath’, etc subcommand with the given parameters

• Returns

will print & exit with no params

hadoop_exec_hadooprc

• Synopsis

hadoop_exec_hadooprc 

• Description

Read the user’s settings. This provides for users to run Hadoop Shell API after system bootstrap

• Returns

Nothing

hadoop_exec_user_hadoopenv

• Synopsis

hadoop_exec_user_hadoopenv 

• Description

Read the user’s settings. This provides for users to override and/or append hadoop-env.sh. It is not meant as a complete system override.

• Returns

Nothing

hadoop_finalize

• Synopsis

hadoop_finalize 

• Description

Finish all the remaining environment settings prior to executing Java. This is a wrapper that calls the other finalize routines.

• Returns

Nothing

hadoop_finalize_classpath

• Synopsis

hadoop_finalize_classpath 

• Description

Finish Java classpath prior to execution

• Returns

Nothing

hadoop_finalize_hadoop_heap

• Synopsis

hadoop_finalize_hadoop_heap 

• Description

Finish Java heap parameters prior to execution

• Returns

Nothing

hadoop_finalize_hadoop_opts

• Synopsis

hadoop_finalize_hadoop_opts 

• Description

Finish configuring Hadoop specific system properties prior to executing Java

• Returns

Nothing

hadoop_finalize_jpms_opts

• Synopsis

hadoop_finalize_jpms_opts 

• Description

Finish configuring JPMS that enforced for JDK 17 and higher prior to executing Java keep this list sync with hadoop-project/pom.xml extraJavaTestArgs

• Returns

Nothing

hadoop_finalize_libpaths

• Synopsis

hadoop_finalize_libpaths 

• Description

Finish Java JNI paths prior to execution

• Returns

Nothing

hadoop_generic_java_subcmd_handler

• Synopsis

hadoop_generic_java_subcmd_handler 

• Description

Handle subcommands from main program entries

• Returns

Nothing

hadoop_import_shellprofiles

• Synopsis

hadoop_import_shellprofiles 

• Description

Import shellprofile.d content

• Returns

Nothing

hadoop_parse_args

• Synopsis

hadoop_parse_args [parameters, typically "$@"]

• Description

generic shell script option parser. sets HADOOP_PARSE_COUNTER to set number the caller should shift

• Returns

Nothing

hadoop_privilege_check

• Synopsis

hadoop_privilege_check 

• Description

Check if we are running with priv by default, this implementation looks for EUID=0. For OSes that have true priv separation, this should be something more complex

• Returns

1 = no priv 0 = priv

hadoop_secure_daemon_handler

• Synopsis

hadoop_secure_daemon_handler [start|stop|status|default] command class daemonpidfile daemonoutfile wrapperpidfile wrapperoutfile wrappererrfile [options]

• Description

Manage a privileged daemon.

• Returns

Nothing

hadoop_setup_secure_service

• Synopsis

hadoop_setup_secure_service 

• Description

• Returns

Nothing

hadoop_shellprofiles_classpath

• Synopsis

hadoop_shellprofiles_classpath 

• Description

Apply the shell profile classpath additions

• Returns

Nothing

hadoop_shellprofiles_finalize

• Synopsis

hadoop_shellprofiles_finalize 

• Description

Apply the shell profile final configuration

• Returns

Nothing

hadoop_shellprofiles_init

• Synopsis

hadoop_shellprofiles_init 

• Description

Initialize the registered shell profiles

• Returns

Nothing

hadoop_shellprofiles_nativelib

• Synopsis

hadoop_shellprofiles_nativelib 

• Description

Apply the shell profile native library additions

• Returns

Nothing

hadoop_start_daemon

• Synopsis

hadoop_start_daemon command class pidfile [options]

• Description

Start a non-privileged daemon in the foreground.

• Returns

Nothing

hadoop_start_daemon_wrapper

• Synopsis

hadoop_start_daemon_wrapper command class pidfile outfile [options]

• Description

Start a non-privileged daemon in the background.

• Returns

Nothing

hadoop_start_secure_daemon

• Synopsis

hadoop_start_secure_daemon command class daemonpidfile daemonoutfile daemonerrfile wrapperpidfile [options]

• Description

Start a privileged daemon in the foreground.

• Returns

Nothing

hadoop_start_secure_daemon_wrapper

• Synopsis

hadoop_start_secure_daemon_wrapper command class daemonpidfile daemonoutfile wrapperpidfile warpperoutfile daemonerrfile [options]

• Description

Start a privileged daemon in the background.

• Returns

Nothing

hadoop_sudo

• Synopsis

hadoop_sudo user commandstring

• Description

Execute a command via sudo when running as root if the given user is found or exit with failure if not. otherwise just run it. (This is intended to be used by the start-/stop- scripts.)

• Returns

exitstatus

hadoop_verify_logdir

• Synopsis

hadoop_verify_logdir 

• Description

• Returns

Nothing

hadoop_verify_piddir

• Synopsis

hadoop_verify_piddir 

• Description

• Returns

Nothing

hadoop_verify_secure_prereq

• Synopsis

hadoop_verify_secure_prereq 

• Description

Verify that prerequisites have been met prior to excuting a privileged program.

• Returns

This routine may exit.