Sindbad~EG File Manager
3
�f�> � @ s> d dl Z d dlmZ d dlmZ d dlmZ G dd� d�ZdS )� N)�
ClusterOption)�bold)�Lockc @ s e Zd ZdZg Zd;Zg Zi Zi ZdZ dZ
dZ dd� Z e
dd� �Ze
d d
� �Ze
d d � �Zd
d� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Z d<d'd(�Z d)d*� Z d+d,� Z d-d.� Z d/d0� Z!d1d2� Z"d3d4� Z#d5d6� Z$d7d8� Z%d9d:� Z&dS )=�Clustera\ This is the class that cluster profiles should subclass in order to
add support for different clustering technologies and environments to
sos-collector.
A profile should at minimum define a package that indicates the node is
configured for the type of cluster the profile is intended to serve and
then additionally be able to return a list of enumerated nodes via the
``get_nodes()`` method
:param commons: The commons dict containing system information. The same as
what is handed to ``Plugin()``
:type commons: ``dict``
:cvar option_list: Options supported by the profile, and set by the
--cluster-option cmdline arg
:vartype option_list: ``list`` of ``tuples``
:cvar packages: What package(s) should this profile enable on
:vartype packages: ``tuple``
:cvar sos_plugins: Which plugins to forcibly enable for node reports
:vartype sos_plugins: ``list``
:cvar sos_options: Options to pass to report on every node
:vartype sos_options: ``dict``
:cvar sos_plugin_options: Plugin options to forcibly set for nodes
:vartype sos_plugin_options: ``dict``
:cvar sos_preset: A SoSReport preset to forcibly enable on nodes
:vartype sos_preset: ``str``
:cvar cluster_name: The name of the cluster type
:vartype cluster_name: ``str``
� NFc C s� d | _ d | _|d | _|d | _| jjg| _x(| jjD ] }|jdkr6| jj|j� q6W d | _ t
� | _ t j
d�| _t j
d�| _g | _| j� d S )N�tmpdirZ cmdlineoptsr ZsosZsos_ui)�primary�cluster_ssh_keyr �opts� __class__�__name__� cluster_type� __bases__�append� node_listr �lock�loggingZ getLogger�soslogZui_log�options� _get_options)�selfZcommons�cls� r � /usr/lib/python3.6/__init__.py�__init__E s
zCluster.__init__c C s | j r | j S | jj� S )z0Returns the cluster's name as a string.
)� cluster_namer �lower)r r r r �nameU s z Cluster.namec s | t kr| j|� d S |jd| j � | jrF| jt jk rF|j| j� n8| jd jrt| jd t k rt|j| jd j� n
|jd� | jr�|jddjdd� | jD �� dd � | j r�|jd
| j dd � | j
r�djd d� | j
j � D ��� |jd � � �� | j �r |jd
djdd� | j D �� dd � | j
�rV| j
� dj� fdd�� D ��}|jd| dd � | j�r|jd�}|jdtd| j � � |jtddd�dd�dd�dd�d��dd � xf| jD ]\}|d }t|t��r�|�r�d }nd }dd�|d d�|d�|d d��}|j|dd � �q�W d S ) Nz %s Cluster Profile Detailed Help� z/
Detailed help not available for this profile
z%Enabled by the following packages: %sz, c s s | ]
}|V qd S )Nr )�.0�pr r r � <genexpr>q s z'Cluster.display_help.<locals>.<genexpr>F)�newlinez!Uses the following sos preset: %sc s s" | ]\}}d |� d|� �V qdS )z--� Nr )r �k�vr r r r! | s z Sets the following sos options: z!Enables the following plugins: %sc s s | ]
}|V qd S )Nr )r Zplugr r r r! � s c 3 s | ]}d |� | f V qdS )z%s=%sNr )r �opt)�_optsr r r! � s z%Sets the following plugin options: %szAvailable cluster optionsz2These options may be toggled or changed using '%s'z-c %s.$option=$value�
r# z<4z Option Namez<20ZDefaultz<30� DescriptionzTrue/Onz False/Offr � )r �display_self_help� set_titler �__doc__�add_text�__mro__�packages�join�
sos_preset� sos_options�items� sos_plugins�sos_plugin_options� option_listZ add_sectionr r �
isinstance�bool)r �sectionr
Zoptsecr& �valZ_lnr )r' r � display_help] sf
$zCluster.display_helpc C s� |j d� |jd� |jd� ddlm} dd l}|j|j| �d�}|jd� |jdd �d
d �d d
��dd� xB|D ]:}td|d �}|jdd �|d �|d jd
��dd� qtW d S )Nz*SoS Collect Cluster Profiles Detailed Helpz�
Cluster profiles are used to represent different clustering technologies or platforms. Profiles define how cluster nodes are discovered, and optionally filtered, for default executions of collector.z�Cluster profiles are enabled similarly to SoS report plugins; usually by package, command, or configuration file presence. Clusters may also define default transports for SoS collect.r )� SoSCollector�clustersz6The following cluster profiles are locally available:
r# z>8�Namez<40r) z<30F)r" zcollect.clusters.%sr ) r, r. Z
sos.collectorr= �inspectZ
_load_modulesZ getmoduler r )r r: r= r@ r> �clusterZ_secr r r r+ � s&
zCluster.display_self_helpc C sF x@| j D ]6}t|d |d j|d | j|d d�}| jj|� qW dS )zALoads the options defined by a cluster and sets the default valuer r r* )r Zopt_type�valuerA � descriptionN)r7 r r r
r r )r r& �optionr r r r � s
zCluster._get_optionsc C s d| j d |f S )Nz[%s] %sr )r
)r �msgr r r �_fmt_msg� s zCluster._fmt_msgc C s | j j| j|�� dS )zUsed to print info messagesN)r �inforF )r rE r r r �log_info� s zCluster.log_infoc C s | j j|� dS )z Used to print error messagesN)r �error)r rE r r r � log_error� s zCluster.log_errorc C s | j j| j|�� dS )z Used to print debug messagesN)r �debugrF )r rE r r r � log_debug� s zCluster.log_debugc C s | j j| j|�� dS )z Used to print warning messagesN)r ZwarningrF )r rE r r r �log_warn� s zCluster.log_warnc C sR x,| j jD ] }|j|kr
|j| jkr
|jS q
W x | jD ]}|j|kr6|jS q6W dS )a
This is used to by clusters to check if a cluster option was
supplied to sos collect
:param option: The name of the option to fetch
:type option: ``str``
:returns: The value of the requested option if it exists, or ``False``
F)r
Zcluster_optionsr rA r
rB r )r rD r& r r r �
get_option� s
zCluster.get_optionc C s
|| _ dS )a� Some clusters generate and/or deploy well-known and consistent
SSH keys across environments. If this is the case, the cluster profile
may call this command so that subsequent node connections will use that
key rather than prompting the user for one or a password.
Note this will only function if collector is being run locally on the
primary node.
N)r )r �keyr r r �add_default_ssh_key� s zCluster.add_default_ssh_keyc C s dS )a
If there is a need to set specific options on ONLY the non-primary
nodes in a collection, override this method in the cluster profile
and do that here.
:param node: The non-primary node
:type node: ``SoSNode``
Nr )r �noder r r �set_node_options s zCluster.set_node_optionsc C s dS )a` The default connection type used by sos collect is to leverage the
local system's SSH installation using ControlPersist, however certain
cluster types may want to use something else.
Override this in a specific cluster profile to set the ``transport``
option according to what type of transport should be used.
Zcontrol_persistr )r r r r �set_transport_type
s zCluster.set_transport_typec C s dS )a If there is a need to set specific options in the sos command being
run on the cluster's primary nodes, override this method in the cluster
profile and do that here.
:param node: The primary node
:type node: ``SoSNode``
Nr )r rQ r r r �set_primary_options s zCluster.set_primary_optionsc C s |j | jj kS )a� In the event there are multiple primaries, or if the collect command
is being run from a system that is technically capable of enumerating
nodes but the cluster profiles needs to specify primary-specific
options for other nodes, override this method in the cluster profile
:param node: The node for the cluster to check
:type node: ``SoSNode``
)Zaddressr )r rQ r r r �check_node_is_primary s z Cluster.check_node_is_primary� �autoc C s4 | j j||||d�}|d r0|d jdd�|d< |S )a( Used to retrieve command output from a (primary) node in a cluster
:param cmd: The command to run
:type cmd: ``str``
:param need_root: Does the command require root privileges
:type need_root: ``bool``
:param timeout: Amount of time to allow cmd to run in seconds
:type timeout: ``int``
:param use_shell: Does the command required execution within a shell?
:type use_shell: ``auto`` or ``bool``
:returns: The output and status of `cmd`
:rtype: ``dict``
)� need_root� use_shell�timeout�outputz Password:r )r Z run_command�replace)r �cmdrX rZ rY �resr r r �exec_primary_cmd) s
zCluster.exec_primary_cmdc C s dS )z�
This MAY be used by a cluster to do prep work in case there are
extra commands to be run even if a node list is given by the user, and
thus get_nodes() would not be called
Nr )r r r r �setupB s z
Cluster.setupc C s$ x | j D ]}| jj|�rdS qW dS )a�
This may be overridden by clusters
This is called by sos collect on each cluster type that exists, and
is meant to return True when the cluster type matches a criteria
that indicates that is the cluster type is in use.
Only the first cluster type to determine a match is run
:returns: ``True`` if the cluster profile should be used, or ``False``
:rtype: ``bool``
TF)r0 r Z is_installed)r Zpkgr r r �
check_enabledJ s
zCluster.check_enabledc C s dS )z�
This may be overridden by clusters
Perform any necessary cleanup steps required by the cluster profile.
This helps ensure that sos does make lasting changes to the environment
in which we are running
Nr )r r r r �cleanup\ s zCluster.cleanupc C s dS )aB
This MUST be overridden by a cluster profile subclassing this class
A cluster should use this method to return a list or string that
contains all the nodes that a report should be collected from
:returns: A list of node FQDNs or IP addresses
:rtype: ``list`` or ``None``
Nr )r r r r � get_nodesf s
zCluster.get_nodesc C s< y| j � S tk
r6 } z| jd| � g S d }~X nX d S )NzFailed to get node list: %s)�format_node_list� ExceptionrL )r �er r r �
_get_nodesr s
zCluster._get_nodesc C s | j |�}|jjd|� |S )aE
Used by ``SosNode()`` to retrieve the appropriate label from the
cluster as set by ``set_node_label()`` in the cluster profile.
:param node: The name of the node to get a label for
:type node: ``str``
:returns: The label to use for the node's report
:rtype: ``str``
�label)�set_node_labelZmanifestZ add_field)r rQ rh r r r �get_node_labely s
zCluster.get_node_labelc C s dS )z�This may be overridden by clusters profiles subclassing this class
If there is a distinction between primaries and nodes, or types of
nodes, then this can be used to label the sosreport archive differently
r r )r rQ r r r ri � s zCluster.set_node_labelc C s� y | j � }W n0 tk
r< } ztd|� ���W Y dd}~X nX t|t�rXdd� |D �}n(t|t�rrdd� |D �}ntd|� ���tt|��}x |D ]}|jd�r�|j|� q�W |S )z�
Format the returned list of nodes from a cluster into a known
format. This being a list that contains no duplicates
:returns: A list of nodes, without extraneous entries from cmd output
:rtype: ``list``
z#Cluster failed to enumerate nodes: Nc S s g | ]}|r|j � �qS r )�strip)r �nr r r �
<listcomp>� s z,Cluster.format_node_list.<locals>.<listcomp>c S s g | ]}|j d �j� �qS )�,)�splitrk )r rl r r r rm � s z'Cluster returned unexpected node list: �-�_�(�)�[�]�/�\)rp rq rr rs rt ru rv rw )rc re r8 �list�str�set�
startswith�remove)r Znodes�errr rQ r r r rd � s
zCluster.format_node_listc C st g }yV| j � }|rXt|t�s"|g}x4|D ],}|j� }|j|� d|kr(|j|d � q(W W n tk
rn Y nX |S )a(
Ensures that any files returned by a cluster's run_extra_cmd()
method are properly typed as a list for iterative collection. If any
of the files are an additional sosreport (e.g. the ovirt db dump) then
the md5 sum file is automatically added to the list
Z sosreportz.md5)Z
run_extra_cmdr8 rx rk r �AttributeError)r �filesr^ Z
extra_filer r r �_run_extra_cmd� s
zCluster._run_extra_cmd)r )FrV rW )'r �
__module__� __qualname__r- r7 r0 r5 r3 r6 r2 r Zstrict_node_listr � classmethodr r< r+ r rF rH rJ rL rM rN rP rR rS rT rU r_ r` ra rb rc rg rj ri rd r� r r r r r sH % G "
r )r Z sos.optionsr Z
sos.utilitiesr Z threadingr r r r r r �<module> s
Sindbad File Manager Version 1.0, Coded By Sindbad EG ~ The Terrorists