Current File : //snap/core/17212/usr/lib/python3/dist-packages/cloudinit/__pycache__/util.cpython-35.pyc
"�T`u; � @ s d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l
Z
d d l Z
d d l Z d d l
Z
d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z d d l m Z d d l m Z d d l m Z d d l! m" Z" d d l! m# Z$ d d l! m% Z% d d l! m& Z& m' Z' m( Z( m) Z) m* Z* m+ Z+ d d
l, m- Z- d a. e$ j/ e0 � Z1 e
j2 d i Z3 d e j4 e j5 Z6 dLZ7 dMZ8 d d � Z9 e � d d d � � Z: e � d d d � � Z; d d d � Z< d d d � Z= d d! � Z> d" d# � Z? d$ d% � Z@ Gd& d' � d' eA � ZB Gd( d) � d) eC � ZD Gd* d+ � d+ eC � ZE d, d- � ZF d d. d/ � ZG d d0 d1 � ZH d d2 d3 � ZI d4 d d5 d6 � ZJ d d7 d8 � ZK d9 d: � ZL d; d< � ZM d= d> � ZN d? d@ � ZO dA dA dB dC � ZP dD dE � ZQ dF dG � ZR dA dA d e$ jS dA dH dI � ZT e � dJ dK � � ZU e � dL dM � � ZV e � dN dO � � ZW e � dP dQ � � ZX e � dR dS � � ZY dT dU dV � ZZ d dW dX � Z[ d dY dZ � Z\ d d[ d\ � Z] e � d] d^ � � Z^ e � d_ d` � � Z_ d da db � Z` d dc dd � Za de df � Zb d d dg dh � Zc d di di di di dj dk � Zd dT dl dm � Ze e jf dn do � � Zg e jf dp dq � � Zh dr ds � Zi dt du � Zj di di dv dw dx � Zk d dy dz � Zl d em f d{ d| � Zn di di dv d} d d~ d � Zo d� d� � Zp d� d� � Zq d d� d� � Zr d d� d� � Zs d� d� � Zt dT d� d� � Zu d� d� d� � Zv d� d� � Zw d� d� � Zx d� d� � Zy d� d� � Zz d� d� � Z{ d� d� � Z| d d� d dT d d� d� � Z} d d� d dT d d� d� � Z~ d d� d dT d d� d� � Z d d� d dT d d� d� � Z� d dT d� d� � Z� d� d� � Z� d� d� � Z� d dT dA d� d� � Z� e � d� d� � � Z� d� d� � Z� d� d d� d� � Z� d d d� d� � Z� d d d� d� � Z� d� d� � Z� d� d� � Z� d� d� � Z� d d� d� � Z� d� d� � Z� d� d� � Z� d� d� � Z� d� d� d� � Z� em f d� d� � Z� d� d� � Z� d� d� � Z� d� d� � Z� d d� d� � Z� e jf d� d� � � Z� d� d� � Z� d d d d� d� � Z� d� d� � Z� d� d� � Z� dT d� d� � Z� d� d� � Z� d� d� � Z d� d� � Z� e � d� d� � � Z� d� d� � Z� d� d� � Z� d� d� dT e� e� d d� d� d� � �Z� d� d� � Z� d� d� � Z� d� d� dT d� dA d� d� �Z� d� d� � Z� d� d� d� d� � Z� d� d� � Z� dA d� d � Z� d d dd� Z� dd� Z� dd� Z� dd� Z� d d
� Z� d d � Z� e � d
d� � Z� dd� Z� d ddd� Z� dd� Z� dd� Z� dd� Z� e1 dT dd� Z� d d � Z� d d � Z� d d!� Z� d"d#� Z� d$d%� Z� d&d'� Z� e1 dT d(d)� Z� d d dT d*d+� Z� d,d-� Z� d d e
j� j2 d.d/� Z� d0dT d1d2� Z� d3d4� Z� d d5d6� Z� d7d8� Z� d d9d:� Z� d;d<� Z� d=d>� Z� d?d@� Z� dT d dAdB� Z� dCdi dDdE� Z� dFdG� Z� d d dHdI� Z� dJdK� Z� d S(N � N)� b64decode� b64encode)�ENOENT)� lru_cache)�parse)�importer)�log)�subp)�mergers�safeyaml�
temp_utils�
type_utils�
url_helper�version)� CFG_BUILTIN�_z_-.()�true�1�on�yes�off�0�no�falsec C s/ t t t t j � j j d � d d � � � S)N�.� )�tuple�map�int�os�uname�release�split� r# r# �0/usr/lib/python3/dist-packages/cloudinit/util.py�kernel_versionA s r% c C s1 t j d d g d d d | �\ } } | j � S)z�Return the sanitized string output by `dpkg --print-architecture`.
N.B. This function is wrapped in functools.lru_cache, so repeated calls
won't shell out every time.
Zdpkgz--print-architecture�captureT�target)r �strip)r' �outr r# r# r$ �get_dpkg_architectureE s r* c s@ d d d d d d d d i } i � y� t j d d
g d d d
| �\ } } xL | j � D]> } | j d � \ } } } | | k r[ | j � � | | <q[ W� f d d � | j � D� } t | � r� t j d d j | � � WnW t j k
r;} z4 t j d | � t
d d � | j � D� � � WYd d } ~ Xn X� S)NZCodename�codenameZ DescriptionZ descriptionzDistributor ID�idZReleaser! � lsb_releasez--allr& Tr' �:c s" g | ] } | � k r | � q Sr# r# )�.0�k)�datar# r$ �
<listcomp>^ s z lsb_release.<locals>.<listcomp>z.Missing fields in lsb_release --all output: %s�,z#Unable to get lsb_release --all: %sc s s | ] } | d f Vq d S)Z UNAVAILABLENr# )r/ �vr# r# r$ � <genexpr>e s z lsb_release.<locals>.<genexpr>) r �
splitlines� partitionr( �values�len�LOG�warning�join�ProcessExecutionError�dict) r' Zfmapr) r �line�fname�val�missing�errr# )r1 r$ r- Q s$ 2r- zutf-8c C s t | t � r | S| j | � S)N)�
isinstance�str�decode)�blob�encodingr# r# r$ �
decode_binaryj s rI c C s t | t � r | S| j | � S)N)rD �bytes�encode)�textrH r# r# r$ � encode_textq s rM c C s: t | � } y | j d � SWn t k
r5 | SYn Xd S)Nzutf-8)r rF �UnicodeDecodeError)�source�decodedr# r# r$ �b64dx s
rQ c C s1 t | t � s | j d � } t | � j d � S)Nzutf-8)rD rJ rK r rF )rO r# r# r$ �b64e� s rR c C st | j d d � } | j � d k rp t | t � rp | j � } | rZ | j rZ | j } n d } | j | d � S| S)NrF TrL zutf-8�surrogateescape)Z get_payloadZget_content_maintyperD rJ Z get_charsetZ input_codecrF )�partZ cte_payload�charsetrH r# r# r$ �fully_decoded_payload� s rV c @ s7 e Z d Z d d d � Z d d � Z d d � Z d S) � SeLinuxGuardFc C sJ y t j d � | _ Wn t k
r3 d | _ Yn X| | _ | | _ d S)N�selinux)r �
import_modulerX � ImportError�path� recursive)�selfr[ r\ r# r# r$ �__init__� s
zSeLinuxGuard.__init__c C s$ | j r | j j � r d Sd Sd S)NTF)rX �is_selinux_enabled)r] r# r# r$ � __enter__� s zSeLinuxGuard.__enter__c C s
| j s | j j � r d St j j | j � s7 d St j j | j � } y- t j | � } | j j | | t j � Wn t
k
r� d SYn Xt j d | | j
� y | j j | d | j
�Wn> t
k
r} z t j d | | j
| � WYd d } ~ Xn Xd S)Nz,Restoring selinux mode for %s (recursive=%s)r\ z,restorecon failed on %s,%s maybe badness? %s)rX r_ r r[ �lexists�realpath�lstatZ matchpathcon�stat�ST_MODE�OSErrorr: �debugr\ Z
restoreconr; )r] Z excp_typeZ
excp_valueZexcp_tracebackr[ Zstats�er# r# r$ �__exit__� s"
zSeLinuxGuard.__exit__N)�__name__�
__module__� __qualname__r^ r` ri r# r# r# r$ rW � s
rW c @ s e Z d Z d S)�MountFailedErrorN)rj rk rl r# r# r# r$ rm � s rm c @ s e Z d Z d S)�DecompressionErrorN)rj rk rl r# r# r# r$ rn � s rn c O s� t j � } | d k rt y | | | � t j d � Wq� t k
rp t t d t j | � � t j d � Yq� Xn t j d | t j | � � d S)Nr z&Failed forking and calling callback %s� z(Forked child %s who will run callback %s) r �fork�_exit� Exception�logexcr: r
�obj_namerg )Zchild_cb�args�kwargsZfidr# r# r$ �fork_cb� s
rw c C s[ t | t � r | d k St } | r5 t | � | } t | � j � j � | k rW d Sd S)NTF)rD �bool� TRUE_STRINGS�listrE �lowerr( )rA �addons� check_setr# r# r$ �is_true� s
r~ c C s[ t | t � r | d k St } | r5 t | � | } t | � j � j � | k rW d Sd S)NFT)rD rx �
FALSE_STRINGSrz rE r{ r( )rA r| r} r# r# r$ �is_false� s
r� c C s* | s
d St | t � r | St | | � S)NF)rD rx r~ )rA r| r# r# r$ �translate_bool� s
r� � c sN t j � � � s" t j t j � d j � � f d d � t d | � D� � S)N� c s g | ] } � j � � � q Sr# )Zchoice)r/ Z_x)�r� select_fromr# r$ r2 � s z rand_str.<locals>.<listcomp>r )�randomZ SystemRandom�string�
ascii_letters�digitsr< �range)�strlenr� r# )r� r� r$ �rand_str� s r� c C s; | s d } x( t d d � d | } | | k r Pq W| S)Nr� r� � r )r� )Z
dictionaryZpostfixZnewkeyr# r# r$ �
rand_dict_key s r� c C s\ y t t | � d i �SWn; t k
rW } z | j t k rB i S� WYd d } ~ Xn Xd S)N�default)� load_yaml� load_file�IOError�errnor )r@ rh r# r# r$ � read_conf s r� c G s t t | � � S)N)�sorted�
uniq_merge)�listsr# r# r$ �uniq_merge_sorted s r� c G se g } xR | D]J } t | t � rJ | j � j d � } d d � | D� } | j | � q
Wt | � S)Nr3 c S s" g | ] } t | � r | � q Sr# )r9 )r/ �ar# r# r$ r2 + s z uniq_merge.<locals>.<listcomp>)rD rE r( r" �extend� uniq_list)r� Z
combined_list�a_listr# r# r$ r� % s
r� c C s� x, t j � D] \ } } | j | | � } q
Wg } x' | D] } | t k r< | j | � q< Wx | D] } | j | d � } qf W| j � } | S)Nr� )�FN_REPLACEMENTS�items�replace�
FN_ALLOWED�appendr( )�fnr0 r4 Zremovalsr# r# r$ �clean_filename0 s
r� Tc C s� yd t j t | � � } t j t j d d d | � � �' } | rR t | j � � S| j � SWd QRXWnD t k
r� } z$ | r� | St
t | � � | � WYd d } ~ Xn Xd S)N�rbro ) �io�BytesIOrM �
contextlib�closing�gzipZGzipFilerI �readrr rn rE )r1 �quietrF �bufZghrh r# r# r$ � decomp_gzip= s $r� c C s� | s
d S| j d d � } | d j � } t | � d k rQ | d j � } n d } | s| | d k s| | j � d k r� d } | s� | d k s� | j � d k r� d } | | f S)Nr. ro r r z-1Znone)NN)r" r( r9 r{ )Zug_pairZ ug_parted�u�gr# r# r$ �extract_usergroupM s %%r� c C s� t � } x� t j t j j | d � � D]h } t j j | � sC q( t j j | � d d � } | j � } | r( | j d � d k r( | | | <q( W| S)Nz*.pyr � r ro ������) r> �globr r[ r< �isfile�basenamer( �find)Zroot_dir�entriesr@ �modnamer# r# r$ � find_modules] s % r� c C s� | r t j j | � | r} d } t j j | � rg t | d � � } | j | � | j � Wd QRXn | r} t j j | � | r� | d d k r� | j | | d d � � n | j | | � d S)Nz /dev/console�wro �
r� r� )
�sys�stderr�writer r[ �exists�open�flush�stdoutr )rL Zconsoler� r Z log_levelZfallback_to_stdoutZconpathZwfhr# r# r$ � multi_logi s
r� c C s d t j � k S)NZLinux)�platform�systemr# r# r# r$ �is_Linux� s r� c C s d t j � k S)NZBSD)r� r� r# r# r# r$ �is_BSD� s r� c C s t � d d k S)N�variant�freebsd)� system_infor# r# r# r$ �
is_FreeBSD� s r� c C s t � d d k S)Nr� �netbsd)r� r# r# r# r$ � is_NetBSD� s r� c C s t � d d k S)Nr� �openbsd)r� r# r# r# r$ �
is_OpenBSD� s r� Fc C s | | k r | St | | � S)N)r� )�yobj�keyr� r# r# r$ �get_cfg_option_bool� s r� c C s9 | | k r | S| | } t | t � s5 t | � } | S)N)rD rE )r� r� r� rA r# r# r$ �get_cfg_option_str� s
r� c C s t t | | d | �� S)Nr� )r r� )r� r� r� r# r# r$ �get_cfg_option_int� s r� c C s� | s d } t j j | � s" i St | � } d } t j | | � } | r� | j � } | d j � j d � d | d <| d d k r� d | d <d | d d | d
d | d i Si S)
z�Return a dictionary of distro info fields from /etc/redhat-release.
Dict keys will align with /etc/os-release keys:
ID, VERSION_ID, VERSION_CODENAME
z/etc/redhat-releasezA(?P<name>.+) release (?P<version>[\d\.]+) \((?P<codename>[^)]+)\)�namez linuxr zred hat enterprise�redhat�ID�
VERSION_IDr �VERSION_CODENAMEr+ ) r r[ r� r� �re�match� groupdictr{ r7 )Z release_fileZredhat_releaseZ redhat_regexr� �groupr# r# r$ �_parse_redhat_release� s !
r� c C s� d } d } d } i } t j j d � r< t t d � � } | sK t � } | r� | j d d � } | j d d � } d | k s� d | k r� t j � } nL | j d d � } | s� t j
d | j d d � � } | r� | j � d
} | d k r�d } n� t � r't j
� j � } t j � } nm d } z) y t j � } Wn t k
rTYn XWd d } x | D] } | rfd
} qfW| s�t j d � X| S| | | f S)Nr� z/etc/os-releaser� r� �sles�suser� z [^ ]+ \((?P<codename>[^)]+)\)�VERSIONr+ �rhelr� ro zPUnable to determine distribution, template expansion may have unexpected results)r� r� r� )r r[ r� �load_shell_contentr� r� �getr� �machiner� r� r� r� r� r{ r! �distrr r: r; )Z distro_nameZdistro_versionZflavorZ
os_releaser� r� �found�entryr# r# r$ �get_linux_distro� sJ
r� c C s d t j � d t j � d t j � d t j � d t t j � � d t � i } | d j � } d } | d k r� | d d j � } | d k r� | } q� | d! k r� d } q� | d k r� d } q� | d" k r� d } q� d } n | d# k r� | } | | d <| S)$Nr� r� r! �pythonr r� �unknown�linuxr �alpine�arch�centos�debian�fedorar� r� �ubuntu� linuxmint�mintr� �opensuse�opensuse-tumbleweed�
opensuse-leapr� �sle_hpc�windows�darwinr� r� r� r� )r� r� r� r� r� zrhelzsuse)r� r� r� )r� r� r� zslesr� )r� zdarwinzfreebsdznetbsdzopenbsd)r� r� r! Zpython_versionrz r r� r{ )�infor� �varZ
linux_distr# r# r$ r� � s6
r� c C sv | | k r | S| | d k r$ g S| | } t | t � rT d d � | D� } | St | t � so t | � } | g S)a�
Gets the C{key} config option from C{yobj} as a list of strings. If the
key is present as a single string it will be returned as a list with one
string arg.
@param yobj: The configuration object.
@param key: The configuration key to get.
@param default: The default to return if key is not found.
@return: The configuration option as a list of strings or default if key
is not found.
Nc S s g | ] } | � q Sr# r# )r/ r4 r# r# r$ r2 3 s z'get_cfg_option_list.<locals>.<listcomp>)rD rz rE )r� r� r� rA Zcvalr# r# r$ �get_cfg_option_list! s
r� c C sS t | t � r | j d � } | } x( | D] } | | k rA | S| | } q+ W| S)a� Return the value of the item at path C{keyp} in C{yobj}.
example:
get_cfg_by_path({'a': {'b': {'num': 4}}}, 'a/b/num') == 4
get_cfg_by_path({'a': {'b': {'num': 4}}}, 'c/d') == None
@param yobj: A dictionary.
@param keyp: A path inside yobj. it can be a '/' delimited string,
or an iterable.
@param default: The default to return if the path does not exist.
@return: The value of the item at keyp."
is not found.�/)rD rE r" )r� Zkeypr� Zcur�tokr# r# r$ �get_cfg_by_path< s
r c C s, t | | � \ } } t | | � | | f S)N)�get_output_cfg�redirect_output)�cfg�mode�outfmt�errfmtr# r# r$ � fixup_outputT s
r c
C sX t t j j d � � r) t j d � d S| s8 t j } | sG t j } d d � } | rst j d | | � | j d d � \ } } | d k s� | d k r� d
} | d k r� d } t
| | � } nL | d k rt j | d
d d t j
d | �} | j } n t d | � � | r4t j | j � | j � � | | k rst j d | | � t j | j � | j � � d S| rTt j d | | � | j d d � \ } } | d k s�| d k r�d
} | d k r�d } t
| | � } nL | d k r"t j | d
d d t j
d | �} | j } n t d | � � | rTt j | j � | j � � d S)NZ_CLOUD_INIT_SAVE_STDOUTz5Not redirecting output due to _CLOUD_INIT_SAVE_STDOUTc S sI t j d � y t j d � j } Wn t k
r7 Yn Xt j | � d S)a� Reconfigure umask and group ID to create output files securely.
This is passed to subprocess.Popen as preexec_fn, so it is executed in
the context of the newly-created process. It:
* sets the umask of the process so created files aren't world-readable
* if an adm group exists in the system, sets that as the process' GID
(so that the created file(s) are owned by root:adm)
� ZadmN)r �umask�grp�getgrnam�gr_gid�KeyError�setgid)Zgroup_idr# r# r$ � set_subprocess_umask_and_gids s
z5redirect_output.<locals>.set_subprocess_umask_and_gidzRedirecting %s to %s� ro �>z>>�ab�wb�|�shellT�stdinZ
preexec_fnz"Invalid type for output format: %sz!Invalid type for error format: %s)r~ r �environr� r: rg r� r� r� r" r� �
subprocess�Popen�PIPEr � TypeError�dup2�fileno)
r r Zo_outZo_errr r �argZowithZnew_fp�procr# r# r$ r g s`
r r� c C s� | p d g } d } | r' t | � } | d k rE | d d | 7} | j | pT d � | j | pg d � | j | pz d � | j | p� d � | j | p� d � t j | � S)Nr� r. z%s)rE r� r Z
urlunparse) �scheme�hostZportr[ ZparamsZqueryZfragment�piecesZnetlocr# r# r$ �make_url� s r$ c C su | r t | � } i } xV | D]N } | r t j | � } | sL t j � } t j | � } | j | | � } q W| S)N)�reversedr
Zdict_extract_mergersZdefault_mergersZ construct�merge)Zsrcs�reverseZ
merged_cfgr Zmergers_to_applyZmergerr# r# r$ �
mergemanydict� s
r( c c s7 t j � } z t j | � | VWd t j | � Xd S)N)r �getcwd�chdir)ZndirZcurrr# r# r$ r* � s
r* c c s- t j | � } z | VWd t j | � Xd S)N)r r
)Zn_msk�oldr# r# r$ r
� s r
c C s d j | d | d d d | �S)Nz{0:{fill}{align}{size}}�fillZalign�^�size)�format)rL r, Zmax_lenr# r# r$ �center� s r0 c C s! t j d | � t j | � d S)NzRecursively deleting %s)r: rg �shutilZrmtree)r[ r# r# r$ �del_dir� s r2 � c C s� yA t | | | � \ } } } | | d <| | d <| | d <d SWnA t j k
r� } z | j t j k ro d S� WYd d } ~ Xn Xd S)Nz user-dataz vendor-dataz meta-dataTF)� read_seededr �UrlError�codeZ NOT_FOUND)r, �base�ext�timeout�md�ud�vdrh r# r# r$ �read_optional_seed� s
r= c C sM i } d d g } | r[ | j t j j | j d � d � t j j | j d � d � g � t | � } d d � | D� } d } xE | D]= } t j j t j j | d � � r� t j j | d � } Pq� Wd } xE | D]= } t j j t j j | d � � r� t j j | d � } Pq� W| r9| r9| | d <| | d
<n | rI| | d <| S) Nz/var/lib/cloud/data/sslz /var/lib/cloud/instance/data/sslr1 Zsslc S s. g | ]$ } | r t j j | � r | � q Sr# )r r[ �isdir)r/ �dr# r# r$ r2 s z%fetch_ssl_details.<locals>.<listcomp>zcert.pemzkey.pem� cert_file�key_file)r� r r[ r< Z
get_ipath_curZ get_cpathr� r� )�pathsZ ssl_detailsZssl_cert_pathsr@ r? rA r# r# r$ �fetch_ssl_details
s2 "
!
!
rC c C s� | } t | � } y� t j d t | � | � t j | � } | d k r_ t j d � | } n. t | | � s� t d | t j | � f � � | } Wn� t j
t t f k
r�} z� d } d } t | d � r� t
| d � r� t
| d � } n- t | d � r t
| d � r t
| d � } | rW| d j d | j d d
| j d d | � 7} n | d j d | � 7} t j | � WYd d } ~ Xn X| S)
NzKAttempting to load yaml from string of length %s with allowed root types %sz-loaded blob returned None, returning default.z2Yaml load allows %s root types, but got %s insteadzFailed loading yaml blobZ context_markZ problem_markz5. Invalid format at line {line} column {col}: "{err}"r? ro �colrC z. {err})rI r: rg r9 r �loadrD r r
rt Z YAMLError�
ValueError�hasattr�getattrr/ r? �columnr; )rG r� ZallowedZloadedZ convertedrh �msgZmarkr# r# r$ r� * s6
' r� �
c C s� | j d � d k rB | d | } | d | } | d | } n9 d | d | f } d | d | f } d | d | f } t j | d | d | �} d } | j � r� t t | j � d i �} t j | d | d | �}
d } |
j � r� |
j } d } y t j | d | d | �}
Wn8 t j k
rX} z t j d
| � WYd d } ~ Xn& X|
j � rq|
j } n
t j d � | | | f S) Nz%sr z user-dataz vendor-dataz meta-dataz%s%s%sr9 �retriesr� z!Error in vendor-data response: %sz Error in vendor-data response)
r� r Zread_file_or_url�okr� rI �contentsr5 r: rg )r7 r8 r9 rL Z file_retriesZud_urlZvd_urlZmd_urlZmd_respr: Zud_respr; r< Zvd_resprh r# r# r$ r4 L s6
#
r4 c s� t t j � � d d �} d d � | D� } � f d d � | D� } g } x0 | D]( } | j t t j j � | � � � qT Wt | � S)Nr' Tc S s% g | ] } | j d � r | � q S)z.cfg)�endswith)r/ �fr# r# r$ r2 v s z read_conf_d.<locals>.<listcomp>c s7 g | ]- } t j j t j j � | � � r | � q Sr# )r r[ r� r< )r/ rP )�confdr# r$ r2 y s )r� r �listdirr� r� r[ r< r( )rQ ZconfsZcfgsr� r# )rQ r$ � read_conf_dq s
&rS c C s� t | � } d } d | k rt | d } | r� t | t � s_ t d | t j | � f � � q� t | � j � } n t j j d | � r� d | } | s� t j j | � r� | St
| � } t | | g � S)NFZconf_dz8Config file %s contains 'conf_d' with non-string type %sz%s.d) r� rD rE r r
rt r( r r[ r> rS r( )Zcfgfiler rQ Z confd_cfgr# r# r$ �read_conf_with_confd� s
rT c C s t t d | � � S)N�cmdline)r� �read_cc_from_cmdline)rU r# r# r$ �read_conf_from_cmdline� s rW c C s� | d k r t � } d } d } t | � } t | � } t | � } g } | j | � } x� | d k r� | j | | | � } | d k r� | } | j t j | | | | � j � � j d d � � | j | | | � } q] Wd j | � S)Nzcc:Zend_ccr z\nr� ) � get_cmdliner9 r� r� r Zunquote�lstripr� r< ) rU Z tag_beginZtag_endZbegin_lZend_lZclen�tokensZbegin�endr# r# r$ rV � s$
*rV c C sC | j d � } | d k s/ | | d d k r3 | S| j d d � S)Nr� r ro �
z
)r� r� )rN �posr# r# r$ �dos2unix� s r^ c C s� d | k r8 | d } t | d | j d � d � } n� d | k r� | d j d � d k r� | d } | d d | j d � � } nC | j d d d | � } d | k r� | d } n | j d | � } | | f S)a� Get hostname and fqdn from config if present and fallback to cloud.
@param cfg: Dictionary of merged user-data configuration (from init.cfg).
@param cloud: Cloud instance from init.cloudify().
@param metadata_only: Boolean, set True to only query cloud meta-data,
returning None if not present in meta-data.
@return: a Tuple of strings <hostname>, <fqdn>. Values can be none when
metadata_only is True and no cfg or metadata provides hostname info.
�fqdn�hostnamer r NT�
metadata_only)r� r" r� � get_hostname)r Zcloudra r_ r` r# r# r$ �get_hostname_fqdn� s
"%
rc z
/etc/hostsc C s� d } y� x� t | � j � D]� } | j d � } | d k rM | d | � } | j � } | sb q | j � } t | � d k r� q | | d d � k r | d } Pq WWn t k
r� Yn X| S)a�
For each host a single line should be present with
the following information:
IP_address canonical_hostname [aliases...]
Fields of the entry are separated by any number of blanks and/or tab
characters. Text from a "#" character until the end of the line is a
comment, and is ignored. Host names may contain only alphanumeric
characters, minus signs ("-"), and periods ("."). They must begin with
an alphabetic character and end with an alphanumeric character.
Optional aliases provide for name changes, alternate spellings, shorter
hostnames, or generic hostnames (for example, localhost).
N�#r r� r ro )r� r6 r� r( r" r9 r� )r` �filenamer_ r? Zhashpos�toksr# r# r$ �get_fqdn_from_hosts� s$
rg c C sV t d k r� t � } d } i } x� | D]� } y� t j | d d d t j t j � } g | | <xM | D]E \ } } } } }
| | j d | |
d f � | j |
d � qf WWq( t j t j f k
r� Yq( Xq( W| a | r� t
j d | � y< t j | d � } | d d d } | t k r(d Sd
SWn" t j t j f k
rQd SYn Xd S) a� determine if a url is resolvable, return a boolean
This also attempts to be resilent against dns redirection.
Note, that normal nsswitch resolution is used here. So in order
to avoid any utilization of 'search' entries in /etc/resolv.conf
we have to append '.'.
The top level 'invalid' domain is invalid per RFC. And example.com
should also not exist. The '__cloud_init_expected_not_found__' entry will
be resolved inside the search list.
N�does-not-exist.example.com.�example.invalid.�!__cloud_init_expected_not_found__r z%s: %sz detected dns redirection: %s� FT)rh ri rj ) �_DNS_REDIRECT_IP�set�socketZ getaddrinfoZ SOCK_STREAMZ AI_CANONNAMEr� �addZgaierror�errorr: rg ) r� ZbadipsZbadnamesZ
badresultsZiname�resultZ_famZ_stypeZ_protoZcnameZsockaddrZaddrr# r# r$ �
is_resolvable s6
rr c C s t j � } | S)N)rn Z gethostname)r` r# r# r$ rb < s rb c C s5 y t j | � d SWn t j k
r0 d SYn Xd S)Nr )rn �
gethostbyaddrZherror)Zipr# r# r$ rs A s rs c
C s5 t d t j d d | d t d t j | � j f � S)z5determine if this url is resolvable (existing or ip).�logfuncrJ zResolving URL: �funcru )�log_timer: rg rr r Zurlparser` )Zurlr# r# r$ �is_resolvable_urlH s rw c C sn | d k r d St j d | � xG | D]? } y$ t | � rP t j d | � | SWq' t k
re Yq' Xq' Wd S)zc
Search through a list of mirror urls for one that works
This needs to return quickly.
Nz%search for mirror in candidates: '%s'zfound working mirror: '%s')r: rg rw rr )Z
candidatesZcandr# r# r$ �search_for_mirrorO s
rx c
C sX t t j j d � � r d St t j � �& } t j | j � t j j � � Wd QRXd S)z�
reopen stdin as /dev/null so even subprocesses or other os level things get
/dev/null as input.
if _CLOUD_INIT_SAVE_STDIN is set in environment to a non empty and true
value then input will not be closed (useful for debugging).
Z_CLOUD_INIT_SAVE_STDINN)
r~ r r r� r� �devnullr r r� r )�fpr# r# r$ � close_stdinb s r{ �devicec C s� g } | s& t j d � t j d � S| j d � rh | j d � } d d � d | d | g D� } n9 | d k r� t j d � } n | d k r� t j d � } | S)
Nz/dev/msdosfs/*z/dev/iso9660/*zLABEL=c S s( g | ] } t j j | � r | � q Sr# )r r[ r� )r/ �pr# r# r$ r2 x s z*find_devs_with_freebsd.<locals>.<listcomp>z
/dev/msdosfs/z
/dev/iso9660/z TYPE=vfatz TYPE=iso9660)r� �
startswithrY )�criteria�oformat�tag�no_cacher[ �devlist�labelr# r# r$ �find_devs_with_freebsdp s $ r� c
C s) g } d } d } | rT | j d � r6 | j d � } | j d � rT | j d � } t j d d d g d d g �\ } } x� | j � D]� }
| s� | r� t j d |
g d d d g �\ } } | r� d
| | k r� q� | d k r� d | k r� q� | d
k rd | k rq� | j d |
� q� W| S)NzLABEL=zTYPE=�sysctlz-nz hw.disknames�rcsr Z mscdlabelro z
label "%s"�iso9660zISO filesystem�vfatz/dev/)r~ rY r r" r� )
r r� r� r� r[ r� r� �_typer) �_err�devZ
mscdlabel_outr r# r# r$ �find_devs_with_netbsd� s( ' 'r� c
C s t j d d d g d d g �\ } } g } xn | j d � D]] } | j d � sU q= | d k rd q= | j d � ry d
n d } | j | d d � | � q= W| d
k r� d d � | D� } n8 | d k r� d d � | D� } n | r� t j d | � d d � | D� S)Nr� z-nz hw.disknamesr� r r3 r. zfd0:�cdr� �iro z TYPE=iso9660c S s% g | ] } | j d � r | � q S)r� )r~ )r/ r� r# r# r$ r2 � s z*find_devs_with_openbsd.<locals>.<listcomp>�LABEL=CONFIG-2� TYPE=vfatc S s% g | ] } | j d � s | � q S)r� )r~ )r/ r� r# r# r$ r2 � s zUnexpected criteria: %sc S s g | ] } d | � q S)z/dev/r# )r/ r� r# r# r$ r2 � s r� )r� r� )r r" rO r~ r� r: rg )
r r� r� r� r[ r) r� r� r� Zpart_idr# r# r$ �find_devs_with_openbsd� s ' r� c
C s� t � r t | | | | | � St � r> t | | | | | � St � r] t | | | | | � Sd g } g } | r� | j d | � | r� | j d | � | r� | j d d g � | r� | j d | � | r� | j | � | | } y% t j | d d d g �\ } } WnC t j k
rQ}
z |
j
t k r<d
} n � WYd d }
~
Xn Xg } x3 | j � D]% } | j
� } | re| j | � qeW| S) z�
find devices matching given criteria (via blkid)
criteria can be *one* of:
TYPE=<filesystem>
LABEL=<label>
UUID=<uuid>
�blkidz-t%sz-s%sz-cz /dev/nullz-o%sr� r r r� N)r� r� r� r� r� r� r� r� r r= r� r r6 r( )
r r� r� r� r[ Z
blk_id_cmdZoptions�cmdr) r� rh r� r? r# r# r$ �find_devs_with� sD
% r� c C s� | d k r g } n t | � } d d d g } | rI | j d d g � | j | � t j | d d d d
�\ } } i } xJ | j � D]< } | j d � \ } } } t | � | | <| | | d <q� W| S)
z�Get all device tags details from blkid.
@param devs: Optional list of device paths you wish to query.
@param disable_cache: Bool, set True to start with clean cache.
@return: Dict of key value pairs of info for the device.
Nr� z-oZfullz-cz /dev/nullr& TrF r� r. ZDEVNAME)rz r� r r6 r7 r� ) ZdevsZ
disable_cacher� r) r �retr? r� r1 r# r# r$ r� � s
!r� c C s= t j d | | � t | d � � } | j | � SWd QRXd S)Nz Peeking at %s (max_bytes=%s)r� )r: rg r� r� )r@ Z max_bytes�ifhr# r# r$ � peek_file s r� c C s: g } x- | D]% } | | k r% q
q
| j | � q
W| S)N)r� )Zin_listZout_listr� r# r# r$ r� s
r� c C s� t j d | | � t j � } y0 t | d � � } t | | d | �Wd QRXWn@ t k
r� } z | sm � | j t k r � WYd d } ~ Xn X| j � } t j d t
| � | � | r� t | � S| Sd S)NzReading from %s (quiet=%s)r� �chunk_cbzRead %s bytes from %s) r: rg r� r� r� � pipe_in_outr� r� r �getvaluer9 rI )r@ Zread_cbr� rF Zofhr� rh rN r# r# r$ r� s
r� c C s� t � rv y, t d � } | j d d � d d � } Wq� t k
rr } z t j d | � d } WYd d } ~ Xq� Xn1 y t d � j � } Wn t k
r� d } Yn X| S) Nz/proc/1/cmdline� r ro z"failed reading /proc/1/cmdline: %sr� z
/proc/cmdliner� )� is_containerr� r� rr r: r; r( )rN rU rh r# r# r$ � _get_cmdline. s
r� c C s! d t j k r t j d St � S)NZDEBUG_PROC_CMDLINE)r r r� r# r# r# r$ rX A s rX i c C sm d } xV | j | � } t | � d k r. Pq | j | � | t | � 7} | r | | � q W| j � | S)Nr )r� r9 r� r� )Zin_fhZout_fhZ
chunk_sizer� Z bytes_pipedr1 r# r# r$ r� H s
r� c C sI | d k r | d k r d St j d | | | � t j | | | � d S)Nro z%Changing the ownership of %s to %s:%sr� )Nr� r� )Nr� )r: rg r �chown)r@ �uid�gidr# r# r$ � chownbyidW s r� c C s� d } d } y4 | r' t j | � j } | r? t j | � j } Wn8 t k
rz } z t d | � | � WYd d } ~ Xn Xt | | | � d S)Nro zUnknown user or group: %sr� r� ) �pwd�getpwnamZpw_uidr r r
r rf r� )r@ �userr� r� r� rh r# r# r$ � chownbyname_ s &r� c
C s� d d g } | s d | k r# | S| d } | | k rF | | } n d | k rV | S| d } t | t � r{ | | g } t | t � r� t | � d k r� | d | d <t | � d k r� | d | d <t | t � r
d | k r� | d | d <d | k r
| d | d <| d d k r+| d | d <d d d g } x� t t | � � D]� } | | s`qM| | j � } d
} xJ | D]B } | j | � r}d | | t | � d � j � f } d } Pq}W| s�d d | j � f } | | | <qMW| S)
N�output�allr ro rp z&1z>>r r Fz%s %sT) rD rE rz r9 r> r� rY r~ r( )
r r r� ZoutcfgZmodecfgZswlistr� rA r� �sr# r# r$ r u sL
&r c C s� g } | s t | t � r! | S| j d � } | rC | j | � x� t | d � D]� } | sb qS t j d | � } | s} qS | j d � } | j � } t | � d k r� | j | � qS d d g | d d � k rS | j | d � qS Wt
t | � � S) z�Return a list of log file paths from the configuration dictionary.
@param cfg: The cloud-init merged configuration dictionary.
Z def_log_fileNz (?P<type>\||>+)\s*(?P<target>.*)r' ro �teez-ar ) rD r> r� r� r r� r� r� r" r9 rz rm )r ZlogsZ default_logZfmtr� r' �partsr# r# r$ �get_config_logfiles� s&
r� c G sN | r | j | | � t j � } | d k r4 d } | j | | d | �d S)N�exc_info)NNN)r; r� r� rg )r rJ ru r� r# r# r$ rs � s rs c C sP t j | � } | j t | � � | j � } | d k rH | d | � S| Sd S)Nr )�hashlib�new�updaterM Z hexdigest)rG ZroutineZmlenZhasherZdigestr# r# r$ � hash_blob� s r� c C s4 y t j | � r d SWn t k
r/ d SYn Xd S)NTF)r� r� r )r� r# r# r$ �is_user� s
r� c C s4 y t j | � r d SWn t k
r/ d SYn Xd S)NTF)r r r )r� r# r# r$ �is_group� s
r� c C s' t j d | | � t j | | � d S)NzRenaming %s to %s)r: rg r �rename)�src�destr# r# r$ r� � s r� i� c C s" x | D] } t | | � q Wd S)N)�
ensure_dir)�dirlistr r? r# r# r$ � ensure_dirs� s
r� c C sf t j t | � � } t | t | � � sb d j d d � | D� � } t d | t | � f � � | S)Nz, c S s g | ] } t | � � q Sr# )rE )r/ �tr# r# r$ r2 s z load_json.<locals>.<listcomp>z((%s) root types expected, got %s instead)�json�loadsrI rD r r< r �type)rL Z
root_typesrP Zexpected_typesr# r# r$ � load_json s r� c C sC y d j t | � � SWn% t k
r> d j t | � � SYn Xd S)z1Handler for types which aren't json serializable.z
ci-b64:{0}z)Warning: redacted unserializable type {0}N)r/ rR �AttributeErrorr� )Z_objr# r# r$ �json_serialize_default
s
r� c C sw t j | � } xa | j � D]S \ } } t | t � rG t | � | | <t | t � r d j t | � � | | <q W| S)a Preserialize any discovered binary values to avoid json.dumps issues.
Used only on python 2.7 where default type handling is not honored for
failure to encode binary data. LP: #1801364.
TODO(Drop this function when py2.7 support is dropped from cloud-init)
z
ci-b64:{0}) �obj_copy�deepcopyr� rD r> �json_preserialize_binaryrJ r/ rR )r1 r� �valuer# r# r$ r� s r� c C sw y) t j | d d d d d d d t �SWnG t k
rr t j d d
� d
k rk t | � } t j | � S� Yn Xd S)z%Return data in nicely formatted json.�indentro Z sort_keysTZ
separatorsr3 �: r� Nr � )r3 r� )r r� )r� �dumpsr� rN r� � version_infor� )r1 r# r# r$ �
json_dumps" s
r� c
C sf t j j | � sU t t j j | � d d �� t j | � Wd QRXt | | � n
t | | � d S)Nr\ T)r r[ r> rW �dirname�makedirs�chmod)r[ r r# r# r$ r� / s
r� c c s0 z | VWd | r+ d | g } t j | � Xd S)N�umount)r )r� Z
umount_cmdr# r# r$ � unmounter: s
r� c C sy i } yGt j j d � r6 t d � j � } d } n' t j d � \ } } | j � } d } d } x� | D]� } y | d k r� | j � \ } } } }
} } nN t j | | � }
|
j d � } |
j d � } |
j d � } |
j d � }
Wn t
k
rwj Yn X| j d d
� } d | d | d
|
i | | <qj Wt j
d | | � Wn% t t f k
rtt t d � Yn X| S)Nz /proc/mountsr �mountz*^(/dev/[\S]+) on (/.*) \((.+), .+, (.+)\)$ro r r� rk z\040r �fstype�
mountpoint�optszFetched %s mounts from %sz Failed fetching mount points)r r[ r� r� r6 r r" r� �searchr� rr r� r: rg r� rf rs )�mounted�
mount_locs�method� mountoutputr� ZmountreZmpliner� Zmpr� r� Z_freqZ_passno�mr# r# r$ �mountsD s8
!
r� c C s� t | t � r | g } nW t | t t f � r? t | � } n3 | d k rT d } n t d j d t | � � � � t � r� | d k r d g } ny t � r| d k r� d d d g } xR t | � D]8 \ } } | d k r� d | | <| d k r� d | | <q� Wn d g } t
� } t j � ��} d } t
j j | � | k r_| t
j j | � d
}
n� d } x� | D]� } d }
yf d d d g } | r�| j d | g � | j | � | j | � t j | d | �| } | }
PWqlt t f k
r'}
z! t j d | | |
� |
} WYd d }
~
XqlXqlW|
sKt d | | | f � � |
j d � sd|
d 7}
t | � �3 | d k r�| |
� } n | |
| � } | SWd QRXWd QRXd S)a2
Mount the device, call method 'callback' passing the directory
in which it was mounted, then unmount. Return whatever 'callback'
returned. If data != None, also pass data to callback.
mtype is a filesystem type. it may be a list, string (a single fsname)
or a list of fsnames.
Nz6Unsupported type provided for mtype parameter: {_type}r� Zauto�ufsZcd9660Zmsdosr� r� �msdosfsr� Fr� r� z-oZroz-tZ
update_envz Failed mount of '%s' as '%s': %sz#Failed mounting %s to %s due to: %sr� )zvfatr� )rD rE rz r r r/ r� r� r� � enumerater� r Ztempdirr r[ rb r� r� r r� rf r: rg rm rO r� )r| �callbackr1 ZmtypeZupdate_env_for_mountZmtypes�indexr� Ztmpdr� r� Zfailure_reasonZmountcmd�excr� r# r# r$ �mount_cbl sj
r� c C s
t j t � S)N)r� r� r r# r# r# r$ �get_builtin_cfg� s r� c C s t j d | � t j j | � S)Nz Testing if a link exists for %s)r: rg r r[ �islink)r[ r# r# r$ �is_link� s r� c C sI t j d | | � | r5 t j j | � r5 t | � t j | | � d S)Nz$Creating symbolic link from %r => %r)r: rg r r[ r� �del_file�symlink)rO �linkZforcer# r# r$ �sym_link� s
r� c C sb t j d | � y t j | � Wn: t k
r] } z | j t k rK | � WYd d } ~ Xn Xd S)NzAttempting to remove %s)r: rg r �unlinkrf r� r )r[ rh r# r# r$ r� � s r� c C s' t j d | | � t j | | � d S)NzCopying %s to %s)r: rg r1 �copy)r� r� r# r# r$ r� � s r� c C s; y t j d t j � � } Wn t k
r6 d } Yn X| S)Nz%a, %d %b %Y %H:%M:%S %zz??)�timeZstrftimeZgmtimerr )Ztsr# r# r$ � time_rfc2822� s
r� c s� d d l � d d l � d } G� f d d � d � j � } � j � j j d � � } � j � } � j | � | _ | � } | j d | � j
| � � j
| � d d � d k r� | j | j d St
d
� � d S) z�Use sysctlbyname(3) via ctypes to find kern.boottime
kern.boottime is of type struct timeval. Here we create a
private class to easier unpack it.
@return boottime: float to be compatible with linux
r Ns c s. e Z d Z d � j f d � j f g Z d S)zboottime.<locals>.timeval�tv_sec�tv_usecN)rj rk rl Zc_int64Z_fields_r# )�ctypesr# r$ �timeval� s r� �cs
kern.boottimero g ��.Az/Unable to retrieve kern.boottime on this systemr� )r� Z ctypes.utilZ StructureZCDLL�utilZ find_libraryZc_size_tZsizeofr� Z sysctlbynameZbyrefr� r� � RuntimeError)Z
NULL_BYTESr� Zlibcr. r� r# )r� r$ �boottime� s r� c C s� d } d } y` t j j d � rL d } t d � } | rk | j � d } n d } t t j � t � � } Wn# t k
r� t t
d | � Yn X| S)Nz??r� z /proc/uptimer r� z&Unable to read uptime using method: %s) r r[ r� r� r" rE r� r� rr rs r: )Z
uptime_strr� rN r# r# r$ �uptime� s
r� c C s t | | d d d d �d S)N�omoder r )�
write_file)r[ �contentr# r# r$ � append_file s r� i� �
preserve_mode)r r� �returnc
C s& t | d d d d d | d | �d S)Nr� r� r� r r r� )r� )r[ r r� r# r# r$ � ensure_file s r� c C s1 y t | � SWn t t f k
r, d SYn Xd S)N)r rF r )Z possible_intr# r# r$ �safe_int s r� c
C s@ t | � } | r< | r< t | � � t j | | � Wd QRXd S)N)r� rW r r� )r[ r Z real_moder# r# r$ r� " s
r� r �ensure_dir_existsc
! C s< | r@ y% t j | � } t j | j � } Wn t k
r? Yn X| r\ t t j j | � � d | j � k r� t | � } d } n t
| � } d } y d | } Wn t k
r� d | } Yn Xt j
d | | | t | � | � t d | � �5 t | | � � } | j | � | j � Wd QRXWd QRXt | | � d S) a�
Writes a file with the given content and sets the file mode as specified.
Restores the SELinux context if possible.
@param filename: The full path of the file to write.
@param content: The content to write to the file.
@param mode: The filesystem mode to set on the file.
@param omode: The open mode used when opening the file (w, wb, a, etc.)
@param preserve_mode: If True and `filename` exists, preserve `filename`s
current mode instead of applying `mode`.
@param ensure_dir_exists: If True (the default), ensure that the directory
containing `filename` exists before writing to
the file.
�brJ Z
charactersz%oz%rz Writing to %s - %s: [%s] %s %sr[ N)r rd �S_IMODE�st_moderf r� r[ r� r{ rM rI r r: rg r9 rW r� r� r� r� )
re r� r r� r� r� Z file_statZ
write_typeZmode_rZfhr# r# r$ r� ) s0
r� c C s\ xU t j | � D]D } t j j | | � } t j j | � rJ t | � q t | � q Wd S)z�
Deletes all contents of a directory without deleting the directory itself.
@param dirname: The directory whose contents should be deleted.
N)r rR r[ r< r> r2 r� )r� ZnodeZ
node_fullpathr# r# r$ �delete_dir_contents] s
r rd Zcreatedc C sG t j � } t | � } | d | j � | f 7} | d t � 7} | S)Nz %s by cloud-init v. %sz on %s)r Zversion_stringrE �titler� )Z comment_charr7 Zci_ver�headerr# r# r$ � make_headerk s
r c G s t j j t j j | | � � S)N)r r[ �abspathr< )r7 rB r# r# r$ �abs_joins s r c C s5 t | t t f � s. t d t j | � � � d } | rD | d 7} d } d } x� | D]� } t | t t f � r� g } x1 | D]) } | j d t | � j d | � � q Wd | d
j | � f } | d 7} qW t | t � r� d | | f } | d 7} qW t d t j | � | f � � qW Wt
j d
| � | S)Nz8Input to shellify was type '%s'. Expected list or tuple.r� z
#!/bin/sh
z%s%s%s%s�'�\r z'%s'z%s%s
r ro zCUnable to shellify type '%s'. Expected list, string, tuple. Got: %szShellified %s commands.)r r r r z'\'') rD r rz r r
rt r� rE r� r< r: rg )ZcmdlistZ
add_headerr� ZescapedZ cmds_maderu ZfixedrP r# r# r$ �shellify{ s0
'
r
c C s[ | r+ | j | � r+ | t | � d � } | rW | j | � rW | d t | � � } | S)N)r~ r9 rO )r? �prefix�suffixr# r# r$ �strip_prefix_suffix� s
r
c C sN t j | d � d k r d Sy t j | � Wn t j k
rI d SYn Xd S)Nr FT)r �whichr= )r� r# r# r$ �_cmd_exits_zero� s r c C s t d d d g � S)Nzsystemd-detect-virtz--quietz --container)r r# r# r# r$ �_is_container_systemd� s r c C s
t d g � S)Nzrunning-in-container)r r# r# r# r$ �_is_container_upstart� s r c C s
t d g � S)Nzlxc-is-container)r r# r# r# r$ �_is_container_old_lxc� s r c C s^ t � s
d Sd d d g } t j | d � d k r9 d St j | � \ } } | j � d k S)NFr� z-qnzsecurity.jail.jailedr r )r� r r r( )r� r) r r# r# r$ �_is_container_freebsd� s r c C s' t t t t f } x | D] } | � r d Sq Wy0 t d � } d | k rO d Sd | k r_ d SWn t t f k
rz Yn Xt j j d � r� t j j d � r� d Syd t
d � j � } xK | D]C } | j d � r� | j
� j d d � \ } } | d
k r� d Sq� WWn t t f k
r"Yn Xd S) zH
Checks to see if this code running in a container of some sort
Tro Z containerZLIBVIRT_LXC_UUIDz/proc/vzz/proc/bcz/proc/self/statuszVxID:r. r F)r r r r � get_proc_envr� rf r r[ r> r� r6 r~ r( r" )Zchecks�helperZpid1env�linesr? Z_keyrA r# r# r$ r� � s6
%
r� c C s t j j d � S)z2Check to see if we are running in a lxd container.z
/dev/lxd/sock)r r[ r� r# r# r# r$ �is_lxd� s r r� c C s� t j j d t | � d � } y t | d d �} Wn t t f k
rR i SYn Xi } d
\ } } | r� d \ } } | j | | � } xH | j | � D]7 } | s� q� | j | d � \ } }
| r� |
| | <q� W| S) aH
Return the environment in a dict that a given process id was started with.
@param encoding: if true, then decoding will be done with
.decode(encoding, errors) and text will be returned.
if false then binary will be returned.
@param errors: only used if encoding is true.z/procr rF F� � =r� �=ro )r r )r� r ) r r[ r< rE r� r� rf rF r" ) �pidrH �errorsr� rN �envZnullZequalr r� rA r# r# r$ r � s" r c C sh i } x[ | j � D]M } y | j d d � \ } } Wn t k
rU | } d } Yn X| | | <q W| S)Nr ro T)r" rF )Zkvstringr� r r� rA r# r# r$ �keyval_str_to_dict s
r c C s3 | j d � r | d d � } t j j d | � S)Nz/dev/r3 z /sys/class/block/%s/partition)r~ r r[ r� )r| r# r# r$ � is_partition s r c C s� t | t � s | g } g } x� | D]� } t | t � rJ | j | � q% t | t t f � r� t | � d k s� t | � d k r� t d � � t | � d k r� | d r� | j | t | � � q% | j | d � q% t d � � q% W| S)Nro r z Invalid package & version tuple.r zInvalid package type.)rD rz rE r� r r9 r� )Z version_fmtZpkgsZpkglist�pkgr# r# r$ �expand_package_list' s
$ r! c C s6 d d � | j d � D� } d } d } d } d } x�t | � D]�\ } }
|
j � } t | � d k r� | j d | d t | � |
� d S| d } d d � | j d � D� }
t |
� t | � k r� qA t t |
� t | � � } |
d
| � | d
| � k rqA | d k r5t | � t |
� k r5qA y | j d � } Wn- t k
rw| j d | d |
� d SYn Xy | | d } | | d
} Wn- t k
r�| j d | d |
� d SYn X| } |
} | d } qA W| r| r2| r2| r2| r2| | | | f Sn | r2| r2| r2| | | f Sd S)zRReturn the mount information for PATH given the lines from
/proc/$$/mountinfo.c S s g | ] } | r | � q Sr# r# )r/ rh r# r# r$ r2 F s z$parse_mount_info.<locals>.<listcomp>r� NrK z$Line %d has two few columns (%d): %sro rk c S s g | ] } | r | � q Sr# r# )r/ rh r# r# r$ r2 Z s r �-z,Did not find column named '-' in line %d: %sr z/Too few columns after '-' column in line %d: %sr3 )r" r� r9 rg �minr� rF �
IndexError)r[ Zmountinfo_linesr � get_mnt_optsZ
path_elements�devpth�fs_typeZmatch_mount_pointZmatch_mount_point_elementsr� r? r� � mount_pointZmount_point_elements�xZ
mount_optionsr# r# r$ �parse_mount_infoB sV
r* c C sY xR t d � j � D]> } | j � d d � \ } } } | | k r | | | f Sq Wd S)z<On older kernels there's no /proc/$$/mountinfo, so use mtab.z /etc/mtabNr� )r� r6 r" )r[ r? r& r( r' r# r# r$ �
parse_mtab� s
r+ c C s� | j d � } t | � d k r) | d S| d d k r� | d d � } t j d d d
g � \ } } xP | j d � D]? } | j � } t | � d k rw | d | k rw | d } Pqw Wt | � St j d
| � d S)Nr� r� r r� �gptr� r3 Zglabel�statusz-sr� r z)Unexpected input in find_freebsd_part: %s)zlabelr, zufs)r" r9 r rE r: r; )ZfsZsplittedZ target_labelrT r� Zlabelsr� r# r# r$ �find_freebsd_part� s "
r. c C sc d } xV | j d � D]E } | j � } t | � d k r t j j | d | � r | } Pq W| S)Nr� r ro )r" r9 r r[ r� )r[ �mnt_list�
path_foundr? r� r# r# r$ �get_path_dev_freebsd� s ,r1 c C s� t j d d | g d d d g �\ } } t | � rv t j d d g � \ } } t | | � } | d k rp d S| } | j � } t | d � } d | | d | d f S)Nr� z-pr� r ro z/dev/r )r r9 r1 r" r. )r[ rq rC r/ r0 r� Z
label_partr# r# r$ �get_mount_info_freebsd� s * r2 c C s t j j d � s# t j d � d Sy" t j d d | g � \ } } Wn? t j k
r� } z t j d | | � d SWYd d } ~ Xn Xt | � r� d Sd } xh | j d � D]W } t
j | | � r� | | k r� d | k r� | j � d } t j d
| | � | Sq� Wd S) Nz/dev/zfsz"Cannot get zpool info, no /dev/zfs�zpoolr- z$Unable to get zpool status of %s: %sz .*(ONLINE).*r� �stater zfound zpool "%s" on disk %s) r r[ r� r: rg r r= r; r9 r" r� r� )r3 Z zpoolstatusrC r� r? Zdiskr# r# r$ �get_device_info_from_zpool� s
" *r5 c C s t j d g � \ } } | j � } d } x� | D]� } t j | | � } | sR q1 | j d � } | j d � } | j d � } | d k r� | j d � } t j d | | | � t j d | � }
|
r� t � r� | d k r� t | � S| | k r1 | | | f Sq1 Wd S)
Nr� zH^(/dev/[\S]+|.*zroot\S*?) on (/[\S]*) (?=(?:type)[\s]+([\S]+)|\(([^,]*))ro r r� rk z?found line in mount -> devpth: %s, mount_point: %s, fs_type: %sz^(/dev/.+)p([0-9])$Zzfs) r r6 r� r� r� r: rg r� r2 ) r[ r� r� r� Zregexr? r� r& r( r' Zdevmr# r# r$ � parse_mount� s(
r6 c C sq d t j � } t j j | � rG t | � j � } t | | | | � St j j d � rc t | � St | � Sd S)Nz/proc/%s/mountinfoz /etc/mtab) r �getpidr[ r� r� r6 r* r+ r6 )r[ r r% Zmountinfo_pathr r# r# r$ �get_mount_info� s
r8 c $ C s. | d k r g } | d k r$ i } t j � } d } | rd y t t � � } Wn t k
rc Yn Xz | | | � } Wd t j � | } d }
| d k r� y t t � � | }
Wn t k
r� Yn Xd | } | rt |
t � r� | d |
7} n
| d 7} y | | | � Wn t k
r(Yn XX| S)Nz took %0.3f secondsz (%0.2f)z (N/A))r� �floatr� rF rD rr ) rt rJ ru ru rv Z
get_uptime�startZustartr� ZdeltaZudeltaZtmsgr# r# r$ rv s<
rv c C s6 | j d d � } t | � d k r( | S| d f Sd S)Nr ro )�rsplitr9 )Zdottedrf r# r# r$ �expand_dotted_devnameC s r< c C s� | d k r g } | d k r$ g } g } i } x� | | D]� } y( t | | | d d d d �| | <Wq; t k
r� } z0 | j t k r� � | | k r� | j | � WYd d } ~ Xq; Xq; Wt | � r� t d j d d j | � � � � | S)Nr� FrF z Missing required files: {files}�filesr3 ) r� r� r� r r� r9 rF r/ r< )r7 ZrequiredZoptionalZdelimrB r� rP rh r# r# r$ �pathprefix2dictK s$ ( $ r> z
/proc/meminfoc
C s� d d d d d d d d i } d
d d d
d d i } i } x� t | � j � D]� } y | j � \ } } } Wn* t k
r� | j � \ } } d } Yn X| r� t | � | | | | <qO | | k rO t | � | | | | | <qO W| S)NZkBr rK ZmB� �Bro ZgB� z MemTotal:ZtotalzMemFree:Zfreez
MemAvailable:Z availablei i i @)r� r6 r" rF r ) Zmeminfo�raw�mpliersZkmapr� r? r� r� Zunitr# r# r$ � read_meminfoe s
rD c C s | } | j d � r% | d d � } d d d d d d d d d d i } | } d } x: | D]2 } | j | � r\ | } | d
t | � � } q\ Wy t | � } Wn8 t k
r� } z t d | � | � WYd d } ~ Xn X| d
k r� t d | � � t | | | � S)zbConvert human string or integer to size in bytes
10M => 10485760
.5G => 536870912
r@ Nro �Kr rK �Mr? �GrA �T�( r z'%s' is not valid input.z'%s': cannot be negativer� i i i @l )rO r9 r9 rF r )r. Zsize_inrC ZnumZmplierr� rh r# r# r$ � human2bytesz s" $
& rJ c C sR | d k r t j � d } | d k pK | d d k oK | d d � d k } | S)z$Return True if platform is x86-basedNrk Zx86_64r r� r Z86)r r )Z
uname_archZx86_arch_matchr# r# r$ �is_x86� s
&rK c C s< t j d d � d k r/ t j t j | � � St j | � S)Nr r� )r r� )r� r� �emailZmessage_from_filer� �StringIO�message_from_string)r� r# r# r$ rN � s rN c C s� t j d d g d | d d �\ } } t � } x� | j � D]w } y | j d d � \ } } } Wn t k
ry w= Yn X| j d � s� | j d � r= | j t j d d
| � � q= W| S) Nz
dpkg-queryz--listr' r& Tr �hiZiiz:.*r� ) r rm r6 r" rF r~ ro r� �sub)r' r) r Z pkgs_instr? r4 r r# r# r$ �get_installed_packages� s '
rQ c C s� d } y> t t | d d �� } | j d d � j � d k rC d SWn8 t k
r~ } z t j d | | � WYd d } ~ Xn Xt � } d | k r� d St d d d �} d | j � k r� d St j j
d
� r� d Sd S) Nz/etc/os-releaser� Tr� r� z ubuntu-corez!Unexpected error loading '%s': %sz
snap_core=z /etc/system-image/channel.iniz/etc/system-image/config.d/F) r� r� r� r{ rF r: r; rX r r[ r> )ZorpathZorinforh rU r� r# r# r$ �system_is_snappy� s & rR c C s> g } x( | j d � D] } | j | | � q Wd j | � S)zBreplacement for indent from textwrap that is not available in 2.7.Tr� )r6 r� r< )rL r r r? r# r# r$ r� � s r� c C s d } x4 | j � D]& } | j d � r | d d � } Pq W| d k rM d S| j d � r` | S| j d � r� d | t d � d � S| j d � r� d | t d � d � j � S| j d � rd | t d � d � j � } t j j | � r� | St | � } | r| d
S| Sd | S) Nzroot=r3 z/dev/zLABEL=z/dev/disk/by-label/zUUID=z/dev/disk/by-uuid/z PARTUUID=z/dev/disk/by-partuuid/r )r" r~ r9 r{ r r[ r� r� )rU r� r Z
disks_pathZresultsr# r# r$ �rootdev_from_cmdline� s. rS c C sg d d � } i } xN | | � D]@ } | j d d � \ } } | sI | } | sU | r | | | <q W| S)z�Given shell like syntax (key=value
key2=value2
) in content
return the data in dictionary form. If 'add_empty' is True
then add entries in to the returned dictionary for 'VAR='
variables. Set their value to empty_val.c S s t j | d d �S)NZcommentsT)�shlexr" )rG r# r# r$ � _shlex_split� s z(load_shell_content.<locals>._shlex_splitr ro )r" )r� Z add_emptyZ empty_valrU r1 r? r� r� r# r# r$ r� � s r� g �?c C s� t | � } d } x� | t d d � | D� � 8} t | � d k r^ t j d | | | � g S| d k r� t j d | | | � | | | k r� Pt j | � | | 7} q Wt j d | | | � | S)Nr c S s( g | ] } t j j | � r | � q Sr# )r r[ r� )r/ rP r# r# r$ r2
s z"wait_for_files.<locals>.<listcomp>z)%sAll files appeared after %s seconds: %sz6%sWaiting up to %s seconds for the following files: %sz*%sStill missing files after %s seconds: %s)rm r9 r: rg r� Zsleep)ZflistZmaxwaitZnaplenZlog_preZneedZwaitedr# r# r$ �wait_for_files
s$
rV c C s3 t | d d �} | d j d � } | d d k S)z1Check whether the given mount point is mounted rwr% Tro r3 r Zrwr� )r8 r" )r( rq Z
mount_optsr# r# r$ �mount_is_read_write
s rW c C sc d d g } | r< t j j | � r( d S| j d | g � | rV | j d | g � t j | � S)zAInvoke udevadm settle with optional exists and timeout parametersZudevadmZsettleNz--exit-if-exists=%sz --timeout=%s)r r[ r� r� r )r� r9 Z
settle_cmdr# r# r$ �udevadm_settle%
s rX c C s� d } y t d | d d �} Wn8 t k
rZ } z t j d | | � WYd d } ~ Xn X| r� | j d d � } t | d � } | S)
z-
Return the parent pid of a process.
r z
/proc/%s/statr� Tz Failed to load /proc/%s/stat. %sNr rk r� )r� r� r: r; r" r )r ZppidrN rh r� r# r# r$ �
get_proc_ppid3
s &rY )ztruer r zyes)r r znozfalse)�r� r� r� rL r� r r� r� r� r� r �os.pathr� r� r� r� rT r1 rn rd r� r r� r� �base64r r r� r � functoolsr Zurllibr Z cloudinitr r Zloggingr r
r r r
r r Zcloudinit.settingsr rl Z getLoggerrj r: �sepr� r� r� r� ry r r% r* r- rI rM rQ rR rV �objectrW rr rm rn rw r~ r� r� r� r� r� r� r� r� r� r� r� �DEBUGr� r� r� r� r� r� r� r� r� r� r� r� r� r r r r$ r( �contextmanagerr* r
r0 r2 r= rC r> r� r4 rS rT rW rV r^ rc rg rr rb rs rw rx r{ r� r� r� r� r� r� r� r� r� rX r� r� r� r r� rs r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r rx r� r� r� r� r r r r
r
r r r r r r� r r r r r! r* r+ r. r1 r2 r5 r6 r8 rv r< r[ r> rD rJ rK rN rQ rR r� rS r� rV rW rX rY r# r# r# r$ �<module> s� .
'
3$ Q
"% ( , =
:
(K
-
. J
#''
Mini Shell