Your IP : 216.73.216.52
U
�Ad�� � @ sN d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dlm Z d dl
m Z e � � d dl
mZ d dlmZ d dlmZ d dlmZ d d lmZ d d
lmZ d d lmZ d d lmZ d d
lmZ d dlmZ d dlmZ d dlmZ d dl m Z m Z m Z m Z d dlm!Z! d dl"m#Z# d dlm$Z$ d dl%m&Z& dZ'dZ(e e e d�Z)e�*� Z+dHdd�Z,dId d �Z-d d � Z.d d!� Z/e d"�d#d$�Z0d%d&� Z1dJd(d)�Z2dKee3e4f d+�d,d-�Z5d.d/� Z6d0d1� Z7d2d3� Z8d4d5� Z9d6d7� Z:d8d9� Z;dLd:d;�Z<ej=d<�d=d>�Z>d?d@� Z?dAdB� Z@dMdCdD�ZAeBdEk�rJdFejCk�r0dGejCdF< eAejD�ZEeE�rJe�FeE� dS )N� N)�Tuple)�patcher)�Modules)�validate_cloudconfig_schema)�log)�netinfo)�signal_handler)�sources)�stages)�
url_helper)�util)�version)�warnings)� reporting)�events)� PER_INSTANCE�
PER_ALWAYS�PER_ONCE� CLOUD_CONFIG)�
atomic_helper)�cc_set_hostname)�
dhclient_hook)�read_cfg_pathszOCloud-init v. {version} running '{action}' at {timestamp}. Up {uptime} seconds.zcloud_%s_modules)�instance�always�once� c C sV | rt j�d| � t j�d� t j�d� tjt jd� t j�d� t j�d� d S )N�%s
z<------------------------------------------------------------�
)�file)�sys�stderr�write� traceback� print_exc��msg� r' �4/usr/lib/python3/dist-packages/cloudinit/cmd/main.pyr$ L s r$ c C s& |s t | �}tjd| ddtd� |S )Nr FT)Zconsoler! r )�welcome_formatr Z multi_log�LOG)�actionr& r' r' r( �welcomeV s r, c C s t jt�� t�� t�� | d�S )N)r
�uptimeZ timestampr+ )�WELCOME_MSG_TPL�formatr
�version_stringr r- Z time_rfc2822�r+ r' r' r( r) ] s �r) c C s. g }| j r*| j D ]}|�tj�|j�� q|S )N)�files�append�os�path�realpath�name)�argsZfn_cfgsZfhr' r' r( � extract_fnsf s
r9 )�modsc C sv t | }| �|�\}}t|�t|� }|dkrXd||f }tj�d| � t�|� g S t�dt|�t|�� |S d S )Nr z)No '%s' modules to run under section '%s'r z Ran %s modules with %s failures)�MOD_SECTION_TPLZ run_section�lenr r! r" r* �debug)r: � action_nameZsectionZfull_section_name� which_ran�failuresZtotal_attemptedr& r' r' r( �run_module_sections s" �
�rA c C s | � d�rt�| � d�� d S )Nr )�getr Zupdate_configuration)�cfgr' r' r( �apply_reporting_cfg� s
rD ��cloud-config-url�urlc C s@ t �| �}|D ] }||kr||| f S qtd| |f ��d S )Nz!No keys (%s) found in string '%s')r Zkeyval_str_to_dict�KeyError)�cmdline�names�data�keyr' r' r( �parse_cmdline_url� s
rM T)�returnc
C s2 |dkrt �� }zt|�\}}W n tk
r> tjdf Y S X |�d�pR|�d�}|r�tj� | �r�|r�d| |f }tj
}|r�tj}nd| |f }tj }||fS |ddd d
�}|s�|r�tj }d |d < ntj}d
|d < d} d}
z�t j
f |�} d} | �� �r�d }
t| t j��rPz | t| jt|
�d��7 } W n tk
�r< Y nX | �|
��sbd}
n| j�|
��sbd}
|
�r~|dk�r�t�d� n2|dk�r�tj }ntj
}|d|� dt|
�� �fW S n|d|| jf fW S | | j } W n: t jk
�r } z|d||f f W Y �S d}~X Y nX t j| | dd� tj
d||| f fS ) a� Write data from url referenced in command line to path.
path: a file to write content to if downloaded.
network: should network access be assumed.
cmdline: the cmdline to parse for cloud-config-url.
This is used in MAAS datasource, in "ephemeral" (read-only root)
environment where the instance netboots to iscsi ro root.
and the entity that controls the pxe config has to configure
the maas datasource.
An attempt is made on network urls even in local datasource
for case of network set up in initramfs.
Return value is a tuple of a logger function (logging.DEBUG)
and a message indicating what happened.
Nz!No kernel command line url found.zfile://�/z_file '%s' existed, possibly from local stage download of command line url '%s'. Not re-writing.zafile '%s' existed, possibly from previous boot download of command line url '%s'. Not re-writing.�
� T)rG ZtimeoutZretries�stream� Z sec_betweeng�������?s
#cloud-config� )Z
chunk_sizeFrG z�DEPRECATED: `url` kernel command line key is deprecated for providing cloud-config via URL. Please use `cloud-config-url` kernel command line parameter insteadrF z
contents of 'z' did not start with z$url '%s' returned code %s. Ignoring.z retrieving url '%s' failed: %si� )�modez*wrote cloud-config data from %s='%s' to %s) r Z get_cmdlinerM rH �logging�DEBUG�
startswithr4 r5 �exists�INFO�WARNr Zread_file_or_url�ok�
isinstanceZ UrlResponse�nextZ iter_contentr< �
StopIteration�contentsr* �warning�str�codeZUrlError�
write_file)r5 �networkrI Z cmdline_namerG Z
path_is_local�m�level�kwargsrK �headerZrespZsniffed_contentZ is_cloud_cfg�er' r' r( �attempt_cmdline_url� s� ����
�
�
� �&��rk c C s� dt jjt jjf }tj�| j�d�d�}tj� |�rlt
|�� � }||kr�t �
d� | �d� t�||� n*tj� | j�d��r�t �d� t�||� dS ) z�Purge the cache if python version changed on us.
There could be changes not represented in our cache (obj.pkl) after we
upgrade to a new version of python, so at that point clear the cache
z%d.%drK zpython-versionz-Python version change detected. Purging cacheTZobj_pklzMWriting python-version file. Cache compatibility status is currently unknown.N)r � version_info�major�minorr4 r5 �join�paths� get_cpathrY �open�readr* r= � purge_cacher rd �
get_ipath_cur�info)�initZcurrent_python_versionZpython_version_pathZcached_python_versionr' r' r( �$purge_cache_on_python_version_change� s& �
�
�rx c C s t �| jd�rdS |j S )NZdisable_network_activationF)r �get_cfg_option_boolrC �local)rw r8 r' r' r( �_should_bring_up_interfaces s r{ c C s t jt jg}|jrt jg}ttj�dt d�|j d�g}|jsJt | �}n t d| �}t
j ||j d�}|�
t|�� d }d }z.|�tjdf� t�� t�|j| �\}}W n< tk
r� d}t�t|� t|� |�tj|f� Y nX |j�rt�d� t� � t� |j� t |j� t | |d � |D ]\} }t� | |� �q(z |�!� W n" tk
�rn t�td
� Y nX |j"}
t#|� |j�r�t j$nt j%} | t j%k�r�d } t&j'�(d t)�*� � nZd
} t�+|jdd�}
|
�r�t�d� d } n(|
�,d�}tj�-|��r
t�d|� d } |�.� t/||�}zD|j0| d� | t j%k�r^|j1j2| k�r^t�d| |j1� d g fW S W n� t j3k
�r� | t j$k�r�t�d� n t�td� |j4�s�|j5|d� t�d| � | t j$k�r�d g f Y S d dgf Y S n t�d| � Y nX t6|� |�7� }t�d| | ||�8� � | t j$k�r2t9|d d d � |j5|d� | t j$k�r�|j1j2| k�rrt�d | |j1� |j1g fS t�d | |j1� |�:� |�;� t9|d!d"d � z2|�<� j=d#|j>t?gt?d$�\}}|�s�|�>t@� W n. tk
�r t�td%� |j1d%gf Y S X tj�-|j"�,d&���r,tA|jddd'd(� n
t�d)� t |j� tB|t|�|j d*�}zR|}|}t�C|j| �\}}||k�s�||k�r�t�Dd+||� t�|j| �\}}W n" tk
�r� t�td,� Y nX t� |j� |�E� tF|j1|jd-� |j1tG|| | �fS ).Nz%s.dz91_kernel_cmdline_url.cfg)r5 re z%s-local�Zds_deps�reporterzClosing stdin.�#Failed to setup output redirection!�@Logging being reset, this logger may no longer be active shortlyr% z0Failed to initialize, likely bad things to come!�trustr ZcheckZmanual_cache_cleanFz"manual cache clean set from configZmanual_clean_markerz(manual cache clean found from marker: %s��existingz)[%s] Exiting. datasource %s in local modezNo local datasource foundz8No instance datasource found! Likely bad things to come!)Zbring_upz [%s] Exiting without datasourcez No instance datasource found.z2[%s] barreling on in force mode without datasourcez5[%s] %s will now be targeting instance id: %s. new=%srz re )�stage� retry_stagez.[%s] Exiting. datasource %s not in local mode.z6[%s] %s is in local mode, will apply init modules now.zinit-netzmodules:config� consume_data)r8 ZfreqzConsuming user data failed!Z userdata_rawT)�config�strictZ log_detailsZlog_deprecationsz2Skipping user-data validation. No user-data found.�r} z#Stdout, stderr changing to (%s, %s)z'Failed to re-adjust output redirection!)�
datasourcerC )Hr ZDEP_FILESYSTEMZ DEP_NETWORKrz rk r4 r5 ro r r) r
�Initr} �read_cfgr9 r3 rV rW r � close_stdin� fixup_outputrC � Exception�logexcr* r$ r[ r= � resetLogging� setupLoggingrD r, r Z
initializerp rx Z DSMODE_LOCALZDSMODE_NETWORKr r! r" r Z
debug_infory ru rY rt r{ �fetchr� Zdsmode�DataSourceNotFoundException�forceZapply_network_config� _maybe_persist_instance_dataZ
instancifyZis_new_instance�_maybe_set_hostnameZsetup_datasource�update�cloudify�runr� r r r r Zget_output_cfgra Zactivate_datasource�di_report_warnrA )r7 r8 ZdepsZ
early_logs�w_msgrw ZoutfmtZerrfmtr& ZlvlZ path_helperrU r� ZmcfgZmfileZbring_up_interfacesZiidZranZ_resultsr: Z outfmt_origZ errfmt_origr' r' r( � main_init# s& ���
�
� � �
� �
��
�
r� c C s� d|krt �d� d S |d }|d kr4t �d� d S t|t�sNt �d|� d S |�d�}|d krnt �d� d S t|t�s�t �d|� d S | j�d�d }|� t
j �r�|t t
j �d � }nt �d
| |� ||kr�t �d | ||� d S t
jd ||t|�d
� d S )NZ di_reportz no di_report found in config.zdi_report was None.z%di_report config not a dictionary: %sZdatasource_listz(no 'datasource_list' found in di_report.z(di_report/datasource_list not a list: %s�.rQ z1Datasource '%s' came from unexpected module '%s'.z:used datasource '%s' from '%s' was in di_report's list: %sZdsid_missing_source)�source�dslist)r* r= r] �dictra rB �list�
__module__�
rpartitionrX r Z DS_PREFIXr< r Z show_warningrb )r� rC Zdicfgr� �modnamer' r' r( r� sN
�� �r� c C s2 |j }td| |f �}tjg |jd�}|�t|�� z|jdd� W nB tj k
r� d| }t
� t |� t
|� |js�|g Y S Y nX t|� t|t|�|jd�}z$t �d� t
�� t
�|j|� W n tk
r� t
� t d� Y nX |j�rt �d � t�� t�|j� t|j� t||d
� t|||�S ) Nz%s:%sr| r� r� zGCan not apply stage %s, no datasource found! Likely bad things to come!r� �
Closing stdinr~ r r% ) rU r) r
r� r} r� r9 r� r r� r r� r* r$ r� r� r r= r� r� rC r� rV r� r� rD r, rA )r> r8 r7 r� rw r& r: r' r' r( � main_modules4 s@ ��
�
r� c
C s� |j }t| �}tjg |jd�}|�t|�� z|jdd� W n6 tj k
rr t
� t d� t
d� |jsnY dS Y nX t|� t|t|�|jd�}|j}|r�t �d|� |j}|r�t �d|� t�|�}z$t �d � t
�� t
�|jd � W n" tk
�r t
� t d
� Y nX |j�r(t �d � t�� t� |j� t |j� t | |d � |� |||�\}} | �rrt � d
|� dS |�s�t � d|� dS dS d S )Nr| r� r� z;Failed to fetch your datasource, likely bad things to come!rS r� z Using passed in arguments %sz Using passed in frequency %sr� r~ r r% zRan %s but it failed!z Did not run %s, does it exist?r )!r7 r) r
r� r} r� r9 r� r r� r r� r* r$ r� r� r � module_argsr= Z frequency�FREQ_SHORT_NAMESrB r� r� rC r� rV r� r� rD r, Z
run_singlera )
r7 r8 �mod_namer� rw r: Zmod_argsZmod_freqr? r@ r' r' r( � main_singlek s^ ��
�
r� c
C s
|d krt � }|�d�}|d kr,tj�d�}tj�|d�}tj�|d�}tj�|d�}tj�|d�}t�||f� |j\} }
| dkr�|j r�d} q�d} n | dkr�d|j
} n t d | ��d
} | | kr�t d � | ���d }
| dkr�||||fD ]}t�
|� q�n,zt�t�|��}
W n tk
�r$ Y nX g d d d �}|
d k�rPd
i i}
d |
d
d< | D ]$}||
d
k�rT|�� |
d
|< �qT|
d
}| |d< t�� || d< t�||
� tjtj�||�|dd� zR|
| |�}| dk�r�|\}}|d k �r�t|�|d< n|}dd� |D �|| d< W nP tk
�rb } z0t�td| � td| � t|�g|| d< W 5 d }~X Y nX t�� || d< d |d< t�||
� | dk�r�g }| D ]*}|| d �r�|� || � dg �� �q�t�|d
|d |d�i� tjtj�||�|dd� t || d �S ) NrK z/run/cloud-initz status.jsonz result.jsonrw �
init-local�modules�
modules-%szunknown name: %s)rw r� z modules-initzmodules-config�
modules-finalz'Invalid cloud init mode specified '{0}')�errors�start�finished�v1r� r� r� T)r� )rw r� c S s g | ] }t |��qS r' )rb )�.0rj r' r' r( �
<listcomp> s z"status_wrapper.<locals>.<listcomp>r� zfailed stage %szfailed run of stage %sr� r� )r� r� ) r rq r4 r5 �normpathro r Z ensure_dirsr+ rz rU �
ValueErrorr/ Zdel_file�json�loadsZ load_filer� �copy�timer Z
write_jsonZsym_link�relpathrb r� r* r$ �extendrB r< )r7 r8 Zdata_dZlink_drp Z status_pathZ status_linkZ result_pathZ result_link�_name�functorrU Zmodes�status�fZ
nullstatusrf r� Zretr� r� rj r' r' r( �status_wrapper� s�
��
��
�
$
� �r� )rw c C s6 | j r2| jr2| j�d�}tj�|�s2| j jdd� dS )zCWrite instance-data.json file if absent and datasource is restored.Z
instance_dataF)Z write_cacheN)r� Z ds_restoredrp Z get_runpathr4 r5 rY Zpersist_instance_data)rw Zinstance_data_filer' r' r( r� % s r� c
C sz | � � }tj| j|dd�\}}}|rvzt�d| j|td� W n8 tjk
rt } zt�d||t |�� W 5 d}~X Y nX dS )z�Call set-hostname if metadata, vendordata or userdata provides it.
@param stage: String representing current stage in which we are running.
@param retry_stage: String represented logs upon error setting hostname.
T)Z
metadata_onlyz set-hostnameNzGFailed setting hostname in %s stage. Will retry in %s stage. Error: %s.)
r� r Zget_hostname_fqdnrC r Zhandler* ZSetHostnameErrorr= rb )rw r� r� ZcloudZhostnameZ_fqdn�_rj r' r' r( r� - s � �r� c C s t j�d�ttj��d � d S )Nr )r �stdoutr" ro �sortedr
ZFEATURES)r7 r8 r' r' r( �
main_featuresD s r� c # C sv | s
t j} tj| �d�d�}|jddddt�� dd� |jd d
d d d
t�d�d� |jdddddd� |jdddddd� |j d d� |j
dd d �}d |_ |j d d d!�}|jd"d#dd$dd� |j d t
fd%� |j d&d'd!�}|jd(d)d*d+d,d-d.� |j d&tfd%� |j d/d0d!�}|jd1d2d*d3d d4� |jd5d*d6dtt�� �d7� |jd8dd9dd4� |jd:d;d<d=d>� |j d/tfd%� |j d?d@d!�}|j tjtjd!�}t�|� |j dAdBd!�}|j dAtfd%� |j dCdDd!�} |j dEdFd!�}
|j dGdHd!�} |j dIdJd!�} |j dKdLd!�}
|j dMdNd!�}| �rd| d }|dCk�r@ddOlm} || � �n$|dEk�rbddOlm} ||
� �n|dGk�r�ddPlm}m} || � | j dG|fd%� n�|dIk�r�ddQl m}m } || � | j dI|fd%� n�|d?k�r�ddRl m}m } ||� |j dS|fd%� nf|dMk�r2ddTl m}m!} ||� |j dM|fd%� n2|dKk�rdddUl"m}m#} ||
� |
j dK|fd%� |j$| dV�} | j%\} } | j&�r�t'�(� t)�*� | dWk�r�t+} d } d } | d k�r�| j,�r�dX\} }!ndY\} }!nZ| d&k�r�dZ| j- d[| j- } }!n8| d/k�rd\| j. d]| j. } }!| j/} n| } d^| }!d} t0j1| |!| d_�| _2| j2�$ t3j4t5j&d`| d | | | fda�}"W 5 Q R X t6�7� |"S )bNr )�progz --versionz-vr
z %(prog)s z'Show program's version number and exit.)r+ r
�helpz--filez-fr3 r2 z(Use additional yaml configuration files.�rb)r+ �destr� �typez--debugz-d�
store_truez:Show additional pre-action logging (default: %(default)s).F)r+ r� �defaultz--forcezDForce running even if no datasource is found (use at your own risk).r� )r+ r� r� r� r� Z Subcommands�
subcommand)�titler� Trw z2Initialize cloud-init and perform initial modules.)r� z--localz-lz+Start in local mode (default: %(default)s).r1 r� z1Activate modules using a given configuration key.z--modez-mZstorez8Module configuration name to use (default: %(default)s).r� )rw r� �final)r+ r� r� �choicesZsinglezRun a single module.z--namez-nzModule name to run.)r+ r� �requiredz --frequencyz Module frequency for this run.)r+ r� r� r� z--reportzEnable reporting.r� �*Zargumentz0Any additional arguments to pass to this module.)�nargs�metavarr� Zqueryz;Query standardized instance metadata from the command line.ZfeatureszList defined features.Zanalyzez-Devel tool: Analyze cloud-init logs and data.ZdevelzRun development tools.z collect-logsz*Collect and tar all cloud-init debug info.Zcleanz3Remove logs and artifacts so cloud-init can re-run.r� z/Report cloud-init status or wait on completion.Zschemaz-Validate cloud-config files using jsonschema.)�
get_parser)r� �handle_collect_logs_args)r� �handle_clean_args)r� � handle_argsZrender)r� �handle_schema_args)r� �handle_status_args)r8 )r� rw )r� z searching for local datasources)z init-networkz!searching for network datasourcesr� zrunning modules for %sz single/%szrunning single module %szrunning 'cloud-init %s')Zreporting_enabledzcloud-init mode '%s')Zlogfuncr& Z
get_uptime�funcr8 )8r �argv�argparse�ArgumentParser�pop� add_argumentr
r0 ZFileTypeZ set_defaultsZadd_subparsersr� Z
add_parserr� r� r� r� �keysr� r �NAME�__doc__r� r� Zcloudinit.analyze.__main__Zcloudinit.cmd.devel.parserZcloudinit.cmd.devel.logsr� Zcloudinit.cmd.cleanr� Zcloudinit.cmd.queryr� �cloudinit.config.schemar� Zcloudinit.cmd.statusr� �
parse_argsr+ r= rV ZsetupBasicLoggingr Zattach_handlersr� rz rU r7 �reportr ZReportEventStackr} r Zlog_timer* r Z flush_events)#Z sysv_args�parserZ
subparsersZ parser_initZ
parser_modZ
parser_singleZ parser_queryZparser_dhclientZparser_featuresZparser_analyzeZ parser_develZparser_collect_logsZ parser_cleanZ
parser_statusZ
parser_schemar� Zanalyze_parserZ devel_parserZ logs_parserr� Z clean_parserr� Z query_parserZhandle_query_argsZ
schema_parserr� Z
status_parserr� r8 r7 r� ZrnameZ report_onZrdescZretvalr' r' r( �mainH s�
���� �� �� ��
���� �
� � � � � � �
�
�
� ��r� �__main__ZTZz:/etc/localtime)r )N)rE )TN)NN)N)Gr� r� r4 r r� r# �typingr Z cloudinitr Zcloudinit.config.modulesr Z
patch_loggingr� r r rV r r r r
r r r
r r Zcloudinit.reportingr Zcloudinit.settingsr r r r r Zcloudinit.configr r Zcloudinit.cmd.develr r. r; r� Z getLoggerr* r$ r, r) r9 rA rD rM �intrb rk rx r{ r� r� r� r� r� r� r� r� r� r� �__name__�environr� Z return_value�exitr' r' r' r( �<module> s| ��
l `27G
s