Your IP : 216.73.216.14
U
8�-d�f � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
m Z d dl m
Z
mZmZmZmZmZ d dlZd dlZd dlmZmZmZmZmZ d dlm Z dZ dZ dZ d Z d
Z!d Z"d Z#d
Z$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ,dddgZ-e�.� Z/ej0G dd� dej1��Z2edd e3fd e3fd e3fg�Z4d d � Z5e3eej6 d!�d"d#�Z7di fee3 ee3 ee
e3e3f e3d$�d%d&�Z8e dd'�di fee3 ee
e3e3f e3d(�d)d*��Z9G d+d,� d,�Z:d-d.� Z;d/d0� Z<e3ee3 d1�d2d3�Z=di fe3ee3 ee
e3e3f e3d4�d5d6�Z>i fee
e3e3f e3d7�d8d9�Z?ddi fee3 eee3 ee3 ee
e3e3f e3d:�d;d<�Z@e3e3e3ee3 e3dd=�d>d?�ZAd@dA� ZBdBdC� ZCdqe3e3ee3 ddD�dEdF�ZDdGdH� ZEdIdJ� ZFdKdL� ZGdMdN� ZHddO�dPdQ�ZIe3eJd1�dRdS�ZKee4 dT�dUdV�ZLdreJee3 dX�dYdZ�ZMdde2jNfee3 ee3 ee2 dd[�d\d]�ZOe3e3e3eJd^�d_d`�ZPeeQ dT�dadb�ZReej dT�dcdd�ZSddT�dedf�ZTee3 e3dg�dhdi�ZUdjdk� ZVdldm� ZWee3 e
e3ee3ee3 f f dn�dodp�ZXdS )s� N)� lru_cache)�Dict�Iterable�List�
NamedTuple�Optional�Union)� event_logger�
exceptions�gpg�messages�system)�ESM_APT_ROOTDIRg N@z # ubuntu-advantage-toolszDir::Etc::netrc/zDir::Etc::netrcparts/zDir::State::lists/z$Acquire::http::Proxy "{proxy_url}";
z%Acquire::https::Proxy "{proxy_url}";
z4Acquire::http::Proxy::esm.ubuntu.com "{proxy_url}";
z5Acquire::https::Proxy::esm.ubuntu.com "{proxy_url}";
z/etc/apt/trusted.gpg.d/z/usr/share/keyringsz/usr/lib/apt/methods/httpsz /usr/sbin/update-ca-certificatesz//etc/apt/apt.conf.d/90ubuntu-advantage-aptproxyz*/var/lib/apt/periodic/update-success-stampaL # Written by ubuntu-advantage-tools
deb https://esm.ubuntu.com/{name}/ubuntu {series}-{name}-security main
# deb-src https://esm.ubuntu.com/{name}/ubuntu {series}-{name}-security main
deb https://esm.ubuntu.com/{name}/ubuntu {series}-{name}-updates main
# deb-src https://esm.ubuntu.com/{name}/ubuntu {series}-{name}-updates main
g �?g @g $@c @ s e Zd Ze� Ze� ZdS )�
AptProxyScopeN)�__name__�
__module__� __qualname__�object�GLOBAL�UACLIENT� r r �./usr/lib/python3/dist-packages/uaclient/apt.pyr = s r �InstalledAptPackages�name�version�archc
C s | � d�\}}tj�d�s dS zFt�� �4}tjddd�||||�tj� |d�gt
t d� W 5 Q R X W n� t j
k
r� } z`|jdkr�t|j��� }t�d |�r�t �d
�| ���n t�d |�r�t �d �| ���t �d
��W 5 d}~X Y n* tjk
�r t �d�t
|���Y nX dS )a Validate apt credentials for a PPA.
@param repo_url: private-ppa url path
@param username: PPA login username.
@param password: PPA login password or resource token.
@raises: UserFacingError for invalid credentials, timeout or unexpected
errors.
�://z/usr/lib/apt/apt-helperNz
download-filez{}://{}:{}@{}/ubuntu/pool/zapt-helper-output)Ztimeout� retry_sleeps�d z 401\s+unauthorized|httperror401z'Invalid APT credentials provided for {}zconnection timed outz-Timeout trying to access APT repository at {}z7Unexpected APT error. See /var/log/ubuntu-advantage.logzVCannot validate credentials for APT repo. Timeout after {} seconds trying to reach {}.)�split�os�path�exists�tempfileZTemporaryDirectoryr
�subp�format�join�APT_HELPER_TIMEOUT� APT_RETRIESr
�ProcessExecutionErrorZ exit_code�str�stderr�lower�re�search�UserFacingError�
subprocessZTimeoutExpired)�repo_url�username�passwordZprotocol� repo_pathZtmpd�er+ r r r � assert_valid_apt_credentialsH sT
� ��
� ��� ��r6 )� apt_error�returnc C s� d}t � }| �� �d�D ]<}|rt�d|�}|rd|�� d �d�d }|�|� q|r�tjj t
|�dkrpd nd
d� t |��d �}|S ) aA Parse apt update errors for invalid apt config in user machine.
This functions parses apt update errors regarding the presence of
invalid apt config in the system, for example, a ppa that cannot be
reached, for example.
In that scenario, apt will output a message in the following formats:
The repository 'ppa 404 Release' ...
Failed to fetch ppa 404 ...
On some releases, both of these errors will be present in the apt error
message.
:param apt_error: The apt error string
:return: a NamedMessage containing the error message
N�
z2(Failed to fetch |The repository .)(?P<url>[^\s]+)z- �urlz/distsr � �s� )Zplural� failed_repos)
�set�stripr r- r. � groupdict�addr Z APT_UPDATE_INVALID_URL_CONFIGr% �lenr& �sorted)r7 � error_msgr> �lineZ
pattern_matchZrepo_url_matchr r r �(_parse_apt_update_for_invalid_apt_config| s$ �� �rG )�cmdrE �envr8 c
C s� zt j| dt|d�\}}W nr tjk
r� } zRdt|j�krFt�� �n t|j�}|rbtj |j
d��|rj|nt|�}t� |��W 5 d}~X Y nX |S )a� Run an apt command, retrying upon failure APT_RETRIES times.
:param cmd: List containing the apt command to run, passed to subp.
:param error_msg: The string to raise as UserFacingError when all retries
are exhausted in failure.
:param env: Optional dictionary of environment variables to pass to subp.
:return: stdout from successful run of the apt command.
:raise UserFacingError: on issues running apt-cache policy.
T)Zcapturer rI z%Could not get lock /var/lib/dpkg/lock)rE N) r
r$ r( r
r) r* r+ �APTProcessConflictErrorrG �APTInvalidRepoError�msgr/ )rH rE rI �out�_errr5 Zrepo_error_msgrL r r r �run_apt_command� s$ �
� rO )�maxsize)rE rI r8 c C s t ddg| |d�S �N� apt-cache�policy�rH rE rI �rO )rE rI r r r �get_apt_cache_policy� s
�rV c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�PreserveAptCfgc C s || _ i | _d S �N)�apt_func�current_apt_cfg)�selfrY r r r �__init__� s zPreserveAptCfg.__init__c s& t j� � fdd�� �� D �| _| �� S )Nc s i | ]}|t �� �|���qS r )�copy�deepcopy�get)�.0�key��cfgr r �
<dictcomp>� s z,PreserveAptCfg.__enter__.<locals>.<dictcomp>)�apt_pkg�config�keysrZ rY )r[ r rb r � __enter__� s
�zPreserveAptCfg.__enter__c C s4 t j}| j�� D ]}|�|| j| � qt �� d S rX )re rf rZ rg r? Z init_system)r[ �type�value� tracebackrc ra r r r �__exit__� s zPreserveAptCfg.__exit__N)r r r r\ rh rl r r r r rW � s rW c C s0 t j�� D ]} t j�| � q
t �� t�� }|S rX )re rf rg �clear�init�apt�Cache�ra �cacher r r �
get_apt_cache� s
rs c C sl zNt j�� D ] } t�d| �s t j�| � q t j�dt� t �� t j
td�}W n t k
rf i }Y nX |S )Nz^AcquireZDir)Zrootdir) re rf rg r- r. rm r? r rn ro rp � Exceptionrq r r r �
get_esm_cache� s
ru )�pkgr8 c
C s t t��T}z || }W n tk
r6 Y W 5 Q R � d S X |jsLW 5 Q R � d S t|jd�}W 5 Q R X |sjd S t t���}|�r z || }W n$ tk
r� | Y W 5 Q R � S X |js�|W 5 Q R � S t|jd�}|s�|W 5 Q R � S t||d��r |W 5 Q R � S W 5 Q R X |S )Nr �ge)rW rs rt � candidate�getattrru �compare_versions)rv rr �packageZ
pkg_candidateZ esm_cacheZ esm_packageZesm_pkg_candidater r r �get_pkg_candidate_version s0
r| )r{ rE rI r8 c C s t dd| g||d�S rQ rU )r{ rE rI r r r � get_apt_cache_policy_for_package/ s
�r} )rI r8 c
C s� z�ztddg| d�}W n� tjk
r4 t�� �Y nt tjk
rd } ztj|jd��W 5 d }~X Y nD tj k
r� } z$tj t
j jd |j t
j j d��W 5 d }~X Y nX W 5 t �� X |S )N�apt-get�update)rH rI )�repo_msgr9 )rL Zmsg_code)
rV � cache_clearrO r
rJ Z APTUpdateProcessConflictErrorrK ZAPTUpdateInvalidRepoErrorrL r/ r ZAPT_UPDATE_FAILEDr )rI rM r5 r r r �run_apt_update_command9 s �
r� )�packages� apt_optionsrE rI r8 c
C s� |d kr g }z t dddg| | ||d�}W nT tjk
rN tj|d��Y n4 tjk
r� } ztj|j|d��W 5 d }~X Y nX |S )Nr~ �install� --assume-yesrT )�
header_msg)r� r� )rO r
rJ Z APTInstallProcessConflictErrorrK ZAPTInstallInvalidRepoErrorrL )r� r� rE rI rM r5 r r r �run_apt_install_commandN s( ���
�r� )�
repo_filenamer1 � credentials�suites� keyring_filer8 c C s6 z|� d�\}}W n tk
r. d}|}Y nX t�� d }|�d�rR|dd� }t|||� d}tdd gtjj �} | �
� D ]&}
d
� |�|
kr�q|d |
kr�q|d } q�q|d
} |D ]D} || kr�q�d
}
d| kr�|s�t �
d| |� d}
| dj |
|| d�7 } q�t�| | � t|||� tj�t|�}tj�t|�}t�||� dS )z�Add an authenticated apt repo and credentials to the system.
@raises: InvalidAPTCredentialsError when the token provided can't access
the repo PPA.
�:Zbearer�series�/N���FrR rS z a={}-updatesz o=Ubuntu,Tr= z-updatesz?Not enabling apt suite "%s" because "%s-updates" is not enabledz# zQ{maybe_comment}deb {url}/ubuntu {suite} main
# deb-src {url}/ubuntu {suite} main
)�
maybe_commentr: �suite)r �
ValueErrorr
Zget_platform_info�endswithr6 rO r ZAPT_POLICY_FAILEDrL �
splitlinesr% �logging�debug�
write_file�add_apt_auth_conf_entryr r! r& � KEYRINGS_DIR� APT_KEYS_DIRr Zexport_gpg_key)r� r1 r� r� r� r2 r3 r� Zupdates_enabledrS rF �contentr� r� Zsource_keyring_fileZdestination_keyring_filer r r �add_auth_apt_repoi sZ
� � �� r� c
C s� t � }| �d�\}}|�d�s&|d7 }tj�|�r>t�|�}nd}dj|||t d�}d}g } |�
� D ]\}
|s�|
�� } t | �dkr�| d } | |kr�| � |� d }qd| |kr�| � |� d }| � |
� qd|s�| � |� | � d� tj
|d
�| �d d � d
S )zBAdd or replace an apt auth line in apt's auth.conf file or conf.d.r r� r= z:machine {repo_path} login {login} password {password}{cmt})r4 �loginr3 ZcmtF� r; Tr9 � ��modeN)�!get_apt_auth_file_from_apt_configr r� r r! r" r
� load_filer% �APT_AUTH_COMMENTr� rC �appendr� r& )
r1 r� r3 �
apt_auth_file� _protocolr4 Z orig_contentZrepo_auth_lineZadded_new_authZ new_linesrF Z
split_lineZcurr_line_repor r r r� � sB
��
r� c s� | � d�\}}|�d�r$|dd� }t� }tj�|�r�t�|�}dj|d�� d� � fdd �|�
� D ��}|sxt� |� ntj ||d
d � dS ) z+Remove a repo from the shared apt auth filer r� Nr� zmachine {repo_path}/ login)r4 r9 c s g | ]}� |kr|�qS r r )r` rF �Z auth_prefixr r �
<listcomp>� s z2remove_repo_from_apt_auth_file.<locals>.<listcomp>r� r� )
r r� r� r r! r" r
r� r% r& r� �ensure_file_absentr� )r1 r� r4 r� Zapt_authr� r r� r � remove_repo_from_apt_auth_file� s
� r� )r� r1 r� r8 c C s2 t �| � |r&tj�t|�}t �|� t|� dS )z>Remove an authenticated apt repo and credentials to the systemN)r
r� r r! r& r� r� )r� r1 r� r r r �remove_auth_apt_repo� s
r� c C sB |� d�\}}|�d�r$|dd� }dj||d�}t�| |� dS )z.Add an apt preferences file and pin for a PPA.r r� Nr� z<Package: *
Pin: release o={origin}
Pin-Priority: {priority}
)�origin�priority)r r� r% r
r� )Zapt_preference_filer1 r� r� r� r4 r� r r r �add_ppa_pinning� s
��r� c C sZ t �dddtg�\} }| r,| �d�d d S t �dddtg�\} }| �d�d �d�S dS ) z7Return to patch to the system configured APT auth file.�
apt-config�shellra �'r; z90ubuntu-advantager� N)r
r$ �APT_CONFIG_AUTH_PARTS_DIRr �APT_CONFIG_AUTH_FILE�rstrip)rM rN r r r r� � s
�
�r� c
C s~ | � d�\}}|�d�r$|dd� }d}t�dddtg�\}}|rP|� d �d
}|�dd �}tt�tj �
||d � |� ���S )
zEList any apt files in APT_CONFIG_LISTS_DIR given repo_url and series.r r� Nr� z/var/lib/apt/listsr� r� ra r� r; �_z
_dists_{}*) r r� r
r$ �APT_CONFIG_LISTS_DIR�replacerD �globr r! r& r% )r1 r� r� r4 Z lists_dirrM rN Zaptlist_filenamer r r �find_apt_list_files s$
� ���r� c C s t | |�D ]}t�|� q
dS )z?Remove any apt list files present for this repo_url and series.N)r� r
r� )r1 r� r! r r r �remove_apt_list_files! s r� )�
_entitlementsc C s� ddl m} | dkr$ddlm} |} | jD ]�}t||�s:q*|jj|jd�}|j j|jd�}t
j � |�r�t
jd�|�tjd� t�|� t
j � |�r*t
jd�|�tjd� t�|� q*dS ) a
Clean apt files written by uaclient
:param _entitlements:
The uaclient.entitlements module to use, defaults to
uaclient.entitlements. (This is only present for testing, because the
import happens within the function to avoid circular imports.)
r )�RepoEntitlementN)� entitlements�r z Removing apt source file: {})Z file_typez!Removing apt preferences file: {})Zuaclient.entitlements.repor� �uaclientr� ZENTITLEMENT_CLASSES�
issubclassZrepo_list_file_tmplr% r Zrepo_pref_file_tmplr r! r" �event�info�sysr+ r
r� )r� r� Z__entitlementsZent_clsZ repo_fileZ pref_filer r r �clean_apt_files' s*
�
�r� c C s
| t � kS rX )� get_installed_packages_names)rv r r r � is_installedJ s r� )r8 c C s2 t �dddg�\} }| �� dd � }dd� |D �S )Nro �listz --installedr; c S s8 g | ]0}t |�d �d |�d�d |�d�d d��qS )r� r � r; r� )r r r )r r )r` �entryr r r r� Q s � �z*get_installed_packages.<locals>.<listcomp>)r
r$ r� )rM r� � package_listr r r �get_installed_packagesN s
�r� F)�include_versionsr8 c C s t � }dd� |D �}|S )Nc S s g | ]
}|j �qS r r� )r` rv r r r r� ] s z0get_installed_packages_names.<locals>.<listcomp>)r� )r� r� Z pkg_namesr r r r� [ s r� )�
http_proxy� https_proxy� proxy_scoper8 c C s� | s|rB|rBd}|t jkr d}n|t jkr.d}t�tjj|d�� d}| r�|t jkrf|tj| d�7 }n|t jkr�|t j| d�7 }|r�|t jkr�|t
j|d�7 }n|t jkr�|t j|d�7 }|dkr�tj | }|dkr�t
�t� n t
�t|� dS )a�
Writes an apt conf file that configures apt to use the proxies provided as
args.
If both args are None, then no apt conf file is written. If this function
previously wrote a conf file, and was run again with both args as None,
the existing file is removed.
:param http_proxy: the url of the http proxy apt should use, or None
:param https_proxy: the url of the https proxy apt should use, or None
:return: None
r= z UA-scoped�global)Zscope)Z proxy_urlN)r r r r� r� r ZSETTING_SERVICE_PROXY_SCOPEr% �APT_CONFIG_UA_PROXY_HTTP� APT_CONFIG_GLOBAL_PROXY_HTTP�APT_CONFIG_UA_PROXY_HTTPS� APT_CONFIG_GLOBAL_PROXY_HTTPSZAPT_PROXY_CONFIG_HEADERr
r� �APT_PROXY_CONF_FILEr� )r� r� r� �messageZapt_proxy_configr r r �setup_apt_proxya sD
�
�
�
�
�
r� )�version1�version2�relationr8 c C s8 zt �dd| ||g� W dS tjk
r2 Y dS X dS )zCReturn True comparing version1 to version2 with the given relation.Zdpkgz--compare-versionsTFN)r
r$ r
r) )r� r� r� r r r rz � s �rz c C s d } t j�t�r t �t�j} | S rX )r r! r" � APT_UPDATE_SUCCESS_STAMP_PATH�stat�st_mtime�Z
cache_timer r r �get_apt_cache_time� s r� c C s$ t � } | d krd S tj�| tjj�S rX )r� �datetimeZ
fromtimestamp�timezoneZutcr� r r r �get_apt_cache_datetime� s r� c C sV t �� s d S ddlm} ddlm} ddlm}m} d}d}| � d�}|d krZ|| �d }|�
dg �D ]D}|�
dd �d
kr�|�
d d �d
k}|�
dd �dkrf|�
d d �d
k}qf|| �} |r�| � � d |j kr�| �
� n| �� t �� �r|| �}
|�r|
� � d |j k�r|
�
� n|
�� t� } z | �� W n$ tjjk
�rP t�d� Y nX d S )Nr )�status)�ApplicationStatus)�ESMAppsEntitlement�ESMInfraEntitlementFz status-cache�servicesr r= zesm-appsZ availableZnoZyesz esm-infraz!Failed to fetch the ESM Apt Cache)r
Zis_current_series_ltsZuaclient.actionsr� Z(uaclient.entitlements.entitlement_statusr� Zuaclient.entitlements.esmr� r� Z
read_cacher_ Zapplication_statusZDISABLEDZsetup_local_esm_repoZdisable_local_esm_repoZ is_current_series_active_esmru r ro rr ZFetchFailedExceptionr� Zwarning) rc r� r� r� r� Zapps_availableZinfra_availableZcurrent_status�serviceZappsZinfrarr r r r �update_esm_caches� sF
��
��
r� �Z
package_namesZ
error_messagec C s( t dddddgt| � |ddid� d S ) Nr~ �remover� z$-o Dpkg::Options::="--force-confdef"z$-o Dpkg::Options::="--force-confold"ZDEBIAN_FRONTENDZnoninteractive)rI )rO r� r� r r r �remove_packages� s ���r� c C s* t j�� D ]} t j�| � q
t �� t jS rX )re rf rg rm Z init_config)ra r r r �_get_apt_config� s r� c C s" t t��}|�| �}W 5 Q R X |S rX )rW r� r� )Zbase_key�apt_cfgZ apt_cfg_keysr r r �get_apt_config_keys s
r� )� cfg_namesr8 c C sN i }t t��8}| D ],}|�|�}t|�s6|�|�p4d}|||< qW 5 Q R X |S )z�
Get all APT configuration values for the given config names. If
one of the config names is not present on the APT config, that
config name will have a value of None
N)rW r� r_ r* Z
value_list)r� Z apt_cfg_dictr� Zcfg_nameZ cfg_valuer r r �get_apt_config_values s
r� )N)F)Yr] r� �enumr� r� r r- r0 r� r# � functoolsr �typingr r r r r r ro re r� r r
r r r
Zuaclient.defaultsr r' r� r� r� r� r� r� r� r� r� r� ZAPT_METHOD_HTTPS_FILEZCA_CERTIFICATES_FILEr� r� ZESM_REPO_FILE_CONTENTr( Zget_event_loggerr� �unique�Enumr r* r r6 Z NamedMessagerG rO rV rW rs ru r| r} r� r� r� r� r� r� r� r� r� r� r� �boolr� r� r� r r� rz �floatr� r� r� r� r� r� r� r r r r �<module> s� ��
�5� /�� '�� &��
�
� � ?+ � �
#
�� 8 9
�