CasperSecurity
o
쑛h�D � @ sH d Z ddlZddlZddlZddlZddlZddlmZmZ ddl m
Z
ddl m Z m
Z
mZmZmZmZmZ ddlZddlmZ ddlmZ ddlmZ dd lmZm Z m Z m Z m Z dd
l m!Z! e�"e#�Z$d Z%d Z&d
Z'ddddddd�Z(de)fdd�Z* d9deee) de
e)e f fdd�Z+G dd� de�Z,G dd� de�Z-G d d � d e�Z.d e)de/fd d �Z0G d!d"� d"e j1�Z2 #d:d$ej3d%e)d&e4fd'd(�Z5 #d:d$ej3d%e)d&e4dej6fd)d*�Z7G d+d,� d,e�Z8G d-d.� d.�Z9e&e8j:fd/e)d0e8de/fd1d2�Z;e2e j<ffgZ=d3d4� Z>e#d5k�r"ddl?Z?d6Z@e?jAe@d7�ZBeB�C� eDe�Ee;e8j:d8��� dS dS );a� Datasource for LXD, reads /dev/lxd/sock representation of instance data.
Notes:
* This datasource replaces previous NoCloud datasource for LXD.
* Older LXD images may not have updates for cloud-init so NoCloud may
still be detected on those images.
* Detect LXD datasource when /dev/lxd/sock is an active socket file.
* Info on dev-lxd API: https://documentation.ubuntu.com/lxd/en/latest/dev-lxd/
� N)�Flag�auto)�JSONDecodeError)�Any�Dict�List�Optional�Tuple�Union�cast)� HTTPAdapter)�HTTPConnection)�HTTPConnectionPool)�
atomic_helper�sources�subp�
url_helper�util)�find_fallback_nicz
/dev/lxd/sockz1.0z
http://lxd� user-data�network-config� vendor-data)�cloud-init.user-datazcloud-init.network-config�cloud-init.vendor-data�user.user-datazuser.network-config�user.vendor-data�returnc
C s� d} t �d�rIz
t � dg�\}}W n t jy, } zt�d|� | W Y d }~S d }~ww |�� dv rIt�� d d }|dkrAdS |d krGd
S d S | S ) N�eth0zsystemd-detect-virtzHUnable to run systemd-detect-virt: %s. Rendering default network config.)�kvm�qemu�uname� �ppc64le�enp0s5�s390x�enc9�enp5s0)r �which�ProcessExecutionError�LOG�warning�stripr � system_info)� default_name� virt_type�_�err�arch� r2 �A/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceLXD.py� _get_fallback_interface_name/ s(
��� r4 �nicsc C sF t � }|r t�d|� n t� }t�d|� dd|ddd�gd�gd �S )
zCReturn network config V1 dict representing instance network config.zCLXD datasource generating network from discovered active device: %szVLXD datasource generating network from systemd-detect-virt platform default device: %s� �physical�dhcpr )�type�control)r9 �name�subnets)�version�config)r r) �debugr4 )r5 � primary_nicr2 r2 r3 �generate_network_configI s$ ��
���rA c �$ e Zd Z� fdd�Zdd� Z� ZS )�SocketHTTPConnectionc s t � �d� || _d | _d S �N� localhost)�super�__init__� socket_path�sock��selfrH �� __class__r2 r3 rG p s
z SocketHTTPConnection.__init__c C s$ t � t jt j�| _| j�| j� d S �N)�socket�AF_UNIX� SOCK_STREAMrI �connectrH �rK r2 r2 r3 rR u s z SocketHTTPConnection.connect)�__name__�
__module__� __qualname__rG rR �
__classcell__r2 r2 rL r3 rC o s rC c rB )�SocketConnectionPoolc s || _ t� �d� d S rD )rH rF rG rJ rL r2 r3 rG { s z SocketConnectionPool.__init__c C s
t | j�S rN )rC rH rS r2 r2 r3 � _new_conn s
z SocketConnectionPool._new_conn)rT rU rV rG rY rW r2 r2 rL r3 rX z s rX c @ s" e Zd Zddd�Z ddd�ZdS )�LXDSocketAdapterNc C s t t�S rN )rX �LXD_SOCKET_PATH)rK �url�proxiesr2 r2 r3 �get_connection� s z LXDSocketAdapter.get_connectionc C s | � |j|�S rN )r^ r\ )rK �request�verifyr] �certr2 r2 r3 � get_connection_with_tls_context� s z0LXDSocketAdapter.get_connection_with_tls_contextrN )NN)rT rU rV r^ rb r2 r2 r2 r3 rZ � s
�rZ �
metadata_typec
C sx t |t�r|S |du r
i S zt�|�}W n ty+ } z t�dj| |d��|�d}~ww |du r:t�dj| |d���|S )a6 Convert raw instance data from str, bytes, YAML to dict
:param metadata_type: string, one of as: meta-data, vendor-data, user-data
network-config
:param metadata_value: str, bytes or dict representing or instance-data.
:raises: InvalidMetaDataError on invalid instance-data content.
NzAInvalid {md_type}. Expected str, bytes or dict but found: {value})�md_type�valuez:Invalid {md_type} format. Expected YAML but found: {value})�
isinstance�dictr � load_yaml�AttributeErrorr �InvalidMetaDataException�format)rc �metadata_value�parsed_metadata�excr2 r2 r3 �_raw_instance_data_to_dict� s.
�������ro c s� e Zd ZU dZejZeee f e
d< ejZ e eee f e
d< ej
jd Zee df e
d< dZded d
f� fd d � Zed efd
d��Zd efdd�Zd e fdd�Zd e fdd�Zed efdd��Z� Z S )�
DataSourceLXD�LXD�_network_config�_crawled_metadata)�user.meta-datar r r r .�sensitive_metadata_keysT�ci_pkl_versionr Nc s t � �|� d| _d S )NT)rF � _unpickle�skip_hotplug_detect)rK rv rL r2 r3 rw � s
zDataSourceLXD._unpicklec C sB t j�t�st�dt� dS t�t �t�j �s t�dt� dS dS )z@Check platform environment to report if this datasource may run.z%s does not exist.Fz%s is not a socketT)
�os�path�existsr[ r) r* �stat�S_ISSOCK�lstat�st_moder2 r2 r2 r3 � ds_detect� s zDataSourceLXD.ds_detectc C s� t � | _td| j�d��| _| j�di �}|�di �}|r&| j�td|�� d| jv r1| jd | _d| jv r?td| jd �| _d| jv rJ| jd | _dS )z=Crawl LXD socket API instance data and return True on success� meta-datar> rt r r r T) �
read_metadatars ro �get�metadata�update� userdata_rawrr �vendordata_raw)rK r> �
user_metadatar2 r2 r3 � _get_data� s& � �
�
zDataSourceLXD._get_datac C s dj ttd�S )z.Return subplatform details for this datasourcez"LXD socket API v. {ver} ({socket}))�verrO )rk �LXD_SOCKET_API_VERSIONr[ rS r2 r2 r3 �_get_subplatform� s �z DataSourceLXD._get_subplatformc C sB t tjd�}|�di �}t|t�st�|�}|�d�| j�d�kS )z%Return True if instance_id unchanged.��
metadata_keysr� z instance-id) r� � MetaDataKeys� META_DATAr� rf rg r rh r� )rK �sys_cfg�response�mdr2 r2 r3 �check_instance_id� s
z DataSourceLXD.check_instance_idc C s� | j tjkr?| jtjkr| �� t| jt�r?| j�d�r(t� d� | jd | _ n| j�d�r?dd� | jd �
� D �}t |�| _ | j tjkrNt� d� t � | _ t t| j �S )z�Network config read from LXD socket config/user.network-config.
If none is present, then we generate fallback configuration.
r z,LXD datasource using provided network config�devicesc S s g | ] \}}|d dkr|�qS )r9 �nicr2 )�.0�k�vr2 r2 r3 �
<listcomp> s
�z0DataSourceLXD.network_config.<locals>.<listcomp>z8LXD datasource generating network config using fallback.)
rr r �UNSETrs r� rf rg r� r) r? �itemsrA r )rK r� r2 r2 r3 �network_config� s(
� �
� z DataSourceLXD.network_config) rT rU rV �dsnamer r� rr r
r �str�__annotations__rs r �
DataSourceru r rx �intrw � staticmethod�boolr� r� r� r� �propertyrg r� rW r2 r2 rL r3 rp � s"
��
rp T�sessionr\ �do_raisec
C sr t | ||�}|jst�d||j|j�d�� i S z|�� W S ty8 } zt �
dj ||j�d�d��|�d }~ww )N�Skipping %s on [HTTP:%d]:%s�utf-8zFUnable to process LXD config at {url}. Expected JSON but found: {resp})r\ �resp) � _do_request�okr) r? � status_code�content�decode�jsonr r rj rk )r� r\ r� � url_responsern r2 r2 r3 �_get_json_response s,
�
�����r� c C s� t ddd�D ]}| �|�}d|jkr!t�d� t�d|j||� q t�d|j|� |r?|js?t �
dj |j||j �
d �d
���|S ) N� r ���i� g�������?z,[GET] [HTTP:%d] %s, retrying %d more time(s)z[GET] [HTTP:%d] %sz3Invalid HTTP response [{code}] from {route}: {resp}r� )�code�router� )�ranger� r� �time�sleepr) r* r? r� r rj rk r� r� )r� r\ r� �retriesr� r2 r2 r3 r� , s*
�
��r� c @ s0 e Zd Ze� Ze� Ze� Ze� ZeeB eB ZdS )r� N) rT rU rV r �NONE�CONFIG�DEVICESr� �ALLr2 r2 r2 r3 r� I s r� c @ sD e Zd Zefdefdd�Zdejdefdd�Z de
defd d
�Z d S ) �_MetaDataReader� api_versionc C s || _ t�t| j �| _d S rN )r� r � combine_url�LXD_URL� _version_url)rK r� r2 r2 r3 rG R s z_MetaDataReader.__init__r� r c
C s� di i}t �| jd�}t||�}t|�D ]L}t �t|�}t||dd�}|j�d�}|j s6t
� d||j |� q|�
d�d } ||d | < | tv r`t| |vrT||t| < qt
�d| | �d d
d �� q|S ) a� Iterate on LXD API config items. Promoting CONFIG_KEY_ALIASES
Any CONFIG_KEY_ALIASES which affect cloud-init behavior are promoted
as top-level configuration keys: user-data, network-data, vendor-data.
LXD's cloud-init.* config keys override any user.* config keys.
Log debug messages if any user.* keys are overridden by the related
cloud-init.* key.
r> F�r� r� r� �/r� z,Ignoring LXD config %s in favor of %s value.�userz
cloud-initr6 )r r� r� r� �sortedr� r� r� r� r� r) r? r� �
rpartition�CONFIG_KEY_ALIASESr* �replace)
rK r� r> �
config_url�
config_routes� config_route�config_route_url�config_route_response�
response_text�cfg_keyr2 r2 r3 �_process_configV s:
� � ��z _MetaDataReader._process_configr� c C s� t �� �T}|�| jt� � d| ji}tj|v r)t� | jd�}t
||�j � d�|d< tj
|v r6|�| �|�� tj|v rOt� | jd�}t||dd�}|rO||d< |W d � S 1 s[w Y d S )N�_metadata_api_versionr� r� r� Fr� )�requests�Session�mountr� rZ r� r� r� r r� r� r� r� r� r� r� r� r� )rK r� r� r� �md_router\ r� r2 r2 r3 �__call__� s*
���
$�z_MetaDataReader.__call__N) rT rU rV r� r� rG r� r� rg r� r� r� r2 r2 r2 r3 r� Q s 6r� r� r� c C s t | d�|d�S )a/ Fetch metadata from the /dev/lxd/socket routes.
Perform a number of HTTP GETs on known routes on the devlxd socket API.
Minimally all containers must respond to <LXD_SOCKET_API_VERSION>/meta-data
when the LXD configuration setting `security.devlxd` is true.
When `security.devlxd` is false, no /dev/lxd/socket file exists. This
datasource will return False from `ds_detect` in that case.
Perform a GET of <LXD_SOCKET_API_VERSION>/config` and walk all `user.*`
configuration keys, storing all keys and values under a dict key
LXD_SOCKET_API_VERSION: config {...}.
In the presence of the following optional user config keys,
create top level aliases:
- user.user-data -> user-data
- user.vendor-data -> vendor-data
- user.network-config -> network-config
:param api_version:
LXD API version to operated with.
:param metadata_keys:
Instance of `MetaDataKeys` indicating what keys to fetch.
:return:
A dict with the following optional keys: meta-data, user-data,
vendor-data, network-config, network_mode, devices.
Below <LXD_SOCKET_API_VERSION> is a dict representation of all raw
configuration keys and values provided to the container surfaced by
the socket under the /1.0/config/ route.
)r� r� )r� )r� r� r2 r2 r3 r� � s #�r� c C s t �| t�S rN )r �list_from_depends� datasources)�dependsr2 r2 r3 �get_datasource_list� s r� �__main__z*Query LXD metadata and emit a JSON object.)� descriptionr� rN )T)F�__doc__�loggingry rO r| r� �enumr r � json.decoderr �typingr r r r r r
r r� �requests.adaptersr �urllib3.connectionr
�urllib3.connectionpoolr � cloudinitr r r r r �
cloudinit.netr � getLoggerrT r) r[ r� r� r� r� r4 rA rC rX rZ rg ro r� rp r� r� r� �Responser� r� r� r� r� �DEP_FILESYSTEMr� r� �argparser� �ArgumentParser�parser�
parse_args�print�
json_dumpsr2 r2 r2 r3 �<module> s�
$
�
�
�
�& j���
�����
� R���
�
*�
��