| Server IP : 198.38.94.13 / Your IP : 216.73.217.33 Web Server : Apache System : Linux d4744.dxb1.stableserver.net 5.14.0-611.49.1.el9_7.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 21 16:39:08 EDT 2026 x86_64 User : revivere ( 1140) PHP Version : 8.2.33 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : OFF | Pkexec : OFF Directory : /opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/ |
Upload File : |
o
;j� � 1 @ s d Z ddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
Z
ddlZddlZddlZddlm mZ ddlZddlZddlZddlZddlZddl Zddl Zddl Zddl Zddl Zddl!Zddl"Zddl#Zddl$Zddl%Zddl&m' m(Z) ddl*Zddl+Zddl,m-Z- ddl.m/Z/ ddl0m1Z1 z ddl
m2Z2m3Z3 dZ4W n7 e5y� z ddl6m2Z2m3Z3 dZ4W n! e5y� z ddl7m2Z2m3Z3 dZ4W n e5y� dZ4Y nw Y nw Y nw zddl8Z8dZ9W n e5y� dZ9Y nw zddl:Z:dZ;W n e5�y dZ;Y nw e�<e=�Z>d ej?j@� �ZAd
d � ZBd&d d
�ZCd&dd�ZDe1d�dddddddddddddddddddddddddddddddddddddddddeAddddddf0dd��ZEd'dd�ZF d(dd�ZGd d � ZHd d � ZId d!� ZJd"d#� ZKd)d$d%�ZLdS )*z�
Utils for making various web calls. Primarily designed for REST, SOAP, webhooks
and the like, but also useful for basic HTTP testing.
.. versionadded:: 2015.5.0
� N)�
HTTPClient)�compile_template)� jinja_filter)�CertificateError�match_hostnameTFzSalt/c C s� |s|S t �dt|�| � | dkrt�|tj �}n,| dkr.t�|�}tj |d�}|�
� }n| dkr6t d��| dkr>t d��| d krFt d
��t �d t|�� |S ) z�
Decompress returned HTTP content depending on the specified encoding.
Currently supports identity/none, deflate, and gzip, which should
cover 99%+ of the content on the internet.
z7Decompressing %s byte content with compression type: %sZdeflate�gzip)�fileobjZsdchz+SDCH compression is not currently supported�brz-Brotli compression is not currently supported�compressz*LZW compression is not currently supportedz$Content size after decompression: %s) �log�trace�len�zlib�
decompress� MAX_WBITS�io�BytesIOr �GzipFile�read�
ValueError)�codingZpgctnt�buf�f� r �C/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/http.py�__decompressContentS s&
�
r c C sF |dkrt | t�s|r| �|jpd�} | S t | t�r!|r!| �d�} | S )z%
Decode only the result_text
�requestszutf-8)�
isinstance�str�decode�encoding�bytes)� result_text�backend� decode_body�resultr r r �_decode_result_texts s �
r& c C sh d|v r(t j�� }|�d|d � |�� �d�r(|�� }|r(t| t�s(| � |�} t
| |||d�} | |fS )z-
Decode the result_text and headers.
� Content-Typeztext/�r$ r% ) �email�message� EmailMessage�
add_header�get_content_type�
startswith�get_content_charsetr r r r& )r" �result_headersr# r$ r% �msgZcontent_charsetr r r �_decode_result� s
�r2 Z
http_queryZGET�autoZlwp�minion�P c1 f s� i }2| du r,| dkrt j�tj�t jjd��} n| dkr*t j�tj�t jjd��} ni } | s4| � dd�} | � dd�}3|3rCt j
j � |3�}3| � dd�}4| � dd�}5|5rXt j
j � |5�}5| � d d�}6|6rgt j
j � |6�}6| � d
g �}7t
j�| �j|7v r~d}3d}4d}5d}6d}8|3r�|4r�| d kr�t�d � d } |5r�|6r�d
|5� d|6� d|3� d|4� �}8nd
|3� d|4� �}8t�d| �}9|9s�t j
j�� | d kr�tdu r�d|2d< t�|2d � |2S t�d �}:|:�tj � |r�t j j j � | |�n| };| du r�t!| �} |!du r�| � dd�}!|"du �r| � dd�}"|du�rt"||||| �}t#|;|+�}<t�d|<� � t�d| � � dk�ret�$tj%��ret&|t'��r\|�(� }=t&|+t)��rR|D ]}>|+D ] }?|>|?k�rNd|=|>< �qC�q?t�*dt+�,|=�� n t�*dt+�,|�� |du�rt"||||| �}@t&|@t'��r{|@}n|@�-� }|du �r�i }|du �r�g }|du �r�tj�| � d t jj.�d �}|du �r�tj�| � d t jj.�d �}|du �rt j
j/j0�rtj�1|��r�t j
j2�3|d ��}At j
j/�4|A�}BW d � n 1 �s�w Y t&|Bt'��r�|�5|B� n!t j
j2�3|d ��}At j
j/�6d!|A� W d � n 1 �s w Y |D ] }C|C�7d�}Dt8|D�d"k �r"�q|Dd# �9� ||Dd$ �9� < �q|
�s=|�r=| �r=|| f}
|*t:k�rG|*� d%�}*|*|d&< |3�rp|4�rp� dk�rpd'|v�rpt�d(� d)|d'< d*|v�rpt8|�� |d*< | d k�r�t;�<� }E|
|E_=|Ej>�5|� t�*d+|Ej>� |Ej?}F|!|E_@|8du�r�|8|8d,�|E_An
| d-k�r�d}Fnd}F|du�r�|d.k�r�tBjC�D|�}FntBjC�E|�}Ftj�1|��s�|F�F� |F�4� |du �r�|du �r�i S |} d|2d/< | d k�r�i }G|&du �r�t;jGd$ d0k�r�d|Gd1< nd|Gd2< |"du�r4t&|"tH��rtj�I|"��r|"|Gd< n#t&|"t)��r.tj�I|"d$ ��r-tj�I|"d# ��r-|"|Gd< nt�d3|"� |-�r\|.�sGd4|2d< t�|2d � |2S |EjJ� | f||.|/tK�L|�fid5�|G��}Hn
|EjJ� | f||d6�|G��}H|H�M� |&du �r�|(d7|HjN� d8�� |'|HjO� d9|HiS |)du �r�|H|HjOd:�S t�d;t#|HjP|+�� |HjN}I|Hj>}J|HjO}K|Hj?}LtQ|K| |0|Hd<�}K|K|2d=< �n�| d-k�r t
jJ�R|;|�}Mt
jJjSt
jJ�T|F�g}N| �Ud>��r�|M�V� }Ot
jJ�Wd#�|Nd$< tX�s�t�Yd?� n�|!du �r�t�Yd@� n�d|Ov �r�|O�7d�\}O} ndA} tZ�ZtZj[tZj\�}P|P�]|Ot^| �f� t_j`|P| t_jadB�}Qz tb|Q�c� |O� W n td�y@ }R zdC�et+�,|R��|2d< |2W Y d}R~RS d}R~Rww |"du�r�d}St&|"tH��rXtj�I|"��rW|"}Sn#t&|"t)��rstj�I|"d$ ��rrtj�I|"d# ��rr|"}Snt�d3|"� dS tft_dD��r�t_jgjh|S� }T|N�it
jJjW|TdE�� n"|M�V� | |Sd$ dF�}Ut8|S�d#k�r�|Sd# |UdG< tBjjjkdoi |U��|Nd$< t
jJjl|N� }V|D ] }C|M�m|C||C � �q�� fdHdI�|M_nz|V�o|M�}HW n t
jjp�y� }R z dJtH|R�iW Y d}R~RS d}R~Rww |&du �s�|)du �r|H|HjOd:�S |Hjq}It'|H�r� �}J|H�s� }Ktt|K|J| |0|Hd<�\}K}J|K|2d=< �nti }G|"du�rdt&|"tH��r9tj�I|"��r8|"|GdK< n+t&|"t)��r^tj�I|"d$ ��r]tj�I|"d# ��r]|"d$ |GdK< |"d# |GdL< nt�d3|"� t&|t'��rpt
j�u|�}|!�rw| |GdM< | � dNt jjvdN �}W| � dOt jjvdO �}X| � dPt jjvdP �}Yt j j jwjx�yd� t j
jz�{t j j j|j}j~�}ZdQ|Zjzv }[|G�5� ||| ||!d|'|(|X|Y|,ddR�
� t j
jj�|GddS�}Gz|[�r�t�|WdT�nt�� }\|\j�|;fi |G��}HW nl t j j jwj��y }R z)|Rjq|2dU< tH|R�|2d< |Rj�du�rtt|Rj�j�|Rj�j>| |0dV�\|2d=< }]|2W Y d}R~RS d}R~Rw tZj�t�t�tZj�f�yM }R z |
du �r2d$|2dU< tH|R�|2d< t�dW|;|2d � |2W Y d}R~RS d}R~Rww |&du �sX|)du �r^|H|Hj�d:�S |Hjq}I|Hj>}J|Hj�}Ktt|K|J| |0|Hd<�\}K}J|K|2d=< dX|Jv �r�|du�r�t�|JdX �}L|LD ]}>|F��|>� �q�nd}Lt&|Jt)��r�i }^|JD ]}C|C�7d�}Dd�|Dd#d� ��9� |^|Dd$ �9� < �q�|^}Jt�dY|I� t�*dZ|J� t�*d[|F� |J� d\d]�}_| d k�r�t�|_|K�}Kzt�*d^|K� W n t��y� }R z t�*d_|R� W Y d}R~Rnd}R~Rww |#du�r!t j
j2�3|#d`��
}`|`��|K� W d � n 1 �s w Y |$du�rKtj�I|$��rKt j
j2�3|$d`��
}a|a��|J� W d � n 1 �sFw Y |du�rT|F�F� |du �r�t j
j/j0�r�da|Jv �r�t j
j2�3|d ��&}A|J� dad�}B|Bdu�r�t j
j/�6db|Bi|A� nt j
j/�6d!|A� W d � n 1 �s�w Y |
du �r�|I|2dU< |du �r�|J|2dc< | du �rV| ddk�r�|J� dedf�}bdg|bv �r�dg} ndh|bv �r�dh} n
di|bv �r�di} ndj} dk}c| |cv�r�dl�et+�,|c��|2d< t�|2d � |2S | dhk�r t j
j���|K�|2dm< n5| dgk�r g |2dm< t���|K�}d|dD ]
}>|2dm �it���|>�� �qn| dik�r3t j
j��t j
j���|K��|2dm< nd}|%�rVt j
j2�3|%d`��
}e|e��|K� W d � n 1 �sQw Y |du �r_|K|2dn< |2S )pz6
Query a resource, and decode the return data
NZmasterr4 r# �tornado�
proxy_host�
proxy_port�proxy_username�proxy_password�no_proxyr z7Switching to request backend due to the use of proxies.zhttp://�:�@zOhttps?://((25[0-5]|2[0-4]\d|[01]?\d\d?)\.){3}(25[0-5]|2[0-4]\d|[01]?\d\d?)($|/)Fz_http.query has been set to use requests, but the requests library does not seem to be installed�error�
verify_sslT�certz!Requesting URL %s using %s methodzUsing backend: %s�POSTZ
XXXXXXXXXXzRequest POST Data: %sZcachedirz cookies.txtzcookies.session.p�rb�wb� � � r z
http.query()z
User-agentr' zVContent-Type not provided for POST request, assuming application/x-www-form-urlencodedz!application/x-www-form-urlencodedzContent-LengthzRequest Headers: %s)�http�httpsZurllib2Zmozilla�test�0Zprefetch�streamzAThe client-side certificate path that was passed is not valid: %sz1formdata_fieldname is required when formdata=True)�params�files)rL �dataz HTTP/1.0 z MESSAGE�handle)rO �bodyz"Final URL location of Response: %sr( rP rH zgmatch_hostname() not available, SSL hostname checking not available. THIS CONNECTION MAY NOT BE SECURE!z]SSL certificate verification has been explicitly disabled. THIS CONNECTION MAY NOT BE SECURE!i� )�ca_certs� cert_reqsz3The certificate was invalid. Error returned was: {}�
SSLContext)�context)�host�port� cert_file�key_filec s � S �Nr r ��methodr r �<lambda> s zquery.<locals>.<lambda>�ErrorZ client_certZ
client_keyrQ Z
http_max_bodyZhttp_connect_timeoutZhttp_request_timeout�
max_body_size)
r[ �headersZ
auth_usernameZ
auth_passwordrP Z
validate_certZallow_nonstandard_methods�streaming_callback�header_callback�connect_timeoutZrequest_timeout� raise_errorZdecompress_response)�to_str)r^ �status)r$ z$Cannot perform 'http.query': %s - %sz
Set-CookiezResponse Status Code: %szResponse Headers: %szResponse Cookies: %szContent-Encoding�identityzResponse Text: %szfCannot Trace Log Response Text: %s. This may be due to incompatibilities between requests and logging.�wz
set-cookie�Cookier_ r3 z content-typezapplication/json�xml�json�yaml�plain)rj ri rk rl z9Invalid decode_type specified. Valid decode types are: {}�dict�textr )��saltZconfigZ
master_config�os�path�join�syspathsZ
CONFIG_DIRZ
minion_config�get�utilsZ stringutilsrd �urllib�parse�urlparse�hostnamer �debug�re�match�networkZ refresh_dns� HAS_REQUESTSr> �logging� getLogger�setLevel�WARNING�extr6 ZhttputilZ
url_concat�
get_ca_bundle�_render� sanitize_url� isEnabledForZTRACEr rm �copy�listr �pprintZpformat�
splitlinesZ CACHE_DIRZmsgpackZ HAS_MSGPACK�isfilerM �fopen�load�update�dump�splitr
�strip� USERAGENTr ZSession�authr_ �cookies�verifyZproxiesrG � cookiejarZMozillaCookieJarZ LWPCookieJarZsave� __version__r �exists�requestr �StringIOZraise_for_statusZ status_code�content�urlr& �RequestZ HTTPHandlerZHTTPCookieProcessorr. Zget_hostZ HTTPSHandler�HAS_MATCHHOSTNAME�warning�socket�AF_INET� SOCK_STREAM�connect�int�ssl� wrap_socket�
CERT_REQUIREDr � getpeercertr �format�hasattrrS �load_cert_chain�append�client�HTTPSConnectionZ build_openerr, Z
get_method�open�URLError�code�infor r2 � urlencodeZDEFAULT_MINION_OPTSZ
httpclientZAsyncHTTPClientZ configure�argsZget_function_argspecZsimple_httpclientZSimpleAsyncHTTPClientZ
initializerN r r Zfetch� HTTPError�responserP �herror�OSError� TimeoutError�gaierror�parse_cookie_headerZ
set_cookier �UnicodeEncodeError�writerj �loads�ETZ
fromstringri Zto_dictrk Z safe_load)fr� r[ rL rN Z data_fileZ header_dictZ header_listZ header_file�username�passwordr� r Z decode_typere r_ rn r� Z
cookie_jarZ
cookie_formatZpersist_sessionZsession_cookie_jarZ data_renderZ
data_rendererZ
header_renderZheader_renderer�
template_dictrI Ztest_url�noderV �optsr# � ca_bundler? r@ �text_outZ headers_outZ
decode_outrK r` ra rO Zagent� hide_fieldsrc ZformdataZformdata_fieldnameZformdata_filenamer$ �kwargs�retr7 r8 r9 r: r; Zhttp_proxy_urlr| Z requests_logZurl_full�log_urlZlog_data�item�fieldZ
header_tpl�fh_Zsession_cookies�header�compsZsessZ sess_cookiesZ
req_kwargsr% Zresult_status_coder0 r" Zresult_cookiesr� �handlersry �sockZsockwrap�excZ
cert_chainrT Z cert_kwargsZopenerZmax_bodyrb �timeoutZclient_argspecZsupports_max_body_sizeZdownload_client�_Zresult_headers_dictr ZtofZhof� content_typeZ
valid_decodes�itemsZdofr rZ r �query� s� 8��
�� �
��
�
�
� �
� �
��
�
��
� $�����
�
� ��
� �
�
�����
� $�� �� ���
�
� $ �� �
�
� �
����
��
���
� �
&
���
� �
� �
��
�
�
r� c C s� t td�rtjS | du ri } | �dd�}|dur tj�|�r |S | �ddtjj gi�}|�dg �D ]}dD ]}tj�
||�}tj�|�rJ| S q5q1d}|D ] }tj�|�r\| S qPtj j �
� ritrit�� S dS )zs
Return the location of the ca bundle file. See the following article:
http://tinyurl.com/k7rx42a
�__return_value__Nr� �
file_roots�base)z
cacert.pemz
ca-bundle.crt)z"/etc/ssl/certs/ca-certificates.crtz /etc/pki/tls/certs/ca-bundle.crtz&/etc/pki/tls/certs/ca-bundle.trust.crtz /etc/ssl/certs/ca-bundle.crtz&/var/lib/ca-certificates/ca-bundle.pemz/etc/ssl/cert.pem)r� r� r� rt rp rq r� ro rs Z SRV_ROOT_DIRrr ru �platformZ
is_windows� HAS_CERTIFI�certifi�where)r� Z opts_bundler� Z salt_rootrq Z cert_pathZ locationsr r r r� s.
��
�r� c C s� |du ri }| du rt |�} | du rt�d� dS |du r#|�dd�}t�d|| � t|dddd| d� |dur�t|t�r@|g}t|t�sLt�d � dS d
}|D ]L}t j
� |�r�t�d || � z#t j
j�|d ��}d
�||�� f�}W d � n1 s|w Y W qP ty� } z
t�d||� W Y d}~qPd}~ww qP|r�t�d| � z't j
j�| d��}|�d
� |�|� W d � W dS 1 s�w Y W dS ty� } zt�d| |� W Y d}~dS d}~ww dS dS )a.
Attempt to update the CA bundle file from a URL
If not specified, the local location on disk (``target``) will be
auto-detected, if possible. If it is not found, then a new location on disk
will be created and updated.
The default ``source`` is:
http://curl.haxx.se/ca/cacert.pem
This is based on the information at:
http://curl.haxx.se/docs/caextract.html
A string or list of strings representing files to be appended to the end of
the CA bundle file may also be passed through as ``merge_files``.
Nz/Unable to detect location to write CA bundle toZ
ca_bundle_urlz!http://curl.haxx.se/ca/cacert.pemz Attempting to download %s to %sTF)rn r r_ re r� zIA value was passed as merge_files which was not either a string or a listrD z#Queueing up %s to be appended to %s�r�
z.Reading from %s caused the following error: %szAppending merge_files to %s�az,Writing to %s caused the following error: %s)r� r r> rt rz r� r r r� rp rq r� ro ru rM r� rr r r� r� ) �target�sourcer� Z merge_filesZ
merge_contentrW Zfcfr� Ztfpr r r �update_ca_bundle6 s`
� ������
&� ���r� c
C s� |rR|du ri }|s|� dd�}tj�|i �}|� d�}|� d�}t| ||||fi |��}tjj�|�r8|�� }t |��
d�rPt |��
d�sPt |�� dd �d }|S tjj �
| d
�� } | �� W d � S 1 siw Y dS ) z
Render a template
N�rendererz
jinja|yamlZrenderer_blacklistZrenderer_whitelistz#!z#!/r� rF r� )rt ro �loader�renderr ru ZstringioZ is_readabler r r. r� rM r� )
�templater� r� r� r� ZrendZ blacklistZ whitelistr� r� r r r r� � s*
�� $�r� c C s d}g }| � d�D ]!}|�� }d|v r%d|vr%|� d�D ]}|�|� q q |�|� q g }i }d}|D ]Y}|� d�} | d �� | d< | d |v rp| d |v rU|�|� i }t| �dkrid�| dd � �|| d < q3d
|| d < q3|d
u r}|�|� i }d}d�| dd � �|| d < d
}q3|r�|�|� d }
g } |D ]m}d } d }
t|�D ]}||v r�q�|} |�|�}
q�d|v r�tj �
|d �|d< |
D ]
}||vr�d ||< q�|d
d kr�d|d
< |d d kr�i |d< |d d kr�d|d< |�dd � |�dd � | �tj j d| |
d�|��� q�| S )z�
Parse the "Set-cookie" header, and return a list of cookies.
This function is here because Tornado's HTTPClient doesn't handle cookies.
) �expiresrq �domain�version�httponly�secure�commentzmax-age�samesite�;�,r� F�=r rF NT)r� rV Zport_specifiedr� Zdomain_specifiedZdomain_initial_dotrq Zpath_specifiedr� r� �discardr� Z comment_url�restrD r� r� r� r� )�name�valuer ) r� r� r� �lowerr
rr r� �poprG r� Z http2timerh )r� ZattribsZmorselsr� �partr� ZcookieZ value_setZmorsel�partsZreqdr� r� r� �reqr r r r� � sp
�
� r� c C s� t |t�rItj�| �}|d }t|�dkr|d7 }|dd� D ]$}d}|D ]}|�d�}|r9|�d�}t||�}q%t||�}q%||7 }q |�d�S t | �S )z4
Make sure no secret fields show up in logs
r rF �?N�&)
r r� rv rw �
splitqueryr
r� �_sanitize_url_components�rstripr )r� r� Z url_compsr� �pairZurl_tmpr� Z
comps_listr r r r� s
r� c C sl | sdS | d � |� d��r!|� d�}| �| d � |t| |� S | d � d�}| �| d � |t| |� S )zC
Recursive function to sanitize each component of the url.
rD r r� z =XXXXXXXXXX&r� )r. �remover )Z comp_listr� r� r r r r s
r c C sd t �� }| r
|r
| |f|_|r|st�d� dS |r#d|i}t|�|_|s(d|_|r0|j�|� |S )z#
create a requests session
z;You cannot use both ca_bundle and verify_ssl False togetherFr� ) r �sessionr� r r> r� r� r_ r� )�userr� r? r� r_ r r� r r r r + s
r )NNrY )NNNN)NNTNN)M�__doc__�
email.messager) r � http.clientrG Zhttp.cookiejarr r rp r� r{ r� r� � urllib.errorrv � urllib.parse�urllib.requestZxml.etree.ElementTreeZetreeZ ElementTreer� r Z salt.configro Zsalt.ext.tornado.httputilZ"salt.ext.tornado.simple_httpclientZ salt.loaderZ
salt.syspathsZsalt.utils.argsZsalt.utils.dataZsalt.utils.filesZsalt.utils.jsonZsalt.utils.msgpackZsalt.utils.networkZsalt.utils.platformZsalt.utils.stringutilsZsalt.utils.urlZsalt.utils.xmlutilru Zxmlutilri Zsalt.utils.yamlZ salt.versionZsalt.ext.tornado.httpclientr Z
salt.templater Zsalt.utils.decorators.jinjar r r r� � ImportErrorZ backports.ssl_match_hostnameZsalt.ext.ssl_match_hostnamer r~ r� r� r� �__name__r r� r� r� r r& r2 r� r� r� r� r� r� r r r r r r �<module> s ����� ��
�
u3
�Jk