ruạṛ
a �u:j!? � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZm Z m Z d dl m Z d dl mZ d dlmZmZ dZG dd� d�Zd d � Zd d � Zeeed �dd�ZdNeeed�dd�ZdOejee e d�dd�ZedPeee e ed�dd��Z dd� Z dd � Z d d � Z d d � Z ed!�d"d#�Z!ed$�d%d&�Z"ed$�d'd(�Z#eed)�d*d+�Z$eed)�d,d-�Z%d.d/� Z&eee e d0�d1d2�Z'd3Z(dQe eee f ee e e e d4�d5d6�Z)dRee e e e e d7�d8d9�Z*dSee e e e d:�d;d<�Z+dTee e e e e d7�d=d>�Z,dUee e e e d:�d?d@�Z-dVeee e e e e dA�dBdC�Z.ed$�dDdE�Z/eedF�dGdH�Z0ed$�dIdJ�Z1edK�dLdM�Z2dS )W� N)�List�Optional�Union)�bart_jobs_folder)� get_job_id_for_context_logging)�apply_sudo_wrapper_list�apply_sudo_wrapper_strTc @ s� e Zd ZdZdZdZdZdZdZdZ dZ d d l m Z ed d � �Zeeeed �dd��Zedd� �Zedd� �Zedd� �Zedd� �Zedd� �Zedd� �Zd S ) � LogPrinterz[92mz[33mz [38;5;208mz[91mz[0mz[94mz[90mFr )�loggerc C s d| _ d S )NT)� _use_logger)�cls� r �N/opt/bart/bart_venv/lib/python3.9/site-packages/app/utils/utility_functions.py�enable_logging s zLogPrinter.enable_logging)�level�message�colorc C sP | j r6t� }| jjd|d�}|jdd��|�� |� nt|� |� | j� �� d S )NZ application)Zlog_type�job_id� )�depth) r r �_logger�bind�opt�log�upper�print�RESET)r r r r r Z bound_loggerr r r �_output# s zLogPrinter._outputc C s | � dd|� �| j� d S )N�errorzERROR: )r �RED�r r r r r r , s zLogPrinter.errorc C s | � dd|� �| j� d S )N�warningz WARNING: )r �ORANGEr r r r �warn0 s zLogPrinter.warnc C s | � dd|� �| j� d S )N�infozNOTE: )r �YELLOWr r r r �note4 s zLogPrinter.notec C s | � dd|� �| j� d S )Nr$ z SUCCESS: )r �GREENr r r r �success8 s zLogPrinter.successc C s | � dd|� �| j� d S )Nr$ zINFO: )r �BLUEr r r r r$ < s zLogPrinter.infoc C s t r| �dd|� �| j� d S )N�debugzDEBUG: )� debug_moder �GREYr r r r r* @ s zLogPrinter.debugN)�__name__� __module__� __qualname__r' r% r" r r r) r, r Zlogurur r � classmethodr �strr r r# r& r( r$ r* r r r r r s2 r c s � fdd�}|S )Nc sF t � � }� | i |��}t � � }|| }t�d� j� d|d�d�� |S )Nz==> z took z.3fz seconds)�timer r$ r- )�args�kwargs� start_time�resultZend_timeZ elapsed_time��funcr r �wrapperG s z measure_time.<locals>.wrapperr �r8 r9 r r7 r � measure_timeF s r; c s � fdd�}|S )Nc sP z� | i |��W S t yJ } z"t�|� � t�� � W Y d }~n d }~0 0 d S )N)� Exceptionr r � traceback� print_exc)r3 r4 �er7 r r r9 S s z handle_errors.<locals>.wrapperr r: r r7 r � handle_errorsR s r@ )�base�target�returnc C sJ t j�| �}t j�|�}zt j�||g�}W n ty@ Y dS 0 ||kS )NF)�os�path�realpath� commonpath� ValueError)rA rB Z base_realZ target_real�commonr r r �_is_within_directory^ s rJ )rE � jobs_folderrC c C s� |du r t }tj�| �}tj�|�}z"tj�||g�}||krDW dS W n tyX Y n0 tj�| �}tj�|�}|�|tj �s�||kr�dS dS )a" Check if a path is under the jobs folder, handling symlinks correctly. This function handles the case where jobs_folder might be a symlink. It checks if the path is under either: 1. The jobs_folder path (as given, e.g., /opt/bart/jobs) 2. The realpath of jobs_folder (e.g., /home1/nf_staging/bart_jobs) Args: path: The path to check jobs_folder: The jobs folder path (defaults to bart_jobs_folder from config) Returns: True if path is under the jobs folder, False otherwise NTF) r rD rE rF rG rH �abspath� startswith�sep)rE rK Z path_realZjobs_folder_realrI �path_absZjobs_folder_absr r r �_is_under_jobs_folderh s rP )�member� extract_root�usernamec C s | j }|�d�s|�d�r(td|����dd� |�d�D �}tdd� |D ��r\td|����tj�||�}t||�s�td |����| � � r�td |����| � � s�| � � �r| j p�d }|r�|d |� �kr�d S tj� |�r�td |�d|����tj�||�}t||��std|�d|����d S )N�/�\z#Unsafe tar member (absolute path): c S s g | ]}|d vr|�qS ))� �.r ��.0�pr r r � <listcomp>� � z(_validate_tar_member.<locals>.<listcomp>c s s | ]}|d kV qdS )z..Nr rX r r r � <genexpr>� r\ z'_validate_tar_member.<locals>.<genexpr>z$Unsafe tar member (path traversal): z"Unsafe tar member (escapes root): z!Unsafe tar member (device file): rV z/usr/local/apache/domlogs/z*Unsafe tar member (absolute link target): z -> z.Unsafe tar member (link target escapes root): )�namerM rH �split�anyrD rE �joinrJ �isdev�issym�islnk�linkname�isabs)rQ rR rS r^ �parts� dest_pathZ link_target� link_destr r r �_validate_tar_member� s, �rj )� tarfile_path� extract_torS rC c C s� t j�| �s td| � d���t|t�sHdt� d|� �}t�|� t|��t j |dd� g }z�t � | d���}|� � }|D ] }t |||� |�|j� qvt�dt|�� d | � �� z|j||d d � W n ty� |j||d � Y n0 W d � n1 s�0 Y t�d| � d|� d�� W n> t�yZ } z$t�d| � d|� �� � W Y d }~n d }~0 0 dd� |D �} t�dt| �� �� t| �dk�r�t j�|| �� �} n|} t�d| � d|� �� | S )aO Safely extract a gzipped tar archive into extract_to. Security: - Only extracts into directories under bart_jobs_folder. - Validates all members for path traversal, devices, and unsafe links. - Uses tarfile's 'data' extraction filter when available. - No sudo fallback: if we can't extract, we fail fast. z Tar file z does not exist.z Refusing to extract outside �: T��exist_okzr:gzz Validated z members in �data)rE �members�filter)rE rq NzExtracted tar file z to z using standard tarfile modulezFailed to extract tar file c S s( h | ] }|r|� d �s|�d�d �qS )�.tar.gzrT r )�endswithr_ )rY rQ r r r � <setcomp>� s �z extract_tar.<locals>.<setcomp>ztop_level_folders: � )rD rE �exists�FileNotFoundErrorrP r r r rH �makedirs�tarfile�open� getmembersrj �appendr^ r& �len� extractallr< r( �listra �pop) rk rl rS �msgZ members_names�tarZ all_members�mr? Ztop_level_foldersZextracted_rootr r r � extract_tar� s@ 2 �r� c C s t dd| g�}|d uS )Nr� z-tzf)� run_command)� file_pathr6 r r r �is_valid_gzipped_tar� s r� c C s� z8t | d��}|�� }W d � n1 s*0 Y |W S ty� } z|t�d|� d�� z td| g�}|W W Y d }~S tjy� } z$t�d|j � � � �� � W Y d }~n d }~0 0 W Y d }~n d }~0 0 d S )N�rzStandard file read failed: �, attempting sudo fallback�cat� Failed to read file with sudo: ) r{ �readr< r r# �run_sudo_command� subprocess�CalledProcessErrorr �stderr�strip)�filenameZ original_file�contentsr? r6 �e2r r r �read_file_contents� s & r� c C sV zt d| g�}|W S tjyP } z$t�d|j�� � �� � W Y d }~n d }~0 0 d S )Nr� r� )r� r� r� r r r� r� )r� r6 r� r r r �read_file_contents_sudo s r� c C sT zt | �}t�|�W S tjyN } z td| � d|� ���W Y d }~n d }~0 0 d S )Nz Failed to parse JSON from file rm )r� �json�loads�JSONDecodeErrorrH )r� r� Zjer r r �read_json_file s r� )� backup_folderc C s� t | t�s.t�dt� d| � �� td| � ���tj�| �r�z t� | � t� d| � �� W n� t y� } z�t� d|� d�� z"t dd| g� t� d | � �� W n> tjy� } z$t�d | � d|� �� � W Y d }~n d }~0 0 W Y d }~n d }~0 0 d S ) Nz"Refusing to delete folder outside rm zUnsafe cleanup path: z Cleaned up backup folder at zStandard cleanup failed: r� Zrmz-rfz$Cleaned up backup folder with sudo: zSudo cleanup failed for )rP r r r rH rD rE rw �shutil�rmtreer( r< r# r� r� r� )r� r? r� r r r �cleanup_backup_folder s r� �rE c C sr zt j| dd� W nZ tyl t�d| � d�� tdd| g�}|d u rht�d| � d�� td | � ���Y n0 d S ) NTrn z!Permission denied while creating z, retrying with sudo...�mkdir�-p�Failed to create directory z even with sudo.�Could not create directory )rD ry �PermissionErrorr r# r� r )rE r6 r r r �create_directory* s r� c C sJ t | dd|g�}|d u rFt�d|� d| � d�� td|� d| � d���d S )Nr� r� r� z as user rW r� )�run_sudo_as_userr r r� )Z run_as_userrE r6 r r r �create_directory_as_user5 s r� )r� rC c C s` | � d�}t �|d��&}|j| tj�| �d� W d � n1 sB0 Y t�d|� �� |S )Nrs zw:gz)�arcname�Created tar file: )rz r{ �addrD rE �basenamer r( )r� rk r� r r r �create_backup_tar< s 4r� c C s� | � d�}t j�| �}t j�| �}ddd|d||g}z t|� t�d|� �� W n6 ty� } z t�d|� �� � W Y d }~n d }~0 0 |S )Nrs r� z!--use-compress-program=pigz -p 20z-cfz-Cr� zFailed to create tar: ) rD rE r� �dirnamer� r r( r< r )r� rk Z folder_name� parent_dir�cmdr? r r r �create_backup_tar_cliD s �r� c C sf t d��� }|D ]P}|�d�}|d �d�}|d }|| krd�|d �d�d d� �}| S qd S ) Nz/etc/userdatadomainsrm rv z==r rT � � )r� � splitlinesr_ ra )Zaccount_usernamer� �lineZsub_lineZsub_line_contentrS Zaccount_homedirr r r � read_homedir[ s r� )rE �ownerrC c C s@ zt |d| g�}|W S ty: } zW Y d }~d S d }~0 0 d S )Nz/bin/cat)r� r< )rE r� Z file_contentr? r r r �read_file_as_ownerg s r� i )r� � shell_mode� input_textrC c C s\ z�t | t�r| nd�| �}|d urFt�d|� dt|�d��� d�� nt�d|� �� tj| |dtj tj d|d�}t� d� |j W S tj �yV } z�|j p�d �� }|j p�d �� }g }|r�|�|� |r�|�|� |r�d �|�nd } t| �tk�r| d t� d } d | �� v �r"t�d� td��t�d|j� d| � �� t| ��W Y d }~n d }~0 0 d S )N� zRunning command: z [stdin bytes: zutf-8�]T)�shell�check�stdoutr� �text�inputz Command executed successfully.rV � zCommand failedz ...[truncated]za password is requiredz)Sudo Access Denied: password is required.z Command failed with exit code z . Output: )� isinstancer1 ra r r& r~ �encoder� �run�PIPEr( r� r� r� r� r} �_MAX_CMD_ERR_DETAIL_CHARS�lowerr r< � returncode) r� r� r� Zlog_cmdr6 r? r� r� rg Zdetailedr r r �_run_command_internalt sD $� �r� )r� r� rC c C s t | �}tddg| d|d�S )N�sudo�-nF�r� r� )r r� )r� r� Z wrapped_cmdr r r r� � s r� )�cmd_strr� rC c C s t | �}td|� �d|d�S )Nzsudo -n Tr� )r r� )r� r� Zwrapped_cmd_strr r r �run_sudo_command_str� s r� c C s t | d|d�S )NFr� �r� )r� r� r r r r� � s r� c C s t | d|d�S )NTr� r� )r� r� r r r �run_command_str� s r� )�run_asr� r� rC c C s t ddd| g| d|d�S )Nr� r� z-uFr� r� )r� r� r� r r r r� � s r� c C s. zt dd| g� W dS ty( Y dS 0 d S )N�testz-eTF�r� r< r� r r r �does_path_exists� s r� )rE rC c C s. zt dd| g� W dS ty( Y dS 0 d S )Nr� z-dTFr� r� r r r � is_directory� s r� c C sF t j�| �rBt j�| �}|dk r0t|d d�}nt|d d�}|S d S )Ni r� r )rD rE rw �getsize�round)rE Z size_bytesZsize_mbr r r �get_file_size_in_mb� s r� )rC c C s t d�S )Nz/usr/local/cpanel)r� r r r r �is_cpanel_server� s r� )N)N)N)N)N)N)N)N)N)3r� r� r� r= r2 rD rz �typingr r r Z app.configr Zapp.utils.log_helperr Zapp.utils.sudo_wrapperr r r+ r r; r@ r1 �boolrJ rP �TarInforj r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r �<module> s^ 5 )' : �� / "
cải xoăn