ruạṛ
a ���f�? � @ sx d dl Z d dlZd dlZd dlmZ d dlmZmZ G dd� de�ZG dd� de �Z G dd � d e �Z G d d � d e �Z dS ) � N)�Enum)�DownloadTerminated�#DownloadFailedIncorrectDownloadSizec @ s e Zd ZdZdZdZdS )� DownloadStater � � N)�__name__� __module__� __qualname__Z DOWNLOADING�PAUSED� TERMINATED� r r �`/usr/lib/python3.9/site-packages/oci/object_storage/transfer/internal/download/DownloadThread.pyr s r c @ s: e Zd ZdZddd�Zdd� Zdd � Zd d � Zd d � ZdS )�DownloadThreada The main class whose methods the threads use to perform the downloads and write to the stream. :param: DownloadManager download_manager: The download manger object :param: DownloadConfiguration download_configuration: The download configuration object :param: ObjectStorageClient object_storage_client: The object storage client :param: str namespace_name: The namespace name :param: str bucket_name: The bucket name :param: str object_name: The object name :param: bytestream stream: The stream to write into :param: int bytes_downloaded: The bytes downloaded so far before invoking this. :param: int object_size: The total size of the download in bytes, including the bytes already downloaded :param function progress_callback: (optional) This function is used to update the progress bar of the download operation. The arguments that it takes are (total_bytes_downloaded_so_far, total_bytes_to_download) :param any start_byte: (optional) The byte in the content of the object from which to start the download. The default value is 0 :param any end_byte: (optional) The byte in the content of the object from which to stop the download. The default value is the last byte of the object. Note: Both the start_byte and end_byte are included in the download. :param: bool did_some_parts_fail: True if some parts fail to download. :param: dict failed_parts: A dictionary filled with all the failed parts. Key: Failed part, Value: Error {(start_byte, end_byte) : error, (start_byte, end_byte): error,...} :param str version_id: (optional) VersionId used to identify a particular version of the object :param str if_match: (optional) The entity tag (ETag) to match with the ETag of an existing resource. If the specified ETag matches the ETag of the existing resource, GET and HEAD requests will return the resource and PUT and POST requests will upload the resource. :param str if_none_match: (optional) The entity tag (ETag) to avoid matching. Wildcards ('*') are not allowed. If the specified ETag does not match the ETag of the existing resource, the request returns the expected response. If the ETag matches the ETag of the existing resource, the request returns an HTTP 304 status without a response body. :param str opc_client_request_id: (optional) The client request ID for tracing. :param str opc_sse_customer_algorithm: (optional) The optional header that specifies "AES256" as the encryption algorithm. For more information, see `Using Your Own Keys for Server-Side Encryption`__. __ https://docs.cloud.oracle.com/Content/Object/Tasks/usingyourencryptionkeys.htm :param str opc_sse_customer_key: (optional) The optional header that specifies the base64-encoded 256-bit encryption key to use to encrypt or decrypt the data. For more information, see `Using Your Own Keys for Server-Side Encryption`__. __ https://docs.cloud.oracle.com/Content/Object/Tasks/usingyourencryptionkeys.htm :param str opc_sse_customer_key_sha256: (optional) The optional header that specifies the base64-encoded SHA256 hash of the encryption key. This value is used to check the integrity of the encryption key. For more information, see `Using Your Own Keys for Server-Side Encryption`__. __ https://docs.cloud.oracle.com/Content/Object/Tasks/usingyourencryptionkeys.htm :param str http_response_content_disposition: (optional) Specify this query parameter to override the value of the Content-Disposition response header in the GetObject response. :param str http_response_cache_control: (optional) Specify this query parameter to override the Cache-Control response header in the GetObject response. :param str http_response_content_type: (optional) Specify this query parameter to override the Content-Type response header in the GetObject response. :param str http_response_content_language: (optional) Specify this query parameter to override the Content-Language response header in the GetObject response. :param str http_response_content_encoding: (optional) Specify this query parameter to override the Content-Encoding response header in the GetObject response. :param str http_response_expires: (optional) Specify this query parameter to override the Expires response header in the GetObject response. :param obj retry_strategy: (optional) A retry strategy to apply to this specific operation/call. This will override any retry strategy set at the client-level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. This operation uses :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` as default if no retry strategy is provided. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. To have this operation explicitly not perform any retries, pass an instance of :py:class:`~oci.retry.NoneRetryStrategy`. :param bool allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this request should allow control characters in the response object. By default, the response will not allow control characters in strings Nr c s� || _ || _|| _|| _|| _|| _|| _| j�� | _|| _ | | _ | | _ | | _ | | _ d| _i | _g d�� � fdd�t�| �D �}|r�td|����| | _d S )NF)Zallow_control_chars�retry_strategyZ version_idZif_matchZ if_none_matchZopc_client_request_idZopc_sse_customer_algorithmZopc_sse_customer_keyZopc_sse_customer_key_sha256Z!http_response_content_dispositionZhttp_response_cache_controlZhttp_response_content_typeZ http_response_content_languageZ http_response_content_encodingZhttp_response_expiresc s g | ]}|� vr|�qS r r )�.0Z_key�Zexpected_kwargsr r � <listcomp>� � z+DownloadThread.__init__.<locals>.<listcomp>z get_object got unknown kwargs: )�download_manager�download_config�object_storage_client�namespace_name� bucket_name� object_name�stream�tell�stream_original_start�bytes_downloaded� object_size�progress_callback� start_byte�end_byte�did_some_parts_fail� failed_parts�sixZiterkeys� ValueError� header_args)�selfr r r r r r r r r r r! r" �kwargsZ extra_kwargsr r r �__init__� s, �zDownloadThread.__init__c c s( | j }|| jkr$|V || jj7 }qd S �N)r! r" r �part_size_in_bytes)r( r! r r r �get_start_bytes� s z DownloadThread.get_start_bytesc C s | j r dS | jS )N���)r# r )r( r r r � get_response� s zDownloadThread.get_responsec C s d S r+ r )r( �part_start_byter r r �get_part_with_start_byte� s z'DownloadThread.get_part_with_start_bytec C s d S r+ r )r( � part_contentr0 r r r �write_part_to_stream� s z#DownloadThread.write_part_to_stream)Nr N) r r r �__doc__r* r- r/ r1 r3 r r r r r s } � 8r c s6 e Zd Zd � fdd� Zdd� Zdd� Zd d � Z� ZS ) �SequentialDownloaderNr c s2 t t| �j||||||||| | | | f i | �� d S r+ )�superr5 r* �r( r r r r r r r r r r r! r" r) �� __class__r r r* � s ��z SequentialDownloader.__init__c C sH | j | | j }| j�|� | j�|� | j�� }| �|| � || S r+ )r r! r �seek�writer �callback�r( r2 r0 Z stream_startZ stream_endr r r r3 � s z)SequentialDownloader.write_part_to_streamc C s, | j |7 _ | j }| jr(| �|| j� d S r+ )r r r �r( Zdownloaded_bytesZtotal_bytes_downloadedr r r r< � s z SequentialDownloader.callbackc C sr | j jtjkr t�| jj� q | j jtjkrT| j � d� | j � � | j � � t d��| jrtt| j|| jj d �}n|| jj d }| j}d|� d|� �}d| jvr�| j�� | jd< z~|j| j| j| jfd|i| j��}|jj}|j� � || d }|dk�r0| �||�}||k�r0d| _t ||�| j ||f< W n: t �yl } z d| _| | j ||f< W Y d } ~ n d } ~ 0 0 d S � Nr z!Download canceled, Thread Stoppedr zbytes=�-r �rangeT) r �stater r �time�sleepr �pause_wait_in_secondsr r r: �truncate�closer r" �minr, r r' �make_retry_strategy� get_objectr r r �data�contentr3 r# r r$ � Exception� r( r0 Z part_end_byter Z range_headerZresponser2 r, Z bytes_written�er r r r1 � sB �� �z-SequentialDownloader.get_part_with_start_byte)Nr N�r r r r* r3 r< r1 � __classcell__r r r8 r r5 � s �r5 c s6 e Zd Zd � fdd� Zdd� Zdd� Zd d � Z� ZS ) �ParallelDownloaderNr c sP t t| �j||||||||| | | | f i | �� t�� | _t�� | _t�� | _d S r+ )r6 rR r* �multiprocessing�Lock� stream_lock� callback_lock�failed_parts_lockr7 r8 r r r* ' s �� zParallelDownloader.__init__c C sr | j �X | j| | j }| j�|� | j�|� | j�� }| �|| � || W d � S 1 sd0 Y d S r+ )rU r r! r r: r; r r< r= r r r r3 ? s z'ParallelDownloader.write_part_to_streamc C sR | j �$ | j|7 _| j}W d � n1 s00 Y | jrN| �|| j� d S r+ )rV r r r r> r r r r< H s $zParallelDownloader.callbackc C s� | j jtjkr t�| jj� q | j jtjkrT| j � d� | j � � | j � � t d��| jrtt| j|| jj d �}n|| jj d }| j}d|� d|� �}d| jvr�| j�� | jd< z�|j| j| j| jfd|i| j��}|jj}|j� � || d }|dk�rX| �||�}||k�rX| j�* d| _ t ||�| j ||f< W d � n1 �sN0 Y W nb t �y� } zH| j�$ d| _ | | j ||f< W d � n1 �s�0 Y W Y d } ~ n d } ~ 0 0 d S r? ) r rB r r rC rD r rE r r r: rF rG r r" rH r, r r' rI rJ r r r rK rL r3 rW r# r r$ rM rN r r r r1 P sF �� �2z+ParallelDownloader.get_part_with_start_byte)Nr NrP r r r8 r rR & s � rR ) r% rC rS �enumr Zoci.exceptionsr r r �objectr r5 rR r r r r �<module> s FO
cải xoăn