ruạṛ
a ���f�H � @ sj d dl mZ d dlZd dlmZ ddlmZmZ ddlm Z m Z ddl m Z dd l mZ G d d � d �ZdS ) � )�print_functionN)�requests� )�MultipartObjectAssembler� DEFAULT_PARALLEL_PROCESS_COUNT)�DEFAULT_PART_SIZE�STREAMING_DEFAULT_PART_SIZE)�FileReadCallbackStream� )�MultipartUploadErrorc @ sT e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Ze d d � �Z e e fdd��Z dS )� UploadManager� c K s` || _ d|v r|d nd| _d|v r,|d nd| _d|v rB|d nd| _t�| j | j| j� dS )aj UploadManager simplifies interaction with the Object Storage service by abstracting away the method used to upload objects. Depending on the configuration parameters, UploadManager may choose to do a single put_object request, or break up the upload into multiple parts and utilize multi-part uploads. An advantage of using multi-part uploads is the ability to retry individual failed parts, as well as being able to upload parts in parallel to reduce upload time. PLEASE NOTE that for oci versions < 2.23.2 and >= 2.18.0, timeout for the object storage client is overwritten to `None` for all operations which call object storage. For this reason, the operations are NOT thread-safe, and you should provide the UploadManager class with its own Object Storage client that isn't used elsewhere. For more information please see `Known Issues <https://oracle-cloud-infrastructure-python-sdk.readthedocs.io/en/latest/known-issues.html>`_ :param ObjectStorageClient object_storage_client: A configured object storage client to use for interacting with the Object Storage service. :param bool allow_multipart_uploads (optional): Whether or not this UploadManager supports performing mulitpart uploads. Defaults to True. :param bool allow_parallel_uploads (optional): Whether or not this UploadManager supports uploading individual parts of a multipart upload in parallel. This setting has no effect on uploads that are performed using a single put_object call. Defaults to True. :param int parallel_process_count (optional): The number of worker processes to use in parallel for uploading individual parts of a multipart upload. This setting is only used if allow_parallel_uploads is set to True. Defaults to 3. �allow_multipart_uploadsT�allow_parallel_uploads�parallel_process_countN)�object_storage_clientr r r r � _add_adapter_to_service_client)�selfr �kwargs� r �N/usr/lib/python3.9/site-packages/oci/object_storage/transfer/upload_manager.py�__init__ s zUploadManager.__init__c K s2 d|vrt |d< | j|d< | jdur.| j|d< t| j|||fi |��}i }d|v r^|d |d< |�� z|j|fi |�� W n ty� |�� � Y n0 t |j d �dkr�|� � }nx|�� |� � } d| v r�| d | d < | � d� | � dd� | � dd� | � dd� | � dd� | jj|||d fi | ��S |S ) u� Uploads streaming data to Object Storage. If the stream is non-empty, this will always perform a multipart upload, splitting parts based on the part size (10 MiB if none specified). If the stream is empty, this will upload a single empty object to Object Storage. Stream uploads are not currently resumable. PLEASE NOTE that for oci versions < 2.53.1, this operation potentially causes data corruption. For more information, please see this `github issue <https://github.com/oracle/oci-python-sdk/issues/410>`_ :param str namespace_name: The namespace containing the bucket in which to store the object. :param str bucket_name: The name of the bucket in which to store the object. :param str object_name: The name of the object in Object Storage. :param stream_ref: The stream to read data from. :param int part_size (optional): Override the default streaming part size of 10 MiB, value is in bytes. :param function progress_callback (optional): Callback function to receive the number of bytes uploaded since the last call to the callback function. :param str if_match (optional): The entity tag of the object to match. :param str if_none_match (optional): The entity tag of the object to avoid matching. The only valid value is ‘*’, which indicates that the request should fail if the object already exists. :param str content_type (optional): The content type of the object to upload. :param str content_language (optional): The content language of the object to upload. :param str content_encoding (optional): The content encoding of the object to upload. :param str content_disposition (optional): The content disposition of the object to upload. :param str cache_control (optional): The cache control for the object to upload. :param dict metadata (optional): A dictionary of string to string values to associate with the object to upload :param str storage_tier: (optional) The storage tier that the object should be stored in. If not specified, the object will be stored in the same storage tier as the bucket. Allowed values are: "Standard", "InfrequentAccess", "Archive" :return: The response from multipart commit operation or the put operation. In both cases this will be a :class:`~oci.response.Response` object with data of type None. For a multipart upload (non-empty stream data) the :class:`~oci.response.Response` will contain the :code:`opc-multipart-md5` header and for a non-multipart upload (empty stream data) it will contain the :code:`opc-content-md5 header`. :rtype: :class:`~oci.response.Response` � part_sizer Nr �progress_callback�partsr �metadata�opc_meta� )r r r r r � new_upload� upload_streamr �abort�lenZmanifest�commit�copy�pop� put_object) r �namespace_name� bucket_name� object_nameZ stream_refr �ma� upload_kwargs�responseZ copy_kwargsr r r r 4 sF H �� zUploadManager.upload_streamc K s> t }d|v r |d }|�d� t|d�� ��}t�|�� �j}| jrPtj ||d�sv| j ||||fi |��W d � S d|v r�|�d� ||d< | j |d< | j dur�| j |d< t | j|||fi |��} i } d|v r�|d | d< | �� | �|� | jf i | �� | �� } | W d � S W d � n1 �s00 Y dS ) u� Uploads an object to Object Storage. Depending on the options provided and the size of the object, the object may be uploaded in multiple parts. :param str namespace_name: The namespace containing the bucket in which to store the object. :param str bucket_name: The name of the bucket in which to store the object. :param str object_name: The name of the object in Object Storage. :param file_path: The path to the file to upload. :param int part_size (optional): Override the default part size of 128 MiB, value is in bytes. :param function progress_callback (optional): Callback function to receive the number of bytes uploaded since the last call to the callback function. :param str if_match (optional): The entity tag of the object to match. :param str if_none_match (optional): The entity tag of the object to avoid matching. The only valid value is ‘*’, which indicates that the request should fail if the object already exists. :param str content_md5: (optional) The base-64 encoded MD5 hash of the body. This parameter is only used if the object is uploaded in a single part. :param str content_type (optional): The content type of the object to upload. :param str content_language (optional): The content language of the object to upload. :param str content_encoding (optional): The content encoding of the object to upload. :param str content_disposition (optional): The content disposition of the object to upload. :param str cache_control (optional): The cache control for the object to upload. :param dict metadata (optional): A dictionary of string to string values to associate with the object to upload :param str storage_tier: (optional) The storage tier that the object should be stored in. If not specified, the object will be stored in the same storage tier as the bucket. Allowed values are: "Standard", "InfrequentAccess", "Archive" :return: The response from multipart commit operation or the put operation. In both cases this will be a :class:`~oci.response.Response` object with data of type None. For a multipart upload the :class:`~oci.response.Response` will contain the :code:`opc-multipart-md5` header and for a non-multipart upload it will contain the :code:`opc-content-md5 header`. :rtype: :class:`~oci.response.Response` r �rb)r NZ content_md5r r r )r r$ �open�os�fstat�fileno�st_sizer r �_use_multipart�_upload_singlepartr r r r r �add_parts_from_fileZuploadr" ) r r& r' r( � file_pathr r � file_object� file_sizer) r* r+ r r r � upload_file� s: F & �� zUploadManager.upload_filec K s� i }d|v r"|d |d< |� d� | j|d< | jdur@| j|d< t| j|||fi |��}|�|� |jf d|i|�� |�� } | S )a� Resume a multipart upload. :param str namespace_name: The namespace containing the bucket and multipart upload to resume. :param str bucket_name: The name of the bucket that contains the multipart upload to resume. :param str object_name: The name of the object in Object Storage. :param file_path: The path to the file to upload. :param str upload_id: The upload id for the multipart upload to resume. :param int part_size (optional): Part size, in bytes, to use when resuming the transfer. The default is 128 mebibytes. If this value is supplied, it must be the same value as the one used when the original upload was started. :param function progress_callback (optional): Callback function to receive the number of bytes uploaded since the last call to the callback function. :return: The response from the multipart commit operation. This will be a :class:`~oci.response.Response` object with data of type None :rtype: :class:`~oci.response.Response` r r Nr � upload_id)r$ r r r r r4 Zresumer" ) r r& r' r( r5 r9 r Z resume_kwargsr) r+ r r r �resume_upload_file s$ ) �� z UploadManager.resume_upload_filec s� d|v r |d |d< |� d� d � d|v r<|d � |� d� t|d��t}t�|�� �j}|dkr�� r�t|� fdd��}| jj||||fi |��} n| jj||||fi |��} W d � n1 s�0 Y | S )Nr r r r, r c s � | �S �Nr )Z bytes_read�r r r �<lambda>n r z2UploadManager._upload_singlepart.<locals>.<lambda>) r$ r- r. r/ r0 r1 r r r% ) r r& r' r( r5 r r6 r7 Z wrapped_filer+ r r< r r3 V s8 �����$z UploadManager._upload_singlepartc C s� |r|s d S | j j}d}|�d�r&d}t}|d ur6|}tj| }tjj|d�}|| j j jv rt| j j j| j |krtd S | j j � ||� d S )Nzhttps://zhttp://)Z pool_maxsize) Z base_client�endpoint� startswithr r �REQUESTS_POOL_SIZE_FACTORr ZadaptersZ HTTPAdapterZsessionZ _pool_maxsizeZmount)r r r r> Zmount_protocolZparallel_processesZtarget_pool_sizeZadapterr r r r } s z,UploadManager._add_adapter_to_service_clientc C s || k S r; r )Zcontent_lengthr r r r r2 � s z UploadManager._use_multipartN) �__name__� __module__� __qualname__r@ r r r8 r: r3 � staticmethodr r r2 r r r r r s #|i=' r )Z __future__r r. Z oci._vendorr Z#internal.multipart_object_assemblerr r Z constantsr r Z"internal.file_read_callback_streamr � exceptionsr r r r r r �<module> s
cải xoăn