File: //proc/722141/root/lib/python3.6/site-packages/s3transfer/__pycache__/copies.cpython-36.pyc
3
\��_�3 � @ s� d dl Z d dlZd dlmZ d dlmZ d dlmZ d dlmZ d dlmZ d dlm Z d dlm
Z
d d lm Z G d
d � d e�Z G d d
� d
e�Z
G dd� de�ZdS )� N)�Task)�SubmissionTask)�CreateMultipartUploadTask)�CompleteMultipartUploadTask)�
get_callbacks)�calculate_range_parameter)�get_filtered_dict)�ChunksizeAdjusterc @ s� e Zd ZdZdddddddd d
�Zd d d
dddddddd g Zd d d
ddddddg Zd gZdd� Zdd� Z dd� Z
dd� Z d d � Z d d � Z
d d!� Zd"S )#�CopySubmissionTaskz+Task for submitting tasks to execute a copyZIfMatchZIfModifiedSinceZ IfNoneMatchZIfUnmodifiedSinceZSSECustomerKeyZSSECustomerAlgorithmZSSECustomerKeyMD5� RequestPayer)�CopySourceIfMatch�CopySourceIfModifiedSince�CopySourceIfNoneMatch�CopySourceIfUnmodifiedSince�CopySourceSSECustomerKey� CopySourceSSECustomerAlgorithm�CopySourceSSECustomerKeyMD5r r r
r r r r r ZMetadataDirectiveZTaggingDirectivec C s� |j jdkrr|j j}| j|j�}|j}x,|j� D ] \} }
| | jkr0|
|| j| < q0W |jj f |�} |j j
| d � |j j|j k r�| j |||||� n| j
|||||� dS )a�
:param client: The client associated with the transfer manager
:type config: s3transfer.manager.TransferConfig
:param config: The transfer config associated with the transfer
manager
:type osutil: s3transfer.utils.OSUtil
:param osutil: The os utility associated to the transfer manager
:type request_executor: s3transfer.futures.BoundedExecutor
:param request_executor: The request executor associated with the
transfer manager
:type transfer_future: s3transfer.futures.TransferFuture
:param transfer_future: The transfer future associated with the
transfer request that tasks are being submitted for
NZ
ContentLength)�meta�size� call_args�)_get_head_object_request_from_copy_source� copy_source�
extra_args�items� EXTRA_ARGS_TO_HEAD_ARGS_MAPPINGZ
source_clientZ head_objectZprovide_transfer_sizeZmultipart_threshold�_submit_copy_request�_submit_multipart_request) �self�client�config�osutil�request_executor�transfer_futurer Zhead_object_requestr �param�value�response� r& � /usr/lib/python3.6/copies.py�_submitF s"
zCopySubmissionTask._submitc C sL |j j}t|d�}| jj|t| j||j|j|j|j ||j j
d�dd�� d S )N�progress)r r �bucket�keyr � callbacksr T)�transfer_coordinator� main_kwargs�is_final) r r r �_transfer_coordinator�submit�CopyObjectTaskr r* r+ r r )r r r r r! r" r �progress_callbacksr& r& r' r | s
z'CopySubmissionTask._submit_copy_requestc C sr |j j}i }x(|jj� D ]\}} || jkr| ||< qW | jj|t| j||j|j |d�d��}
|j
} t � } | j | |j j
�} ttj|j j
t| � ��}
g }t|d�}x�td|
d �D ]~}| j|j�}t| |d |
|j j
�|d< | j| |d |
|j j
�}|j| jj|t| j||j|j|j ||||d�d|
id��� q�W | j|j�}| jj|t| j||j|j |d�|
|d �d
d �� d S ) N)r r* r+ r )r- r. r) � ZCopySourceRange)r r r* r+ � part_numberr r, r � upload_id)r- r. �pending_main_kwargs)r6 �partsT)r- r. r7 r/ ) r r r r � CREATE_MULTIPART_ARGS_BLACKLISTr0 r1 r r* r+ Zmultipart_chunksizer Zadjust_chunksizer �int�mathZceil�floatr �range�_extra_upload_part_argsr �_get_transfer_size�append� CopyPartTaskr � _extra_complete_multipart_argsr )r r r r r! r" r Zcreate_multipart_extra_argsr# �valZcreate_multipart_future� part_sizeZadjuster� num_partsZ part_futuresr3 r5 Zextra_part_argsr Z complete_multipart_extra_argsr& r& r' r � sn
z,CopySubmissionTask._submit_multipart_requestc C s, t |t�rtj|�S td|t|�f ��d S )NzZExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got %s or type %s.)�
isinstance�dict�copy� TypeError�type)r r r& r& r' r � s
z<CopySubmissionTask._get_head_object_request_from_copy_sourcec C s t || j�S )N)r �UPLOAD_PART_COPY_ARGS)r r r& r& r' r> � s z*CopySubmissionTask._extra_upload_part_argsc C s t || j�S )N)r �COMPLETE_MULTIPART_ARGS)r r r& r& r' rB s z1CopySubmissionTask._extra_complete_multipart_argsc C s ||d kr||| S |S )Nr4 r& )r rD Z
part_indexrE Ztotal_transfer_sizer& r& r' r? s z%CopySubmissionTask._get_transfer_sizeN)�__name__�
__module__� __qualname__�__doc__r rK r9 rL r( r r r r> rB r? r& r& r& r' r
sJ 6] r
c @ s e Zd ZdZdd� ZdS )r2 z Task to do a nonmultipart copyc C s4 |j f |||d�|�� x|D ]}||d� q W dS )a�
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to copy to
:param key: The name of the key to copy to
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy
:param size: The size of the transfer. This value is passed into
the callbacks
)�
CopySource�Bucket�Key)�bytes_transferredN)Z copy_object) r r r r* r+ r r, r �callbackr& r& r' �_main s
zCopyObjectTask._mainN)rM rN rO rP rV r& r& r& r' r2 s r2 c @ s e Zd ZdZdd� ZdS )rA z)Task to upload a part in a multipart copyc
C sJ |j f |||||d�|��}
x|D ]} | | d� q"W |
d d } | |d�S )a�
:param client: The client to use when calling PutObject
:param copy_source: The CopySource parameter to use
:param bucket: The name of the bucket to upload to
:param key: The name of the key to upload to
:param upload_id: The id of the upload
:param part_number: The number representing the part of the multipart
upload
:param extra_args: A dictionary of any extra arguments that may be
used in the upload.
:param callbacks: List of callbacks to call after copy part
:param size: The size of the transfer. This value is passed into
the callbacks
:rtype: dict
:returns: A dictionary representing a part::
{'Etag': etag_value, 'PartNumber': part_number}
This value can be appended to a list to be used to complete
the multipart upload.
)rQ rR rS ZUploadId�
PartNumber)rT ZCopyPartResult�ETag)rX rW )Zupload_part_copy)
r r r r* r+ r6 r5 r r, r r% rU Zetagr& r& r' rV & s
zCopyPartTask._mainN)rM rN rO rP rV r& r& r& r' rA $ s rA )rH r; Zs3transfer.tasksr r r r Zs3transfer.utilsr r r r r
r2 rA r& r& r& r' �<module>
s u