File: //usr/lib64/python3.6/site-packages/borg/__pycache__/locking.cpython-36.opt-1.pyc
3
�iD; � @ s� d dl Z d dlZd dlZd dlZddlmZ ddlmZmZ ddl m
Z
d \Z Z Z
d \ZZe
e�Z G d d � d �ZG d
d� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� d�ZG dd � d �ZG d d � d �ZdS )!� N� )�platform)�Error�ErrorWithTraceback)�
create_logger�add�remove�remove2�shared� exclusivec @ sB e Zd ZdZddd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dS )� TimeoutTimerz�
A timer for timeout checks (can also deal with "never timeout").
It can also compute and optionally execute a reasonable sleep time (e.g. to avoid
polling too often or to support thread/process rescheduling).
Nc C sX |dk r|dk rt d��|| _|dkrB|dkr4d}ntd|d �}|| _d| _d| _dS )ag
Initialize a timer.
:param timeout: time out interval [s] or None (never timeout, wait forever) [default]
:param sleep: sleep interval [s] (>= 0: do sleep call, <0: don't call sleep)
or None (autocompute: use 10% of timeout [but not more than 60s],
or 1s for "never timeout" mode)
Nr ztimeout must be >= 0g �?g N@g $@)�
ValueError�timeout_interval�min�sleep_interval�
start_time�end_time)�self�timeout�sleep� r � /usr/lib64/python3.6/locking.py�__init__ s zTimeoutTimer.__init__c C s d| j j| j| j| j| jf S )Nz)<%s: start=%r end=%r timeout=%r sleep=%r>)� __class__�__name__r r r r )r r r r �__repr__+ s zTimeoutTimer.__repr__c C s& t j � | _| jd k r"| j| j | _| S )N)�timer r r )r r r r �start0 s
zTimeoutTimer.startc C s | j dkrtj| j � d S )Nr )r r r )r r r r r 6 s
zTimeoutTimer.sleepc C s | j d k otj� | j kS )N)r r )r r r r � timed_out: s zTimeoutTimer.timed_outc C s | j � r dS | j� dS d S )NTF)r r )r r r r �timed_out_or_sleep= s z TimeoutTimer.timed_out_or_sleep)NN)
r �
__module__� __qualname__�__doc__r r r r r r r r r r r s
r c @ s e Zd ZdZdS )� LockErrorz Failed to acquire the lock {}.N)r r r! r" r r r r r# E s r# c @ s e Zd ZdZdS )�
LockErrorTz Failed to acquire the lock {}.N)r r r! r" r r r r r$ I s r$ c @ s e Zd ZdZdS )� LockTimeoutz/Failed to create/acquire the lock {} (timeout).N)r r r! r" r r r r r% M s r% c @ s e Zd ZdZdS )�
LockFailedz*Failed to create/acquire the lock {} ({}).N)r r r! r" r r r r r& Q s r& c @ s e Zd ZdZdS )� NotLockedz/Failed to release the lock {} (was not locked).N)r r r! r" r r r r r' U s r' c @ s e Zd ZdZdS )� NotMyLockz=Failed to release the lock {} (was/is locked, but not by me).N)r r r! r" r r r r r( Y s r( c @ sl e Zd ZdZddd�Zdd� Zdd � Zd
d � Zdd d
�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� ZdS ) �
ExclusiveLocka/ An exclusive Lock based on mkdir fs operation being atomic.
If possible, try to use the contextmanager here like::
with ExclusiveLock(...) as lock:
...
This makes sure the lock is released again if the block is left, no
matter how (e.g. if an exception occurred).
NFc C sP || _ || _tjj|�| _|p$tj� | _tjj| jd| j �| _ || _
d| _ d S )Nz%s.%d-%xF) r r �os�path�abspathr �get_process_id�id�join� unique_name�kill_stale_locks�stale_warning_printed)r r+ r r r. r1 r r r r h s zExclusiveLock.__init__c C s | j � S )N)�acquire)r r r r � __enter__q s zExclusiveLock.__enter__c G s | j � d S )N)�release)r �excr r r �__exit__t s zExclusiveLock.__exit__c C s d| j j| jf S )Nz<%s: %r>)r r r0 )r r r r r w s zExclusiveLock.__repr__c C s� |d kr| j }|d kr | j}t||�j� }x�ytj| j� W nl tk
rv | j� rX| S | j � |j
� rrt | j��Y q, t k
r� } zt
| jt|��d �W Y d d }~X q,X t| jd�� W d Q R X | S q,W d S )N�wb)r r r r r* �mkdirr+ �FileExistsError�by_me�kill_stale_lockr r% �OSErrorr& �str�openr0 )r r r �timer�errr r r r3 z s& $
zExclusiveLock.acquirec C s@ | j � st| j��| j� s$t| j��tj| j� tj| j� d S )N) � is_lockedr' r+ r; r( r* �unlinkr0 �rmdir)r r r r r5 � s
zExclusiveLock.releasec C s t jj| j�S )N)r* r+ �exists)r r r r rB � s zExclusiveLock.is_lockedc C s t jj| j�S )N)r* r+ rE r0 )r r r r r; � s zExclusiveLock.by_mec
" C s� yt j| j�}W n tk
r$ dS X �x|D � ]�}y4|jdd�\}}|jdd�\}}t|�}t|�}W n$ tk
r� tjd|| j� dS X t j
|||�r�dS | j s�| j s�tj
d|� d| _ dS y&t jt jj| j|�� tj
d|� W q. tk
�r* } z$| j �s tjd |t| �� d| _ dS d } ~ X q.X q.W yt j| j� W nD tk
�r� } z&| jtjk�rfdS tjd
t| �� dS d } ~ X nX dS ) NF�-r �.z9Found malformed lock %s in %s. Please check/fix manually.zOFound stale lock %s, but not deleting because BORG_HOSTNAME_IS_UNIQUE is False.TzKilled stale lock %s.z0Found stale lock %s, but cannot delete due to %sz Failed to remove lock dir: %s)r* �listdirr+ �FileNotFoundError�rsplit�intr
�logger�errorr �
process_aliver1 r2 �warningrC r/ r= r> rD �errnoZ ENOTEMPTY)
r �names�nameZhost_pidZ
thread_str�hostZpid_str�pid�threadrA r r r r< � sH z ExclusiveLock.kill_stale_lockc C sD | j � r@x*tj| j�D ]}tjtjj| j|�� qW tj| j� d S )N)rB r* rH r+ rC r/ rD )r rR r r r �
break_lock� s zExclusiveLock.break_lockc
C sX t jj| jd| �}| j� rF| j� rFt|d�� W dQ R X t j| j� || | _| _dS )z0migrate the lock ownership from old_id to new_idz%s.%d-%xr8 N) r* r+ r/ rB r; r? rC r0 r. )r �old_id�new_idZnew_unique_namer r r � migrate_lock� s
zExclusiveLock.migrate_lock)NNNF)NN)r r r! r" r r4 r7 r r3 r5 rB r; r< rV rY r r r r r) ] s
2r) c @ sR e Zd ZdZddd�Zdd� Zdd � Zd
d � Zd d
� Zdd� Z dd� Z
dd� Z dS )�
LockRosterz�
A Lock Roster to track shared/exclusive lockers.
Note: you usually should call the methods with an exclusive lock held,
to avoid conflicting access by multiple threads/processes/machines.
NFc C s || _ |ptj� | _|| _d S )N)r+ r r- r. r1 )r r+ r. r1 r r r r � s zLockRoster.__init__c C s� y�t | j��}tj|�}W d Q R X | jr�x�ttfD ]�}y || }W n tk
rX w2Y nX t� }xD|D ]<\}}}t j
|||�r�|j |||f� qft j
d||||� qfW t|�||< q2W W n ttfk
r� i }Y nX |S )Nz:Removed stale %s roster lock for host %s pid %d thread %d.)r? r+ �json�loadr1 �SHARED� EXCLUSIVE�KeyError�setr rN r rL rO �listrI r
) r �f�data�keyZentries�elementsrS rT rU r r r r\ � s&
zLockRoster.loadc
C s( t | jd��}tj||� W d Q R X d S )N�w)r? r+ r[ �dump)r rc rb r r r �save s zLockRoster.savec C s* yt j| j� W n tk
r$ Y nX d S )N)r* rC r+ rI )r r r r r
s zLockRoster.removec C s" | j � }tdd� |j|g �D ��S )Nc s s | ]}t |�V qd S )N)�tuple)�.0�er r r � <genexpr> s z!LockRoster.get.<locals>.<genexpr>)r\ r` �get)r rd �rosterr r r rm s zLockRoster.getc s t � fdd�|D ��S )Nc 3 s | ]}� j |� V qd S )N)rm )rj rd )r r r rl s z#LockRoster.empty.<locals>.<genexpr>)�all)r �keysr )r r �empty s zLockRoster.emptyc C s� | j � }ytdd� || D ��}W n tk
r< t� }Y nX |tkrT|j| j� n8|tkrj|j| j� n"|tkr�|j | j� n t
d| ��t dd� |D ��||< | j |� d S )Nc s s | ]}t |�V qd S )N)ri )rj rk r r r rl s z$LockRoster.modify.<locals>.<genexpr>zUnknown LockRoster op %rc s s | ]}t |�V qd S )N)ra )rj rk r r r rl ( s )
r\ r` r_ �ADDr r. �REMOVE�discard�REMOVE2r r
ra rh )r rd �oprn re r r r �modify s zLockRoster.modifyc C s^ | j d }| _ zBy| j|t� W n tk
r: || _Y nX || _| j|t� W d|| _ X dS )z0migrate the lock ownership from old_id to new_idFN)r1 rw ru r_ r. rr )r rd rW rX Zkillingr r r rY + s zLockRoster.migrate_lock)NF) r r r! r" r r\ rh r rm rq rw rY r r r r rZ � s
rZ c @ st e Zd ZdZd dd�Zdd� Zdd � Zd
d � Zd d d
�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� ZdS ) �Locka�
A Lock for a resource that can be accessed in a shared or exclusive way.
Typically, write access to a resource needs an exclusive lock (1 writer,
no one is allowed reading) and read access to a resource needs a shared
lock (multiple readers are allowed).
If possible, try to use the contextmanager here like::
with Lock(...) as lock:
...
This makes sure the lock is released again if the block is left, no
matter how (e.g. if an exception occurred).
FNc C sT || _ || _|| _|| _|p"tj� | _t|d ||d�| _t |d |||d�| _
d S )Nz.roster)r. r1 z
.exclusive)r. r r1 ) r+ � is_exclusiver r r r- r. rZ �_rosterr) �_lock)r r+ r r r r. r1 r r r r N s z
Lock.__init__c C s | j � S )N)r3 )r r r r r4 [ s zLock.__enter__c G s | j � d S )N)r5 )r r6 r r r r7 ^ s z
Lock.__exit__c C s d| j j| jf S )Nz<%s: %r>)r r r. )r r r r r a s z
Lock.__repr__c
C s| |d kr| j }|p| jpd}|r<| j||� | jjtt� n6| j�* |d k rZ| jj|t� | jjt t� W d Q R X || _ | S )Ng�������?)
ry r �_wait_for_readers_finishingrz rw r^ rr r{ rs r] )r r r r r r r r3 d s z Lock.acquirec C s� t | j|�j� }x�| jj� yH|d k r4| jj|t� t| jj t
��dkrLd S |d k rb| jj|t � W n | jj � � Y n X | jj � |j
� rt| j��qW d S )Nr )r r r r{ r3 rz rw rs �lenrm r] rr r5 r r% r+ )r r r r@ r r r r| s s
z Lock._wait_for_readers_finishingc
C st | j r8| jjtt� | jjtt�r,| jj� | jj � n8| j�, | jjtt� | jjtt�rf| jj� W d Q R X d S )N)
ry rz rw r^ rs rq r] r r{ r5 )r r r r r5 � s
z Lock.releasec C s | j s| jdtd� d S )NT)r r )ry r3 r] )r r r r �upgrade� s z Lock.upgradec C s | j r| jdtd� d S )NF)r r )ry r3 r^ )r r r r � downgrade� s zLock.downgradec C s | j o| jj� o| jj� S )N)ry r{ rB r; )r r r r �got_exclusive_lock� s zLock.got_exclusive_lockc C s | j j� | jj� d S )N)rz r r{ rV )r r r r rV � s
zLock.break_lockc C s` || _ | jr,| jj||� | jjt||� n0| j�$ | jj||� | jjt||� W d Q R X d S )N)r. ry r{ rY rz r^ r] )r rW rX r r r rY � s zLock.migrate_lock)FNNNF)NNN)r r r! r" r r4 r7 r r3 r| r5 r~ r r� rV rY r r r r rx ? s
rx )r r r )r
r )rP r[ r* r � r Zhelpersr r rL r rr rs ru r] r^ r r r# r$ r% r& r' r( r) rZ rx r r r r �<module> s(
5 ^