Q`5ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z ddl m Z dZ dZdZe j j"e j j$zZd d gZej*eej.fZdd d Zej4dd edefdZGddej:ZGdd eZGddeZ GddeZ!GddeZ"y)N) constants) exceptions) portalockerg?FLock open_atomic) test_valuec"|D] }||us|cSy)aSimple coalescing function that returns the first value that is not equal to the `test_value`. Or `None` if no value is valid. Usually this means that the last given value is the default value. Note that the `test_value` is compared using an identity check (i.e. `value is not test_value`) so changing the `test_value` won't work for all values. >>> coalesce(None, 1) 1 >>> coalesce() >>> coalesce(0, False, True) 0 >>> coalesce(0, False, True, test_value=0) False # This won't work because of the `is not test_value` type testing: >>> coalesce([], dict(spam='eggs'), test_value=[]) [] N)r argsargs 3/usr/lib/python3/dist-packages/portalocker/utils.pycoalescers , j Jfilenamebinaryc#Ktj|}|jr Jd|z|jj ddt j |xrdxsdt|jd}||jtj|j|j tj|j| tj|jy#t $rYywxYw# tj|jw#t $rYwwxYwxYww) a6Open a file for atomic writing. Instead of locking this method allows you to write the entire file and move it to the actual location. Note that this makes the assumption that a rename is atomic on your platform which is generally the case but not a guarantee. http://docs.python.org/library/os.html#os.rename >>> filename = 'test_file.txt' >>> if os.path.exists(filename): ... os.remove(filename) >>> with open_atomic(filename) as fh: ... written = fh.write(b'test') >>> assert os.path.exists(filename) >>> os.remove(filename) >>> import pathlib >>> path_filename = pathlib.Path('test_file.txt') >>> with open_atomic(path_filename) as fh: ... written = fh.write(b'test') >>> assert path_filename.exists() >>> path_filename.unlink() z %r existsT)parentsexist_okwbwF)modedirdeleteN)pathlibPathexistsparentmkdirtempfileNamedTemporaryFilestrflushosfsyncfilenocloserenamenameremove Exception)rrpathtemp_fhs rr r 7s6!h/D{{}0kD00  KKdT2)) _ #  G M MMOHHW^^  MMO ',,%  IIgll #     IIgll #   s`CE D+D E DEDEE D<;E < EE EE  Ec eZdZUeed<eed<eed< d dejedejedejefdZe j d dededefdZ dZ e jdZ d Zd Zd Zy) LockBasetimeoutcheck_intervalfail_when_lockedNct|t|_t|t|_t|t |_yN)rDEFAULT_TIMEOUTr1DEFAULT_CHECK_INTERVALr2DEFAULT_FAIL_WHEN_LOCKEDr3selfr1r2r3s r__init__zLockBase.__init__ss6 9 &~7MN ()9)A!CrctSr5NotImplementedr9s racquirezLockBase.acquire{s rc#Kt||jd}t||jd}dd}tj}||ztjkDra|dz }|tj|z }tj t d||z|z ||ztjkDr`yyw)NgrrgMbP?)rr1r2time perf_countersleepmax)r:r1r2i start_timesince_start_times r_timeout_generatorzLockBase._timeout_generators7DLL#6!.$2E2EsK &&( 7"T%6%6%88 FAG $002Z?  JJs51~#59I"IJ K 7"T%6%6%88s CCCctSr5r=r:s rreleasezLockBase.releasesrc"|jSr5)r?rJs r __enter__zLockBase.__enter__s||~rc$|jyr5rK)r:type_valuetbs r__exit__zLockBase.__exit__s  rc$|jyr5rO)r:instances r __delete__zLockBase.__delete__srNNN)__name__ __module__ __qualname__float__annotations__booltypingOptionalr;abcabstractmethodr?rHrKrMrSrVr rrr0r0ks N9=:>;?C 6C!'!7C#)??4#8C AE%) 9>" L  rr0c eZdZdZdeeeefdede de de de de jf d Z dde de de d ej fd Zd Zd ej fdZdej d ej fdZdej d ej fdZy )raLock manager with build-in timeout Args: filename: filename mode: the open mode, 'a' or 'ab' should be used for writing truncate: use truncate to emulate 'w' mode, None is disabled, 0 is truncate to 0 bytes timeout: timeout when trying to acquire a lock check_interval: check interval while waiting fail_when_locked: after the initial lock failed, return an error or lock the file. This does not wait for the timeout. **file_open_kwargs: The kwargs for the `open(...)` call fail_when_locked is useful when multiple threads/processes can race when creating a file. If set to true than the system will wait till the lock was acquired and then return an AlreadyLocked exception. Note that the file is opened first and locked later. So using 'w' as mode will result in truncate _BEFORE_ the lock is checked. arrr1r2r3flagsc d|vrd}|jdd}nd}d|_t||_||_||_||_||_||_||_ ||_ y)NrTrcF) replacefhr#rrtruncater1r2r3rdfile_open_kwargs) r:rrr1r2r3rdrirhs rr;z Lock.__init__sk $;H<<S)DH.2 ]  & % %3&6*/ 0rNreturnct||j}|jrS|jfd}d}|j ||D]}d} |j n|r|t j||j|_S#t j$r*}|}|r|t j|Yd}~d}~wwxYw)zAcquire the locked filehandlecF jy#t$rYywxYwr5)r(r,)rgsr try_closezLock.acquire..try_closes#    s   N) rr3rg_get_fhrH _get_lockr LockException AlreadyLocked _prepare_fh) r:r1r2r3rm exception_excrgs @rr?z Lock.acquires $$4d6K6KLWW I\\^  ((.A >AI >^^B'  >&  K**95 5  b ! -++ > $K$229==$ >sB##C 6 CC c|jrAtj|j|jjd|_yy)z)Releases the currently locked file handleN)rgrunlockr(rJs rrKz Lock.releases4 77   tww ' GGMMODG rcXt|j|jfi|jS)zGet a new filehandle)openrrrirJs rrnz Lock._get_fh s"DMM499F0E0EFFrrgcFtj||j|S)zT Try to lock the given filehandle returns LockException if it fails)rlockrdr:rgs rrozLock._get_locks TZZ( rcb|jr"|jd|jd|S)z Prepare the filehandle for usage If truncate is a number, the file will be truncated to that amount of bytes r)rhseekr|s rrrzLock._prepare_fhs& == GGAJ KKN rrW)rXrYrZ__doc__r6r7r8 LOCK_METHODFilenamer#r[r]r LockFlagsr;r^IOr?rKrnrorrr rrrrs0,$:%=)4111 1 " 1 # 1&&12BF%)4 49>4"4.4ii4lGGFII&)) fii FII rc neZdZdZdeedeffd Z d dedede de jffd Z fd Z xZS) RLockz A reentrant lock, functions in a similar way to threading.RLock in that it can be acquired multiple times. When the corresponding number of release() calls are made the lock will finally release the underlying file lock. rcFcDtt| ||||||d|_y)Nr)superrr;_acquire_count)r:rrr1r2r3rd __class__s rr;zRLock.__init__+s) eT#HdG^$4e =rr1r2r3rjc|jdk\r |j}ntt||||}|xjdz c_|sJ|S)Nr)rrgrrr?)r:r1r2r3rgrs rr?z RLock.acquire3sQ   ! #Bud+G^,<>B q  r rc|jdk(rtjd|jdk(rtt||xjdzc_y)Nrz'Cannot release more times than acquiredr)rrrprrrK)r:rs rrKz RLock.release?sU   ! #**9; ;   ! # % & ( q rrW)rXrYrZrr6r7rr;r[r]r^rr?rK __classcell__)rs@rrr$sY"%o1E BF%)   9> " .4ii !!rrc$eZdZdeedefdZdZy)TemporaryFileLockz.lockTc ztj||d||||tj|jy)Nr)rrr1r2r3rd)rr;atexitregisterrK)r:rr1r2r3rds rr;zTemporaryFileLock.__init__Ks8 dXC%3'7u  F  %rctj|tjj |j r tj |j yyr5)rrKr%r-isfilerunlinkrJs rrKzTemporaryFileLock.releaseSs7 T 77>>$-- ( IIdmm $ )rN)rXrYrZr6r7rr;rKr rrrrIs ' 6"&%rrc veZdZUdZej eed<ddeje e fde de de de fd Zd ejej"fd Zd ejej"fd Zd ej"fd Z ddededed ej efdZdejed efdZdZy)BoundedSemaphorea% Bounded semaphore to prevent too many parallel processes from running It's also possible to specify a timeout when acquiring the lock to wait for a resource to become available. This is very similar to threading.BoundedSemaphore but works across multiple processes and across multiple operating systems. >>> semaphore = BoundedSemaphore(2, directory='') >>> str(semaphore.get_filenames()[0]) 'bounded_semaphore.00.lock' >>> str(sorted(semaphore.get_random_filenames())[1]) 'bounded_semaphore.01.lock' r{bounded_semaphorez{name}.{number:02d}.lockmaximumr*filename_pattern directorycf||_||_||_||_d|_||_||_yr5)rr*rrr{r1r2)r:rr*rrr1r2s rr;zBoundedSemaphore.__init__js7  0"+/  ,rrjcpt|jDcgc]}|j|c}Scc}wr5)ranger get_filename)r:ns r get_filenameszBoundedSemaphore.get_filenameszs*.3DLL.AB!!!$BBBs3cbt|j}tj||Sr5)listrrandomshuffle)r: filenamess rget_random_filenamesz%BoundedSemaphore.get_random_filenames}s'++-. y!rctj|j|jj |j |z S)N)r*number)rrrrformatr*)r:rs rrzBoundedSemaphore.get_filenames?||DNN+d.C.C.J.J/K/   rNr1r2r3c |jrJd|j}td||j||D]-}td||j |s!|jcSt j )NzAlready lockedrz trying lock)r{rprintrHtry_lockrrq)r:r1r2r3rrts rr?zBoundedSemaphore.acquires{ 99...}&&(  k9%((.A !A - +}}Y'yy  ! &&((rrc|D]H}td|t|d|_ |jjtd|yy#tj $rYawxYw)Nztrying lock forT)r3lockedF)rrr{r?rrq)r:rrs rrzBoundedSemaphore.try_locksk! H #X .X=DI  !!#h)  ++  s&AA%$A%cF|jjd|_yr5)r{rKrJs rrKzBoundedSemaphore.releases  rrW)rXrYrZrr^r_rr\r! gettempdirr6r7intr#r;Sequencerrrrrr[r]r?rrrKr rrrrYs  //$  ,$>0X002#1---" -  - Cvw||<Cfoogll&C  gll "$(%) ))")# )/5ood.C )$ &//(";  rr)T)#r`r contextlibr%rrr!rAr^rrrr6r7r8r EXCLUSIVE NON_BLOCKINGr__all__Unionr#rrrcontextmanagerr]r ABCr0rrrrr rrrs     !!++i.A.A.N.NN    <<W\\) * $6 0(0D00f1sww1hB8BJ"!D"!J % % QxQr