+ ",i1 (Rt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI H t ^RI H t ^RI Ht^RIHt^RIHt^RIHt^RIt^RIt^RIHtHtHt^R IHt^R IHtHtHtHt^R I H!t!H"t"H#t#H$t$H%t%]e^R I&H't'^R I(H)t)^RI*t*^RI,H-t-^RI.t.^RI/H0t0H1t1H2t2H3t3H4t4^RI5H6t6H7t7H8t8H9t9H:t:HtH;t;H.RO4]"!R?^R@.4RA4444tf]"!R)]E4RB4tg]]"!R)]E4RC44th]]"!R)]i!]?4RD0, 4]"!RERFRG.4RH444tj]]"!R)]D4RI44tk]]"!R)]64RJ44tlRKtm]"!R)]64]"!RL^.RO3^.RO3.4RM44tn]]"!R)]E4RN44toROtp]]"!R)]D4RP44tqRQtrRRtsRStt]]"!R)]E4]PPRTRU7RV444tv!RWRX]34twRYtx]"!R)]C4RZ4ty]]"!R)]E4]"!R*.RO4R[444tzR\t{R]t|]$!]RJR^RU7R_4t}R`t~]ERa,t]EP]!^4Uu.uF pRbV,NK up4]]"!R)]4]"!R$];]<.4Rc444t!RdRe]34t]"!R$]<];.4Rf4t]"!R$]<];.4Rg4tRhtRit!RjRk]EPP`4t]=!Rl]4]]"!R).RO4]"!R$]<];.4Rm444t]]"!R*.RO4]"!R)]E4]"!R$]<];.4Rn4444tRot]]"!Rp]E4]"!Rq]E4]"!R$]<];.4Rr4444t]]"!R$]<];.4]"!RsR1R.4Rt444t]"!Ru.RO4Rv4t]"!Rw.RO4Rx4t]Ry4t]]]"!R)]D4Rz444tR{t]]"!R)]D4R|44tR}tR~tRtRt]]"!R)]D]f.MR.,4]"!R]]].4]"!R.RO4R4444tREP5]EP6EP9]EP6EP9]EP:44R7t]R4tREP5]EP6EP9]EP6EP9]EP:44R7t]R4tRtRt]]]"!R)]D4R444tRt]]R44tRtRt]PPER*.RO4R4tRtRt]PPER*^^.4]]"!R)]i!]?4RD0, 4R444t]"!R)]C4]"!R*.RO4R44tRtRt]]"!R)]?4]"!RERFRG.4]"!R*.RO4R4444t]"!R)]?4]"!RERFRG.4]"!R*.RO4R444t]"!R)]?4]"!RERFRG.4]"!R*.RO4R444t]"!R)]?4]"!RRFRG.4]"!RRFRG.4]"!R*.RO4R4444t]"!R.RO4]"!RRFRG.4]"!RRFRG.4R444t]]]"!R)]D4R444t]"!R)]fRR.M.RO4R4t]]"!R)]D4R44t]]"!R$]<];.4R44t]"!R*^^.4]"!R.RO4R44t]"!R$]<];.4R4tRtRRlt]]"!R)RR.4]"!R$]<];.4R444tRRlt]PEP~]"!R$]<];.4]"!R)]fR.MRR.4R444tRt]"!R)]eRR.MR.4]$!]-RJRRU7R44t]"!R$]<];.4]$!].RJRRU7R44t]"!R$]<];.4R4tRtRtRtRt]]]"!R*.RO4R444t]]]"!R.RO4]"!R*^R.4]"!R$]<];.4R44444t]]"!R*^R.4]"!R.RO4]"!R$]<];.4R4444t]]"!R*.RO4R44tRtRRlt]]"!R*^^.4]"!R)]D4]"!R$]<];.4R4444t]]"!R*^^.4]"!R)]D4R444t]]PPER*^^.4R44t]]PPER*^^.4R44tR# ]+dRt*E Li;i ]+dRt-E Li;i ]+dRt.E Li;iuupiuupi)z Test the parallel module. N) nullcontext)sqrt TimeoutError) PicklingError)sleep)format_exception)dumploadparallel)mp)IS_GIL_DISABLEDnpwith_multiprocessing with_numpy)check_subprocess_call parametrizeraisesskipifwarns)get_reusable_executor)Queue) parallel_sum) LokyBackendMultiprocessingBackendParallelBackendBaseSequentialBackendThreadingBackend) BACKENDSParallel cpu_countdelayedeffective_n_jobsr parallel_backendparallel_configregister_parallel_backendmultiprocessingloky threading get_contextspawnc8\\P,#N)rr DEFAULT_BACKEND;/usr/lib/python3/dist-packages/joblib/test/test_parallel.pyget_default_backend_instancer1^s H,, --r/c 2\VR\VRR44#)_pool_workersN)getattrbackends&r0 get_workersr8fs 7GWWj$%G HHr/cW, #r,r.)xys&&r0divisionr<js 5Lr/cV^,#r.r:s&r0squarerAns a4Kr/c*a]tRt^rtoRtRtRtVtR#)MyExceptionWithFinickyInitz,An exception class with non trivial __init__cR#r,r.)selfabcds&&&&&r0__init__#MyExceptionWithFinickyInit.__init__us r/r.N__name__ __module__ __qualname____firstlineno____doc__rJ__static_attributes____classdictcell__ __classdict__s@r0rCrCrs6  r/rCFcLV^8XdV'd\RRRR4h\hV#)rFrGrHrI)rC ValueError)r:custom_exceptions&&r0exception_raiserrZys4Av  'sCc :  Hr/c:\P!R4\h)g?)timerKeyboardInterruptr@s&r0interrupt_raiserr^sJJt r/c0V^,V,V,#)zFA module-level function so that it can be spawn with multiprocessing. r.)r:r;zs&&&r0fras a4!8a<r/cL\\P!4^,4#)typer get_active_backendr.r/r0_active_backend_typergs ++-a0 11r/cF\WR7!R\^444#)n_jobsr7c3L"TFp\\4!V4xK R#5ir,r!rA.0is& r0 parallel_func..s:$,qH"$rrange) inner_n_jobsr7s&&r0 parallel_funcrvs% < 9:$)!H: r/c(\4^8gQhR#rdN)r r.r/r0test_cpu_countrys ;??r/c(\4^8gQhR#rxr"r.r/r0test_effective_n_jobsr|s   !! !r/contextzbackend_n_jobs, expected_n_jobsrj)idscV!RVR7;_uu_4\RR7V8XgQhRRR4\RR7^8XgQhR# +'giL%;i)r(r~Nr{)r}backend_n_jobsexpected_n_jobss&&&r0test_effective_n_jobs_NonersI ^ 4 4 t,??? 5 4 (A -- - 5 4s A A r7rjverbosec\^4Uu.uFp\V4NK up\WVR7!R\^4448XgQhR#uupi)rjr7rc3L"TFp\\4!V4xK R#5ir,rlrnr:s& r0rp'test_simple_parallel..s+(Qgfoa(rrNrtrAr)r7rjrr:s&&& r0test_simple_parallelrsM %Qx (x!F1Ix (H-+%(+-, ,, , (sAc^dp\P!R4p!RR\4pV!WRR7pT!\V4Uu.uFp\ \ 4!V4NK up4\ 4pVPFGpVPV4;p 'gKV P4wrVPW, 4KI \V4^8XgQhR#uupi)dz(Done\s+\d+ out of \d+ \|)c*a]tRt^to.tRtRtVtR#)/test_parallel_pretty_print..ParallelLogc<VPPV4R#r,)messagesappend)rEmsgs&&r0_print6test_parallel_pretty_print..ParallelLog._prints MM  %r/r.N)rMrNrOrPrrrRrSrTs@r0 ParallelLogrs & &r/ri'rN) recompilerrtr!rasetrsearchspanaddlen) r7rjn_taskspatternrexecutorrolensmessagesrFrGs && r0test_parallel_pretty_printrsGjj67G&h& &5IH U7^ 4^gajm^ 45 5D$$w' '1 ' '668DA HHQUO% t9>> 5sCcVP\P!4RRR7\P!RR7;_uu_4p\ ^VR7!R\ ^444pV.R O8XgQhRRR4XUu.uFCpR\VP49gK\VP\4'dKAVNKE ppVR 9g\V\4'd/R pVUu.uF qE\VP49gKVNK" pp\V4^8XgQhR# +'giL;iuupiuupi) name!some_new_name_for_the_main_thread)targetrvalueTrecordric3L"TFp\\4!V4xK R#5ir,rlrs& r0rp6test_main_thread_renamed_no_warning..s6 (01GFOA  rrNzworker timeoutz3multi-threaded, use of fork() may lead to deadlocks)rd)Nr&) setattrr(current_threadwarningscatch_warningsrrtstrr isinstanceDeprecationWarningrr)r7 monkeypatchwarninforesultsw message_parts&& r0#test_main_thread_renamed_no_warningrs. '') 1   - -!W56 (-a6  )### .A 3qyy> 1 199&89  ++z'00M 'Nx!s199~+MAAxN x=A  9 . -Os*/D-E$EE1EE- D= c\P!RR7;_uu_4p\P!R4\WR7RRR4XUu.uFqDPNK ppV'dsV'di\ ;QJdRV4F 'dK RM RM !RV44p\ 'd\V4^8M \V4^8HpT;'dT#R#V'dQhR# +'giL;iuupi)Tralways)r7ruNc3N"TFpRVP^,9xK R#5i)zbacked parallel loops cannotN)args)rneachs& r0rp)_assert_warning_nested.. s!'KS4.$))A,>8s#%F)rr simplefilterrvrallr r)r7ruexpectedrrwarnings_are_correctwarnings_have_the_right_lengths&&& r0_assert_warning_nestedrs   - -h'gA .$,,8a 8H, #&3'KS'333'KS'$ '6oH "3x=A;M +(JJ,J J|) . --s#C+C>+ C; z%parent_backend,child_backend,expectedTcaa\^VR7!V3Rl\^444\^VR7!VV3Rl\^444pVR8Xd\V4'gQhR#\V4'gQhR#)r?ric3T<"TFp\\4!S^RR7xK R#5i)rFr7rurNr!rrn_ child_backends& r0rp0test_nested_parallel_warnings..(s3/A &'!E  %(c3T<"TFp\\4!S^SR7xK R#5i)r?rNr)rnrrrs& r0rpr0s35A &'!H  rr(N)rrtanyr)parent_backendrrress&ff r0test_nested_parallel_warningsrsq A~./q / !^ 45q 5 C$3xxx3xxxr/cR.pRp\P!W!3R7pVP4VP4V^,'gQhR#)Fc \P!RR7;_uu_4p\^R7!R\^444RRR4\ \ X44\ V4^8HV^&R# +'giL7;i)Trr~c3L"TFp\\4!R4xK R#5i)皙?Nr!rrnrs& r0rpPtest_background_thread_parallelism..background_thread..FsEHqwu~c22HrrN)rrrrtprintr)is_run_parallelrs& r0background_thread=test_background_thread_parallelism..background_threadDsY  $ $D 1 1X A EE!HE E2 c(m ]a/2 1s #A22 B )rrN)r(Threadstartjoin)r7rrts& r0"test_background_thread_parallelismr?sIgO0  18JKAGGIFFH 1   r/cL\^VR7!R\^444R#)r?ric3L"TFp\\4!R4xK R#5i{Gz?Nrlrs& r0rpnested_loop..Qs'Px!(=(=xrrNrsr6s&r0 nested_looprPs Aw''PuQx'PPr/rrcTa\^VR7!V3Rl\^444R#)r?ric3N<"TFp\\4!S4xK R#5ir,)r!rrs& r0rp#test_nested_loop..Ws!/5= ]++X"%Nrs)rrs&fr0test_nested_looprTs% A~./5:1X/r/c\hr,)rXr6s&r0raise_exceptionr\s r/c 0\\4;_uu_4\^RR7;_uu_4pV!\\4!R4\\ 4!R4.4RRR4RRR4R# +'giL;i +'giR#;i)r?r'riN)rrXrr!rr)r s r0)test_nested_loop_with_exception_with_lokyr`s]    Q / /8 gk*62GO4LV4TU V0   / /   s"B1A1 B1 B <B B ca\^R7o\^RR7!V3Rl\^444SP4'gQhR#)z1Input is mutable when using the threading backend)maxsizer(ric3Z<"TF p\SP4!^4xK" R#5irN)r!put)rnrqs& r0rp1test_mutate_input_with_threads..js!+Px!GAEEN1,=,=xs(+N)rrrtfull)rs@r0test_mutate_input_with_threadsrgs5 aA A{++PuQx+PP 6688O8r/c\^ 4pVUu.uFp\V^R7NK up\VR7!RV448XgQhR#uupi)z.Check the keyword argument processing of pmap.r;r~c3P"TFp\\4!V^R7xK R#5irrNr!rars& r0rp'test_parallel_kwargs..rs!?$'q 1C$&N)rtrar)rjlstr:s& r0test_parallel_kwargsrnsP )C" #s!Aa1Is #xv'>?$'?(   #sA c8\^ 4pVUu.uFp\V^R7NK pp\^VR7;_uu_4pVPpW4!RV448XgQhW4!RV448XgQh\e%\ V4\ VP4JgQhRRR4\e\ XP4eQhVX!RV448XgQh\e\ VP4eQhR#R#uupi +'giLq;i) rric3P"TFp\\4!V^R7xK R#5irrrs& r0rp3test_parallel_as_context_manager..=AWQZQ//rc3P"TFp\\4!V^R7xK R#5irrrs& r0rpr r rNc3P"TFp\\4!V^R7xK R#5irrrs& r0rpr s9SA++Sr)rtrar_backendr r8)r7rr:rpmanaged_backends& r0 test_parallel_as_context_managerrws )C#&'3a!q 3H' G , ,**1======1====== >/;qzz3JJ JJ -  ~1::&... q9S99 99 9 ~1::&.../( , ,sDA#D  D ca!RR\4o\\RR7;_uu_4\^RR7!V3Rl\ ^ 444RRR4R# +'giR#;i) zXCheck that pmap captures the errors when it is passed an object that cannot be pickled. c&a]tRtRtoRtRtVtR#)1test_parallel_pickling..UnpicklableObjectic\R4h)123) RuntimeErrorrEs&r0 __reduce__.UnpicklableObject.__reduce__s u% %r/r.N)rMrNrOrPrrRrSrTs@r0UnpicklableObjectrs & &r/rzthe task to sendmatchr'ric3X<"TFp\\4!S!44xK! R#5ir,r!id)rnrrs& r0rp)test_parallel_pickling..s$+ 6?GBK)+ , ,is'*N)objectrrrrt)rs@r0test_parallel_picklingr%sN &F&  %8 9 96*+ 6;Bi+   : 9 9 9s 'A A, byteorder max_nbytes1McaaRo\P!^4PR4PV R24oSPP p\ ^RVR7!VV3Rl\^444pVFIwrEWR8XgQhWTPP 8XgQh\PPSV4KK R#)c0WPP3#r,)dtyper&r@s&r0inspect_byteorder=test_parallel_byteorder_corruption..inspect_byteorders''####r/i4r')rjr7r'c3F<"TFp\S4!S4xK R#5ir,r!)rnrr,r:s& r0rp5test_parallel_byteorder_corruption..s#G/7!!"1%%x!N)r?) rarangereshapeviewr+r&rrttestingassert_array_equal)r&r'initial_np_byteorderresult x_returnedbyteorder_in_workerr,r:s&& @@r0"test_parallel_byteorder_corruptionr=s $ ! V$))YKr*:;A77,, Q: FG/4QxGF,2' ":::"&6&6&@&@@@@ %%a4,2r/cn\\^V^R7!R\^ 4444^ 8XgQhR#)r?rjr7timeoutc3L"TFp\\4!R4xK R#5i)gMbP?Nrrs& r0rp0test_parallel_timeout_success..s</8!u%%yrrN)rrrtr6s&r0test_parallel_timeout_successrCsB Aw ;</4Ry<     r/c\\4;_uu_4\^VRR7!R\^ 444RRR4R# +'giR#;i)r?rr?c3L"TFp\\4!^ 4xK R#5ir Nrrs& r0rp-test_parallel_timeout_fail..s: (11GEN2   rrN)rrrrtr6s&r0test_parallel_timeout_failrHs@   7D9: (-b :       %A A sequential return_as generatorgenerator_unorderedc  \\4;_uu_4\\^WRR7!R\ ^ 4444RRR4\\^W^ R7!R\ ^ 4444R# +'giL?;i)r?r)rjr7rKr@c3L"TFp\\4!^ 4xK R#5irFrrs& r0rp.s R,5qr""IrrNc3L"TFp\\4!R4xK R#5irrrs& r0rprPs M *3QGEN4 )rr)rrlistrrtr7rKs&&r0)test_parallel_timeout_fail_with_generatorrTsw    AwS QR,1"IR    7LM */)M    s .A== B c \Ee\\4;_uu_4\^VR7!\ RR 4UUu.uFwr\ \ 4!W4NK upp4RRR4\\4;_uu_4\^VR7!R Uu.uFp\ \4!V4NK up4RRR4\^VR7;_uu_4p\VP4fQh\VP4p\\4;_uu_4T!\ RR 4UUu.uFwr\ \ 4!W4NK upp4RRR4\VP4fQh\VP4VJgQh\^ 4Uu.uFp\V^R7NK upV!R\^ 4448XgQh\VP4p\\4;_uu_4T!R Uu.uFp\ \4!V4NK up4RRR4\VP4fQh\VP4VJgQh\^ 4Uu.uFp\V^R7NK upV!R\^ 4448Xg4QVPVPVPVP 34hRRR4\XP4eQhMU\\4;_uu_4\^R7!R Uu.uFp\ \4!V4NK up4RRR4\\4;_uu_4\^R7!\ RR 4UUu.uFwr\ \ 4!W4NK upp4RRR4\\"4;_uu_4\^^R7!R\^444RRR4R#uuppi +'giEL;iuupi +'giELl;iuuppi +'giEL;iuupiuupi +'giEL0;iuupi +'giEL;iuupi +'giELB;iuuppi +'giL;i +'giR#;i) Nrirc3P"TFp\\4!V^R7xK R#5irrrs& r0rp%test_error_capture..!>,5q 1""Irc3P"TFp\\4!V^R7xK R#5irrrs& r0rprWrXrr~)rjrc3P"TFp\\4!VRR7xK R#5i)T)rYNr!rZrms& r0rprW+s T)QW% &q4 @ @)r)rdr)rrd)r rZeroDivisionErrorrzipr!r<r]r^r8rrtra _iteratingn_completed_tasksn_dispatched_tasks _abortingrC)r7r:r;r original_workerss& r0test_error_capturercs  ~ % & & Aw /585HI5HTQ"1(5HI ' % & & Aw /7=>v!)*1-v> ' Q 0 0Hx001= ==*8+<+<= )**c&&>QR>Qda'(+A1>QRS+ x001= ==x0019II II',Ry1y!Aa1Iy1X>,1"I>6  +8+<+<= )**G1'"23A6GH+x001= ==x0019II II',Ry1y!Aa1Iy1X>,1"I>6 ##**++""  91N8,,-555 % & & A fMf(8 9! .my_generator2s)rA} !9::Gs*,rirgrc3L"TFp\\4!V4xK R#5ir,rlrms& r0rp.test_error_in_task_iterator..; C*BQgfoa  *Brr)rhNc3L"TFp\\4!V4xK R#5ir,rlrms& r0rprl@rmrrc3L"TFp\\4!V4xK R#5ir,rlrms& r0rprlDs D*CQgfoa  *Crrrc)rrrX)r7rirs& r0test_error_in_task_iteratorrp/s G , , J&> ? ? C,*B C C@ J&> ? ? C,*B C C@J&> ? ? D,*C D D@ - , ? ? @ ?@ ? - , ,sRDC !D-C! !D%C4 <D C D! C1 ,D4 D ?D D c6VPRV,4R#)z Consumed %sN)r)queueitems&&r0consumerrtGs LL%&r/zbatch_size, expected_queueca\4oV3Rlp\^WR7!V3RlV!444SV8XgQh\S4^ 8XgQhR#)z=Test that with only one job, Parallel does act as a iterator.c3l<"\^4FpSPRV,4VxK! R#5iz Produced %iNrtrrorrs r0producer'test_dispatch_one_job..producerx*qA LL* +G14rj batch_sizer7c3P<"TFp\\4!SV4xK R#5ir,r!rt)rnr:rrs& r0rp(test_dispatch_one_job..}s#?-7%##Z#&N)rRrr)r7rexpected_queuer{rrs&&& @r0test_dispatch_one_jobrKsTV FE  A*>?-5Z? N "" " u:  r/cta\P!4pVP4oV3Rlp\^^^VR7!V3RlV!444\S4pV^,R8XgQhVR,P R4pVR 8gQhVP R4pWT8gQh\ S4^ 8XgQhR#) zJCheck that using pre_dispatch Parallel does indeed dispatch items lazily. c3l<"\^4FpSPRV,4VxK! R#5irwryrzs r0r{/test_dispatch_multiprocessing..producerr}r~)rjr pre_dispatchr7c3P<"TFp\\4!SR4xK R#5i)rNr)rnrrrs& r0rp0test_dispatch_multiprocessing..s$F1;A%''r Produced 0:NrNz Consumed any Produced 3N)r ManagerrRrindexr)r7managerr{queue_contentsfirst_consumption_indexproduced_3_indexrrs& @r0test_dispatch_multiprocessingrs jjlG LLNE  A!!WEF19F%[N !  ,, ,-R066~F "R '' '%++L9  55 5 u:  r/c\^RRR7;_uu_4pV!R\R444VPP4^8XgQhRRR4R# +'giR#;i)r?autor(rc3L"TFp\\4!V4xK R#5ir,r!rms& r0rp/test_batching_auto_threading.. .+Q'"+a..+rrNrrtrcompute_batch_size)rs r0test_batching_auto_threadingrsR v{ C Cq .%+ ..zz,,.!333 D C C C :A A- c\^RVR7;_uu_4pV!R\R444VPP4^8gQhRRR4R# +'giR#;i)r?rrc3L"TFp\\4!V4xK R#5ir,r!rms& r0rp2test_batching_auto_subprocesses..rrrrNr)r7rs& r0test_batching_auto_subprocessesrsT vw ? ?1 .%+ .. zz,,.222 @ ? ? ?rc\\4;_uu_4\^^^R7!R\^444RRR4R# +'giR#;i)zCMake sure that exception raised during dispatch are indeed captured)rjrrc3L"TFp\\4!V4xK R#5ir,r[rms& r0rp*test_exception_dispatch..s!7 2;QG$ %a ( ()rrN)rrXrrtr.r/r0test_exception_dispatchrs>   A67 27)7      rIcJ\^R7!R\^444R#)r?r~c3L"TFp\\4!V4xK R#5ir,r[rnjs& r0rp(nested_function_inner..sGYw/033YrrNrsros&r0nested_function_innerrs AGU2YGGr/cJ\^R7!R\^444R#)r?r~c3L"TFp\\4!V4xK R#5ir,)r!rrs& r0rp(nested_function_outer..sL)Qw45a88)rrNrsrs&r0nested_function_outerrs AL%)LLr/z'https://github.com/joblib/loky/pull/255reasonc\\4;_uu_4p\^VR7!R\^444RRR4\ XP VP VP4pRPV4pRV9gQhRV9gQhRV9gQh\ VP 4\JgQhR# +'giL;i)zEnsure errors for nested joblib cases gets propagated We rely on the Python 3 built-in __cause__ system that already report this kind of information to the user. ric3L"TFp\\4!V4xK R#5ir,)r!rrms& r0rp1test_nested_exception_dispatch..s!, 7@!G) *1 - -yrrNrrrZ) rrXrrtrrertbr)r7excinfo report_linesreports& r0test_nested_exception_dispatchrs   w7+, 7VPV4VnW nV#r,)r"rjr )rErjr backend_argss&&&,r0 configureFakeParallelBackend.configures++F3   r/cnV^8d.\\P!4^,V,^4pV#rc)maxr r rErjs&&r0r"$FakeParallelBackend.effective_n_jobss* A:!+f4a8F r/)rjr r)r) rMrNrOrPrQrr"rRrSrTs@r0rrsB r/rc "\\RR7;_uu_4\RR7RRR4\\RR7;_uu_4\RR7;_uu_4RRR4RRR4\\RR7;_uu_4\RR7;_uu_4RRR4RRR4R# +'giL;i +'giLm;i +'giLx;i +'giLS;i +'giR#;i)zInvalid backend:rz unit-testingr6N)rrXrr$r.r/r0test_invalid_backendrs  "4 5 5( 6  "4 5 5 ^ 4 4 5 6  "4 5 5 ^ 4 4 5 6 5 6 55 4 6 5 5 4 6 5 5sS B1CC CC=C* C=1 C  C C C' * C: 5C== D cX\\4;_uu_4p\^VR7P4RRR4R\ XP 49gQh\\4;_uu_4p\RVR7P4RRR4R\ VP 49gQh\\4;_uu_4p\RVR7P4RRR4R\ VP 49gQh\\4;_uu_4p\RVR7P4RRR4R\ VP 49gQhR# +'giEL4;i +'giL;i +'giL;i +'giLh;i)rdriNz&n_jobs == 0 in Parallel has no meaning?z2.3z$n_jobs could not be converted to int invalid_str)rrXr_initialize_backendrr)r7rs& r0test_invalid_njobsrs   w7+??A  3s7==7I II I   wW-AAC  3s7==7I II I   ww/CCE  1S5G GG G   w w7KKM  1S5G GG G         s/E/E3FF E0 3 F  F  F) c\WR7pVP4^8XgQhV!R\^ 444p\;QJd%R\ V44F 'dK RM RM!R\ V444'gQhR#)ric3L"TFp\\4!V4xK R#5ir,rlrms& r0rp.test_njobs_converted_to_int..s 2 1GFOA   rrc3B"TFwrV\V48HxK R#5ir,)rA)rnrors& r0rprs9.$!qF1I~.sFTN)r_effective_n_jobsrtr enumerate)r7rjrrs&& r0test_njobs_converted_to_intrsh 0A   A %% % 2b 2 2C 39)C.93339)C.9 9 99 9r/c\R\4R\9gQh\R,\8XgQh\RR# \Ri;i) test_backendN)r%rrr.r/r0test_register_parallel_backendrsE%!.2EF)))'+>>>> ^ $H^ $s 5A A c \Pp\4\48XgQh\ R\ R,RR7\4\ 8XgQhV\n\4\48XgQhR# T\ni;i)r(T) make_defaultN)r r-rgr1r%rr)default_backend_origs r0test_overwrite_default_backendr%sw#33  !%A%C CC C8!+x /DSWX#%)9999$8  !%A%C CC C$8 s .B B zOnly without multiprocessingcV\\RR7;_uu_4\RR7!R\^444RRR4\ RR7;_uu_4\4!R\^444RRR4R# +'giLO;i +'giR#;i)z)joblib backend '.*' is not available on.*rr'r6c3L"TFp\\4!V4xK R#5ir,rlrms& r0rp2test_backend_no_multiprocessing..4s FX!3!3XrrNc3L"TFp\\4!V4xK R#5ir,rlrms& r0rpr8s8x!76?1%%xrr)r UserWarningrrtr$r.r/r0test_backend_no_multiprocessingr1sl {"M N N FU1X FF O  ( ( 8uQx88 ) ( O N ) ( (s#B!B B  B( cV!V^R7;_uu_4\P!4wr#V^8XgQh\^4^8XgQh\4pVP^8XgQhVR8Xd6\ V4\ JgQh\ VP4\ JgQhMVR8Xd6\ V4\JgQh\ VP4\JgQhMVR8Xd6\ V4\JgQh\ VP4\JgQhMKVPR4'd5\ V4\JgQh\ VP4\JgQhRRR4R# +'giR#;i)r3r~r&r'r(test_N) r rfr"rrjrerrrr startswithr)r} backend_nameactive_backend active_n_jobsrs&& r0check_backend_context_managerr;s? a ( ((0(C(C(E%!!!"a''' Jxx1}} , ,'+AA AA #'== == V #';6 66 #{2 22 [ ('+;; ;; #'77 77  $ $W - -'+>> >> #':: ::# ) ( ( (sDE,.4E,, E= :NNNztest_backend_%dcDaV\9dVP\V\4\4\ 48XgQh\ SV4\4\ 48XgQh\ ^RR7!V3Rl\44\4\ 48XgQhR#)r?r(ric3d<"TF%pV'dK \\4!SV4xK' R#5ir,)r!r)rnrGr}s& r0rp/test_backend_context_manager..cs-,1A ;-.w::1s 00N)rsetitemrrgr1rr all_backends_for_context_manager)rr7r}s&&fr0test_backend_context_managerrTshHg/BC  !%A%C CC C!'73 !%A%C CC C A{+,1, !%A%C CC Cr/c.a]tRtRtoRtRRltRtVtR#)ParameterizedParallelBackendimz9Pretends to run conncurrently while running sequentially.Nc0Vf \R4hWnR#)Nzparam should not be None)rXparam)rErs&&r0rJ%ParameterizedParallelBackend.__init__ps =78 8 r/rr,rLrTs@r0rrmsCr/rc|VP\R\4\4\ 48XgQhV!R^*^R7;_uu_4\ P !4wr#\V4\JgQhVP^*8XgQhV^8XgQh\4pVP^8XgQhVPVJgQhV!R\^444pRRR4X\^4Uu.uFp\V4NK up8XgQh\4\ 48XgQhR# +'giLV;iuupi) param_backend)rrjc3L"TFp\\4!V4xK R#5ir,r!rrms& r0rp=test_parameterized_backend_context_manager..7hGDM!$$hrrN)rrrrgr1r rfrerrrjrrtr)rr}rrrrros&& r0*test_parameterized_backend_context_managerrvs /3OP  !%A%C CC C 1 5 5(0(C(C(E%N#'CCCC##r)))!!! Jxx1}}zz^+++7eAh77 6 a11tAw1 11 1 !%A%C CC C 6 52sBD&.D9& D6 cX\4\48XgQhV!\^+R7^R7;_uu_4\P!4wr\ V4\JgQhVP ^+8XgQhV^8XgQh\4pVP^8XgQhVPVJgQhV!R\^444pRRR4X\^4Uu.uFp\V4NK up8XgQh\4\48XgQhR# +'giLV;iuupi)+rr~c3L"TFp\\4!V4xK R#5ir,rrms& r0rpFtest_directly_parameterized_backend_context_manager..rrrN) rgr1rr rfrerrrjrrtr)r}rrrrros& r03test_directly_parameterized_backend_context_managerrs  !%A%C CC C -B7 B B(0(C(C(E%N#'CCCC##r)))!!! Jxx1}}zz^+++7eAh77 C a11tAw1 11 1 !%A%C CC C C B2sBDD' D$ cB\R4\P!4#)r)rosgetpidr.r/r0sleep_and_return_pidrs #J 99;r/c\4\8XgQh\4P4^8XgQh\^R7!R\ ^444#)rr~c3J"TFp\\4!4xK R#5ir,)r!rrs& r0rp"get_nested_pids..sPx!g&:;==x!#)rgrrrrtr.r/r0get_nested_pidsr sK  !%5 55 5 : ' ' )Q .. . 1 PuQxP PPr/c6aa]tRtRtoRtV3RltRtVtV;t#) MyBackendiz:Backend to test backward compatibility with older backendsc6<\\V` 4^,#rc)superrget_nested_backend)rE __class__s&r0rMyBackend.get_nested_backendsY8:1==r/r.) rMrNrOrPrQrrRrS __classcell__)rrUs@@r0rrsD>>r/rback_compat_backendcV!V4;_uu_4\^R7!R\^ 444pVFp\\V44^8XdKQh RRR4R# +'giR#;i)r?r~c3J"TFp\\4!4xK R#5ir,)r!r rs& r0rp6test_nested_backend_context_manager..s'VIq(@(B(BIr N)rrtrr)r}r7 pid_groups pid_groups&& r0#test_nested_backend_context_managerrsY   Q''VERTI'VV #Is9~&!+ ++$    s>A"A"" A3 caaaRo\^R7!V3Rl\^ 444V!SSR7;_uu_4\^R7!VVV3Rl\^ 444RRR4R# +'giR#;i)c\4\V,8XgQh\V4p\4P 4V8XgQhR#r,)rgrr"rr)expected_backend_typeexpected_n_jobs&&r0check_nested_backend?test_nested_backend_in_sequential..check_nested_backends@$%2G)HHHH*.9z++-???r/r~c3d<"TF%p\S4!\P^4xK' R#5ir)r!r r-)rnrr s& r0rp4test_nested_backend_in_sequential..s*LUq$%h&>&>BBIs-0c3H<"TFp\S4!SS4xK R#5ir,r0)rnrr7r rjs& r0rpr#s$ DMqG( )'6 : :Is"Nrs)r7rjr}r sff&@r0!test_nested_backend_in_sequentialr%sf@ ALQRTI  ( ( DI"I   ) ( ( (s (A00 B cV!V4;_uu_4pV\Jd VR,pV\Jd V^,pXPV8XgQhRRR4R# +'giR#;i)r7N)r$r# nesting_level)r} inner_backendexpected_levelctxr7s&&& r0check_nesting_levelr+sU   3 o %)nG & &!fG$$666   s :A A' outer_backendr(caa\SV^4\^VR7!VV3Rl\^ 444S!S^R7;_uu_4\4!VV3Rl\^ 444RRR4R# +'giR#;i)rdric3R<"TFp\\4!SS^4xK R#5irr!r+rnrr}r(s& r0rp-test_backend_nesting_level..s&.IRA#$WmQ??$'r~c3R<"TFp\\4!SS^4xK R#5irr/r0s& r0rpr1s& MVG' (- C CYr2N)r+rrt)r}r,r(sf&fr0test_backend_nesting_levelr4sk 2 A}-.INr. q ) )  MRSUY   * ) ) )s %A88 B with_retrieve_callbackcaaa^RIo!VV3RlR\4p\RV4RoV!R4;_uu_4p\^R7!V3Rl\ ^444V\ JdVR,P ^8XgQhV\JdV^,P ^8XgQhRRR4R# +'giR#;i) rdNcR<a]tRtRto^tZtZP R4tRtVt R#))test_retrieval_context..MyBackendic3H"V;P^, unRxR#5irrrs&r0retrieval_context;test_retrieval_context..MyBackend.retrieval_context s FFaKF s "r.N) rMrNrOrProsupports_retrieve_callbackcontextmanagerr:rRrS)rU contextlibr5s@r0rr8s( %;"  " "  # r/r retrievalcF\^R7!R\V444#)r?r~c3L"TFp\\4!V4xK R#5ir,r!rms& r0rp>test_retrieval_context..nested_call..s!C(Q'"+a..(rrrs)ns&r0 nested_call+test_retrieval_context..nested_callsq!!C%(!CCCr/r~c3F<"TFp\S4!V4xK R#5ir,r0)rnrorDs& r0rp)test_retrieval_context..sEHq7;/22Hr2r7)r>rr%rrtr$ror#)r}r5rr*r>rDs&f @@r0test_retrieval_contextrHs$k95D   EE!HEE o %y>##q( (( & &q688q= =    s A.B22 C rc\\4;_uu_4\VR7RRR4R# +'giR#;i)rN)rrXrrJs&r0test_invalid_batch_sizerKs$   J'    s / A z)n_tasks, n_jobs, pre_dispatch, batch_sizecRVRVRV/p\V4Uu.uFp\V4NK pp\R/VB!R\V444pWv8XgQhR#uupi)rjrrc3L"TFp\\4!V4xK R#5ir,rlrms& r0rp/test_dispatch_race_condition..;s L^!3!3^rrNr.r)rrjrrparamsrorrs&&&& r0test_dispatch_race_conditionrP%s_( lJ WF#(>2>aq >H2  LU7^ LLG   3sAc\P!4p\^RR7pVPP R4pVP4pW08XgQhR#)r?r&rir}N)r get_start_methodr_backend_kwargsget)mp_start_methodrr} start_methods r0test_default_mp_contextrW?sM))+O#45A##I.G++-L  ** *r/c2aVR8Xd\P!R4p\PP ^*4pVP RR4o\P !SSP4\^VR7!V3Rl\^444R#)r&r*iric3x<"TF/p\\P4!SSP4xK1 R#5ir,)r!rdotT)rnrorFs& r0rpAtest_no_blas_crash_or_freeze_with_subprocesses..^s''RA133(?(?s7:N) r r)rrandom RandomStaterandnrZr[rrt)r7rngrFs& @r0.test_no_blas_crash_or_freeze_with_subprocessesraHsr##..) ))   #C $AFF1accN Aw''Rq'RRr/afrom joblib import Parallel, delayed def square(x): return x ** 2 backend = "{}" if backend == "spawn": from multiprocessing import get_context backend = get_context(backend) print(Parallel(n_jobs=2, backend=backend)( delayed(square)(i) for i in range(5))) cVR8Xd1\P!4R8wd\P!R4\P V4p\ \PRV.^ RR7R#)r&forkzVRequire fork start method to use interactively defined functions with multiprocessing.z-c\[0, 1, 4, 9, 16\]r@ stdout_regexN) r rRpytestskip,UNPICKLABLE_CALLABLE_SCRIPT_TEMPLATE_NO_MAINformatrsys executable)r7codes& r02test_parallel_with_interactively_defined_functionsrnqs[ ##(;(;(=(G  .  8 > >w GD t$b?Tr/aimport sys # Make sure that joblib is importable in the subprocess launching this # script. This is needed in case we run the tests from the joblib root # folder without having installed joblib sys.path.insert(0, {joblib_root_folder!r}) from joblib import Parallel, delayed def run(f, x): return f(x) {define_func} if __name__ == "__main__": backend = "{backend}" if backend == "spawn": from multiprocessing import get_context backend = get_context(backend) callable_position = "{callable_position}" if callable_position == "delayed": print(Parallel(n_jobs=2, backend=backend)( delayed(square)(i) for i in range(5))) elif callable_position == "args": print(Parallel(n_jobs=2, backend=backend)( delayed(run)(square, i) for i in range(5))) else: print(Parallel(n_jobs=2, backend=backend)( delayed(run)(f=square, x=i) for i in range(5))) z!def square(x): return x ** 2 zcdef gen_square(): def square(x): return x ** 2 return square square = gen_square() zsquare = lambda x: x ** 2 define_funccallable_positionc VR9d7V\8wg\PR8Xd\P!R4\ P VVV\PP\PP\P44R7pVPR4pVPV4\\PVP .^ RR7R#) r&win32zNot picklable with pickle)ror7rpjoblib_root_folderzunpicklable_func_script.pyrdreN)r&r*) SQUARE_MAINrkplatformrgrh)UNPICKLABLE_CALLABLE_SCRIPT_TEMPLATE_MAINrjrpathdirnamejoblib__file__rwriterrlstrpath)r7rorptmpdirrm code_files&&&& r00test_parallel_with_unpicklable_functions_in_argsrs..{"cllg&= /0 4 ; ;+77??277??6??+KL < D  89I OOD **+*r/aimport sys import faulthandler # Make sure that joblib is importable in the subprocess launching this # script. This is needed in case we run the tests from the joblib root # folder without having installed joblib sys.path.insert(0, {joblib_root_folder!r}) from joblib import Parallel, delayed from functools import partial class MyClass: '''Class defined in the __main__ namespace''' def __init__(self, value): self.value = value def square(x, ignored=None, ignored2=None): '''Function defined in the __main__ namespace''' return x.value ** 2 square2 = partial(square, ignored2='something') # Here, we do not need the `if __name__ == "__main__":` safeguard when # using the default `loky` backend (even on Windows). # To make debugging easier faulthandler.dump_traceback_later(30, exit=True) # The following baroque function call is meant to check that joblib # introspection rightfully uses cloudpickle instead of the (faster) pickle # module of the standard library when necessary. In particular cloudpickle is # necessary for functions and instances of classes interactively defined in the # __main__ module. print(Parallel(backend="loky", n_jobs=2)( delayed(square2)(MyClass(i), ignored=[dict(a=MyClass(1))]) for i in range(5) )) )rscVPR4pVP\4\\P VP .RRR7R#)z(joblib_interactively_defined_function.pyrdN)rfr@)rr{5INTERACTIVE_DEFINED_FUNCTION_AND_CLASS_SCRIPT_CONTENTrrkrlr|r}scripts& r07test_parallel_with_interactively_defined_functions_lokyrs> [[C DF LLFG (*r/aimport sys # Make sure that joblib is importable in the subprocess launching this # script. This is needed in case we run the tests from the joblib root # folder without having installed joblib sys.path.insert(0, {joblib_root_folder!r}) from joblib import Parallel, delayed, hash import multiprocessing as mp mp.util.log_to_stderr(5) class MyList(list): '''MyList is interactively defined by MyList.append is a built-in''' def __hash__(self): # XXX: workaround limitation in cloudpickle return hash(self).__hash__() l = MyList() print(Parallel(backend="loky", n_jobs=2)( delayed(l.append)(i) for i in range(3) )) cVPR4pVP\4\\P VP .RR^R7R#)z)joblib_interactive_bound_method_script.pyz\[None, None, None\] LokyProcess)rf stderr_regexr@N)rr{9INTERACTIVELY_DEFINED_SUBCLASS_WITH_METHOD_SCRIPT_CONTENTrrkrlr|rs& r0:test_parallel_with_interactively_defined_bound_method_lokyrs? [[D EF LLJK (,# r/cN\.4p\^R7!V4.8XgQhR#)r?r~N)iterr)exhausted_iterators r0%test_parallel_with_exhausted_iteratorr)s%b 1 0 1R 77 7r/c\V\P4'g\R\ V44hVP 4#)z#Expected np.memmap instance, got %r)rrmemmap TypeErrorrecopy)rFs&r0 check_memmapr.s0 a # #=tAwGG 668Or/cRp\^^VR7!RV!^d444p\W!!\V444F$wr4\PP WC4K& \^^VR7!RV!^d444p\W!!\V444F$wr4\PP WC4K& R#)c3"\V4F2p\P!^ \PR7V,xK4 R#5i)r r+N)rtronesfloat32)rCros& r0generate_arraysBtest_auto_memmap_on_arrays_from_generator..generate_arrays<s-qA''"BJJ/!3 3sAArjr'r7c3L"TFp\\4!V4xK R#5ir,r!rrnrFs& r0rp.B"@*>Q a  *>rrc3L"TFp\\4!V4xK R#5ir,rrs& r0rprKrrrN)rr]rrr7r8)r7rrr:rs& r0)test_auto_memmap_on_arrays_from_generatorr4s4 aAw?@*9#*>@G W)FG %%h7H aAw?@*9#*>@G W)FG %%h7Hr/cV#r,r.)args&r0identityrRs Jr/caVPR4Pp\Pp\P !VRR7\P !VRR7.p\W14\VRR7o\^R7!V3RlR44wp\S^,\P4'gQhS^,PV8gQh\PPW44R#) z test.mmapuint8rr) mmap_moder~c3N<"TFp\\4!S4xK R#5ir,)r!r)rnrrs& r0rp.test_memmap_with_big_offset..^s"Jc78#4V#<#.fs%L)Qgfoa&8&8)rrNzThe backend class 'SequentialBackend' does not support timeout. You have set 'timeout=1' in Parallel but the 'timeout' parameter will not be used.) rrrrtrrrrr)rrs r03test_warning_about_timeout_not_supported_by_backendrds   - -1%%L%)%LL . x=A   A aii - -- - qyy>    . -s $B'' B7 cW V&V#r,r.) input_listrrs&&&r0set_list_valuerqsu Lr/c a^.^,o\VRRR7!V3Rl\^444p\V4p\;QJd&R\ SV44F 'dK RM RM!R\ SV444'gQhR#) rdrLr(rjrKr7c3P<"TFp\\4!SW4xK R#5ir,)r!r)rnrors& r0rpPtest_parallel_return_order_with_return_as_generator_parameter..|s$Q;Ca A118rc3."TF wrW8HxK R#5ir,r.rnvrs& r0rprs:"9$!qv"9FTN)rrtrRrr])rjr:rs& @r0=test_parallel_return_order_with_return_as_generator_parameterrvsv qJ V{K PQ;@8QF &\F 3:#j&"9:333:#j&"9: : :: :r/c>V'd \^4\V4#))rr)edelays&&r0_sqrt_with_delayrs  b 7Nr/cda\VRVR7!R\^ 444o\V3Rl\^ 444p^.\\^^ 44,p\;QJd%R\ W244F 'dK RM RM!R\ W2444'gQh>R#)rMrc3b"TF%p\\4!V^,V^8H4xK' R#5ir?N)r!rrms& r0rpK_test_parallel_unordered_generator_returns_fastest_first..s,W;Da !!Q$a119s-/c3:<"TFp\S4xK R#5ir,)next)rnrr:s& r0rprs=Hqd6llHsc3."TF wrW8HxK R#5ir,r.rs& r0rprsS"R$!qv"RrFTN)rrtsortedrRrr])r7rjquickly_returnedexpected_quickly_returnedr:s&& @r08_test_parallel_unordered_generator_returns_fastest_firstrsV/Dg VW;@9WF=E!H==!"d5B<&8 8 3S#&?"RS333S#&?"RS S SS Sr/c\W4R#r,)rr7rjs&&r07test_parallel_unordered_generator_returns_fastest_firstrs =WMr/c6R.^ .^d,,p\\4;_uu_4\P!4p\WR7!RV44RRR4\P!4X, pV^8gQhR# +'giL7;i)rFric3`"TF$p\\P4!V4xK& R#5ir,r!r\rrms& r0rp%test_abort_backend..s#0XQWA1DQ1G1GQWs,.N)rrr\r)rjr7delayst_startdts&& r0test_abort_backendrskUbTCZ F   ))+00XQW0XX  w B 7N7  s /B B cZ\P!\R4\R7pRV^&V#)rrFgA)rrintbool)rr:s& r0get_large_objectrs$ WWS\ .FF1I Mr/c\W VR7;_uu_4pV!R\^ 444p\V4\V4?RRR4R# +'giR#;i))rjr7rKc3L"TFp\\4!V4xK R#5ir,)r!rrms& r0rp0_test_deadlock_with_generator..sJ 1'"23A66 rrN)rrtr)r7rKrjr r:s&&& r0_test_deadlock_with_generatorrsH I F F(Jb JJ V  V  G F F Fs 0A A! c\WV4R#r,)r)r7rKrjs&&&r0test_deadlock_with_generatorrs "'f=r/cf\\RR7;_uu_4\W VR7pV!R\^ 444p\P!4pV!R\^d444pRRR4\P!4X, ^8gQR4h?R# +'giL;;i))This Parallel instance is already runningrrSc3L"TFp\\4!^4xK R#5irrrs& r0rp/test_multiple_generator_call..s: 1WU^A&& rrc3L"TFp\\4!V4xK R#5ir,r!rms& r0rprs; 1 A rrN[The error should be raised immediately when submitting a new task but it took more than 2s.)rrrrtr\)r7rKrjr grgen2s&&& r0test_multiple_generator_callrs  $O P PFyI :b : :))+;c ;; Q 99; 1 $ $ $  Q Ps AB  B0 c \W VR7;_uu_4pV!R\^ 444p\P!4p\\RR7;_uu_4V!R\^d444pRRR4\P!4V, ^8gQR4hRRR4?R# +'giLD;i +'gi?R#;i)rSc3L"TFp\\4!^ 4xK R#5irFrrs& r0rp7test_multiple_generator_call_managed..s;AWU^B''rrrrc3L"TFp\\4!V4xK R#5ir,r!rms& r0rprs=*Q'"+a..*rrNr)rrtr\rr)r7rKrjr rrg2s&&& r0$test_multiple_generator_call_managedrs &Y ? ?8 ;r; ;))+ L(S T T=%*==BUyy{W$q(  ( ( @ U T @ ? s$ACB2 60C2 C =C C return_as_1 return_as_2c h\W0VR7!R\^ 444p\W0VR7!R\^ ^444pVR8Xd \V4pVR8Xd \V4p\;QJd/R\ V\^ 444F 'dK RM$ RM !R\ V\^ 4444'gQh\;QJd0R\ V\^ ^444F 'dK RM% RM!!R\ V\^ ^4444'gQhR#) rSc3Z"TF!p\\4!V^,4xK# R#5irrrms& r0rp9test_multiple_generator_call_separated..s$A%. adY)+c3Z"TF!p\\4!V^,4xK# R#5irrrms& r0rprs$B%2 ad]rrMc3."TF wrW8HxK R#5ir,r.rnrros& r0rprs8&7FCsx&7rFTc3."TF wrW8HxK R#5ir,r.rs& r0rprs=&.&s7Y##Yrrc\R4#)zGenerator collected)rr.r/r0;test_multiple_generator_call_separated_gc..'s u-B'Cr/z The executor underlying Parallelrc3Z"TF!p\\4!V^,4xK# R#5irrrms& r0rpr3s$@ )6AGDM!Q$  rrMc3."TF wrW8HxK R#5ir,r.rs& r0rpr:s@*?38*?rFTr)r rgrhrrtweakreffinalizerrrr\rrr]aliverrra) r7rrerrorr rg_wrr*rretrys &&&& r0)test_multiple_generator_call_separated_gcrs 6  ./7BH7U2Y77A   AC DD  |#EF ]  ))+ Q ?@ ).r2@   / /q As@#ar2*?@sss@#ar2*?@@@@@  99; 1 $$ $ E ***   3 99; 1 $$ $!!#q(!!!!!)1 sAG9'%G9.G9>G99 H cVPp\^^WR7;_uu_4pV!R\PP^ 4.^,44\ \ P !V44^8gQhRRR4\^d4F,p\ P !V4'gM\R4K. \R4h\^^VR7pV!R\PP^ 4.^,44\^d4F-p\ P !V4'gR#\R4K/ \R4h +'giL;i)r?)rjr'r7 temp_folderc3L"TFp\\4!V4xK R#5ir,rrs& r0rp(test_memmapping_leaks..Vs G,Fq',  " ",FrrNrz/temporary directory of Parallel was not removedrc3L"TFp\\4!V4xK R#5ir,rrs& r0rprfsC(B1glA(Brr) r|rrr]rrlistdirrtrAssertionError)r7r}rrs&& r0test_memmapping_leaksrKs ^^F q' N NRS GRYY-=-=b-A,BQ,F GG2::f%&*** O3Zzz&!!  c  NOO a9AC)9)9")=(>(BCC 3Zzz&!!  c  NOO1 O Ns AE E& c\^VR7!R\^ 444pT\^ 4Uu.uF q"^,NK up8XgQhR#uupi)r?ric3F"TFp\R4!V4xK R#5i)cV^,#r>r.r@s&r0r2test_lambda_expression...vs!Q$r/Nr0rms& r0rp)test_lambda_expression..us 2,5q""Is!Nrs)r7rros& r0test_lambda_expressionrpsP a12,1"I2G U2Y/Y!ttY/ // //sAc0a^pRpRV, o\^ WR7pV!V3Rl\V444VPPVPP8XgQhVPP VPP 8XgQhV!V3Rl\V444VPPVPP8XgQhVPP VPP 8XgQhR#)zCTest that a parallel backend correctly resets its batch statistics.ig@)rrjr7c3b<"TF$p\\P4!S4xK& R#5ir,rrnro task_times& r0rp6test_backend_batch_statistics_reset..">ogdjj)$$o,/c3b<"TF$p\\P4!S4xK& R#5ir,rr s& r0rpr"r#r$N)rrtr_effective_batch_size_DEFAULT_EFFECTIVE_BATCH_SIZE_smoothed_batch_duration _DEFAULT_SMOOTHED_BATCH_DURATION)r7rjn_inputsrr!s& @r0#test_backend_batch_statistics_resetr+{sFHhIFeHo>> :: + +qzz/W/W WW W ++ :: 6 6 7 7>eHo>> :: + +qzz/W/W WW W ++ :: 6 6 7 7r/cDR Fp\\VR7P4\4JgQh\VRR7p\VP4\JgQh\VRR7p\VP4\ JgQh\VRR7p\VP4\JdKQh \^RRR7p\VP4\ JgQhV!R^R7;_uu_4\RR 7p\VP4\ JgQhVP ^8XgQhR R R 4V!R^R7;_uu_4\^RR7p\VP4\ JgQhVP ^8XgQhR R R 4V!R^R7;_uu_4\RR 7p\VP4\JgQhVP ^8XgQhR R R 4V!R^R7;_uu_4\^RR7p\VP4\JgQhVP ^8XgQhR R R 4R # +'giEL#;i +'giL;i +'giL;i +'giR #;i) rr~threadsrjprefer processes sharedmemrjrequirer')rjr7r/r/Nr3)rr?r)rerrr1rrrj)r}rjrs& r0$test_backend_hinting_and_constraintsr6s HF+4459U9WWWW F9 5AJJ#3333 F; 7AJJ;... FK 8AJJ#3333 6).s5$-qIrr)r/rjc3L"TFp\\4!V4xK R#5ir,rlrms& r0rpr9sCAWV_Q//rrN)rtrr$)rjr/roexpected_resultsrs&& r0#test_backend_hinting_always_runningr<s ',Bi0i1i0f45$)"I5G  && &  6 6*CrCC 7  && &1 7 6sB!B B' c!RR\4pV!V!44;_uu_4\^RR7p\VP4VJgQh\^RR7p\VP4VJgQhRRR4!RR\4pV!V!44;_uu_4\^RR7p\VP4VJgQhVP 4wrVVR 8XgQhVR 8XgQh\^R^ R 7p\VP4\ JgQhVP 4wrVR pVP 4V8XgQhVR 8XgQhRRR4\\4;_uu_4\V!4RR 7RRR4R# +'giEL ;i +'giLX;i +'giR#;i) c4a]tRtRtoRtRtRtRtRtVt R#)[test_backend_hinting_and_constraints_with_custom_backends..MyCustomThreadingBackendiTcR#r,r.rs&r0 apply_asyncgtest_backend_hinting_and_constraints_with_custom_backends..MyCustomThreadingBackend.apply_async r/cV#r,r.rs&&r0r"ltest_backend_hinting_and_constraints_with_custom_backends..MyCustomThreadingBackend.effective_n_jobsMr/r.N rMrNrOrPsupports_sharedmem use_threadsrAr"rRrSrTs@r0MyCustomThreadingBackendr?s!    r/rJr0r.r1r2Nc4a]tRtRtoRtRtRtRtRtVt R#)\test_backend_hinting_and_constraints_with_custom_backends..MyCustomProcessingBackendiFcR#r,r.rs&r0rAhtest_backend_hinting_and_constraints_with_custom_backends..MyCustomProcessingBackend.apply_asyncrCr/cV#r,r.rs&&r0r"mtest_backend_hinting_and_constraints_with_custom_backends..MyCustomProcessingBackend.effective_n_jobsrFr/r.NrGrTs@r0MyCustomProcessingBackendrLs"    r/rQr)rjr3rzUsing ThreadingBackend as joblib backend instead of MyCustomProcessingBackend as the latter does not provide shared memory semantics.r7r3) rrrer readouterrrstriprrX)capsysr}rJrrQouterrrs&& r09test_backend_hinting_and_constraints_with_custom_backendsrXs#6 )+ , , Ak 2AJJ#;;;; A{ 3AJJ#;;;; -$7 *, - - Ak 2AJJ#<<<<$$&byybyy A{B ?AJJ#3333$$& 8  yy{h&&&byy% .(   24kJ  K - , ," . -(   s%AF#B.F"1F5 F " F2 5 G c\\4;_uu_4\RR7RRR4\\4;_uu_4\RR7RRR4\\4;_uu_4\RRR7RRR4\e]\\4;_uu_4\RRR7RRR4\\4;_uu_4\R RR7RRR4R#R# +'giL;i +'giL;i +'giL;i +'giLz;i +'giR#;i) invalidr4Nr5r0r1)r/r3r'rRr&)rrXrr r.r/r0,test_invalid_backend_hinting_and_constraintsr[ s    "    #      [9   ~J   V[ 9 J   . D            s; C, C?0D%D%D8, C< ? D  D" % D5 8 E c Taa\^R7;_uu_4p\VP4PVPP3.pS^8Xd VuuRRR4#V!VV3Rl\ ^444pW4^,,uuRRR4# +'giR#;i)zCPerform nested parallel calls and introspect the backend on the wayr~Nc3`<"TF#p\\4!RRS^, /SBxK% R#5i)limitNr.)r!_recursive_backend_info)rnrokwargsr^s& r0rp*_recursive_backend_info..'s/  + , G519 G Gs+.)rrerrMr'rt)r^r`r this_levelrsfl r0r_r_ s   qAJJ'00!**2J2JKL A:   1X  AJ&    s?B!*B B' cV!V^R7;_uu_4\4pRRR4VP4R,pV^3RRR.pXV8XgQhR# +'giL:;i)r?r~NBackend)rr)rr?)r_title)r}r7backend_types_and_levelstop_level_backend_typeexpected_types_and_levelss&& r0test_nested_parallelism_limitri.se  # ##:#<  $%]]_y8 #  ! $'@ @@ @ $ #s A A cB\4!R\^444#)z6A horrible function that does recursive parallel callsc3J"TFp\\4!4xK R#5ir,)r!_recursive_parallelrms& r0rp&_recursive_parallel..AsGhg1244hr rs) nesting_limits&r0rlrl?s :GeAhG GGr/c V!V^R7;_uu_4\\4;_uu_4p\4RRR4RRR4XPpVR8Xd4^RIHp\ W4\34'd\P!R4\ V\4'gQhR# +'giLx;i +'giL;i)r?r~Nr')TerminatedWorkerErrorz1Loky worker crash when serializing RecursionError) r BaseExceptionrlr&joblib.externals.loky.process_executorrprrrgxfailRecursionError)r}r7rexcrps&& r0test_thread_bomb_mitigationrvDs  # # M " "g  !# $ --C& Q c=A B B LLL M c> * ** *## " $ #s!B9 B& B9& B6 1B99 C ct/pRF$p\PPV4W&K& V\^d43#)OMP_NUM_THREADS)rxOPENBLAS_NUM_THREADSMKL_NUM_THREADSVECLIB_MAXIMUM_THREADSNUMEXPR_NUM_THREADSNUMBA_NUM_THREADS ENABLE_IPC)renvironrTr)env_varsvars r0_run_parallel_sumr`s;H s+  \#& &&r/zNeed OpenMP helper compiledcT\^VR7!R\^444p\\4^,^4pVFcwr4WB8XgQhVP 4FBwrVVP R4'dV\ V48XgQhK0VR8XgQhVR8XdKBQh Ke R#)r?ric3J"TFp\\4!4xK R#5ir,)r!rrs& r0rp-test_parallel_thread_limit..rs2.6!"$$hr _THREADSr~1N)rrtrr itemsendswithr)r7rexpected_num_threadsworker_env_varsomp_num_threadsrrs& r0test_parallel_thread_limitrosa12.3Ah2Gy{a/3,3(666*002KD}}Z(($8 9999|+++|#| 3-4r/zThis test requires daskc\\RR7;_uu_4V!R4RRR4R# +'giR#;i)zPlease install daskrdaskN)rrX)r}s&r0)test_dask_backend_when_dask_not_installedrs(  "7 8 8 9 8 8 8s - > c P!RR\4pRpV!V!44;_uu_4\P!\VR7;_uu_4\ ^R7!R\ ^444RRR4RRR4R# +'giL;i +'giR#;i)c6a]tRtRtoRtRRltRtRtVtR#)3test_zero_worker_backend..ZeroWorkerBackendic^#rcr.)rErr`s&*,r0r=test_zero_worker_backend..ZeroWorkerBackend.configurer/Nc\R4h)zNo worker availabler)rEfunccallbacks&&&r0rA?test_zero_worker_backend..ZeroWorkerBackend.apply_asyncs45 5r/c^#rcr.rs&&r0r"Dtest_zero_worker_backend..ZeroWorkerBackend.effective_n_jobsrr/r.r,) rMrNrOrPrrAr"rRrSrTs@r0ZeroWorkerBackendrs  6  r/rz&ZeroWorkerBackend has no active workerrr~c3L"TFp\\4!V4xK R#5ir,r!rms& r0rp+test_zero_worker_backend..s@x!wr{1~~xrrN)rrgrrrrt)r}r expected_msgs& r0test_zero_worker_backendrsm,.check_globalss!!r/r~c3D<"TFp\S4!4xK R#5ir,r0rnrors& r0rp.1*2Q   ( z changed valuec3D<"TFp\S4!4xK R#5ir,r0rs& r0rprrrN)rrrtr)workers_global_variablers @r0)test_globals_update_at_each_parallel_callrs *" ?. .. .&a01*/(1 & ',<+= == =) ?o -- -&a01*/(1 & 'O+< << >|L r/czVF4pVF+p\WA4p\W%4V0pVR,V9dK+Qh K6 R#)rN)rmin) workers_inforrchild_threadpool_inforparent_max_num_threadsrs&&& r0check_child_num_threadsrsK".1L%@& "K@+NH .(: :: 2".r/cB\4p\V4^8Xd\P!RR7\ RVR7!R\ ^444p\ V4pV^8XdV^,R,pM\\4V,^4p\W!V4R#)rd&Need a version of numpy linked to BLASrr'rc3J"TFp\\4!4xK R#5ir,r!rrms& r0rp;test_threadpool_limitation_in_child_loky..s G;Ca./118r rN rrrgrhrrtr"rr r)rjrworkers_threadpool_infosexpected_child_num_threadss& r0(test_threadpool_limitation_in_child_lokyrs12K ;1 CD'vFG;@8G f %F {%0^M%B"%()>%B" /Ir/inner_max_num_threadsc\4p\V4^8Xd\P!RR7V!RVR7;_uu_4\ VR7!R\ ^444pRRR4\ V4pV^8XdV^,R,pM"Vf\\4V,^4pMTp\XW54R# +'giLc;i) rdrrr'rr~c3J"TFp\\4!4xK R#5ir,rrms& r0rp>test_threadpool_limitation_in_child_context.. s; ?G!G2 3 5 5xr Nrr)r}rjrrrrs&&& r0+test_threadpool_limitation_in_child_contextrs12K ;1 CD /D E E#+6#:; ?DQx; $   F f %F {%0^M%B"  &%()>%B"%:" + F Es #C C var_namecaa\V4^8Xd\P!R4\RR7P 4Ro\ P PS4pR\ P S&\VR7!VV3Rl\^444pVRR.8XgQhV!R^R 7;_uu_4\VR7!VV3R l\^444pR R R 4VR R .8XgQhVf\ P SR #V\ P S&R # +'giLH;i Tf\ P SiT\ P S&i;i) rzSkip test when n_jobs == 1Treusec@\PPV4#r,)rrrT)rs&r0_get_env>test_threadpool_limitation_in_child_override.._get_env,szz~~h''r/4r~c3F<"TFp\S4!S4xK R#5ir,r0rnrorrs& r0rp?test_threadpool_limitation_in_child_override..3s)Xx!'(*;H*E*Exr2r'rc3F<"TFp\S4!S4xK R#5ir,r0rs& r0rpr7s!.5=!(++Xr2Nr) r"rgrhrshutdownrrrTrrt)r}rjroriginal_var_valuerrs&&f @r0,test_threadpool_limitation_in_child_overriders1$ 01%..0(16" 8&))XuUVx)XX3*$$$ V1 5 5f-.5:1X.G63*$$$  % 8$#5BJJx 6 5  % 8$#5BJJx s%&AD6<'D##D6# D3 .D66+E!cRpV!V4\RR7p\^ 4FpV!V4\RR7pWB8XdKQh R#)cha\^ 4o\VR7!V3Rl\^ 444R#)r r~c3N<"TFp\\4!S4xK R#5ir,)r!sum)rnror:s& r0rpAtest_loky_reuse_workers..parallel_call..KsCA QrN)rtr)rjr:s&@r0 parallel_call.test_loky_reuse_workers..parallel_callIs# "ICrCCr/TrN)rrt)rjrfirst_executorrrs& r0test_loky_reuse_workersrCsJ D &*6N2Yf(t4)))r/c6RV\P!4&R#) initializedN)rr)statuss&r0_set_initializedrYs'F299;r/ct\P!4pVPVR4pVR9g QRV 24hV'gR#RW&\P!4^,p\ VP 4UUu.uFwr6VR8XgKVNK upp4p\P!4V8dUWq8dO\P !R4\ VP 4UUu.uFwr6VR8XgKVNK upp4pKn\P!4V8d \R4hX#uuppiuuppi)Nstartedz2worker should have been in initialized state, got rz-Waited more than 30s to start all the workers)rr)rrrTr\rrrr)rrj wait_workerspidstatedeadliner n_starteds&&& r0 _check_statusr]s ))+C JJsD !E . . L>Q)^>LM  yy{hJKK JIMs; D. D. ' D4 7D4 caa\P!4pVP4oV!VS\S3R7;_uu_4\ 4!VV3Rl\ ^d444RRR4R# +'giR#;i)r7rj initializerinitargsc3P<"TFp\\4!SS4xK R#5ir,r!rrnrorjrs& r0rp+test_initializer_context..s N:a7=)&&99:rN)r rdictrrrt)rjr7r}rrsf&& @r0test_initializer_contextrtsc jjlG \\^F $     N5:NN    s %A00 B caa\P!4pVP4o\VS\S3R7!VV3Rl\ ^d444R#)rc3P<"TFp\\4!SS4xK R#5ir,rrs& r0rp,test_initializer_parallel..s AjgmVV,,jrN)r rrrrrt)rjr7rrsf& @r0test_initializer_parallelrsHjjlG \\^F $  BeCjA Br/cNaa^p\P!4pVP4o\4p\ V4FKp\ RS\ S3R7!VV3Rl\ S444pVP\V44pKM \V4S8XgQR4hR#)r3r'rc3T<"TFp\\4!SSRR7xK R#5iT)rNrrs& r0rp*test_initializer_reused..) " M "66 E E"rz=The workers should be reused when the initializer is the sameN) r rrrrtrrunionrrj n_repetitionsrpidsrorrsf @r0test_initializer_reusedr s MjjlG \\^F 5D = !(Y   6]  zz#g,'" t9 G r/c\aa^p\P!4p\4p\V4F[pVP 4o\ RS\ S3R7!VV3Rl\S444pVP\V44pK] \V4VS,8XgQR4hR#)r3r'rc3T<"TFp\\4!SSRR7xK R#5irrrs& r0rp.test_initializer_not_reused..rrzFThe workers should not be reused when the initializer arguments changeN) r rrrtrrrrrr sf @r0test_initializer_not_reusedrs MjjlG 5D = !(Y   6]  zz#g,'" t9 . .P .r/)F)rdrd)r3r3r)Nr)z positive-intz negative-intNone)rr?r)r? r))r'r&T)r'r'F)r&r&T)r&r'T)r(r&T)r(r'T)r'r&r()rr?r3)<>=) r Consumed 0 Produced 1 Consumed 1 Produced 2 Consumed 2r Consumed 3 Produced 4 Consumed 4 Produced 5 Consumed 5) rrrrrrrrrrrr )2gffffff@r?)r(r'r&r)r?rN)rdrgQ?) )r?r?rr)r?r?rjrr r?rjr)ir?rjrr")r rrjr) rjr)r$ 2 * n_jobsr)r$rr)r'r$r&rW)r#r$r&r)r!rr`)rr?r)rr?rr))r'T)r(F)rJF)Nr'r()Nr0r-)r3r,)r?rrr)rr?rN)ryrzrx)r?rr)rQrrrrkr(r\rr r>rmathrr&rpicklerr tracebackrrgryr r r joblib._multiprocessing_helpersr joblib.test.commonr rrrjoblib.testingrrrrrjoblib.externals.lokyrrrrposix ImportError _openmp_test_helper.parallel_sumr distributedjoblib._parallel_backendsrrrrrjoblib.parallelrrr r!r"r#r$r%rRETURN_GENERATOR_BACKENDSpoprkeysALL_VALID_BACKENDSPROCESS_BACKENDSPARALLEL_BACKENDShasattrrr)r1r8r<rA ExceptionrCrZr^rargrvryr|markrrrrrrrrrrrrrrr%r=rCrHrrTrcrprtrrrrrrrrsrrrrrrrrrrextendrtrrrrrr _parallel_backendsrrr%r+r4rHrKrPrWrarirnrvrt SQUARE_LOCAL SQUARE_LAMBDArrjrwrxrzrrrrrrrrrrrrrrrrrrrrrrrrrr+r6r<rXr[r_rirlno_coverrvrrrrrrrrrrrrrrrrr r) backend_strros00r0rDs  "( & ''. UT>;>   %MMO/6VfX]]_55(K(;x ,.(KK:)62$ }4 2}bnnW56.I    2" Y*:;<% b""- . :0 . =. Y*+ X~& Y %,&',,  Y*+ X1v,( Y*+','T0 +  2 Y@A B Q _h' x()( WW  Xy!" Y)*/+/:      [/* \At9%5&+ 5$ Y)* +  Y)* +  Y56,GH [;(=>?@I$ Y()C *C L Y!E"E,' Y!     $   %$'P Q'"R   Y)*+<4 Y()3*3 HM Y)*CD-E+-, +   Y*+H,H$ Y)* X}%:&+:% D$=>9?9;*$5Q#7 ''a(Q1):Q)>)>(QR Y89 Y)?;<D=:D,#4 Y*:;<D=D& Y*:;<D=D( Q>))55>/; YWX Y*:;<,=Y, X}% Y)* Y*:;< =+& 07 _/0 _/0 Y*:;<  =11   Y*:;< %e}5!6=!: \=)(*(  /  ! ++  Y()S* S, 0,  Y() * -)@    Y("*B7)LM ][, FG "?@AHN,(9P Fbggoobggoofoo.NOFPQ6V  =, Fbggoobggoofoo.NOFP-:28    Y()8* 86  /  /  9- ;. ;"Aq6* Y56,GHNI + N Y*+ X~&',  Y12 [;(=>? X~&>'@3 > Y12 [;(=>? X~& '@3 & Y12 [;(=>? X~& '@3 & Y12 ][*?@A ][*?@A X~&>'BB3>&  ][*?@A ][*?@A)"BB)"X  Y()P* PD  rz{#7R00 Y()*, Y*:;<+=+\ X1v X56 '7 ' Y*:;<3K=3KlE* ' Y-. Y*:;< A=/ AH  Y*:;< Y"*+6;:OQ+R=+2 ' Y2>$vG %BC $DH $ Y*:;< 4(ABC=  Y*:;<A=A&=H + ;  X~&' 0  $o6 X2w Y*:;<= 7 6 X2w ZWX Y*:;< 6=Y  6F Xz"*#*((. X1v Y() Y*:;< O=* O X1v Y() B* BAq6*+0Aq6*+OD E L K6L~)RsB mm*m:n %n m'&m'* m76m7: nn