Q3jRN"ddlmZddlZddlZddlmZmZddlm Z m Z m Z ddl m Z mZmZmZmZmZmZmZmZmZmZ d%dZdZdZd Zd Zd Zd Zd ZdZ dZ!ejDjGde eegdZ$dZ%dZ&ejDjGdeegdZ'ejDjGdddgdZ(ejDjGdddgdZ)dZ*dZ+dZ,dZ-dZ.d Z/d!Z0d"Z1d#Z2d$Z3y)&)partialN)CallbackSupportMixinwith_callbacks)CallbackContext_from_reconstruction_attributesget_context_path) MaxIterEstimator MetaEstimatorNoCallbackEstimatorNoSubtaskEstimatorNotRequiredKwargsCallbackNotValidHookCallbackParentFitEstimatorRecordingAutoPropagatedCallbackRecordingCallbackStopFitCallbackThirdPartyEstimatorc4tj|||||S)zHelper function to create a callback context with default values. To be used instead of estimator._init_callback_context in tests that only check the context tree (without callbacks). )r_from_estimator) estimator task_nametask_id max_subtaskssequential_subtaskss Y/DATA/.local/lib/python3.12/site-packages/sklearn/callback/tests/test_callback_context.py_make_callback_ctxrs#  * *9g|5H ct}t}t}t|}|j ||t |drJt |}|j|5t |dsJ||jvsJ||jvsJ dddt |drJt |drJy#1swY&xYw)z9Check that only auto-propagated callbacks are propagated._skl_callbacks_parent_callback_ctxN) rrr r set_callbackshasattrrpropagate_callback_contextr)not_propagated_callbackpropagated_callbackr metaestimator callback_ctxs r.test_propagate_callback_context_autopropagatedr(+s/19; "I!),M 79LMy"233 3%m4L  0 0 ;y"8999&i.F.FFFF"i&>&>>>> < y"233 3y"899 99 < ;s &/B;;Cct}tj|}t}t |}|j||j |gk(sJt |}|j|5t|dsJ||j vsJ||j vsJ ddd|j |gk(sJt|drJy#1swY*xYw)z9Check that only propagated callbacks are removed on exit.r N) rr r!rr rrr#r") est_callbackrmeta_est_callbackr&r's r(test_propagate_callback_context_clean_upr,@s$&L "00>I79!),M 12  # # ~ 55 5%m4L  0 0 ;y"8999y77777 I$<$<<<< <  # # ~ 55 5y"899 99 < ;s 8/CCct}t|}t|}t|jdk(sJ|j |5t |dsJt |drJt |drJ dddt |drJt |drJt |drJt |drJy#1swYBxYw)z"Y7N V  y .TT* / . .s A**A3ct}t||d}t|D]8}|jd||}t|D]}|jd}:|S)zGHelper function to create a tree of tasks with a context for each task.Frr child task)rrrzgrandchild taskr)r rrange subcontext) n_childrenn_grandchildrenrrootichildj grandchilds r_make_task_treerJwst "I   D: "(   'A))4E)FJ( KrcTtdd}|jJtt|dk(sJt|jdk(sJ|jj D]}|j|usJtt|dk(sJt|jdk(sJ|jj D]E}|j|usJtt|dk(sJt|jdk(rEJ|D]&}t|j|j k(r&Jtjtjgd}td |D}||k(sJtd |DsJtd |DsJy) z,Check that the task tree is correctly built.)rCrDNr)rNrLrMc3 K|]}dyw)rNN).0_s r z!test_task_tree..s)DqDs c38K|]}|jduywN)source_estimator_namerRnodes rrTz!test_task_tree..sCddt))T1dc38K|]}|jduywrV)source_task_namerXs rrTz!test_task_tree..s>t$$,rZ) rJparentr.r _children_mapvaluesrnpsumcumprodall)rErGrIrYexpected_n_nodesactual_n_nodess rtest_task_treerfs a ;D ;;   % &! ++ + t!! "a '' '##**,||t####E*+q0005&&'1,,,--446J$$- --' 349 99z//0A5 557 -4%%&$*;*;;;;vvbjj34)D))N - -- - CdC CC C >> >> >rct}t|dd}t|dd}|j||jdk(sJt |j dk(sJ|j dk(sJt|dd}tjtd 5|j|d d d d|_|j|t |j dk(sJt|dd}tjtd 5|j|d d d y #1swYxYw#1swYy xYw) z)Sanity check for the `_add_child` method.rOFr>r?rrrrNz6Callback context .* already has a child with task_id=0r3Nz$Cannot add child to callback context) r r _add_childrr.r^rr7r8 ValueError)rrE first_child second_child third_childs rtest_add_childrns# "I iaU SD$Y,PQRKOOK    !! ! t!! "a '' '   ! ## #&i)r r rrB _merge_withr]rr^r_rrr\rrWestimator_name)rr; outer_root outer_child inner_roots rtest_merge_withrvs$ "I"9-N#NFJ''t(K $uJ;'    ** *   !4!4 44 4 j66==? ?? ? 1188: :: :  " "a '' '--- -  & &+*?*? ?? ?  + +{/I/I II Irct}t|}t|}t|d}|jdt j t d5|j|dddy#1swYyxYw)z8Check that merging with a non-leaf node raises an error.NrprGr@zCannot merge callback contextr3)r rr rBr7r8rjrq)rrur;rss rtest_merge_with_error_not_leafrxsg "I#I.J"9-N#NFJG, z)I Jz* K J Js A66A?estimator_classcJ|j}t|drJy)zBCheck that the _callback_fit_ctx attribute gets removed after fit._callback_fit_ctxN)r:r")ryrs r#test_callback_ctx_removed_after_fitr|s)  !%%'Iy"566 66rct}t|}|jtt j t d5|jdddy#1swYyxYw)zCheck that meta estimators can have sub estimators without callback support. No error is raised when the sub-estimator does not support callbacks. If callbacks would be propagated, a warning is raised instead. =The estimator NoCallbackEstimator does not support callbacks.r3N)r r r!rr7warns UserWarningr:)rr;s r(test_inner_estimator_no_callback_supportrsX $%I"9-N  !@!BC M      s A$$A-cjt}|jt|jy)zCheck that callback support works for an estimator without subtasks. This test is about verifying that an estimator that does not call its callback context's `call_on_fit_task_end` does not cause a problem. N)r r!rr:r2s rtest_estimator_without_subtaskrs' #$I -/0 MMOrCallbackc$d}|}t|j|j|jddk(sJ|jdd|zk(sJ|jdd|zk(sJ|jddk(sJy) zCheck the number of callback hook calls in a regular estimator. For a regular estimator, it does not depend whether it's an autopropagated callback or not. max_itersetuprNon_fit_task_beginon_fit_task_endteardownN)r r!r: count_hooks)rrcallbacks rtest_callback_hooks_calledrsHzHh'55h?CCE    (A -- -    3 4H DD D    1 2a(l BB B    +q 00 0rn_jobsrNrOcd\}}}t}tt||||j|j |j ddk(sJt jt jd|||g}|j d|k(sJ|j d|k(sJ|j ddk(sJy ) aCheck the number of callback hook calls in a meta-estimator. For an auto-propagated callback, setup and teardown are called only once, by the meta-estimator. To count the number of task ends, we need to aggregate the number of tasks from all the levels of the global task tree (which contains the task tree of the meta-estimator and the task trees of each sub-estimator). rOrLrMrn_outern_innerrrrNrrrN) rr r r!r:rr`rarb)rrrrrexpected_n_taskss r8test_meta_estimator_autopropagated_callback_hooks_calledr/s")GWh.0H(+  mHcce    (A -- -vvbjj!Wgx)HIJ    3 48H HH H    1 26F FF F    +q 00 0rcfd\}}}t}t|j|}t||||j ||z}|j d|k(sJ|j d|d|zzk(sJ|j d|d|zzk(sJ|j d|k(sJy ) aCheck the number of callback hook calls in a meta-estimator. For a non auto-propagated callback, setup and teardown are called once for each fit of the sub-estimator. The number of task ends is the sum of the number of task ends from all the sub-estimators. rrrrrrNrrN)rr r!r r:r)rrrrrestn_fitss r)test_meta_estimator_callback_hooks_calledrIs")GWh "H H - ; ;H EC#wGKKM w F    (F 22 2    3 4!h,8O OO O    1 2fH 6M MM M    +v 55 5rcd\}}t}tt||j|}t j t d5|jddd|jddk(sJtjtjd||g}|jd|k(sJ|jd |k(sJ|jd dk(sJy#1swYxYw) zCheck the number of hook calls when the sub-estimator doesn't support callbacks. The number of task begins and ends is just the number of nodes in the context tree of the meta-estimator. )rOrL)rrr~r3NrrNrrr) rr r r!r7rrr:rr`rarb)rrrr;rs r6test_autopropagation_to_callback_agnostic_subestimatorr^s GW.0H"wmH M        (A -- -vvbjj!Wg)>?@    3 48H HH H    1 26F FF F    +q 00 0  s C--C6ct}|jtj}d}t j t |5|j|dddddy#1swYyxYw)zLCheck that a callback with invalid kwargs in its signatures raises an error.z6on_fit_task_begin .* has parameters that are not validr3rNrO)rr5r6N)r r!r_init_callback_contextr7r8r9call_on_fit_task_begin)rcontextmsgs r$test_hook_calling_invalid_kwargs_outrys[ "I%%&:&<=TTVG CC y ,&&a1&E - , ,s A--A6c&t}|jtj}|j |}|dusJ|jtt |jj |}|dusJy)z)Check the return value of the hook calls.r2FTN)r r!rrcall_on_fit_task_endr)rrresults rtest_hook_calling_return_valuers "I%%&7&9:QQSG  ) )I ) >F U?? -/1BC  - - / D DEF T>>rcdddfd}t}t}|j|j}|j |t |dt |dddk(sJddk(sJddi|jt t |j}|j|t |dddk(sJy ) zCheck lazy evaluation of kwargs. kwargs are not evaluated if no callback uses them. They are evaluated only once and passed to all callbacks that use them. r)r5metadatac |xxdz cc<y)NrNrQ)key eval_countss r eval_kwargz5test_hook_calling_lazy_evaluation..eval_kwargsCArr5r)rr5rrN)rr5N)r r r!rrrrr)rrrrrs @r!test_hook_calling_lazy_evaluationrs q)K !"I(*H%%h/FFHG    *c "Z0! s q  z "a '' '(K -/1B1DE..0G ""Y'*c:R"S s q  rcZt}t}|j|j}|j |dd|j ddvsJd|j ddvsJ|j ddd}t |tsJ|jdk(sJy) zCheck lazy evaluation of reconstruction_attributes. "reconstruction_attributes" is processed by the context and used to create a fitted estimator that is passed to the callback as "fitted_estimator". c ddiS)Nn_iter_rNrQrQrrzMtest_hook_calling_lazy_evaluation_reconstruction_attributes..s 1~r)rreconstruction_attributesrkwargsfitted_estimatorrNN)r rr!rrrecord isinstancer)rrrrs r;test_hook_calling_lazy_evaluation_reconstruction_attributesrs !"I "H%%h/FFHG   7M! 'hoob.A(.K KK K !4X!> >> >r*845GH &(8 99 9  # #q (( (rcd}t|}t|ddi}t|tsJ||usJ|j|jk(sJ|jdk(sJy)z9Test the _from_reconstruction_attributes helper function.rMrrrON)r rr get_paramsr)rrreconstructed_ests r#test_from_reconstruction_attributesrsvH (3I7 Iq>R ')9 :: : I -- -  ' ' )Y-A-A-C CC C  $ $ )) )rct}t|dd}tdD]#}|j}|j|k(r#Jy)zFCheck that the task_id is automatically assigned in the correct order.rMTr>N)r rrArBr)rrrFrBs r test_subcontext_task_id_orderingrsI "I PTUG 1X'') !!Q&&&rcZt}t|dd}tjtd5|j ddd d d t|dd }tjtd 5|j d d d d y #1swYNxYw#1swYy xYw) zCheck errors raised when task_id and sequential_subtasks are inconsistent. - if sequential_subtasks is True, children task_ids must be left to None - if sequential_subtasks is False, children task_ids must be provided rNTr>z\task_id for MaxIterEstimator child_task must be None if sequential_subtasks is True for fit.r3 child_taskrrhNFzatask_id for MaxIterEstimator child_task must be provided if sequential_subtasks is False for fit.r@)r rr7r8rjrB)rrs r&test_subcontext_task_id_ordering_errorrs !"I PTUG  3  \1= !PUVG  4  \2      sB9B!B!B*c6Gddt}|}t}|j||j|j ddk(sJ|j ddk(sJ|j ddk(sJ|j ddk(sJy) z.LocallyDefinedEstimatorNcn|j}|j||j||S)Nr2)rrr)selfr5r6r's rr:zCtest_locally_defined_estimator..LocallyDefinedEstimator.fits7668L  / /$ / ?  - - - =Kr)NN)__name__ __module__ __qualname__rr:rQrrLocallyDefinedEstimatorrs    rrrrNrrrN)rrr!r:r)rrrs rtest_locally_defined_estimatorrs"6()I "H H% MMO    (A -- -    3 4 99 9    1 2a 77 7    +q 00 0rcXt}t|dd}d}t||k(sJy)z0Smoke test for the repr of the callback context.mytask*rhzRCallbackContext(estimator_name='MaxIterEstimator', task_name='mytask', task_id=42)N)r rrepr)rr expected_reprs rtest_callback_context_reprrs6 "I hKG  =M )) )r)r:rrT)4 functoolsrnumpyr`r7sklearn.callbackrr"sklearn.callback._callback_contextrrrsklearn.callback.tests._utilsr r r r r rrrrrrrr(r,r0r<rJrfrnrvrxmark parametrizer|rrrrrrrrrrrrrrrrQrrrs^ A     PT :*:*>& +(?@%:J@ +(*=?QR77 "02CD 1 1 Aq6*1+12Aq6*6+6(16F  !@),*'381,*r