6>>C ,<,<>>  c" tjtjtj|_|j|j|jfd|_t|j|j |_ | tj |jd}||dS#t"$r/}t$d|d|_Yd}~dSd}~wwxYw)zConnette al coordinatorT)targetdaemonz"Failed to connect to coordinator: FN)rAF_INET SOCK_STREAMconnectrrrrr r r_register_with_coordinator threadingThread_heartbeat_loopstart _receive_loop Exceptionloggererror)rheartbeat_threades rrzGPUWorker.connects # -8JKKDK K  !68M N O O O!DN *$/4;GGD   + + - - - )/t7KTXYYY   " " $ $ $     # # # LLAaAA B B B"DNNNNNNN #sCC D$D  Dcbd|_|jr|jd|_dS)zDisconnette dal coordinatorFN)rrcloser)rs r disconnectzGPUWorker.disconnect/s2 ; K     rcd|}|j}d|j||||d}|jtj| dt d|jddS)z%Registra il worker con il coordinatorworker_register)typergpu_info model_infoperformance_scoreutf-8Worker z registered with coordinatorN) _get_gpu_inforget_model_infor_calculate_performance_scorersendjsondumpsencoder&info)rr0r1registration_messages rrz$GPUWorker._register_with_coordinator6s%%''%4466 & $!%!B!B8!L!L    $899@@IIJJJ JdnJJJKKKKKrreturnctjrItj|j}|j|j|j|jd|j dSddddS)zOttiene informazioni sulla GPU.)gpu_name total_memory cuda_corescompute_capabilityCPUr)rArBrC) torchcuda is_availableget_device_propertiesr namerBmulti_processor_countmajorminor)r gpu_propss rr5zGPUWorker._get_gpu_infoFsv : " " $ $  88EEI%N ) 6'=)2&L&L9?&L&L   "1AFFFrr0c|ddkrdS|ddz }|d}|dz dz|d z d zz}td td |S) z.Calcola score prestazionale per load balancingrArEg?rBi@rCg333333?dg?g?g?)maxmin)rr0 memory_gbrCscores rr7z&GPUWorker._calculate_performance_scoreRsg J 5 ( (3^,8 l+ R3&*s*:c)AA3C(((rc|jr d|jtjd}|jt j|dtjdn<#t$r/}t d|d|_Yd}~dSd}~wwxYw|jdSdS)z(Invia heartbeat periodico al coordinator heartbeat)r/r timestampr3 zError sending heartbeat: FN) rrrrr8r9r:r;sleepr%r&r')rheartbeat_messager)s rr"zGPUWorker._heartbeat_loop^sn  '!%!%%%!    ,=!>!>!E!Eg!N!NOOO 2    <<<===!& n     sA/A99 B2$B--B2cd|_|jr|jr |jdd}|sdSt j|}||n<#t$r/}t d|d|_Yd}~dSd}~wwxYw|jr |jdSdSdSdS)z$Loop principale per ricevere compitiTir3zError receiving data: FN) rrrrecvdecoder9loads_handle_messager%r&r')rdatamessager)s rr$zGPUWorker._receive_loopns l t~  {''--44W==E*T**$$W----    9a99:::!& l t~         s/A2)A22 B+<$B&&B+rbc|d}|dkr||dS|dkrtddSdS)z!Gestisce messaggi dal coordinatorr/inference_taskregistration_confirmedz%Registration confirmed by coordinatorN)get_handle_inference_taskr&r<)rrb message_types rr`zGPUWorker._handle_messagesf{{6** + + +  ' ' 0 0 0 0 0 5 5 5 KK? @ @ @ @ @6 5rch|d}|d}|d} |j|}d||j||d}|jt j|dt d|jd|d S#t$r}t d |d ||jt|d }|jt j|dYd }~d Sd }~wwxYw) zGestisce task di inferenza request_id prompt_chunkchunk_idworker_response)r/rjrrlresultr3r4z completed task for request zError during inference: worker_error)r/rjrr'N) rgeneraterrr8r9r:r;r&r<r%r'str) rrbrjrkrlrnresponse_messager) error_messages rrgz GPUWorker._handle_inference_tasksZ\* ~. :& H%..|<r|s  ######  8 $ $\H\H\H\H\H\H\H\H\H\Hr