jadZddlZddlZddlZddlmZddlmZdZdZ dZ dZ dZ d Z d Zd Zd Zd ZdZdZdZdZdZdZdZdZe ee ee ee eeeeeeeeeiZdeDZdZdZdZd Z d Z!dZ"dZ#dZ$dZ%dZ&dZ'dZ(dZ)ej*e)Z+dZ,GddZ-e-Z. d/d e/d!e/d"e0d#e1d$e1f d%Z2d$e1fd&Z3d$e1fd'Z4d$e1fd(Z5d$e1fd)Z6 d0d*e7d+e/d$e1fd,Z8d1d*e7d-e7d$e1fd.Z9dS)2a6 Dirty Worker Binary Protocol Binary message framing over Unix sockets, inspired by OpenBSD msgctl/msgsnd. Replaces JSON protocol for efficient binary data transfer. Header Format (16 bytes): +--------+--------+--------+--------+--------+--------+--------+--------+ | Magic (2B) | Ver(1) | MType | Payload Length (4B) | +--------+--------+--------+--------+--------+--------+--------+--------+ | Request ID (8 bytes) | +--------+--------+--------+--------+--------+--------+--------+--------+ - Magic: 0x47 0x44 ("GD" for Gunicorn Dirty) - Version: 0x01 - MType: Message type (REQUEST, RESPONSE, ERROR, CHUNK, END) - Length: Payload size (big-endian uint32, max 64MB) - Request ID: uint64 (replaces UUID string) Payload is TLV-encoded (see tlv.py). N)DirtyProtocolError) TLVEncodersGDrequestresponseerrorchunkendstashstatusmanageci|]\}}|| Sr).0kvs J/var/www/html/venv/lib/python3.11/site-packages/gunicorn/dirty/protocol.py rHs>>>daQ>>> z>2sBBIQiceZdZdZeZeZeZeZ e Z e Z eZeZeZeZededededefdZededefdZe d&ded ed ed ed edef dZededefdZededefdZ ededefdZ!ededefdZ"ededefdZ#ed'dedededefdZ$e d(dedededefdZ%ededefdZ&ede'j(defdZ)ede'j*dedd fdZ+ed e,j,d!edefd"Z-ed e,j,defd#Z.ed e,j,dedd fd$Z/ededefd%Z0d S))BinaryProtocolz-Binary message protocol for dirty worker IPC.msg_type request_idpayload_lengthreturncRtjttt|||S)a, Encode the 16-byte message header. Args: msg_type: Message type (MSG_TYPE_REQUEST, etc.) request_id: Unique request identifier (uint64) payload_length: Length of the TLV-encoded payload Returns: bytes: 16-byte header )structpack HEADER_FORMATMAGICVERSION)r$r%r&s r encode_headerzBinaryProtocol.encode_headerrs%{=%():77 7rdatac<t|tkr)tdt|dt|tjt |dt\}}}}}|t kr$td|dt |dd|tkr$td|dt|dd|tvrtd |d |dd|tkrtd |d td |||fS)z Decode the 16-byte message header. Args: data: 16 bytes of header data Returns: tuple: (msg_type, request_id, payload_length) Raises: DirtyProtocolError: If header is invalid zHeader too short:  bytes, expected raw_dataNzInvalid magic: z , expected zUnsupported protocol version: zUnknown message type: 0x02xzMessage too large: z bytes (max: )) len HEADER_SIZErr)unpackr+r,r-MSG_TYPE_TO_STRMAX_MESSAGE_SIZE)r/magicversionr$lengthr%s r decode_headerzBinaryProtocol.decode_headersy t99{ " "$NSYYNNNN  8>} 4  -8 8 4w&* E>>$?%??e??crc  g  $NNNWNNcrc  ? * *$98999crc  $ $ $$NfNN;KNNN V++rNapp_pathactionargskwargsc|||rt|ng|pid}tj|}tt |t |}||zS)al Encode a request message. Args: request_id: Unique request identifier (uint64) app_path: Import path of the dirty app action: Action to call on the app args: Positional arguments kwargs: Keyword arguments Returns: bytes: Complete message (header + payload) )r@rArBrC)listrencoder#r.MSG_TYPE_REQUESTr7)r%r@rArBrC payload_dictpayloadheaders rencode_requestzBinaryProtocol.encode_requestso"!"&.DJJJBl   #L11--.> .1'll<<rcd|i}tj|}tt|t |}||zS)a Encode a success response message. Args: request_id: Request identifier this responds to result: Result value (must be TLV-serializable) Returns: bytes: Complete message (header + payload) result)rrFr#r.MSG_TYPE_RESPONSEr7)r%rMrHrIrJs rencode_responsezBinaryProtocol.encode_responsesL!&) #L11--.?.1'll<<rchddlm}t||r|}n=t|tr|}n%t |jt|id}d|i}tj |}t t|t|}||zS)a Encode an error response message. Args: request_id: Request identifier this responds to error: DirtyError instance, dict, or Exception Returns: bytes: Complete message (header + payload) r DirtyError error_typemessagedetailsr)errorsrR isinstanceto_dictdicttype__name__strrrFr#r.MSG_TYPE_ERRORr7)r%rrR error_dictrHrIrJs r encode_errorzBinaryProtocol.encode_errors '&&&&& eZ ( ( JJ t $ $ JJ#5kk2u::J  , #L11--nj.1'll<<rcd|i}tj|}tt|t |}||zS)a Encode a chunk message for streaming responses. Args: request_id: Request identifier this chunk belongs to data: Chunk data (must be TLV-serializable) Returns: bytes: Complete message (header + payload) r/)rrFr#r.MSG_TYPE_CHUNKr7)r%r/rHrIrJs r encode_chunkzBinaryProtocol.encode_chunksJ~ #L11--nj.1'll<<rcHtt|d}|S)z Encode an end-of-stream message. Args: request_id: Request identifier this ends Returns: bytes: Complete message (header + empty payload) r)r#r. MSG_TYPE_ENDr%rJs r encode_endzBinaryProtocol.encode_ends  --lJJJ rcHtt|d}|S)z Encode a status query message. Args: request_id: Request identifier Returns: bytes: Complete message (header + empty payload) r)r#r.MSG_TYPE_STATUSrfs r encode_statuszBinaryProtocol.encode_status s  --oz1MM rropcountc||d}tj|}tt|t |}||zS)a4 Encode a worker management message. Args: request_id: Request identifier op: Management operation (MANAGE_OP_ADD or MANAGE_OP_REMOVE) count: Number of workers to add/remove Returns: bytes: Complete message (header + payload) )rkrl)rrFr#r.MSG_TYPE_MANAGEr7)r%rkrlrHrIrJs r encode_managezBinaryProtocol.encode_manage/sU  #L11--oz.1'll<<rtablec||d}|||d<|||d<|||d<tj|}tt|t |}||zS)a Encode a stash operation message. Args: request_id: Unique request identifier (uint64) op: Stash operation code (STASH_OP_*) table: Table name key: Optional key for put/get/delete operations value: Optional value for put operation pattern: Optional pattern for keys operation Returns: bytes: Complete message (header + payload) )rkrpNkeyvaluepattern)rrFr#r.MSG_TYPE_STASHr7) r%rkrprrrsrtrHrIrJs r encode_stashzBinaryProtocol.encode_stashEs$   ?"%L   $)L !  &-L ##L11--nj.1'll<<rct|\}}}t|t|zkr4t dt|zdt||dd|dkri}ne|tt|z} t j|}n8#t$rt$r!}t d||ddd}~wwxYwt|}|||fS)a Decode a complete message (header + payload). Args: data: Complete message bytes Returns: tuple: (msg_type_str, request_id, payload_dict) msg_type_str is the string name (e.g., "request") payload_dict is the decoded TLV payload as a dict Raises: DirtyProtocolError: If message is malformed zIncomplete message: expected z bytes, got N2r2rFailed to decode TLV payload: ) r#r?r7r8rr decode_full Exceptionr:)r/r$r%r>rH payload_datae msg_type_strs rdecode_messagezBinaryProtocol.decode_messagefs7 (6'C'CD'I'I$*f t99{V+ + +$# f0D##4yy##crc  Q;;LL K&,@ @AL )5lCC %      (8Q88)#2#. 'x0 Z55sB$$C8CCreadercK |td{V}nc#tj$rQ}t |jdkrt dt |jdt|jd}~wwxYwt|\}}}|dkr ||d{V}nE#tj$r3}t dt |jd||jd}~wwxYw tj |}n:#t $rt$r!}t d||ddd}~wwxYwi}t|}||d } | || S) ap Read a complete binary message from async stream. Args: reader: asyncio StreamReader Returns: dict: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If read fails or message is malformed asyncio.IncompleteReadError: If connection closed mid-read NrzIncomplete header: got r1r2zIncomplete payload: got ryrxr[id) readexactlyr8asyncioIncompleteReadErrorr7partialrr#r?rrzr{r:update) rrJr}r$r%r>r|rHr~rMs rread_message_asyncz!BinaryProtocol.read_message_asyncs !--k::::::::FF*   19~~""$*#ai..**'**   (6'C'CF'K'K$*f A:: %+%7%7%?%??????? .   ()s19~~)) &))Y  )5lCC %      (8Q88)#2#.  L'x0 &j99 l### sE %BA BB-C D .DD D$$E8EEwriterrUcKt|}|||d{VdS)a[ Write a message to async stream. Accepts dict format for backwards compatibility. Args: writer: asyncio StreamWriter message: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If encoding fails ConnectionError: If write fails N)r#_encode_from_dictwritedrain)rrUr/s rwrite_message_asyncz"BinaryProtocol.write_message_asyncsS //88 Tllnnrsocknc:d}t||kr||t|z }|sFt|dkrtdtdt|d||||z }t||k|S)a Receive exactly n bytes from a socket. Args: sock: Socket to read from n: Number of bytes to read Returns: bytes: Received data Raises: DirtyProtocolError: If read fails or connection closed rrzConnection closedzConnection closed after r1r2)r7recvr)rrr/rs r _recv_exactlyzBinaryProtocol._recv_exactlys$ii!mmIIa#d))m,,E t99>>,-@AAA(Ns4yyNN1NN! EMD$ii!mm rct|t}t|\}}}|dkrit||} t j|}n:#t $rt$r!}t d||ddd}~wwxYwi}t|}||d} | || S)a  Read a complete message from socket (sync). Args: sock: Socket to read from Returns: dict: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If read fails or message is malformed rryNrxr2r) r#rr8r?rrzrr{r:r) rrJr$r%r>r|rHr}r~rMs r read_messagezBinaryProtocol.read_messages --dK@@'5'C'CF'K'K$*f A::)77fEEL )5lCC %      (8Q88)#2#.  L'x0 &j99 l### s!A66B+ B&&B+cdt|}||dS)a Write a message to socket (sync). Args: sock: Socket to write to message: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If encoding fails OSError: If write fails N)r#rsendall)rrUr/s r write_messagezBinaryProtocol.write_message/s///88 Trc |d}|dd}t|trt|dz}t|}|t d||t krlt||dd|d d|d |d S|tkr.t ||d S|tkr/t ||d iS|tkr.t||dS|tkrt|S|t"krt||d|dd|d|d|dS|t&krt|S|t*krCt||d|ddSt d|)a Encode a message dict to binary format. Supports the old dict-based API for backwards compatibility. Args: message: Message dict with 'type', 'id', and payload fields Returns: bytes: Complete encoded message r[rrlNzUnknown message type: r@rArBrCrMrr/rkrprrrsrtrlrzUnhandled message type: )getrXr]hashMSG_TYPE_FROM_STRrrGr#rKrNrOr^r`rbrcrergrurvrirjrnro)rUr~r%r$s rrz BinaryProtocol._encode_from_dict?s{{6** [[q))  j# & & ?j)),>>J$((66  $%Ll%L%LMM M ' ' '!00 J++ Hb)) F## H%%  * * *!11 H%%  ' '!.. GR((  ' '!.. F##  % %!,,Z88 8  ' '!.. D!! GR(( E"" G$$ I&&   ( (!// ;; ;  ( (!// D!! GQ''  %%J%J%JKK KrNNrNNN)1r\ __module__ __qualname____doc__r8r;MSG_TYPE_REQUEST_STRrGMSG_TYPE_RESPONSE_STRrNMSG_TYPE_ERROR_STRr^MSG_TYPE_CHUNK_STRrbMSG_TYPE_END_STRreMSG_TYPE_STASH_STRruMSG_TYPE_STATUS_STRriMSG_TYPE_MANAGE_STRrn staticmethodintbytesr.tupler?r]rZrKrOr`rcrgrjrorvrr StreamReaderr StreamWriterrsocketrrrrrrrr#r#bs77K'+-'N'N#L'N)O)O 7 7 7c 7e 7 7 7\ 7.,E.,e.,.,.,\.,`:>  3 # s " 37 CH   \ 4 C E   \ "     \ <  u   \ " s u   \  # %   \   # 3 s 5   \ *37   # c +/48\.FMce\6%6=%T%%%\%N FM D T   \ CL4CLECLCLCL\CLCLCLrr#r@rArBrCr'cNtj||||rt|ng|pidS)aU Build a request message dict. Args: request_id: Unique request identifier (int or str) app_path: Import path of the dirty app (e.g., 'myapp.ml:MLApp') action: Action to call on the app args: Positional arguments kwargs: Keyword arguments Returns: dict: Request message dict )r[rr@rArBrC) DirtyProtocolrGrE)r%r@rArBrCs r make_requestrs; ."*T ,B   rc"tj||dS)z Build a success response message dict. Args: request_id: Request identifier this responds to result: Result value Returns: dict: Response message dict )r[rrM)rrN)r%rMs r make_responsers/  rcddlm}t||r|}n=t|tr|}n%t |jt|id}tj ||dS)z Build an error response message dict. Args: request_id: Request identifier this responds to error: DirtyError instance or dict with error info Returns: dict: Error response message dict rrQrS)r[rr) rWrRrXrYrZr[r\r]rr^)r%rrRr_s rmake_error_responsers#"""""%$$  ]]__ E4   u++.5zz  ,  rc"tj||dS)z Build a chunk message dict for streaming responses. Args: request_id: Request identifier this chunk belongs to data: Chunk data Returns: dict: Chunk message dict )r[rr/)rrb)r%r/s rmake_chunk_messagers,  rc tj|dS)z Build an end-of-stream message dict. Args: request_id: Request identifier this ends Returns: dict: End message dict r)rre)r%s rmake_end_messagers*  rrkrpcRtj|||d}|||d<|||d<|||d<|S)a Build a stash operation message dict. Args: request_id: Unique request identifier (int or str) op: Stash operation code (STASH_OP_*) table: Table name key: Optional key for put/get/delete operations value: Optional value for put operation pattern: Optional pattern for keys operation Returns: dict: Stash message dict )r[rrkrpNrrrsrt)rru)r%rkrprrrsrtmsgs rmake_stash_messagersR",   C  E  G  I Jrrlc$tj|||dS)a Build a worker management message dict. Args: request_id: Unique request identifier (int or str) op: Management operation (MANAGE_OP_ADD or MANAGE_OP_REMOVE) count: Number of workers to add/remove Returns: dict: Manage message dict )r[rrkrl)rrn)r%rkrls rmake_manage_messagers"-   rrrr):rrrr)rWrtlvrr,r-rGrNr^rbrerurirnrrrrrrrrr:itemsr STASH_OP_PUT STASH_OP_GETSTASH_OP_DELETE STASH_OP_KEYSSTASH_OP_CLEAR STASH_OP_INFOSTASH_OP_ENSURESTASH_OP_DELETE_TABLESTASH_OP_TABLESSTASH_OP_EXISTS MANAGE_OP_ADDMANAGE_OP_REMOVEr+calcsizer8r;r#rr]rrZrrrrrrrrrrrrs , &&&&&&   !"*,&&"&(( ?>o&;&;&=&=>>>      fom,, $aLaLaLaLaLaLaLaLR 59sC-1=A2$d<D$ D    "6:s3>B>Cr