hBj<dZddlmZddlZddlZddlmZddlmZddlm Z m Z m Z ddl m Z ejeZdd d d ZGd d Zy)zBilling ledger: shadow/live token charging with dedup, circuit breaker, and logging. In SHADOW mode: calculates would_charge, logs it, but never calls the airminal API. In LIVE mode: checks balance, charges via API BEFORE the action, blocks on failure. ) annotationsNdatetime)Path)AirminalClient ChargeResultInsufficientTokensError)Settingstokens_per_lead_67tokens_per_lead_68tokens_per_lead_69) DopasowanozDo weryfikacjizBrak dopasowaniac:eZdZdZdddZeddZeddZeddZddZ ddZ ddZ ddd Z dd Z dd Zd d Zd d Zd!dZd!dZ d"dZ d"dZ d"dZd#dZd$dZ d%dZy)& BillingLedgerz7Manages token charges per cycle with shadow/live modes.c||_|j|_||_|j|_d|_d|_d|_|jr%t|j|j|_|j}t|jjddt!j"||_t j&|j$_|j+y)NFT)parentsexist_ok) _settings billing_mode_mode _cycle_idbilling_max_tokens_per_cycle_max_per_cycle _cycle_total_halted_clientairminal_billing_keyrairminal_billing_urldb_pathrparentmkdirsqlite3connect_connRow row_factory _init_schema)selfsettingscycle_idr s G/var/www/html/agent.samochodowy/src/agent_samochodowy/billing/ledger.py__init__zBillingLedger.__init__"s!** !&CC /3  ( ()----DL "" W ""4$"?__W- !(  c |jdk(S)Nlive)rr)s r,is_livezBillingLedger.is_live9szzV##r.c|jSN)rr1s r,haltedzBillingLedger.halted=s ||r.c|jSr4)rr1s r, cycle_totalzBillingLedger.cycle_totalAs   r.c|jj}|dkryd|d|j}d|dd}|j|||dS) z?Charge for a group scan. Returns True if action should proceed.rTzscan--zskan N2scan)rtokens_per_scanr_charge_or_log)r)group_id group_nametokens referencetasks r, charge_scanzBillingLedger.charge_scanIs\// Q;H:Qt~~&67 z#2'(""64FCCr.ctj|}|syt|j|d}|dkryd|d|}d|}|j |||dS)z?Charge for a lead write. Returns True if action should proceed.Trrzlead-r9zlead lead)_LEAD_STATUS_TOKEN_FIELDgetgetattrrr=)r) status_name client_idpost_idfieldr@rArBs r, charge_leadzBillingLedger.charge_leadRsk),,[94 Q;I;ay1 {m$""64FCCr.c8tj|}|jdj}|Dcgc]}t |d}}|s|j dddSdj d|D}|jd|d|}|j\}} |jd |d||j|j tjd || t||t| t|d Scc}w) zMark billing entries as invalid for cycles where posts_fetched=0. Returns summary dict with counts and tokens invalidated. z0SELECT id FROM cycle_log WHERE posts_fetched = 0rr) invalidatedr@,c3 K|]}dyw)?N).0_s r, z7BillingLedger.invalidate_empty_scans..os77s zNSELECT COUNT(*), COALESCE(SUM(tokens), 0) FROM billing_log WHERE cycle_id IN (z=) AND action_type = 'scan' AND result != 'invalid_empty_scan'zHUPDATE billing_log SET result = 'invalid_empty_scan' WHERE cycle_id IN (z>Invalidated %d scan charges (%.1f tokens) from %d empty cycles)rOr@ empty_cycles) r#r$executefetchallstrclosejoinfetchonecommitloggerinfolenfloat) r)r connrWr empty_ids placeholderscurcountr@s r,invalidate_empty_scansz$BillingLedger.invalidate_empty_scans`s w'|| > (* )551S1Y5 5 JJL#$4 4xx7Y77 ll"".01 2      v "".01 2     L 63y>  %f sS\~^^;6sDc|jsy |jj}|j|jz }||kr:|js)|jd|t jd||y|jr(|jd|t jd|y#t$rt j dYywxYw)zCheck if org has enough tokens to proceed. Returns True if OK. Sets tokens_exhausted flag in DB if insufficient. Auto-clears flag if balance is restored (soft stop). Tu.Balance check failed — proceeding cautiouslyu7TOKENS EXHAUSTED: available=%.1f < min=%.1f — haltingFu,TOKENS RESTORED: available=%.1f — resuming) r check_balancebalancelocked Exceptionr_ exception_is_tokens_exhausted_set_tokens_exhaustederrorr`)r) min_tokensresult availables r,check_balance_sufficientz&BillingLedger.check_balance_sufficients || \\//1F6I z !,,.**4; Mz  $ $ &  & &ui 8 KK> )    M N s3B::CCc"|jSr4)rpr1s r,is_tokens_exhaustedz!BillingLedger.is_tokens_exhausteds((**r.c\|jjd}|jduS)NzMSELECT 1 FROM account_guard WHERE key = 'tokens_exhausted' AND value = 'true'r%rXr])r)rgs r,rpz"BillingLedger._is_tokens_exhausteds,jj  [ ||~T))r.cDddlm}|jj}|rE|jj d|f|jj dt ||fn|jj d|jj y)NrrzdINSERT OR REPLACE INTO account_guard (key, value, updated_at) VALUES ('tokens_exhausted', 'true', ?)zgINSERT OR REPLACE INTO account_guard (key, value, updated_at) VALUES ('tokens_exhausted_balance', ?, ?)zWDELETE FROM account_guard WHERE key IN ('tokens_exhausted', 'tokens_exhausted_balance'))rnow isoformatr%rXrZr^)r) exhaustedrl_dtr|s r,rqz#BillingLedger._set_tokens_exhausteds,ggi!!#  JJ  9;>&  JJ  <>A'lC=P  JJ  C  r.c |jr |jsy ddlm}ddlm}|jj dDcgc]#}|js|j%}}|r d}d|dd } n d }d |dd } |D]9} ||j} | j||j| || ;tjd|rdndt|ycc}w#t$rtjdYywxYw)z1Send email about token exhaustion or restoration.Nr)SendGridAPIClient)MailrPu.ALARM: Agent Samochodowy — tokeny wyczerpanezL

Tokeny na koncie wyczerpane

Saldo: z.1fu tokenów

Agent został automatycznie wstrzymany.

Doładuj tokeny, aby wznowić skanowanie.

u:INFO: Agent Samochodowy — wznowiono (tokeny doładowane)uV

Saldo doładowane — agent wznowiony

Saldo: uI tokenów

Skanowanie zostało automatycznie wznowione.

) from_email to_emailssubject html_contentz&Token %s alarm sent to %d recipient(s)r~restoredz Failed to send token alarm email)sendgrid_api_keynotify_email_tosendgridrsendgrid.helpers.mailrsplitstripsendnotify_email_fromr_r`rarnro) r)r*r~rlrre recipientsrhtml recipientsgs r,send_tokens_alarmzBillingLedger.send_tokens_alarms/((0H0H  A 2 2-5-E-E-K-KC-P^TUT[T[T]!'')^J^J))0 6GHW))0 6JK (  &x'@'@A'99'#!%   KK@'0 j#j/ S3_6 A   ? @ As*)C+C&C&,A9C+&C++D  D c|jj|jj|jr|jjyyr4)r%r^r[rr1s r,r[zBillingLedger.closes>   << LL    r.c|jjd|jjd|jjd|jjy)Na CREATE TABLE IF NOT EXISTS billing_log ( id INTEGER PRIMARY KEY AUTOINCREMENT, timestamp TEXT NOT NULL, cycle_id TEXT, action_type TEXT NOT NULL, task TEXT NOT NULL, reference TEXT NOT NULL, tokens REAL NOT NULL, mode TEXT NOT NULL, result TEXT NOT NULL, balance_after REAL ) z CREATE TABLE IF NOT EXISTS charged_references ( reference TEXT PRIMARY KEY, charged_at TEXT NOT NULL ) z CREATE TABLE IF NOT EXISTS account_guard ( key TEXT PRIMARY KEY, value TEXT NOT NULL, updated_at TEXT NOT NULL ) )r%rXr^r1s r,r(zBillingLedger._init_schemas]         r.c|jr&tjd|||jdk7S|j|z|j kDrXd|_tj d|j||j |j||||dd|jdk7S|j|rtjd|y|jr|j||||S|j||||S)zFUnified charge/log entry point. Returns True if action should proceed.u#Billing HALTED — skipping %s (%s)r0Tu@BILLING CIRCUIT BREAKER: cycle total %.1f + %.1f > %.1f — HALTHALTEDNz+Billing dedup: %s already charged, skipping) rr_warningrrrrr _log_entry _is_duplicatedebugr2 _charge_live_charge_shadowr)r@rBrA action_types r,r=zBillingLedger._charge_or_logs << NN@)T R::' '   v %(;(; ;DL LLR!!64+>+>  OOKy&(D Q::' '   i ( LLF R <<$$VT9kJ J""64KHHr.c|xj|z c_|j||j||||ddtj d||||jy)z.Shadow mode: log would_charge, always proceed. would_chargeNzC[SHADOW] would_charge %.1f tokens for %s (ref=%s, cycle_total=%.1f)T)r _mark_chargedrr_r`rs r,rzBillingLedger._charge_shadow8s\ V# 9%  T9fndS Q D)T%6%6 r.c |js-tjd||j||||ddy |jj |||}|xj |z c_|j ||j||||d|jtjd||||jy#t$rJ|j||||dd|jdd d|_ tjd |||Yyt$r/|j||||d dtjd |YywxYw) z:Live mode: charge via API BEFORE action. Block on failure.u8LIVE mode but no airminal API key — blocking action %s error_no_keyNFchargedz8[LIVE] charged %.1f tokens for %s (ref=%s, balance=%.1f)T insufficientruc[LIVE] INSUFFICIENT TOKENS for %s (%.1f needed, ref=%s) — setting tokens_exhausted, halting cyclerru?[LIVE] airminal API error for %s — fail-safe: blocking action)rr_rrrchargerr balance_afterr`r rqrrnro)r)r@rBrArrts r,rzBillingLedger._charge_liveEsG|| LLSU^ _ OOKy&.RV W \\((yAF    '    y ) OOT9f6//  KKJi)=)= &  OOKy&.RV W  & &tQ /DL LL:fi    OOKy&'4 P   QS\   sBCAE 4E  E c`|jjd|f}|jduS)Nz4SELECT 1 FROM charged_references WHERE reference = ?rz)r)rArgs r,rzBillingLedger._is_duplicateps0jj  BYL ||~T))r.c|jjd|tjj f|jj y)NzNINSERT OR IGNORE INTO charged_references (reference, charged_at) VALUES (?, ?))r%rXrr|r}r^)r)rAs r,rzBillingLedger._mark_chargedvs@  \  002 3  r.c |jjdtjj t |j |||||j||f |jjy)Nz INSERT INTO billing_log (timestamp, cycle_id, action_type, task, reference, tokens, mode, result, balance_after) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?) ) r%rXrr|r}rZrrr^)r)rrBrAr@rtrs r,rzBillingLedger._log_entrysk  LLN $ $ &       JJ      r.N)r)r*r r+ int | strreturnNone)rbool)rrb)r>rZr?rZrr)rIrZrJrrKrZrr)r rZrdict)g333333?)rsrbrr)r~rrlrbrr)rr) r@rbrBrZrArZrrZrr)rArZrr)rArZrr)rrZrBrZrArZr@rbrtrZrz float | Nonerr)__name__ __module__ __qualname____doc__r-propertyr2r5r7rCrMrirvrxrprqrr[r(r=rrrrrrSr.r,rrsA.$$!!D D D+4 D?B D  D'_Z D+* &$AL!DII#&I36IEHI I6  #& 36 EH   %%#&%36%EH% %V*      $ r.r)r __future__rloggingr#rpathlibr agent_samochodowy.billing.clientrrr agent_samochodowy.configr getLoggerrr_rFrrSr.r,rs[ # .   8 $'*,zzr.