+ bi(Rt^RIHt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI t ^RI Ht^RIHt^RIHtHtHtHtHt^RIHt^RIHt^RIHt^R IHt^R IH t ^R I!H"t"^R I#H$t$^R I%H&t&^RI'H(t)^RI*H+t+Rt,Rt-Rt.Rt/Rt0Rt1Rt2Rt3Rt40Rmt5]!RR7!RR44t60Rmt7RRRllt8RRlt9R R!lt:R"R#lt;R$R%ltR*R+lt?R,R-lt@RR.R/lltARR0R1lltBRR2R3lltCR4R5ltDR6R7ltER8R9R:R;RR?lltFR@RAltGRBRCltHRDREltIRFRGltJRHRIltKRJRKltLRLRMltMRRNROlltNRPRQltORRRSltPRTRUltQRVRWltRRXRYltSRRZR[lltTR\R]ltUR^R_ltVR`RaltWRbRcltXRdReltYRfRgltZRhRilt[RjRklt\RlRmlt]RRnRollt^RpRqlt_RrRslt`RtRultaRvRwltbRxRyltcRzR{ltdR|R}lteR~Rltf]gR8Xd]h!]f!44hR# ] d Rt ^RI t ELi;i)aVoucher_List_Scraper.py USAGE pip install selenium # Ensure Firefox + geckodriver are installed. # If geckodriver is not on PATH, set: # export GECKODRIVER_PATH=/full/path/to/geckodriver python3 Voucher_List_Scraper.py python3 Voucher_List_Scraper.py --headless WHAT THIS DOES - Opens the Accounts list page and logs in (credentials hard-coded below). - Clicks id=accSearchBox, types "aa", waits 3 seconds, then presses Enter. - Waits a moment for the results to refresh. - Clicks the FIRST account row in the results table id='device-grid-list'. - Creates a folder in the same directory as this .py. - Writes a Markdown file inside that folder named after the clicked account text. - On the account page, finds id=ProgramListView; if the FIRST program row is active (checkbox checked), it records that program name and opens it. - Records "Program Summary" section (best effort) and captures all rows from the main DataTables product list (not just the first 10 displayed). NOTES - The portal uses DataTables; to avoid stale element errors, this script snapshots tables with JavaScript (reads text + hrefs from the DOM) instead of reading WebElement.text repeatedly. ) annotationsN) dataclass)Path)DictListOptionalSequenceTuple)urljoin) webdriver)TimeoutException)By)Keys) ActionChains)Options)Service)expected_conditions) WebDriverWaitzFhttps://portal.redwingforbusiness.com/RWS_AccountsListPage?tab=accountzwalpine614@rwfb.comzSammiandCoco2!aa accSearchBoxzdevice-grid-listProgramListViewALLT)frozenc,]tRt^_t$R]R&R]R&RtR#)LinkCellstrtexthrefN)__name__ __module__ __qualname____firstlineno____annotations____static_attributes__rvoucher_scraper_core.pyrr_s I Ir%rc$V^8dQhRRRRRR/#)srmax_lenintreturnr)formats"r& __annotate__r.ls!#cr%cT;'gRPRR4PRR4PRR4P4p\P!RRV4p\P!RRV4p\P!R RV4pVP R 4pV'gR pVP 4\ 9dV R2pVR V#) zReturn a filesystem-safe single path component. - Preserves spaces and '$' (so you can get names like '$150 Subsidy Safety Toe.md'). - Removes characters that are invalid on Windows and path separators on all OSes.     \s+z [<>:"/\\|?*]_z [\x00-\x1f]z .itemN)replacestripresubrstripupper_WINDOWS_RESERVED)r)r*s&&r&_safe_fs_componentr?ls b$$,,T37??cJPPRA vsAA Q'A ~r1%A A wwy%%cG Xg;r%c V^8dQhRRRR/#r(pathrr,boolr)r-s"r&r.r.s  S T r%c2\V4pVP4'dVP4'gR#VPR4;_uu_4pVP ^4R8HuuRRR4# +'giR#;i \ dR#i;i)zNReturn True if `path` looks like a real ELF binary (not a shell/snap wrapper).FrbsELFN)rexistsis_fileopenread Exception)rBpfs& r&_is_elf_executablerMsd Jxxzz VVD\\Q66!9 *\\\ s46BBA3( B3 B >BB BBc V^8dQhRRRR/#rAr)r-s"r&r.r.sr%c\V4pVP4;'d6VP4;'dVPP 4R8H# \ dR#i;i)z.exeF)rrFrGsuffixlowerrJ)rBrKs& r&_is_windows_executablerRsT JxxzHHaiikHHahhnn.>&.HH s!AAA A)(A)c V^8dQhRRRR/#rAr)r-s"r&r.r.s$$$$r%cX\PR8Xd \V4#\V4#)nt)osnamerRrM)rBs&r&_is_usable_executablerXs# ww$%d++ d ##r%cV^8dQhRR/#)r(r, Optional[str]r)r-s"r&r.r.s55 5r%c\PPR4pV'dl\\ V4P 44p\ V4'dV#\\ V4PR44p\V4'dV#\PR8XdYRR\P!R4\P!R4.pVF"pV'gK \V4'gK Vu# R#R R .pVFp\V4'gKVu# \P!R4\P!R4\P!R 4.pVF~pV'd\V4'dVu#V'gK*\ V4PR8XgKF\\ V4PR44p\V4'gK|Vu# R#) zFind a real Firefox executable for GeckoDriver. On many Pi / Ubuntu setups, `firefox` on PATH is a snap wrapper script, which GeckoDriver rejects. We prefer `firefox-bin` (real ELF) when available. FIREFOX_BINARYz firefox-binrUz,C:\Program Files\Mozilla Firefox\firefox.exez2C:\Program Files (x86)\Mozilla Firefox\firefox.exez firefox.exefirefoxNz1/snap/firefox/current/usr/lib/firefox/firefox-binz-/snap/firefox/current/usr/lib/firefox/firefoxz firefox-esr) rVenvirongetrr expanduserrX with_namerMrWshutilwhichrR)env_binsibwin_candidatescsnap_candidatespath_candidatess r&_locate_firefox_binaryrjsyjjnn-.Gd7m..01  ) )N$w-))-89 c " "J ww$ ; A LL ' LL #    Aq+A..  <7O a H  ]# Y ]#O  #A&&H 1a*d1g'' 67C!#&&  r%c V^8dQhRRRR/#)r( firefox_binrZr,r)r-s"r&r.r.s99]9}9r%c \PPR4pV'd6\\ V4P 44p\ V4'dV#\PR8XdV'd7\\ V4PR44p\V4'dV#\P!R4\P!R4.pVF"pV'gK \V4'gK Vu# \\ \4P4PR, 4RR.pVFp\V4'gKVu# R#Rp\V4'dV#V'd7\\ V4PR44p\V4'dV#\P!R4pV'd\V4'dV#.R OpVFp\V4'gKVu# R#) z))+225FFGH  ,UG45 E5F F Z[*(++  E5D D E *))*s$ A>2 B>BBB54B5cV^8dQhRR/#r(r,Noner)r-s"r&r.r.)s     r%cd\\4P4PpVR, pVP RRR7\ P PR\V44\ P PR\VR, 44R# \dR#i;i)zIUse a project-local Selenium cache to avoid unwritable default locations.z.selenium-cacheTparentsexist_ok SE_CACHE_PATHXDG_CACHE_HOMEz.cacheN) rrprqrrmkdirrVr^ setdefaultrrJ)base cache_dirs r&_configure_selenium_runtime_envr)s H~%%'..,, t4 os9~> .D8O0DE    sBB B/.B/c V^8dQhRRRR/#)r(headlessrCr,zwebdriver.Firefoxr)r-s"r&r.r.5s!!4!$5!r%c\4\4pV'dVPR4\4pV'd\ RV 24W!nM \ R4VP RR4VP RR4\P!\V4VR7pTPRR4T# \d\PR8Xdh\ R 4\ R T'dR MR 24\ R T;'gR 24\ R\T4'dR MR 24\ R4hi;i \dT#i;i) --headlessz[driver] Using firefox binary: zf[driver] WARNING: Could not locate a real Firefox binary; GeckoDriver may fail on snap-wrapper setups.zdom.webnotifications.enabledFzmedia.volume_scalez0.0)serviceoptionsrUz[driver] Windows setup check:z[driver] Firefox detected: yesnoz[driver] Firefox path: z (not found)z![driver] geckodriver detected: zT[driver] Tip: install geckodriver.exe and put it on PATH, or set GECKODRIVER_PATH.ii)rr add_argumentrjr}binary_locationset_preferencer FirefoxrrJrVrWrwset_window_size)roptsrldrivers& r& build_driverr5sE#% 9D ,')*K / }=>* vw 6>,e4 ""+? +LVZ[ tS) M  77d? 1 2 1;%D1QR S -k.J.J]-KL M 51+>>UDIK L h i    M s%!B;'E;AE 7E EEcV^8dQhRR/#r(timeoutr+r)r-s"r&r.r.Xs]]S]r%c`\W4P\P!W344#N)runtilECpresence_of_element_locatedrbyvaluers&&&&r& wait_presentrXs&  ) / /0N0NPR{0[ \\r%cV^8dQhRR/#rr)r-s"r&r.r.\sYYsYr%c`\W4P\P!W344#r)rrrelement_to_be_clickablers&&&&r&wait_clickabler\s%  ) / /0J0JB;0W XXr%c V^8dQhRRRR/#)r(rr+r,rr)r-s"r&r.r.`s  # t r%c\P!4V,p\P!4V8dVP\PR4pV'gR#\;QJdRV4F 'gK RM RM !RV44'gR#\P !R4KR# \ dR#i;i)z@Best-effort wait for DataTables processing overlay to disappear.zdiv.dataTables_processingNc3@"TFqP4xK R#5ir) is_displayed).0rKs& r& 'datatables_wait_idle..hs7A~~''sTFg?)time find_elementsr CSS_SELECTORanyrJsleep)rrendprocss&& r&datatables_wait_idler`s ))+ C ))+  ((:UVE37733377778 3    s#'B9" B9-B9B99 CCc V^8dQhRRRR/#)r(table_idrr,zDict[str, object]r)r-s"r&r.r.os3330A3r%c(RpVPW!4#)zPReturn headers + row cell texts + first link (text+href) per row for a table id.as const table = document.getElementById(arguments[0]); if (!table) return null; const headers = Array.from(table.querySelectorAll('thead th')).map(th => (th.innerText || '').trim()); const rows = Array.from(table.querySelectorAll('tbody tr')).map(tr => { const cells = Array.from(tr.querySelectorAll('td')).map(td => (td.innerText || '').trim()); const a = tr.querySelector('a[href]'); const link = a ? {text: (a.innerText||'').trim(), href: a.getAttribute('href')||''} : null; return {cells, link}; }); return {headers, rows}; )execute_scriptrrscripts&& r&js_table_snapshotros F   22r%cV^8dQhRR/#rr)r-s"r&r.r.s66T6r%cVP\4\V\PR^4p\V\PR^4pVP RV4VP4VP\4VP4VP\4VP\PR4P4\V\P\^<4R# \ dLi;i \ dLi;i \ dLi;i \ d#TP\P4Li;i)usernamepasswordz.arguments[0].scrollIntoView({block:'center'});LoginN)r_ LOGIN_URLrr IDrrJclear send_keysUSERNAMEPASSWORD find_elementclickrENTERACC_SEARCHBOX_ID)ruser_elpass_els& r&loginrs JJy6255*b9G6255*b9G NPWX   h   h&BEE7+113  0"5)            &$**%&sHC>"DD ..D1> D  D  DD D.-D.1*EEpre_enter_sleep@post_enter_sleep? final_sleep?c ,V^8dQhRRRRRRRRRR/#) r(termrrfloatrrr,rr)r-s"r&r.r.s<55 5 5  5  5 5r%cT;'gRP4P4p\RV R24\V\P \ ^<4pVP4VP4TPT4\P!T4TP4TP\P 4TP\P"4\%T4P\P 4P'4TP\P(4\P!T4\+T^4\P!T4R# \dXTP\PR4TP\P4ELW \dELfi;ii;i \dELDi;i \dEL6i;i \dEL(i;i \dELi;i \dLi;i)z6Type `term` into accSearchBox, wait, then press Enter.r0zFiltering accounts: typing 'z' into accSearchBox...aN)r9rQr}rr rrrrrJrrCONTROL BACKSPACErrrRETURNrperformTABr)rrrrrboxs&&$$$ r&filter_accounts_termrs JJB    % % 'D (.D EF (8" =CIIK MM$JJ    djj!  dkk" V&&tzz2::<  dhh JJ $JJ{K   MM$,, , MM$.. )                      s)F!G'2G9H 26H)H/ G$?G G G$G  G$' G65G69 HH HH H,+H,/ H=<H=cV^8dQhRR/#rr)r-s"r&r.r.s55d5r%c"\V\4#)z&Back-compat wrapper: uses SEARCH_TERM.)r SEARCH_TERM)rs&r&filter_accounts_simplers  44r%cV^8dQhRR/#)r(r,zTuple[LinkCell, Dict[str, str]]r)r-s"r&r.r.scc.Mcr%c4\V\P\^<4RRlp\ V^<4P V4\ V\4pV'dVPR4'g \R4hVPR4;'g.Uu.uFq3NK ppVR,^,pVPR4pV'dVPR4'g \R4hVPR 4;'g.p/p\V4F.wrV \V48gKWy,Y;'gR V 2&K0 \VPR R 4P4VPRR 4P4R 7V3#uupi)zHReturn the first account link + row mapping from accounts results table.cV^8dQhRR/#)r(r,rCr)r-s"r&r.4get_first_account_from_results..__annotate__sdr%cVP\P\4pVP \P R4p\ V4^8# \dR#i;i)ztbody tr td a[href]F)rr rACCOUNTS_TABLE_IDrrlenrJ)dtblrs& r&_has_first_link7get_first_account_from_results.._has_first_linksS ..(9:C!!"//3HIAq6A:   sAA A#"A#rowsz)Accounts results table snapshot is empty.headerslinkrz9Could not find a clickable account link in the first row.cellscol_rr0rr) rr rrrrrr_ RuntimeError enumeraterrr9) rrsnaphrfirstrrrow_mapis & r&get_first_account_from_resultsrsO 126&"##O4 V%6 7D txx''FGG&*hhy&9&?&?R&?A&?!&?GA LOE 99V D txx''VWWyy)//RE G'" s5z>',xGOO4s $# &"-335DHHVR;/r%ca T;'gRP4Uu.uFqP4NK ppVUu.uFqP4NK ppR p\V4FwrVVR8Xg RV9gKV^,pM VR 8Xd/#0R mp.o \ V\ V44F;pW8,V9dM-S P W(,4\ S 4^P8gK;M RV 3Rllp /p V !R4V R&V !R4V R&V !R 4;'g V !R 4V R &V P4U U u/uFwrV 'gKWbK up p #uupiuupiuup p i)zParse Company Information from the Account Summary page text. Parent Account is the first line under 'Company Information' (if present). We pull: - parent_account (optional) - company_name - account_number r0zCOMPANY INFORMATIONc V^8dQhRRRR/#)r(labelrr,r)r-s"r&r.9parse_company_information_from_text..__annotate__&sCCr%c<VP4p\S4Fwr#VP4pWA8Xd`\V^,\S44F?pSV,P 4pV'gK$VP4R9dK;Vuu# VP VR,4'gKV\V4RP 4u# R#)r2Nr0> ACCOUNT # COMPANY NAMEACCOUNT NUMBERPARENT ACCOUNT)r=rrangerr9 startswith)r lab_uidxrawruknxtsections& r& _value_after9parse_company_information_from_text.._value_after&s !'*HCB{sQwG 5A!!***,C yy{&gg J 6}}US[))3u:;'--//+r%rparent_accountr company_namerr account_number>ACCOUNTSPROGRAMS ATTACHMENTSCOMPANY ADDRESSTAX INFORMATIONCONTACT INFORMATIONCREDIT & BILLING INFORMATION#PAYMENT TERMS & INVOICE PREFERENCES) splitlinesr9r=rrrappenditems)rlnlinesr=startru stop_headersjroutrvrs& @r&#parse_company_information_from_textr3sV$-??">">"@ A"@BXXZ"@E A"' (%BXXZ%E ( E%  % %)>!)CEE ! {  LG 5#e* % 8| # ux w<2   & C()9:C&~6C()9:WWl;>WC YY[ .[TQADAD[ ..e B (b /sEE7 EEcV^8dQhRR/#r(r,rr)r-s"r&r.r.>s  # r%c\V\PR^ 4VP\PR4pVP;'gRP 4# \ dR#i;i)zGet the account name from the Account Summary header span. After clicking an account row, the portal shows the canonical account name in: Aaron Equipment Company z AccountSummary:accountForm:anamer0)rr rrrr9rJ)rels& r&"get_account_name_from_summary_spanr8>s\ VRUU$FK  (J K 2$$&& sAA"A"" A10A1c$V^8dQhRRRRRR/#)r(r List[str]rzList[List[str]]r,!Tuple[List[str], List[List[str]]]r)r-s"r&r.r.Ls"!!!/!No!r%c RR0p.p\T;'g.4FQwrET;'gRP4pV'gK)VP4V9dK@VPV4KS V'gW3#VUu.uF q@V,NK pp.pT;'g.F;p TPVUu.uFqD\ V 48d W,MRNK up4K= Wx3#uupiuupi)aDrop backend/hidden columns that DataTables sometimes includes in the DOM. The Red Wing portal product table often contains extra non-user columns such as: - Product Id - Filter Number These may be invisible in the UI but appear in our scrape output. z product idz filter numberr0)rr9rQr)r) rr drop_nameskeep_idxrrhh new_headersnew_rowsrs && r&drop_hidden_product_columnsrCLs0JH'--R(gg2__   88: # ) }'/0x!1::xK0 "H ZZRZxHx!c!f*!$"4xHI   1Is C#3"C( cV^8dQhRR/#)r(r,%List[Tuple[LinkCell, Dict[str, str]]]r)r-s"r&r.r.js((-R(r%c\V\P\^<4\ V\4\ P !R4\V^4\V\4.p\4p\R4EFp\V\4pV'dVPR4'gV#VPR4;'g.Uu.uFqUNK ppVPR4;'g.EF pVPR4;'g/pVPR4;'gRP4p V 'dW9dKXVPV 4\VPR4;'gRP4V R 7p VPR 4;'g.p /p \!V4F.wrV \#V 48gKW,Y;'gR V 2&K0 VP%W34EK \'V\4pV'gV#\ P !R 4\V^4EK V#uupi) zHReturn ALL account links + row mappings from the accounts results table.皙?i,rrrrr0rrrrffffff?)rr rrset_datatable_length_allrrrdatatable_goto_firstsetrrr_r9addrrrr)datatable_click_next)rr1seenr6rrrrowrr link_cellrrrclickeds& r&get_all_accounts_from_resultsrRjs 126V%67JJsO$!2313C 5D 3Z ):;488F++ 0 J-+/((9*=*C*C*CE*CAa*CE88F#))r)C776?((bDHHV$**113D4< HHTN txx'7'='=2&D&D&FTRI"www/552E&(G!'*s5z>/4xGOO4s,+ JJ + ,*'v/@A  J 4VR(36 J-Fs Ic V^8dQhRRRR/#)r(rrr,List[Dict[str, object]]r)r-s"r&r.r.ss7Nr%czRpVPW!4p\T;'g.4# \d.u#i;i)z>Snapshot program rows: link text/href + checkbox active state.aF const table = document.getElementById(arguments[0]); if (!table) return []; const rows = Array.from(table.querySelectorAll('tbody tr')).map(tr => { const a = tr.querySelector('a[href]'); if (!a) return null; const cb = tr.querySelector('input[type="checkbox"]'); const active = cb ? (cb.checked || cb.getAttribute('checked') !== null) : false; return {text: (a.innerText||'').trim(), href: a.getAttribute('href')||'', active: active}; }).filter(x => x && x.href); return rows; )rlistrJ)rrrress&& r&js_program_list_snapshotrXsB F##F5CII2  s** ::c V^8dQhRRRR/#)r( only_activerCr,rTr)r-s"r&r.r.s%%4%D[%r%c F\V\P\^4\ T\4\ P!R4\T^4\T\4.p\4p\^4EFp\T\4pTFpTPR4;'gRP4pT'dYs9dK<TPT4\!TPR44pT'd T'gKyTP#RTPR4;'gRP4RTRT/4K \%T\4p T 'gT#\ P!R4\T^4EK T# \d.u#i;i)zmReturn program links from the 'List Of Account Related Programs' table. Returns dicts: {text, href, active} rGrr0activerrH)rr rPROGRAM_TABLE_IDr rIrrrrJrKrrXr_r9rLrCr)rM) rrZr1rNr6rrBrr\rQs && r&get_account_program_linksr^sI VRUU$4b9 V%56JJsO$!12#%C 5D 3Z'0@AAEE&M''R..0D4< HHTN!%%/*F6 JJv!4!4" ; ; =vtXW]^ _'v/?@  J 4VR(!$ J=  s F F F cV^8dQhRR/#r5r)r-s"r&r.r.sSr%cRpVPV4pT;'gRP4# \dR#i;i)z8Best-effort extraction of the 'Program Summary' section.a function norm(s){return (s||'').replace(/\s+/g,' ').trim();} const headers = Array.from(document.querySelectorAll('h1,h2,h3,h4,legend,strong')); let h = headers.find(x => norm(x.innerText).toLowerCase() === 'program summary'); if (!h) { // fallback: contains h = headers.find(x => norm(x.innerText).toLowerCase().includes('program summary')); } if (!h) return ''; // Walk forward through siblings collecting text until the next header-like element. let out = []; let n = h.nextElementSibling; let guard = 0; while (n && guard < 200) { const tag = (n.tagName||'').toLowerCase(); const txt = norm(n.innerText); if (['h1','h2','h3','h4','legend'].includes(tag)) break; if (txt) out.push(txt); n = n.nextElementSibling; guard++; } return out.join('\n\n'); r0)rr9rJ)rrtxts& r&extract_program_summary_blockrbsEF0##F+ r  "" s// >>c V^8dQhRRRR/#)r(required_headersz Sequence[str]r,rZr)r-s"r&r.r.sMmr%cVUu.uF q"P4P4NK" ppRpVPWC4#uupi \dR#i;i)zfReturn a table id for the first table that contains all required headers (case-insensitive substring).a6 const required = arguments[0]; const tables = Array.from(document.querySelectorAll('table')); for (const t of tables) { const ths = Array.from(t.querySelectorAll('thead th')).map(th => (th.innerText||'').trim().toLowerCase()); if (!ths.length) continue; let ok = true; for (const r of required) { if (!ths.some(h => h.includes(r))) { ok = false; break; } } if (ok) { return t.id || null; } } return null; N)r9rQrrJ)rrdrBrequiredrs&& r&find_table_by_headersrgsY+;<+;a !+;H<F $$V66%=& s&AA AAc V^8dQhRRRR/#r(rrr,rr)r-s"r&r.r. s  s t r%cRRpVPW!4R# \dR#i;i)zOTry to set the DataTable page length to 'All' (value -1) or the largest option.a  const tableId = arguments[0]; const sel = document.querySelector(`select[name='${tableId}_length'], select[name$='_length']`); if (!sel) return false; const opts = Array.from(sel.options); let chosen = opts.find(o => o.value === '-1') || opts.find(o => (o.text||'').toLowerCase().includes('all')) || opts[opts.length-1]; if (!chosen) return false; sel.value = chosen.value; sel.dispatchEvent(new Event('change', {bubbles:true})); return true; N)rrJrs&& r&rIrI s. F f/    s  &&c V^8dQhRRRR/#)r(rrr,rCr)r-s"r&r.r. s34r%c`Rp\VPW!44# \dR#i;i)zAClick Next for a DataTable if available. Returns True if clicked.a const tableId = arguments[0]; const pag = document.getElementById(`${tableId}_paginate`); if (!pag) return false; const next = pag.querySelector('a.paginate_button.next'); if (!next) return false; const cls = (next.className||'').toLowerCase(); if (cls.includes('disabled') || next.getAttribute('aria-disabled') === 'true') return false; next.click(); return true; F)rCrrJrs&& r&rMrM s6 FF))&;<< s  --c V^8dQhRRRR/#rir)r-s"r&r.r.2s' ' 3' 4' r%cRp\VPW!44pV'd%\P!R4\ V^4R#R# \ dR#i;i)z:Best-effort: jump DataTables pagination to the first page.a6 const tableId = arguments[0]; const pag = document.getElementById(`${tableId}_paginate`); if (!pag) return false; const isDisabled = (a) => { if (!a) return true; const cls = (a.className||'').toLowerCase(); if (cls.includes('disabled')) return true; if (a.getAttribute('aria-disabled') === 'true') return true; return false; }; // Prefer "First" button if present const first = pag.querySelector('a.paginate_button.first'); if (first && !isDisabled(first)) { first.click(); return true; } // Otherwise click the smallest numbered page button (usually page 1) const nums = Array.from(pag.querySelectorAll('a.paginate_button')).filter(a => { const cls = (a.className||'').toLowerCase(); if (cls.includes('previous') || cls.includes('next') || cls.includes('first') || cls.includes('last')) return false; const txt = (a.innerText||'').trim(); return /^\d+$/.test(txt); }); if (nums.length > 0) { nums.sort((a,b) => parseInt(a.innerText.trim(),10) - parseInt(b.innerText.trim(),10)); const btn = nums[0]; if (!isDisabled(btn)) { btn.click(); return true; } } return false; g?N)rCrrrrrJ)rrrrQs&& r&rJrJ2sUF> v,,V>?  JJt   ,     sAA AAc$V^8dQhRRRRRR/#)r(r-rrr,r:r)r-s"r&r.r.\s!#r%c,T;'gRP4P4pT;'gRP4P4pRp.pVF9pVF0pWE,pW`8dKWa8dVuu#VPV4K2 K; V#)zLReturn a list of two-letter search terms from start..end inclusive (aa..zz).rzzabcdefghijklmnopqrstuvwxyz)r9rQr))r-rletterstermsrbts&& r&iter_two_letter_termsrw\s ]]d ! ! # ) ) +E ;;$    % % 'C*GE AAyw LLO  Lr%c V^8dQhRRRR/#r( state_pathrr,Dict[str, set]r)r-s"r&r.r.ns$>r%cR\4R\4/pVP4'd\P!VP RR7;'gR4p\RVP R4;'g.44VR&\RVP R4;'g.44VR&V# \ dT#i;i)zzLoad scraper resume state from disk. Backward compatible with older state files that only stored `scanned_account_urls`. scanned_account_urlscompleted_termsutf-8encoding{}c38"TFp\V4xK R#5irrrxs& r&r$load_scrape_state..zs/iAg1AAgc3p"TF,p\V4P4P4xK. R#5irrr9rQrs& r&rr{s(*oLma3q6<<>+?+?+A+ALm46)rKrFjsonloads read_textr_rJ)rzstatedatas& r&load_scrape_staterns 35 E     ::j22G2DLLMD,//iJ`AaAgAgegAg/i,iE( )'**oDHHUfLgLmLmkmLm*o'oE# $ L   L s#>B<%B<=-B<+B<< C  C c V^8dQhRRRR/#)r(rrr,r{r)r-s"r&r.r.s  c n r%c /p\P!T;'gR4pR\RVP R4;'g.44R\RVP R4;'g.44/# \d/pLgi;i)rr}c38"TFp\V4xK R#5irrrs& r&r/_load_scrape_state_from_text..s#]5[qCFF5[rr~c3p"TF,p\V4P4P4xK. R#5irrrs& r&rrs(c@a!s1v||~3355@ar)rrrJrKr_)rrs& r&_load_scrape_state_from_textrs Dzz#++& #]TXX>T5U5[5[Y[5[#] ]3cIZ@[@a@a_a@acc  sA<A<< B  B c$V^8dQhRRRRRR/#)r(scannedrKr~r,zDict[str, List[str]]r)r-s"r&r.r.s"C#:Nr%cNR\RV44R\RV44/#)r}c3J"TFq'gK \V4xK R#5irrrs& r&r!_state_payload..s&Dw!!vs1vvws ##r~c3"TF5q'gK \V4P4P4xK7 R#5irr)rrvs& r&rrs,!W/QUV"8#a&,,."6"6"8"8/s ?/?)sorted)rr~s&&r&_state_payloadrs,&Dw&D D6!W/!WW r%cV^8dQhRR/#rr)r-s"r&r.r.s   r%c^\e6\P!VP4\P4R#VP ^4\ P !VP4\ P^4R# \d\P!R4K\i;i)Ng?) fcntlflockfilenoLOCK_EXseekmsvcrtlockingLK_LOCKOSErrorrrfhs&r&_lock_file_exclusiversn  BIIK/GGAJ   NN299; :   JJt  s4B!B,+B,cV^8dQhRR/#rr)r-s"r&r.r.s   r%c0\e6\P!VP4\P4R#VP ^4\ P !VP4\ P^4R# \dR#i;ir) rrrLOCK_UNrrrLK_UNLCKrrs&r& _unlock_filers_  BIIK/GGAJ ryy{FOOQ7    s4B BBc V^8dQhRRRR/#ryr)r-s"r&r.r.s$>r%cRVPPRRR7VPRRR7;_uu_4p\V4VP ^4\ VP 44\V4uuRRR4# \T4i;i +'giR#;i)Tra+rrN)rrrrHrrrrIr)rzrs& r&_locked_read_scrape_staters~D48  0 0BR   GGAJ/ :   1 0   1 0 0s# B)B/ B BB B& c(V^8dQhRRRRRRRR/#)r(rzrrrKr~r,rr)r-s"r&r.r.s(  $  s t r%c VPPRRR7VPRRR7;_uu_4p\V4VP ^4\ VP 44p\VR,4\V4,p\VR,4\V4,p\WV4pVP ^4VP4VP\P!V^RR74VP4\P!VP!44\#V4R R R 4R # \#T4i;i +'giR #;i \$dR #i;i) zMPersist resume state, merging with on-disk state (safe for parallel workers).Trrrrr}r~)indent sort_keysN)rrrrHrrrrIrKrtruncatewriterdumpsflushrVfsyncrrrJ)rzrr~rcurrentmerged_scannedmerged_completedpayloads&&& r&save_scrape_staters t< __TG_ 4 4  $ ! 6rwwyA!$W-C%D!EG !T#&w/@'A#BSEY#Y (J  GAFG %R 5 4R 5 4 4    sG8E7 E#C6E= E# E7 E  E## E4 .E74E77 FFc$V^8dQhRRRRRR/#)r(rzr account_urlrr,rCr)r-s"r&r.r.s!4cdr%cT\V4pWR,9# \dR#i;i)r}F)rrJ)rzrrs&& r&is_account_scannedrs2)*5$:;;; s  ''c$V^8dQhRRRRRR/#)r(base_dirrrrr,r)r-s"r&r.r.s!))$)S)T)r%cVR, pVPRRR7\P!VPRRR74P 4pW# R2, #)z.voucher_account_claimsTrrignore)errorsz.lock)rhashlibsha1encode hexdigest)rr claims_dirdigests&& r&_account_claim_pathrsW55JTD1 \\+,,WX,F G Q Q SF (%( ((r%c(V^8dQhRRRRRRRR/#) r(rrrr stale_secondsr+r,Optional[Path]r)r-s"r&r.r.s)3sZhr%c 2\W4p\P!4p\^4Fp\P!\ V4\P \P,\P,R4p\P!VRRR7;_uu_4pVPR\P!4 R24VPR\V4 R24VPRV R24R R R 4Vu# R # +'giL;i \dUYCP4P, pY8dTP!R R 7EKEM \"dMi;iR #\"dR #i;i) zKBest-effort account claim to reduce duplicate work across parallel workers.iwrrzpid=r3ztime=zurl=NT missing_ok)rrrrVrHrO_CREATO_EXCLO_WRONLYfdopenrgetpidr+FileExistsErrorstatst_mtimeunlinkrJ) rrr claim_pathnowr6fdrages &&& r&try_claim_accountrs;$X;J ))+C 1X Z"**ryy*@2;;*NPUVB2sW554 }B/05S "-.4 }B/06 & !65   OO-666&%%%6'    s[A:D)*AD D) D& !D)) F58E21F2 F=F?FFFFFc V^8dQhRRRR/#)r(rrr,rr)r-s"r&r.r.s  n  r%cdV'gR#VPRR7R# \dR#i;i)NTr)rrJ)rs&r&release_account_claimrs0  T*    s  //c V^8dQhRRRR/#)r(r)rr,r)r-s"r&r.r.s::#:#:r%c~\P!RRT;'gRP44P4#)r5r2r0)r:r;r9rQ)r)s&r& _norm_namers+ 66&#R0 1 7 7 99r%c V^8dQhRRRR/#)r(accountsrEr,rCr)r-s"r&r.r.s00-R0W[0r%c\V4^ 8wdR#VUUu0uFwr\VP4kK pppV\8H#uuppi) F)rrrSPECIAL_SLOW_RETRY_ACCOUNTS)rrr6namess& r&should_retry_term_in_slow_modersA 8}2: ;(wtZ "(E ; / // VPV 4TPV U u.uFqNK up 4Kq \W4p V 'gW#3#\P!R4\V^4EK W#3#uupiuup i) zSExtract all rows from a DataTables table by snapshotting each page and paging Next.rirrr|:NNrG) rIrrrrKrrr_joinrLr)rM) rrrrrNr6rrrBrsigrgrQs && r&extract_all_datatable_rowsrs@GDV.JJsO$ 5D 3Z 2 " =! $xx 288b8:818:((6"((b(AEE'N((bE((59%C{ HHSM KKE*EqE* + )'v8  = 3VR(%( =!;+s ? E E cV^8dQhRR/#)r(r,zOptional[LinkCell]r)r-s"r&r.r.9s-?r%c\V\P\^4RpTP T\4pT'gR#\ TPR4;'gRP4TPR4;'gRP4R7# \dR#i;i \dR#i;i)zGIf the first program row is active (checkbox checked), return its link.Na& const table = document.getElementById(arguments[0]); if (!table) return null; const firstRow = table.querySelector('tbody tr'); if (!firstRow) return null; const cb = firstRow.querySelector('input[type="checkbox"]'); const active = cb ? (cb.checked || cb.getAttribute('checked') !== null) : false; if (!active) return null; const a = firstRow.querySelector('a[href]'); if (!a) return null; return {text: (a.innerText||'').trim(), href: a.getAttribute('href')||''}; rr0rr) rr rr]r rrr_r9rJ)rrrWs& r&get_first_active_program_linkr 9sVRUU$4b9 F##F,<=cggfo33::4;'gTp VP3R?4;'gR;p!V 'dV R@V 2MT p"V!'dV" R@V! 2p"V\WV"^RA7, p#V#PYR"R"RB7\[VR"RC7p$V$U%u.uF'p%\]V%P3RD44'gK%V%NK) p&p%\)RE\+V&4 24V&'EgN.p'V'P_RFV 24V 'dV'P_RGV 24V!'dV'P_RHV! 24V'P_RIV 24V'P_RJV 24V'P_RK4VPa4Fwp(p)V'P_RLV( RMV) 24K V'P_RN4V'P_RO4V'P_V4V'P_RP4RPcV'4R,p*\eV#RQV*4VP?V4\AWFV4\gV4EKV&EFp%V%P3RR4;'gR;Pi4;'gRSp+V%P3RT4;'gR;Pi4p,\CVV,4p-\)RUV+ 24VP3V-4\6P8!V4\kV4p.V.'g+VPM\NPPR<4PHp..p/.p0\mVRVRW.4p1V1'd \oVV14wp/p0\qV/V04wp/p0MH\mVRV.4;'g\mVRX.4p1V1'd\oVV14wp/p0\qV/V04wp/p0.p'V'P_RFV+ 24V'P_RYV 24V 'dV'P_RZV 24V!'dV'P_RHV! 24V'P_RIV 24V'P_R[V- 24V'P_RJV 24V'P_R\4V'P_RO4V'P_V.4V'P_RP4V'P_R]\+V04 R^24V/'Ed"V0'EdV'P_R_4V'P_R`PcRaV/444V0Fp2V2U3u.uF/p3T3;'gR;PsRRb4PsR`Rc4NK1 p4p3\+V44\+V/48d+V4R;.\+V/4\+V44, ,, p4\+V44\+V/48dV4Rd\+V/4p4V'P_R`PcV444K V'P_RP4MV'P_Re4RPcV'4R,p*\eV#V+V*4VP3V4\6P8!V4EK VP?V4\AWFV4VP3V4\6P8!V4\gV4EK% VP?V 4\AWFV4E K \)Rf4VPu4^#uup p i \0dTTP3TP44\6P8!R 4M \0dMi;i\/Y4E Li;i \0dNTP3T4\6P8!R'4M \0dMi;i\/YR#R$R%R&7E Li;iuup%iuup3i \gT4i;i TPu4i;i)jr store_truezRun Firefox headless)actionhelpz--worker-countz)Total number of parallel workers/browsers)typedefaultrz--worker-indexzThis worker index (0-based)z--worker-count must be >= 1z5--worker-index must be between 0 and --worker-count-1zvoucher_scanned_accounts.jsonr}r~)rrqzSearch terms: z .. z (total )zWorker /z: z assigned terms.zResume (local snapshot): z completed terms, z scanned accounts.zFirst assigned term: z!No terms assigned to this worker.r3z SEARCH TERM: Fgffffff?zTDetected known 9-account partial-load pattern. Retrying same term with slower waits.Tg@g333333?r)rrrg@zNo accounts returned for term 'z'.zAccounts found for 'z': zSlow mode active for this term.g?g?rrgffffff?g333333?)r-[z] SKIP (already scanned): z$] SKIP (claimed by another worker): z ] Account: z Account #zAccount#col_2r0bodyrrrr6)r*r)rZr\z Active programs: z# z - **Account #**: z- **Parent Account**: z- **Account URL**: z- **Search Term**: z$ ## Account Row (from results table)z- **z**: z ## Account Page Textz```textz```zAccount SummaryrProgramrz - Stylez Product NameProductz - **Account Name**: z- **Account #**: z- **Program URL**: z ## Program Summaryu ## Product List (all rows) — z rowsz```csv,c3D"TFqPRR4xK R#5i)r";N)r8)rrs& r&rmain..+s1_!))C2E2Es r2r$Nz._No product table found (or it had no rows)._ z All terms completed.rzP================================================================================zQ ================================================================================);argparseArgumentParserrr+ parse_argsrerrorrrrprqrrOUTPUT_ROOT_DIRNAMErrrrrwrrr}rrrrJr_ current_urlrrrRrrLrr rrrrrr TAG_NAMEr3r8r?rr^rCr)r*rrrr9rbrgrrCr8quit)5apargsr vouchers_rootrz scrape_statescanned_accountsr~rrtrrv worker_termsr current_stateterm_slow_modeaccounts_list_urlraccount_open_sleepprogram_open_sleepaccount_return_sleeplist_return_sleepr account_linkrrracct_numaccount_page_text company_info span_namerrr folder_label out_folderprogramsrKactive_programsr,rr2 md_content program_name program_href program_urlprogram_summary_textproduct_headers product_rows prod_table_idrBrgcleaneds5 r&mainrM_s  "BOOL)??QRUVfRgQhhz{|  ),q/):; < 5 6 D5jAM .D E E  ->? ?O& / " M$( ) (O"N 3$V2!' 2 2 4VO>O=PQR&{{;7pp7;;z;RppV]VaVabiVjppnpHJJ{+JJ12(.(;(;BKK(P(U(U%#FGX#YL B6 JI#,#e#e 0@0@0P#e#eT`TeTeL%1%5%56F%G%S%S8N%1%5%56F%G%M%M2NIWl^1^4D#E`l_mL%*6q8H'I !.1CLZ]1^!^J$$TD$A8TRH2:&T(Qd155?>Sqq(O&T/O0D/EFG*?+- r,%89)!LL+>~>N)OP)!LL+A.AQ)RS ':;-%HI ':4&%AB %LM$+MMODAq!LL4s$qc):;%4 %=> Y/ %67 U+%)YYu%5%< &z3DjQ(,,[9)*X P**5M-()f (;(;'B'B'D'Q'Q ()f (;(;'B'B'D &-k<&H |n56 ;/ #56/LV/T,3393F3Fr{{TZ3[3`3`0578: (=fwP^F_(` ( ? &2"LL/!LL)Z[%)YYu%5%< &z<L ;/ #78}-@%((5%jOTJJ01JJ01)*5M1MP    % jO LI!L &'  mh4 3JJv112JJsO $V2  3&!s #45 3$(s]`nqrr sz'UZ+f,**5  s<)t %%p-p-Dt ( p335t )r84t -A#t  t  t ) t 5Ct 7>s96s9s9(A2s9s94$s9s94 s9?s9?s9"s/7s/=?s9=s9Ds9t ,s9 s9"s9=Cs9s9/As9?s9Cs9As9 s4 .'s4 Es9=t -t 3 r?1q10r1 q?<r>q??r t rt  s, 'ss, ss,ss,(t +s,,t / s99 tt t__main__> town of la platatown of indian headbolling afb commissarycharles county utilitiesbattle creek constructioncharles county public works!charles county emergency services!maryland transportation authority-smithsonian - african american history museum>AUXCONNULPRNCOM1COM2COM3COM4COM5COM6COM7COM8COM9LPT1LPT2LPT3LPT4LPT5LPT6LPT7LPT8LPT9)))F)rrq)i`T)i__doc__ __future__rr&rrrVr:rbrr ImportErrorr dataclassesrpathlibrtypingrrrrr urllib.parser seleniumr selenium.common.exceptionsr selenium.webdriver.common.byr selenium.webdriver.common.keysr'selenium.webdriver.common.action_chainsr"selenium.webdriver.firefox.optionsr"selenium.webdriver.firefox.servicerselenium.webdriver.supportrrselenium.webdriver.support.uirrrrrrrr]r*ONLY_ACTIVE_PROGRAMSrrr>r?rMrRrXrjrwrrrrrrrrrrrr3r8rCrRrXr^rbrgrIrMrJrwrrrrrrrrrrrrrrrr rrMr SystemExitrr%r&rs:# "88 7+/@66@7 U   !&$  $ 8 $ 5p9x*$  !F]Y 3"6@5! 5 " 5  5p5 cD;/~ !<(V*%PB2 ($' T$&    .)6 :00D8m` z TV }( EsG66 HH