Daily scheduled scraping ladder, canonical catalogue normalization, median bargain engine, and client-side rig compression.
Transports scale costs defensively: static TLS impersonation handles baseline requests, while Cloudflare Turnstile triggers pooled headless browsers bounded by process semaphores. HTTP 429 rate limits are discarded and paced via exponential backoff, preventing browser pool cascading.
Independent normalizers resolve component sockets, memory standards, and colour variants into canonical IDs. Real discounts are computed against cross-store medians with a 2.5× plausibility filter, neutralizing prebuilt-PC price contamination.
Static clearance and TDP models evaluate component compatibility before parts are added. Rig configurations are serialized and compressed using native browser Deflate streams into URL hashes, bypassing HTTP 431 header limits.