Subversion Repositories SmartDukaan

Last modification

• Rev 37446 2026-08-27 20:27:13
• Author: amit

• Log message:

  Per-brand batch sizes, and stop chrome forking a GPU process it cannot use
  
  maxResults was hardcoded in the shared repository methods, so Oppo and Vivo were
  forced to the same secondary batch (10) and all three to the same tertiary (10).
  It is now a parameter, set per brand at the call site.
  
  Sizing is arithmetic, from measured IN-BATCH per-imei time. Solving
  M * 86400 / (300 + M*t) = needed/day:
  
  brand needed/day t M required set to
  Vivo 9,407 0.8s 36 50 clears, ~12,700/day
  Realme 1,973 13.4s 10 10 was 5 = ~1,177/day, short
  Oppo 4,798 14.6s 88 10 HELD, see below
  
  Correcting an earlier measurement of mine: I reported Vivo at 13.6s per imei and
  concluded its backlog could not be cleared. That averaged across the ~300s idle
  gaps BETWEEN batches. In-batch it is 0.8s -- Vivo is 17x faster than I said, is
  idle ~97% of the time, and 50 clears its pool comfortably. There is no wait in
  the Vivo path; it is simply fast.
  
  Oppo is deliberately NOT raised. At 14.6s it would need M=88, which means
  20-minute batches and near-permanent chrome sessions. But that 14.6s predates the
  retry cap (r37445), which cuts exhausted imeis from 20 attempts to 7 and should
  drop it sharply. Re-measure before sizing Oppo, rather than guessing high on a
  box with 3GB free.
  
  Also: --disable-gpu, --disable-dev-shm-usage, --disable-software-rasterizer on
  both selenium tasks. Headless needs no GPU yet chrome forks a gpu-process per
  browser -- 6 were alive across the fleet, pure overhead. No behaviour change.
  
  Batch size does not raise peak concurrency (fixedDelay means one batch per job at
  a time, so never more than 4 drivers). It raises DUTY CYCLE, which converts
  chrome's footprint from intermittent to sustained. That matters here: tomcat is
  9.4GB, available is ~3GB, and the two OOM kills this month both took tomcat.
  
  Cron-only deploy. The dao signature change has no callers outside cron.