Significant optimization
The scraping system had been running for years.
"It works" was the only requirement.
The problem: slow, expensive, fragile.
Nobody touched it because "if it ain't broke..."
I touched it.
Not by adding code. By removing it.
Eliminating redundancies nobody saw.
Optimizing flows that "had always been done this way".
Result: significant reduction in execution time.
Same data. Fewer resources. Lower AWS bills.
Sometimes the best code is the code you delete.
- TypeScript
- NestJS
- PostgreSQL
- Puppeteer
- AWS