I have worked on and built at least 20 scrapers over the course of many years. I have designed tables with data requirements of 300million new records being added on a daily basis. I have been responsible for scaling tables which grow at a very fast rate, and I have also worked directly on site optimizations, slow query optimizations, caching and other challenging problems. I am well versed with background jobs, stripe payments, aws s3, API programming, and phantomjs scraping.