github.com/bcampbell/scrapeomat@v0.0.0-20220820232205-23e64141c89e/NOTES (about) 1 # NOTES - stuff to do some time 2 3 ## refactor scraper 4 - decouple store from scraper 5 - move daemon mode out of scraper 6 7 ## improve archive (.warc storage) 8 - allow searching by time period 9 - option for scrapers to check in archive before using HTTP 10 11 12 13