github.com/bcampbell/scrapeomat@v0.0.0-20220820232205-23e64141c89e/NOTES (about)

     1  # NOTES - stuff to do some time
     2  
     3  ## refactor scraper
     4   - decouple store from scraper
     5   - move daemon mode out of scraper
     6  
     7  ## improve archive (.warc storage)
     8   - allow searching by time period
     9   - option for scrapers to check in archive before using HTTP
    10  
    11  
    12  
    13