github.com/pf-qiu/concourse/v6@v6.7.3-0.20201207032516-1f455d73275f/topgun/README.md (about)

     1  # TOPGUN
     2  
     3  This suite is one level above
     4  [Testflight](https://github.com/concourse/testflight) in the sense that it will
     5  target a BOSH deployment and make changes to the cluster. This is to test
     6  things like workers disappearing, being recreated, etc.
     7  
     8  ## Test Boundaries
     9  
    10  ## Do
    11  
    12  * Configure pipelines, run tasks, etc. - same as Testflight.
    13  * Make changes to the BOSH deployment.
    14  * Target the Garden/Baggageclaim APIs to verify container/volume presence.
    15  * Mutate a VM (network partition, data corruption). These can happen in the
    16    real world. Just make sure these get cleaned up after.
    17  * Pretend you're an operator - prefer `fly` over API use.
    18  
    19  ## Don't
    20  
    21  * Modify the database directly. It's unrealistic to expect arbitrary SQL
    22    queries to have run against the database. Try to force scenarios using the
    23    above-defined surface area.
    24  * Only use DB queries to verify state as a last resort, and replace these with
    25    `fly` commands once we bubble up enough information.