github.com/munnerz/test-infra@v0.0.0-20190108210205-ce3d181dc989/docs/oss-oncall-log.md (about)

     1  # OSS oncall log
     2  
     3  "Oh yeah, I remember having to deal with that a while back... what was it again?"
     4  
     5  See also: [post-mortems](./post-mortems.md)
     6  
     7  - Issue: bigquery metrics dashboard in velodrome.k8s.io is out of date ([#8703](https://github.com/kubernetes/test-infra/issues/8703))
     8    - Symptoms:
     9      - velodrome alert fires when [BigQuery Ingress Rate](http://velodrome.k8s.io/dashboard/db/bigquery-metrics?orgId=1&panelId=12&fullscreen) falls to 0 for 6 hours
    10      - velodrome.k8s.io is out of date
    11      - go.k8s.io/triage is out of date
    12      - k8s-gubernator BigQuery table is out of date
    13    - Remediation:
    14      - Kettle froze and needed to be restarted
    15      - See [Kettle's README](/kettle/README.md)