github.com/pachyderm/pachyderm@v1.13.4/examples/deferred_processing/README.md (about)

     1  >![pach_logo](../img/pach_logo.svg) INFO - Pachyderm 2.0 introduces profound architectural changes to the product. As a result, our examples pre and post 2.0 are kept in two separate branches:
     2  > - Branch Master: Examples using Pachyderm 2.0 and later versions - https://github.com/pachyderm/pachyderm/tree/master/examples
     3  > - Branch 1.13.x: Examples using Pachyderm 1.13 and older versions - https://github.com/pachyderm/pachyderm/tree/1.13.x/examples
     4  
     5  # Deferred Processing Examples
     6  
     7  [Deferring processing](https://docs.pachyderm.com/1.13.x/concepts/advanced-concepts/deferred_processing/) is a technique for controlling when data is processed by Pachyderm.
     8  It allows you to commit data more often than it is processed.
     9  
    10  
    11  ## Deferred Processing Plus Transactions
    12  
    13  [This example](./deferred_processing_plus_transactions) uses a simple DAG based on our [OpenCV example](https://github.com/pachyderm/pachyderm/tree/1.13.x/examples/opencv)
    14  to illustrate two Pachyderm usage patterns for fine-grained job control.
    15  
    16  
    17  ## Automated Deferred Processing 
    18  
    19  [This example](./automated_deferred_processing) can be used to automate the movement of branches when doing deferred processing.
    20  It allows you to trigger a job based on the amount of time that's elapsed since the last commit. 
    21  It has versions that work with authentication activated on your Pachyderm cluster and with authentication disabled.
    22  
    23  
    24  
    25  
    26  
    27  
    28  
    29  
    30  
    31