Deferred Processing
Learn about the concept of deferred processing, which allows you to commit data more frequently than you process it.
May 30, 2023
About #
Deferred Processing is a technique that allows you to commit data more frequently than you process it. By default, Pachyderm automatically processes any newly committed data added to its input branch. For example, you may want to commit data hourly, but retrain your ML model daily.