Run Commands
Read the GLOSSARY series >

Pipeline Specification

Learn about the concept of a pipeline specification, which is a declarative configuration file used to define the behavior of a pipeline.

About #

A pipeline specification is a declarative configuration file used to define the behavior of a Pachyderm pipeline. It is typically written in YAML or JSON format and contains information about the pipeline’s input sources, output destinations, Docker image (user code), command, and other metadata.

In addition to simply transforming your data, you can also achieve more advanced techniques though the pipeline specification, such as: