User Code

About #

In Pachyderm, user code refers to the custom code that users write to process their data in pipelines. User code can be written in any language and can use any libraries or frameworks.

Pachyderm allows users to define their user code as a Docker image, which can be pushed to a registry and referenced using the Transform attribute of the pipeline’s specification. The user code image contains the necessary dependencies and configuration for the code to run in Pachyderm’s distributed computing environment.

User code can be defined for each pipeline stage in Pachyderm, allowing users to chain together multiple processing steps and build complex data pipelines. Pachyderm also provides a Python library for building pipelines, which simplifies the process of defining user code and specifying pipeline stages.