Configure the S3 client¶

Before you can work with the S3 gateway, you need to configure your S3 client to access Pachyderm. Complete the steps in one of the sections below that correspond to your S3 client.

Configure MinIO¶

If you are not using the MinIO client, skip this section.

To install and configure MinIO, complete the following steps:

1. Install the MinIO client on your platform as described on the MinIO download page.

2. Verify that MinIO components are successfully installed by running the following command:

minio version
mc version

System Response:

Version: 2019-07-11T19:31:28Z
Release-tag: RELEASE.2019-07-11T19-31-28Z
Commit-id: 31e5ac02bdbdbaf20a87683925041f406307cfb9

1. Set up the MinIO configuration file to use the 30600 port for your host:

vi ~/.mc/config.json

You should see a configuration similar to the following:

• For a minikube deployment, verify the local configuration:

  "local": {
            "url": "http://localhost:30600",
            "accessKey": "YOUR-PACHYDERM-AUTH-TOKEN",
            "secretKey": "YOUR-PACHYDERM-AUTH-TOKEN",
            "api": "S3v4",
            "lookup": "auto"
         },
  

  Set the access key and secret key to your Pachyderm authentication token. If authentication is not enabled on the cluster, you can put any values.

Configure the AWS CLI¶

If you are not using the AWS CLI, skip this section.

If you have not done so already, you need to install and configure the AWS CLI client on your machine. To configure the AWS CLI, complete the following steps:

1. Install the AWS CLI for your operating system as described in the AWS documentation.

2. Verify that the AWS CLI is installed:

aws --version

1. Configure AWS CLI:

aws configure

System Response:

AWS Access Key ID: YOUR-PACHYDERM-AUTH-TOKEN
AWS Secret Access Key: YOUR-PACHYDERM-AUTH-TOKEN
Default region name:
Default output format [None]:

Both the access key and secret key should be set to your Pachyderm authentication token. If authentication is not enabled on the cluster, you can pass any value.