Write an S3 Object

You can write an S3 object to a Pachyderm repo within a project by performing the following commands:

Create the object:

aws --endpoint-url http://localhost:30600/ s3 cp test.csv s3://master.foo.bar

upload: ./test.csv to s3://master.foo.bar/test.csv

Check that the object was added:

aws --endpoint-url http://localhost:30600/ s3 ls s3://master.foo.bar/

2021-04-26 12:11:37  2685061 github_issues_medium.csv
2021-04-26 12:11:37  62 test.csv

Create the object:

mc cp test.csv local/master.foo.bar/test.csv

test.csv:                  62 B / 62 B  ▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓  100.00% 206 B/s 0s

Check that the object was added:

mc ls local/master.foo.bar

[2021-04-26 12:11:37 PDT]  2.6MiB github_issues_medium.csv
[2021-04-26 12:11:37 PDT]  62B test.csv

Note

Not all the repositories that you see in the results of the ls command are repositories that can be written to. Some of them might be read-only. Note that you should have writing access to the input repo in order to be able to add files to it.

Article Summarization

Write an S3 Object