Feature: Pass profile and endpoint_url

[garciampred]

Hello. Thanks a lot for this package. I am looking for supporting optionally passing credentials (profile) and a different endpoint_url. Something like

zarrdump --profile contabo --endpoint https://eu2.contabostorage.com s3://somebucket/somezarr.zarr

So it gets the credentials from that profile from the ~/.aws folder. This can be passed in this line in dump itself

fs, _, _ = fsspec.get_fs_token_paths(url, storage_options=dict(profile=profile, endpoint_url=endpoint_url)

Are you OK if I do a PR with this?

[oliverwm1]

Sure, this seems useful. Only suggestion is to make it more general, since otherwise I expect we may have to keep adding more and more arguments which may be specific to only certain filesystem implementations.

Specifically:

zarrdump --storage_option profile=contabo --storage_option endpoint=https://eu2.contabostorage.com s3://somebucket/somezarr.zarr

which can then be made into the appropriate storage_options dict and passed to get_fs_token_paths as you suggest.

Alternatively we could do:

zarrdump --storage_options profile=contabo endpoint=https://eu2.contabostorage.com s3://somebucket/somezarr.zarr