Skip to contents

Reading publicly hosted data

No credentials needed for public URLs, presigned URLs and local files. parquet_tbl() also reads private buckets as r2://bucket/path.

parquet_tbl()
lazy table to query parquet files at URLs, on R2 or S3, or at local paths
st_filter(<tbl_duckdb_connection>) st_filter(<tbl_r2parquet_connection>)
spatially filter a lazy DuckDB table of GeoParquet data
select_language()
select the columns of a lazy table in a language
collect_parquet()
collect a lazy DuckDB table of parquet data with its metadata
parquet_metadata()
metadata of parquet files
parquet_sources()
metadata of all parquet sources of a table
parquet_sources_attribution()
attribution of all parquet sources of a table
list_parquet()
list parquet files
cache_parquet()
local copies of parquet files on R2, S3 or at URLs
list_parquet_cache()
list the files in the local cache
remove_parquet_from_cache()
remove files from the local cache
clear_cache_checks()
forget the cache checks of the session
parquet_connection()
DuckDB connection shared by the parquet functions

Uploading and managing data on R2 and S3

Need the R2 credentials (see the README), or for s3://bucket/path the AWS ones (see the Credentials section of upload_parquet()), except data_to_parquet() for local paths.

Buckets

create_r2_bucket()
create Cloudflare R2 bucket with private or public access
set_s3_public_access()
public read access to a prefix of an S3 bucket

Writing and uploading

data_to_parquet()
write data to parquet
upload_parquet()
transfer files to Cloudflare R2 or S3
remove_parquet()
remove parquet files from Cloudflare R2, S3 or local directories
write_manifest()
write manifests for directories of parquet files on Cloudflare R2 or S3

Sharing private files

presigned_url()
presigned URL for a file on Cloudflare R2 or S3