Compares local files against GCS using MD5 hashes (with file-size
fallback when MD5 is unavailable from the CLI). Only uploads files
that are new or changed, skipping identical files.
Usage
sync_to_gcs(local_dir, gcs_prefix, bucket, pattern = NULL, verbose = TRUE)
Arguments
- local_dir
Directory containing files to upload
- gcs_prefix
GCS destination prefix (e.g. "ingest/swfsc.noaa.gov_calcofi-db")
- bucket
GCS bucket name
- pattern
Regex to filter local files (default: NULL = all files)
- verbose
Print per-file status messages (default: TRUE)
Value
Tibble with columns: file, action (uploaded/skipped), local_md5
Examples
if (FALSE) { # \dontrun{
sync_to_gcs(
local_dir = "data/parquet/swfsc.noaa.gov_calcofi-db",
gcs_prefix = "ingest/swfsc.noaa.gov_calcofi-db",
bucket = "calcofi-db")
} # }