Skip to contents

Read

functions reading data, particularly from CSV files in the Google Drive CalCOFI data folder

create_redefinition_files()
Create Redefinition Files for Tables and Fields
determine_field_types()
Determine Field Types for Database
read_csv_files()
Read CSV Files and Their Metadata
read_csv_metadata()
Read CSV Files and Extract Metadata

Transform

functions to transform data, after reading data and before ingesting into the database

detect_csv_changes()
Detect Changes in CSV Files
display_csv_changes()
Display CSV Changes in a Formatted Table
print_csv_change_stats()
Print CSV Change Statistics
transform_data()
Transform Data for Database Ingestion

Ingest

functions for ingesting data into the database

ingest_csv_to_db()
Ingest CSV data to database
ingest_dataset()
Ingest a Dataset

Utilities

utility functions for database operations

get_db_con()
Get a database connection to the CalCOFI PostgreSQL database

Visualize

functions visualizing diagnostic outputs, particularly color coded data tables

show_fields_redefine()
Show fields to redefine
show_googledrive_files()
Show Google Drive files
show_tables_redefine()
Show tables to redefine

Other

check for other functions or datasets not captured by above categories