Module trase.tools.push_postgres_tables_to_bigquery

Push one or more PostgreSQL tables to BigQuery via the "postgres_to_bigquery" AWS Lambda function.

Functions

def estimate_row_count(table: PostgresTable, cur=None) ‑> int

def get_select_query(table, cur=None)

def main(cur=None, cnx=None)

def push_postgresql_tables_to_bigquery(recipes: List[LoadRecipe], dry_run=False, cur=None, cnx=None)

Classes

class LoadRecipe (source: PostgresTable, destination_dataset: str, destination_table: str)

LoadRecipe(source: trase.tools.push_postgres_tables_to_bigquery.PostgresTable, destination_dataset: str, destination_table: str)

Class variables

var destination_dataset : str

var destination_table : str

var source : PostgresTable

Static methods

def from_string(value)

Parses a string in the following format:

<source_schema>.<source_table>:<destination_dataset>.<destination_table>

For example, "staging_trase_earth.supply_chains:trase.supply_chains"

class PostgresTable (schema: str, name: str)

PostgresTable(schema: str, name: str)

Class variables

var name : str

var schema : str

Methods

def identifier(self)