Module trase.tools.aws

Wrapper functions for interacting with AWS resources.

See S3_CACHE_PROXY.md to set up an experimental local S3 cache that is aware of ETags.

Sub-modules

trase.tools.aws.athena

Helpers to register parquet datasets in the AWS Glue Data Catalog (so they are queryable from Athena) …

trase.tools.aws.aws_helpers

Functions for s3 access and parsing

trase.tools.aws.aws_helpers_cached

trase.tools.aws.aws_lambda

trase.tools.aws.etag_cache

Caching of objects downloaded from S3 …

trase.tools.aws.lambda

trase.tools.aws.s3_access_logs

Parse AWS S3 server access logs into structured records …

trase.tools.aws.s3_helpers

trase.tools.aws.s3_snapshots

Snapshots of S3 "folders" (key prefixes) …

trase.tools.aws.upload

This module writes data files to disk and uploads them to AWS S3 …