AWS Glue Data Catalog
This source is currently in alpha. The interface and available tables may change.
Let AI connect your sources for you
Skip the manual setup — run this in your project and the wizard auto-detects your databases and APIs and connects them to PostHog.
Connect AWS Glue Data Catalog to PostHog to sync your data into the PostHog data warehouse for analysis and modeling.
Sync catalog metadata, job history, and crawlers from one AWS region. Grant glue:GetDatabases, glue:GetTables, glue:GetPartitions, and glue:GetTableVersions for catalog tables. Grant glue:GetJobs, glue:GetJobRuns, glue:GetCrawlers, and glue:ListCrawls for jobs and crawlers. Grant glue:ListWorkflows and glue:GetWorkflowRuns for workflow runs, and glue:ListDataQualityResults for data quality results. Lake Formation permissions can also restrict catalog access. Enter the access key ID and secret access key. Add a session token for temporary credentials.
Configuration
| Option | Description |
|---|---|
AWS access key IDType: text Required: True | |
AWS secret access keyType: password Required: True | |
AWS session tokenType: password Required: False | Temporary credentials expire. Replace them before the next scheduled sync. |
AWS regionType: text Required: True |
Linking AWS Glue Data Catalog to PostHog
- Go to the Data pipeline page in PostHog
- Click New source and select AWS Glue Data Catalog
- Fill in the required configuration fields
- Click Next, select the tables you want to sync, and then press Import
Supported tables
| Table | Description | Sync method | Incremental field | Primary key |
|---|---|---|---|---|
databases | Databases in the account's default Data Catalog. | Full refresh | — | — |
tables | Table definitions, columns, and storage metadata for each database. | Full refresh | — | — |
partitions | Partition values and storage metadata for each table. | Full refresh | — | — |
jobs | Job definitions and execution settings. | Full refresh | — | — |
job_runs | Job execution history, status, duration, and resource usage. | Full refresh | — | — |
crawlers | Crawler settings, state, and the latest crawl result. | Full refresh | — | — |
crawls | Crawl history for each crawler, including duration, status, and DPU usage. | Full refresh | — | — |
table_versions | Schema and metadata history for each catalog table. | Full refresh | — | — |
workflow_runs | Workflow run history, status, timing, and action statistics. | Full refresh | — | — |
data_quality_results | Data quality evaluation runs, with the evaluated table and the job run. | Full refresh | — | — |