M7XBeastandCursor
13df1026cd
Generate Documentation / generate-docs (push) Canceled after 0s
Run package tests for all dbs / test-postgres (push) Canceled after 0s
Run package tests for all dbs / test-other-dbs (bigquery) (push) Canceled after 0s
Run package tests for all dbs / test-other-dbs (redshift) (push) Canceled after 0s
Run package tests for all dbs / test-other-dbs (snowflake) (push) Canceled after 0s
Run package tests for all dbs / clean-up-schemas (bigquery) (push) Canceled after 0s
Run package tests for all dbs / clean-up-schemas (redshift) (push) Canceled after 0s
Run package tests for all dbs / clean-up-schemas (snowflake) (push) Canceled after 0s
Root logs/ gitignore was hiding f2dq_test_history from the published package (broke f2dq_test_runs). Scope ignore to /logs/, add the model, and use f2dq / f2dq_internal default schemas. Co-authored-by: Cursor <cursoragent@cursor.com>
75 lines
1.9 KiB
Markdown
75 lines
1.9 KiB
Markdown
# dbt_f2dq (`f2dq`)
|
|
|
|
Modernized fork of [re_data](https://github.com/re-data/re-data) for fast2.dev Data Quality (f2dq).
|
|
|
|
- **dbt package name:** `f2dq` (what `dbt_project.yml` / `detect_namespace()` use)
|
|
- **Hub-style identity:** `dbt_f2dq`
|
|
- **Version:** `1.0.1`
|
|
- **Requires:** dbt-core `>=1.0,<2.0`, `dbt_utils==1.4.1`
|
|
|
|
## Install (git — recommended)
|
|
|
|
```yaml
|
|
packages:
|
|
- git: "https://gitea.m7xlab.top/fast2dev/dbt-f2dq.git"
|
|
revision: v1.0.1
|
|
```
|
|
|
|
Then:
|
|
|
|
```bash
|
|
dbt deps
|
|
```
|
|
|
|
Pin a release tag in production; use `main` only if you want floating tip.
|
|
|
|
Default warehouse schemas: `f2dq` (public models) and `f2dq_internal`
|
|
(internal models). Override in the consuming project's `dbt_project.yml`
|
|
under `models.f2dq`.
|
|
|
|
## Install (local path — active development)
|
|
|
|
Prefer a local path while editing the package itself:
|
|
|
|
```yaml
|
|
packages:
|
|
- local: /path/to/dbt_f2dq
|
|
```
|
|
|
|
## Dual-read (migration)
|
|
|
|
Node config keys accept either prefix (config top-level **or** `config.meta` /
|
|
node `meta` — prefer meta on dbt 1.12+ to avoid CustomKeyInConfigDeprecation):
|
|
|
|
- `f2dq_monitored` / `re_data_monitored`
|
|
- `f2dq_time_filter` / `re_data_time_filter`
|
|
- (same for metrics, columns, anomaly_detector, owners)
|
|
|
|
```yaml
|
|
models:
|
|
my_project:
|
|
staging:
|
|
+meta:
|
|
f2dq_monitored: true
|
|
f2dq_time_filter: created_at
|
|
```
|
|
|
|
Vars: `f2dq:<name>` preferred; boolean enable flags also honour `re_data:<name>`
|
|
(`store_table_samples`, `save_test_history`, etc.) via `f2dq.f2dq_var()`.
|
|
|
|
## Artefacts
|
|
|
|
Exports default to `target/f2dq/*.json` (`overview`, `monitored`, `alerts`,
|
|
`tests_history`, `table_samples`). Enable samples + test history:
|
|
|
|
```yaml
|
|
vars:
|
|
f2dq:store_table_samples: true
|
|
f2dq:save_test_history: true
|
|
```
|
|
|
|
## Repository
|
|
|
|
- Public clone URL: `https://gitea.m7xlab.top/fast2dev/dbt-f2dq.git`
|
|
- SSH (when port 22 is reachable): `git@gitea.m7xlab.top:fast2dev/dbt-f2dq.git`
|