dbt (data build tool)

• Models: .sql files, one per table/view
• ref(): lineage-aware table references → auto DAG
• Materializations: view / table / incremental / snapshot
• Tests: not_null, unique, accepted_values, custom
• Docs: auto-generated с column descriptions + lineage graph
• Adapters: Snowflake, BigQuery, Redshift, Postgres, DuckDB, ClickHouse

-- models/orders_summary.sql
{{ config(materialized='table') }}

SELECT
  DATE_TRUNC('day', order_date) AS day,
  COUNT(*) AS orders,
  SUM(amount) AS revenue
FROM {{ ref('orders') }}
WHERE status = 'completed'
GROUP BY 1

-- schema.yml
models:
  - name: orders_summary
    columns:
      - name: day
        tests: [not_null, unique]

• Data Lake
• Iceberg
• Parquet