Source
A training form with server db.example, port 5432 and database analytics_demo. No external database connection was made.
For a SQL connection, select a table or query mode. Queries must be read-only; mutating commands are not a way to configure a source. Set required fields and selection limits and check a small sample before a full run.
Destination
| Mode | Behavior | Required configuration |
|---|---|---|
| insert | Add new rows. | Table and field mapping. |
| update | Change existing records by key. | Key fields and values to update. |
| upsert | Update matching records or insert missing ones. | A stable key, schema and write rules. |
A destination always writes to a table, not an arbitrary SQL query. update/upsert require key fields. ClickHouse supports insertion only.
Keys and types
- A key must identify a record uniquely.
- Check for duplicate input keys before writing.
- Number, date and empty-value types must be compatible with the database schema.
- Required fields without defaults must be supplied.
- Assess repeated-run behavior separately: insert can create duplicates.
Verify results
Compare expected insert/update counts with the log and a query for specific keys in the target table. If the database response was lost, reconcile actual records first, then decide whether a retry is needed.