Hi ,
I am looking for someone who is preferably familiar with the tools “Dagster” and “dbt” or is willing to familiarize himself with them in a rudimentary way.
It is about the development of an automated data pipeline.
The size of the task is very manageable. Actually, it is only about the following process to be automated:
Download of a file (consisting of XML`s, integration of this data into an existing database (PostgreSQL with PostGis extension).
In between a few tests (if the download was successful, test for database consistency after reading…)
More detailed information on request.