Processing and importing files from legacy systems and other sources is a common enterprise requirement. At first glance, this seems like a simple task. However, there are many factors to consider in making the process reliable, auditable and maintainable. Some things to consider:
- Logging the steps in the process, as well as which records failed to import
- Moving or deleting the import files after the process has completed
- Monitoring the process, to alert humans when something unexpected happens
- Easily changing parameters, for example file servers, database connections, and run times as infrastructure and operational requirements change.
This tutorial will take you through the process of setting up a CSV to Postgres workflow in 3 minutes using Synatic. Logging, monitoring, file management and runtime configuration is a standard feature when using Synatic.
