• Add support for dettl_auto_load to manage handle tables in schema other than public
  • Add import mode to import log
  • Add sql only import
  • Add dettl_run function which can run multiple stages, can save output, run with path or import object
  • Remove dettl_run_extract, dettl_run_load, dettl_run_transform
  • Switch force arg on run to allow_dirty_git to be more clear about what its effect
  • Rename dettl_db_create_log_table to dettl_create_log_table
  • Remove exporting of prepare_test_import
  • Update dettl_import_log to record start_time, end_time and duration instead of just start_time
  • Automatic load now orders the transformed data based on pk dependencies from the db
  • Update template upload to use automatic load
  • Make extracted/transformed data available even if tests for that stage fail
  • Set working directory to transform & load stages to be the import directory (working dir now consistent over extract, transform and load)
  • Allow running the load stage outside of a transaction (if dry_run = TRUE then it will still be run inside a transaction)
  • Remove path arg from extract stage - this will break previous imports
  • Always run the extract stage from path of the root of the import directory - all paths should be relative to this this fixes the bug where you needed to be in the same directory as root of the import to run it.
  • The automatic load functions provide information about their progress while they run (VIMC-3432)
  • Add “mode” option to dettl config, by default mode is “append”. If use “create” then import can only create new tables and not append to existing ones. (VIMC-3426)
  • The import object’s sources can be reloaded with $reload(), allowing refreshing of source code and repairing a Postgres connection with a failed transaction (VIMC-3035, partly fixes VIMC-3154)
  • Allow test_transform to refer to extracted_data (VIMC-3108)
  • Users can configure if an import to a particular DB needs to be confirmed. If so they are asked a yes/no question when running load step (VIMC-3007)
  • Allow upload to not specify serial PKs when they are not referenced by any other data within the upload (VIMC-3022)
  • Expose automatic load function for use in custom load functions (VIMC-3015)
  • Use gert package instead of system calls to git (VIMC-3004)
  • Read foreign key constraints automatically from the database (VIMC-2859)