Changing the frequency of updates to the attrep_status table

When the attrep_status table is selected as part of a tasks' metadata setting, it creates and updates a table on the target with details of the task. These details include the task name, status, current position, current timestamp, pending changes, etc.

By default Replicate will update the attrep_status table every minute, which can cause issues with cost on endpoints like Snowflake. In order to modify how often updates are made to the attrep_status table, the task export file needs to be modified.

The first step is to export the task, which should create a task_export.json file. In the task_export.json file, inside the sorter_settings field, a field called "cdc_notification_period" can be added. The value to be set should be in seconds, i.e. If you want the attrep_status table to be updated every 10 minutes, the value should be set to 600.

(the original settings in the task_export.json file)

--------------------------------------------------------------------------------------------------------------------------------------------------

(the new settings in the task_export.json file, with the cdc_notification_period field added in with a value of 600 (10 minutes))

Once the task_export.json has been edited, it can be imported back in to Replicate, and the task can be resumed.

Creation date: 12/05/2023 09:51      Updated: 12/05/2023 09:51
Files   
DataImage25.jpg
30 KB
DataImage9.jpg
32 KB