I have a job where I need to update data from sql rds to redshift on a daily basis.
Below is my Job flow:
And below is the query I am using to retrieve the data:
SELECT * FROM abc.xyz
WHERE id > (SELECT COALESCE(max(id), 0) as id
abc→ myrds Table
Demo → redshift table
The job executes file but the rate of data transfer is very slow.
Can someone help me in speeding up my Job?