Jira Data Pipeline, export only the issues that changed since the last export

[Alex Gay]

Hi

We are exploring the Jira Data Pipeline for Jira.

The export is taking several hours, so I was wondering if we could configure the export to only take the issues that have been updated since the last export.

I can't find anything about this in the documentation.

How do you guys solve this? 

We are running Jira 8.20.2

[Scott Boisvert]

Rather than relying on manual settings you could create a job with ScriptRunner or an external script to hit the Data Pipeline API (Trigger an Export) that automatically sets the "Include data from".

https://developer.atlassian.com/server/data-pipeline/rest/api-group-export/#api-export-post 

[Tushar Gohel]

I agree with Alex, we are looking for an option like this.

[Krzysztof Dubanowicz]

Hi @Alex Gay 

On the settings page, you can modify the "Include data from" parameter. Data Pipeline will only export issues updated after this date.

Unfortunately, you'd have to update the date manually before each export.

[Alex Gay]

thx for your reply @Krzysztof Dubanowicz , but that's not what we expected.

If you can schedule it, you don't want to have to change it manually before it can be executed.

A suggestion could be instead of the field 'include data from* and have to fill in a date,

you should be able to add a variable, like, include data from * 

- last week

- last export

- last day

- last 3 days

- last year 

...