[Bug fix] Incremental irregularities

[fivetran-avinash]

PR Overview

Package version introduced in this PR:

• 1.6.0 (1.5.1-a1 for pre-release)

This PR addresses the following Issue/Feature(s):

• GA-1016729

Summary of changes:

• Updated incremental granularity to avoid partitions removing updated records.

Submission Checklist

• Alignment meeting with the reviewer (if needed)
  • Timeline and validation requirements discussed
• Provide validation details:
  • Validation Steps: Check for unintentional effects (e.g., add/run consistency & integrity tests)
  • Testing Instructions: Confirm the change addresses the issue(s)
  • Focus Areas: Complex logic or queries that need extra attention
• Merge any relevant open PRs into this PR

Changelog

• Draft changelog for PR
• Final changelog for release review

[fivetran-jamie]

Looks good for pre-release!

[fivetran-jamie]

Approved with two questions!

[fivetran-jamie]

Suggested change

| `jira__daily_issue_field_history` | Incremental filter fix (**Breaking Change**) | Filtered by `date_day >= max_date_week` | Filtered by `date_week >= max_date_week` | Aligns the incremental filter with the model's weekly partition key. Previously, the wrong column was used, which could cause data loss during partition overwrites on incremental runs. A full refresh is recommended to backfill any records that may have been missed. |

| `jira__daily_issue_field_history` | Incremental filter fix (**Breaking Change**) | Filtered by `date_day >= max_date_week` | Filtered by `date_week >= max_date_week` | Aligns the incremental filter with the model's weekly partition key. The previous filter could cause data loss during partition overwrites on incremental runs. A full refresh is recommended to backfill any records that may have been missed. |

Also, since partitions are only applied in BigQuery and Databricks, was the bug only present in those warehouses? If so, we may want to note that (though a full refresh is required regardless of destination I think)

[fivetran-avinash]

Good call out, update applied.

[fivetran-savage]

One tiny suggestion but nothing holding up approval.