Skip to content

Remove partition over by to fix memory limit issue#62

Open
fivetran-juliengoulley wants to merge 3 commits intomainfrom
solve_allocated_memory_issue
Open

Remove partition over by to fix memory limit issue#62
fivetran-juliengoulley wants to merge 3 commits intomainfrom
solve_allocated_memory_issue

Conversation

@fivetran-juliengoulley
Copy link

@fivetran-juliengoulley fivetran-juliengoulley commented Sep 5, 2022

Refer to this bug - #56

Pull Request
Are you a current Fivetran customer?

Julien Goulley
Fivetran Employee
Solution Architect

What change(s) does this PR introduce?

Remove memory issue which is due to large partitions

Did you update the CHANGELOG?

  • Yes

Does this PR introduce a breaking change?

  • Yes (please provide breaking change details below.)
  • No (please provide an explanation as to how the change is non-breaking below.)
    New script will scan the existing table and add/update accordingly

Did you update the dbt_project.yml files with the version upgrade (please leverage standard semantic versioning)? (In both your main project and integration_tests)

  • Yes

Is this PR in response to a previously created Bug or Feature Request

How did you test the PR changes?

  • CircleCi
  • Local (please provide additional testing details below)

Select which warehouse(s) were used to test the PR

  • BigQuery
  • Redshift
  • Snowflake
  • Postgres
  • Databricks
  • Other (provide details below)

Provide an emoji that best describes your current mood

🍫

Feedback

We are so excited you decided to contribute to the Fivetran community dbt package! We continue to work to improve the packages and would greatly appreciate your feedback on our existing dbt packages or what you'd like to see next.

@fivetran-jamie
Copy link
Contributor

thanks for opening julien! our team will look into this a bit more and fold it in in an upcoming sprint

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants