Skip to content

What columns to include in parquet export? #62

Description

@rknop

In the provenance refactor PR (no number yet), Issue #52, we had to add another subquery in the parquet export. This caused postgres to start spitting about not being able to handle a type record[] when creating a table. To solve this, we had to explicitly list out the columns we wanted to include, and create a temporary type that listed out what wanted to be included, from diasource and diaforcedsource

Probably SELECT * includes way too much anyway, unless we're viewing this as database backup. (But may as well just use pg_dump for database backup, yes?)

What columns do we want to actually include?

(We could also consider limiting the object columns included; right now there's a SELECT *.)

Relates to Issues #47, #51, #56.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions