Skip to content

Generating Docs using DbtDocsS3Operator #1906

@rahul-ve

Description

@rahul-ve

Hi team,

I am trying to use DbtDocsS3Operator to generate the docs but I dont see an option to specify image or pod_template_file.yaml like for DbtTestKubernetesOperator. Currently the DbtDocsS3Operator is using the Airflow image but it does not contain the project code.

is there a way to set the image and volumes used by this operator.

    generate_dbt_docs_aws = DbtDocsS3Operator(
        task_id="generate_dbt_docs_aws",
        name="generate-dbt-docs-aws",
        project_dir=POD_PROJECT_PATH,
        profile_config=ProfileConfig(
            profile_name="test_profile",
            target_name="test"
            profiles_yml_filepath = "/project/profiles.yml",
        ),
        # docs-specific arguments
        connection_id="aws_s3_conn",
        bucket_name="datalake",
        folder_dir="/dbt_docs/test",
        dbt_cmd_flags=["--static"],
    )

Thanks
Rahul

Metadata

Metadata

Assignees

No one assigned

    Labels

    dbt:docsPrimarily related to dbt docs command or functionalityenhancementNew feature or requestexecution:kubernetesRelated to Kubernetes execution environmentgood first issueGood for newcomersstaleIssue has not had recent activity or appears to be solved. Stale issues will be automatically closed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions