Authentication issue with Dagster Cloud (serverless) + dbt + BigQuery

[kaochikao]

Hi community, I'm wondering if anyone experience similar issue here.
I'm using Dagster Cloud (serverless) + dbt + BigQuery and have asset lineage like this: asset1 (python) -> asset2 (dbt) -> asset3 (dbt). The asset1 and asset2 are materializing fine, but asset3 failed with BigQuery authentication error (default credentials were not found) during dbt build.
For asset1, I supply the GCP credentials with BigQueryPandasIOManager's gcp_credentials argument and this works fine. However, I'm confused how dbt assets authenticate with BigQuery. It appears a bit strange to me that asset2 seems to have picked up the credentials somehow, but asset3 does not.

[kaochikao]

I tested with another set of dummy assets and confirmed a pattern:

1. When a dbt asset (like asset3 mentioned above) has an upstream of another dbt asset, it fails (see screenshot below)
2. When a dbt asset (like asset2 mentioned above) has an upstream of a "native" Dagster asset (python function), it works.

---

Context:
I provided my python asset with BigQuery credentials following the below doc and it works: https://docs.dagster.io/integrations/libraries/gcp/bigquery/reference#providing-credentials-as-configuration

[nines131]

How do you I configured the path to the dbt project in Dagster serveeless(either locally or via an environment variable?) please

[kaochikao]

I also tried supplying the credentials with keyfile_json in profiles.yml (https://docs.getdbt.com/docs/core/connect-data-platform/bigquery-setup#service-account-json), it still failed.