Skip to content

Commit 6828e9f

Browse files
fixes-in-promo-video (#54)
Summary: - Fixes done in real time shooting databricks instructional video.
1 parent ffa21e6 commit 6828e9f

File tree

1 file changed

+2
-1
lines changed
  • examples/databricks/all-purpose-cluster

1 file changed

+2
-1
lines changed

examples/databricks/all-purpose-cluster/README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ Dependencies:
1919
- Create a service principal to use as a "CICD agent", using the page shown in Figure S4.
2020
- Grant the CICD agent account admin role, using the page shown in Figure S5.
2121
- Create a secret for the CICD agent, using the page shown in Figure S6. At the time you create this, you will need to safely store the client secret and client id, as prompted by the web page. These will be used below.
22+
- Setup your virtual environment, from the root of this repository `cicd/setup/setup-env.sh`.
2223

2324
Now, is is convenient to use environment variables for context. Note that for our example, there is only one aws account apropos, however this is not always the case for an active professional, so while `DATABRICKS_AWS_ACCOUNT_ID` is the same as `AWS_ACCOUNT_ID` here, it need not always be the case. Create a file in the path `examples/databricks/all-purpose-cluster/sec/env.sh` (relative to the root of this repository) with contents of the form:
2425

@@ -69,7 +70,7 @@ select account_id, workspace_name, workspace_id, workspace_status from databrick
6970

7071
```
7172

72-
For extra credit, you can (asynchronously) delete the unnecessary workspace with `delete from databricks_account.provisioning.workspaces where account_id = '<your databricks account id>' and workspace_id = '<workspace id (numeric)>';`, where you obtain the workspace id from the above query. I have noted that due to some reponse caching it takes a while to disappear from select queries (much longer than disappearance from the web page), and you may want to bounce the `stackql` session to hurry things along. This is not happening on the `stackql` side, but session bouncing forces a token refresh which can help cache busting.
73+
For extra credit, you can (asynchronously) delete the unnecessary workspace with `delete from databricks_account.provisioning.workspaces where account_id = '<your databricks account id>' and workspace_id = '<workspace id>';`, where you obtain the workspace id from the above query. I have noted that due to some reponse caching it takes a while to disappear from select queries (much longer than disappearance from the web page), and you may want to bounce the `stackql` session to hurry things along. This is not happening on the `stackql` side, but session bouncing forces a token refresh which can help cache busting.
7374

7475
## Lifecycle management
7576

0 commit comments

Comments
 (0)