Skip to content

Feip 1078 merge#9

Merged
landanDB merged 21 commits intomainfrom
feip-1078-merge
Aug 29, 2025
Merged

Feip 1078 merge#9
landanDB merged 21 commits intomainfrom
feip-1078-merge

Conversation

@landanDB
Copy link
Contributor

@landanDB landanDB commented Aug 22, 2025

Refactored and added new components to the demo, including:

  1. Data Gen: refactored the customer and transaction dataset to include more features, and saved the transactions to a volume (that gets automatically created in the specified catalog/schema).
  2. Lakeflow pipeline: Made minor changes to reflect the updates made in the data gen component
  3. Unsupervised notebook: Added a notebook to do similar RFM clustering based off of the lakeflow pipeline. Showcases MLflow, but does not save/write anything
  4. AI/BI dashboard: Added a AI/BI dashboard for the RFM segmentation done in the lakeflow pipeline

landanDB added 19 commits July 25, 2025 10:30
@landanDB
Refactored customer profiles in 01_data_setup
44d40cb
@landanDB
Refactored 01_data_setup
ba0bf05
@landanDB
Minor changes to data setup notebook
5680e24
@landanDB
Refactored lakeflow pipeline code
b437c0a
@landanDB
Changed state names from state code to full name
515c036
@landanDB
Minor fixes to lakeflow pipeline
fb0daf4
@landanDB
Renamed lakeflow file to 02a_Segmentation_Lakeflow
b14f419
@landanDB
Added 02b_Segmentation_MLflow, an unsupervised ML notebook for RFM se…
518c382 
…gmentation
@landanDB
Added the customer segmentation dashboard and corresponding yaml chan…
01b4fe8 
…ges to the databricks.yml file
@landanDB
Removed test target from databricks.yaml
40f061c
@landanDB
Deleted old file
44e5339
@landanDB
Changed mentions of DLT to LDP
f03153f
@landanDB
Fixed experiment path to be more dynamic
07cb77b
@landanDB
Added SQL Warehouse as a variable for the config, since the dashboard…
0399b17 
… requires it
@landanDB
Cleanup in data gen notebook, removed num_transactions variable
cabad9a
@landanDB
Changed the dashboard config to use the default catalog and schema co…
59529e8 
…mbo.
@landanDB
Updated README to reflect changes
9ac3f27
@landanDB
Small readme changes
37e7c4c
@landanDB
Fixed typo
efa7ad8
@landanDB landanDB requested a review from calreynolds August 22, 2025 20:49
@landanDB landanDB self-assigned this Aug 22, 2025
calreynolds
calreynolds approved these changes Aug 28, 2025
View reviewed changes
Copy link
Collaborator

@calreynolds calreynolds left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome stuff!!

@landanDB landanDB merged commit d03d50c into main Aug 29, 2025
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@calreynolds calreynolds calreynolds approved these changes

Assignees

@landanDB landanDB

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@landanDB @calreynolds