Databricks Labs

All

41 repositories

dbldatagen
Public
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simul…
python spark faker
python spark faker pyspark spark-streaming data-generation databricks synthetic-data datagen datagenerator
Python
•
Other
•90•446•31•15•Updated Mar 11, 2026Mar 11, 2026
lakebridge
Public
Accelerates migrations to Databricks by automating key migration activities
reconciliation data-validation code-analysis
reconciliation data-validation code-analysis transpiler databricks code-converter
Python
•
Other
•91•125•285•15•Updated Mar 11, 2026Mar 11, 2026
sandbox
Public
Experimental labs projects
databricks databricks-api databricks-sdk
databricks databricks-api databricks-sdk
Python
•
Other
•53•63•27•25•Updated Mar 11, 2026Mar 11, 2026
pytester
Public
Python Testing for Databricks
python3 pytest pytest-plugin
python3 pytest pytest-plugin databricks databricks-sdk
Python
•
Other
•14•117•41•3•Updated Mar 11, 2026Mar 11, 2026
lsql
Public
Lightweight SQL execution wrapper only on top of Databricks SDK
databricks databricks-sql databricks-sdk
databricks databricks-sql databricks-sdk
Python
•
Other
•6•31•57•11•Updated Mar 11, 2026Mar 11, 2026
dqx
Public
Databricks framework to validate Data Quality of pySpark DataFrames and Tables
spark spark-streaming databricks
spark spark-streaming databricks data-quality data-profiling data-quality-monitoring unity-catalog lakeflow
Python
•
Other
•94•387•61•12•Updated Mar 11, 2026Mar 11, 2026
lakeflow-community-connectors
Public
Python
•
Other
•64•17•2•18•Updated Mar 10, 2026Mar 10, 2026
blueprint
Public
Baseline for Databricks Labs projects written in Python
python cli databricks
python cli databricks databricks-cli-installable
Python
•
Other
•15•59•22•9•Updated Mar 10, 2026Mar 10, 2026
kasal
Public
Python
•30•70•27•9•Updated Mar 7, 2026Mar 7, 2026
brickster
Public
R Toolkit for Databricks
R
•
Apache License 2.0
•15•78•5•0•Updated Mar 6, 2026Mar 6, 2026
dlt-meta
Public
Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
python databricks meta-programming
python databricks meta-programming dlt lakeflow-declarative-pipelines spark-declarative-pipelines
Python
•
Other
•108•247•35•3•Updated Mar 4, 2026Mar 4, 2026
tempo
Public
API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and int…
python data-science scala
python data-science scala timeseries time-series pandas data-analysis timeseries-data timeseries-analysis
Jupyter Notebook
•
Other
•58•338•23•1•Updated Mar 4, 2026Mar 4, 2026
ontos
Public
A Business Catalog for Unity Catalog
Python
•
Other
•31•121•51•4•Updated Mar 4, 2026Mar 4, 2026
ucx
Public
Automated migrations to Unity Catalog
databricks unity-catalog databricks-cli-installable
databricks unity-catalog databricks-cli-installable databricks-governance
Python
•
Other
•100•296•299•28•Updated Feb 27, 2026Feb 27, 2026
arcuate
Public archive
Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)
big-data spark data-sharing
big-data spark data-sharing mlflow delta-sharing
Python
•
Other
•2•22•0•9•Updated Jan 29, 2026Jan 29, 2026
splunk-integration
Public
Databricks Add-on for Splunk
cybersecurity databricks databricks-notebooks
cybersecurity databricks databricks-notebooks splunk-addon
Python
•
Other
•19•29•14•1•Updated Jan 15, 2026Jan 15, 2026
overwatch
Public
THIS PROJECT IS DEPRECATED. Capture deep metrics on one or all assets within a Databricks workspace
monitoring databricks
monitoring databricks
Scala
•
Other
•68•232•134•8•Updated Jan 8, 2026Jan 8, 2026
mosaic
Public
An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.
Jupyter Notebook
•
Other
•86•318•62•18•Updated Dec 15, 2025Dec 15, 2025
access-insights
Public
Python
•
Other
•5•7•0•0•Updated Dec 3, 2025Dec 3, 2025
chatx
Public
Python
•
Other
•2•11•9•0•Updated Sep 20, 2025Sep 20, 2025
mcp
Public
Python
•
Other
•44•85•10•3•Updated Jul 9, 2025Jul 9, 2025
discoverx
Public
A Swiss-Army-knife for your Data Intelligence platform administration.
scanning data-retrieval pii-detection
scanning data-retrieval pii-detection semantic-classification multi-table-operations
Python
•
Other
•17•137•17•10•Updated Apr 30, 2025Apr 30, 2025
dbx
Public
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
ci cicd databricks
ci cicd databricks mlops databricks-cli databricks-api
Python
•
Other
•127•455•91•6•Updated Apr 22, 2025Apr 22, 2025
partner-connect-api
Public
Scala
•
Other
•4•12•1•11•Updated Jan 31, 2025Jan 31, 2025
pylint-plugin
Public
Databricks Plugin for PyLint
python databricks pylint-plugin
python databricks pylint-plugin
Python
•
Other
•4•30•12•1•Updated Nov 15, 2024Nov 15, 2024
tika-ocr
Public
Rich Text Format
•
Other
•4•21•2•5•Updated Oct 21, 2024Oct 21, 2024
geoscan
Public
Geospatial clustering at massive scale
library clustering spark-ml
library clustering spark-ml
Scala
•
Other
•20•109•2•6•Updated Jul 11, 2024Jul 11, 2024
waterbear
Public
Automated provisioning of an industry Lakehouse with enterprise data model
python sql spark
python sql spark data-model databricks delta-lake lakehouse
Python
•
Other
•3•8•0•1•Updated Jul 11, 2024Jul 11, 2024
dataframe-rules-engine
Public
Extensible Rules Engine for custom Dataframe / Dataset validation
Scala
•
Other
•31•138•8•4•Updated May 7, 2024May 7, 2024
databricks-sdk-r
Public
Databricks SDK for R (Experimental)
data-science r sdk
data-science r sdk databricks
R
•
Apache License 2.0
•4•24•6•1•Updated Apr 8, 2024Apr 8, 2024