ODH Data Processing

This repository provides reference data-processing pipelines and examples for Open Data Hub / Red Hat OpenShift AI. It focuses on document conversion and chunking using the Docling toolkit, packaged as Kubeflow Pipelines (KFP), example Jupyter Notebooks, and helper scripts.

📦 Repository Structure

odh-data-processing
|
|- kubeflow-pipelines
|   |- docling-standard
|   |- docling-vlm
|
|- notebooks
    |- model-customization-data-preprocessing
    |- model-customization-data-postprocessing

✨ Getting Started

Kubeflow Pipelines

Refer to the ODH Data Processing Kubeflow Pipelines documentation for instructions on how to install, run, and customize the Standard and VLM pipelines.

🤝 Contributing

We welcome issues and pull requests. Please:

• Open an issue describing the change.
• Include testing instructions.
• For pipeline/component changes, recompile the pipeline and update generated YAML if applicable.
• Keep parameter names and docs consistent between code and README.

📄 License

Apache License 2.0