Add CI Pipeline for Validating challenge_config.yml
#99
Conversation
validate_config.py
Outdated
| from jsonschema import validate, ValidationError | ||
| from datetime import datetime | ||
|
|
||
| SCHEMA = { |
There was a problem hiding this comment.
@Eeshu-Yadav Can you please use the API from EvalAI to validate the challenge configuration on the server?
There was a problem hiding this comment.
Hi @RishabhJain2018,
Thank you for the feedback! I will update the PR to use the EvalAI API for server-side validation of the challenge_config.yml file.
|
Try re-using this script if possible: https://github.com/Cloud-CV/EvalAI-Starters/blob/master/github/challenge_processing_script.py |
.github/workflows/ci.yml
Outdated
| - name: Checkout code | ||
| uses: actions/checkout@v3 | ||
|
|
||
| - name: Set up Python 3.9 |
There was a problem hiding this comment.
Can we use the latest python version?
|
@RishabhJain2018 even after putting the correct credentials , it is failing and showing logs in github actions like this : Eeshu-Yadav#3 |
|
Hey @Eeshu-Yadav , You need to only use this API: https://github.com/Eeshu-Yadav/EvalAI-Starters/blob/b3898846b718e00c938981995ea4b6b74516ad20/github/config.py#L7 and not use the other API for creating the challenge. We just need to validate if the challenge config is valid even when any PR is merged in the repository. |
|
Hey @Eeshu-Yadav , Instead of changing the current python script, I would suggest you to add a new script. The current script is already being utilized in a feature. |
|
okk @RishabhJain2018 sir , will work on that and raise a pr soon , Thanks |
|
Hey @Eeshu-Yadav , Any updates on this? |
|
@RishabhJain2018 extremely sorry for the delay , yesterday my exams finished , will raise a pr in the evening , working on that |
|
No worries. Thanks for the update. |
2 participants
Description
This PR adds a GitHub Actions workflow to automatically validate the
challenge_config.ymlfile whenever a PR is opened or merged into themasterbranch. The validation ensures that the configuration file adheres to the required schema and that all referenced files (e.g., templates, annotations) exist.Changes
.github/workflows/ci.yml:masterchallenge_config.ymlRelated Issues
Checklist