Commit 1eb2b81
[CVAT-M2] Oracles M2 API (#2094)
* Fix job event handling when no assignments exist
* Implement boxes from points task creation
* Refactor cloud storage api
* Implement job downloading
* Estimate max bbox
* Little refactoring
* Copy some shared code from excor to recor
* Refactor task creation and export
* Implement boxes from points validation
* Integrate SDK updates
* Fix escrow access
* [Exchange/Recoring oracles] Add GCS support
* Remove local dev mocks
* Remove some extra changes
* Update tests
* Update some tests
* Remove extra launcher change
* Refactor code
* Add google-cloud-storage dependency
* Fix exception classes
* Set env variables in docker-compose.test.yml
* [CVAT] Points to boxes task (#1560)
* Fix job event handling when no assignments exist
* Implement boxes from points task creation
* Refactor cloud storage api
* Implement job downloading
* Estimate max bbox
* Little refactoring
* Copy some shared code from excor to recor
* Refactor task creation and export
* Implement boxes from points validation
* Integrate SDK updates
* Fix escrow access
* Remove local dev mocks
* Remove some extra changes
* Update tests
* Update some tests
* Remove extra launcher change
* Use virtual hosted bucket style
* Fix creating CS in CVAT
* Fix tests
* Add basic implementation for skeletons from boxes
* Refactor and fix some errors
* Implement job uploading
* Implement downloading
* Fix extra gt boxes in merged results from excor
* Implement skeleton matching
* Fix labels in merged annotations
* Update project events handling in excor
* Improve oks sigma comment
* Remove local testing assets
* Fix label mapping
* Add extra skeleton validations in manifest
* Update .env template
* Update several comments
* Fix failing tests
* Update enum name
* Add more annotation validations for skeletons
* Extend input annotations validation
* Fix quality computation, refactor
* Unify assignment accuracy checks between different job types
* Refactor GT downloading for validation
* Add gcs support - fixes (#1)
* Update code formatting
* Update poetry lock
* Refactor
* Use dict for gcs file contents
* Update class name
* Add backward compatibility for data bucket env var
* Remove extra changes
* Remove extra import
* Fix enum name
* Update bucket access info parsing
* Fix error type in cloud provider parsing
* Update tests
* Add job annotation mode param into assignment links
* Add CD trigger for experimental cvat oracles
* Update code formatting
* Fix test
* Format code
* Fix bucket uses
* Fix result sending
* Remove extra changes
* Fix extra code
* Remove unused code
* Align enum naming convention
* Update oracle-webhook endpoints
* Update webhooks for m2
* Update imports
* Use relative paths in bucket in task creation
* Improve error messages
* Improve skeleton and bbox validation
* Fix escrow manifest downloading
* Update tests
* Fix tests
* Implement general image bans
* Fix import
* Make default gt ban threshold more strict
* Fix comparison for absent points
* Fix comparison for omitted points in jobs
* Finish escrows with too many unverifiable assignments
* Check if an increased healthcheck interval will fix unhealthy container (#1700)
* Fix validations for boxes from points task creation
* Clean code
* disable roi estimation for unreliable cases
* Fix manifest parsing
* Remove m0 launcher stubs
* Remove m0 rep or stubs
* Make max assignment time optional in manifest
* Make label type fully optional in manifest
* Fix test
* Enable and fix a disabled m1 task creation test
* Fix RecOr tests
* Update poetry lock
* Rename rejected_jobs to assignments
* Update imports
* Fix dict traversal
* [Dependent][CVAT-M2] Oracles M2 API - endpoints (#1649)
* Upgrade deps, upgrade pydantic to v2 and fastapi to 0.109
* Migrate code to pydantic v2
* Add filtering and pagination utilities
* Add draft implementation for updated excor endpoints, refactor enum names
* Fixes and refactoring
* Update endpoint response fields and filters
* Implement response field selection
* Add new endpoints
* Support JWT auth
* Update .env template
* Move type definition
* Refactor pagination
* Add page size env var
* Add jwt lib project dependency
* Fix authorization header integration with swagger
* Adopt pagination changes
* Fix assignment status filter
* Add job status field and filter
* Add redis and rate limiting for stats
* Update recording update deps, align versions
* Remove job_title from /job
* Update poetry lock
* Refactor some code
* Add resign endpoint
* Take updated_at from created_at for active assignments
* Update register endpoint api
* Add qualifications stubs in API
* Remove deprecated max_time from manifest
* Add qualifications into job responses
* Update code formatting
* Update deprecated method .dict() uses
* Update deprecated parse_obj calls on pydantic models
* Update comment
* Remove human app signature header from /register
* Fix throttling implementation
* Add new filters in API
* Update fastapi to 0.111.1
* Update email and method name in /register
* Add missing chain_id filter in list_assignments
* Rename amount to total in stats
* Don't allow updating user
* [Exchange Oracle] Update lock file
* [Exchange Oracle] Mark @field_validator as a classmethod decorator
* [Exchange Oracle] Fix Ruff violations
* [Exchange Oracle] Remove deprecated param
* [Recording Oracle] Fix ruff violations
* [Recording Oracle] Update poetry.lock
* Add redis auth
* Refactor some code, allow empty wallet_address in JWT if role is human app
* Fix CI checks
* Update dev env configs
* [Exchange oracle] return 401 instead of 403 when there is no authorization header
* [Exchange oracle] list assignments: make filter params optional && resign assignment: make assignment_id a request body param
* [Exchange oracle] Update api tests
* [Exchange oracle] Update integraton/services/test_exchange.py
* Use renamed enum members
* t
* Update poetry.lock
* t
* Small fixes
* Import StrEnum from strenum directly
* [Exchange oracle] Fix pagination
* [Exchange oracle] GET /job fields param: support json array
* [Exchange oracle] more tests
* [Exchange oracle] Fix sorting
* [Exchange oracle] RecordingOracleEvent_SubmissionRejected::RejectedAssignmentInfo::task_id -> assignment_id
* [Recording oracle] RecordingOracleEvent_SubmissionRejected::RejectedAssignmentInfo::task_id -> assignment_id
* Remove todo
* [Exchange oracle] Fix missed updated_at in GET /job response
* [Exchange oracle] Add description and examples for JobsFilter::fields
* Update packages/examples/cvat/exchange-oracle/src/endpoints/filtering.py
* Remove extra file after merge
* Improve comment
* Refactor some code
* Improve comment
* Improve comment
* Remove outdated comment
* Fix formatting
* Apply comments
* Fix invalid updated_after filtering for assignments
* Fix invalid assignment status filter and refactor job status filter
* Make docker images lighter for oracles
* Refactor some code
* Extend list assignments test
* Fix linter errors
* Touch parents updated_at when updating a child && update tests
* Update packages/examples/cvat/recording-oracle/src/handlers/process_intermediate_results.py
* Update packages/examples/cvat/exchange-oracle/src/crons/cvat/state_trackers.py
* Fix ordering value register in API
* Allow ordering in any register
* Unify parent update mechanism on ORM models
* Unify touch in cvat service
* Remove touch methods from models
* Update tests
* Add dummy joints
* Remove .vscode dir
* Update cryptography to 43.0.1
GHSA-h4gh-qq45-vh27
* Replace python-jose with pyjwt
GHSA-cjwg-qfpm-7377
GHSA-6c5p-j8vq-pqhj
---------
Co-authored-by: maya <[email protected]>
Co-authored-by: Ivan <[email protected]>
Co-authored-by: Dzeranov <[email protected]>
Co-authored-by: Arseny Boykov <[email protected]>
Co-authored-by: Arseny Boykov <[email protected]>1 parent cb7153a commit 1eb2b81
File tree
78 files changed
+4234
-960
lines changed- packages/examples/cvat
- exchange-oracle
- alembic/versions
- dockerfiles
- src
- core
- crons
- cvat
- webhooks
- db
- endpoints
- handlers
- models
- schemas
- services
- cloud
- utils
- validators
- tests
- api
- integration
- cron
- state_trackers
- services
- utils
- recording-oracle
- dockerfiles
- src
- core
- crons
- endpoints
- handlers
- schemas
- services
- cloud
- utils
- tests/integration
- cron
- endpoints
- services
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
78 files changed
+4234
-960
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
| 13 | + | |
13 | 14 | | |
14 | 15 | | |
15 | 16 | | |
| |||
Lines changed: 88 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
Lines changed: 78 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | 1 | | |
4 | 2 | | |
| 3 | + | |
5 | 4 | | |
6 | 5 | | |
7 | 6 | | |
| |||
15 | 14 | | |
16 | 15 | | |
17 | 16 | | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
18 | 84 | | |
19 | | - | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
Lines changed: 17 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | 1 | | |
4 | 2 | | |
5 | 3 | | |
| |||
14 | 12 | | |
15 | 13 | | |
16 | 14 | | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
17 | 29 | | |
18 | 30 | | |
19 | 31 | | |
| |||
72 | 84 | | |
73 | 85 | | |
74 | 86 | | |
| 87 | + | |
75 | 88 | | |
76 | 89 | | |
77 | 90 | | |
| 91 | + | |
| 92 | + | |
78 | 93 | | |
79 | 94 | | |
80 | 95 | | |
| |||
Lines changed: 4 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
| 13 | + | |
13 | 14 | | |
14 | 15 | | |
15 | 16 | | |
16 | | - | |
| 17 | + | |
0 commit comments