Skip to content

Generate CLI reference for evalprotocol.io #1568

Generate CLI reference for evalprotocol.io

Generate CLI reference for evalprotocol.io #1568

Triggered via pull request December 16, 2025 05:50
Status Cancelled
Total duration 4m 47s
Artifacts

ci.yml

on: pull_request
Lint & Type Check
1m 10s
Lint & Type Check
Batch Evaluation Tests
1m 12s
Batch Evaluation Tests
MCP End-to-End Tests
2m 20s
MCP End-to-End Tests
Matrix: test-core
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 2 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10, Shard 2/4)
Canceling since a higher priority waiting request for Python CI-refs/pull/375/merge exists
Core Tests (Python 3.11, Shard 1/4)
Canceling since a higher priority waiting request for Python CI-refs/pull/375/merge exists
Core Tests (Python 3.10, Shard 2/4)
The operation was canceled.
Core Tests (Python 3.11, Shard 1/4)
The operation was canceled.
Core Tests (Python 3.12, Shard 2/4)
Canceling since a higher priority waiting request for Python CI-refs/pull/375/merge exists
Core Tests (Python 3.12, Shard 2/4)
The operation was canceled.
Python CI
Canceling since a higher priority waiting request for Python CI-refs/pull/375/merge exists
Core Tests (Python 3.11, Shard 2/4)
Canceling since a higher priority waiting request for Python CI-refs/pull/375/merge exists
Core Tests (Python 3.11, Shard 2/4)
The operation was canceled.
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)