Skip to content

Migration to lutaml-model#22

Draft
andrew2net wants to merge 39 commits into
mainfrom
lutaml-integration
Draft

Migration to lutaml-model#22
andrew2net wants to merge 39 commits into
mainfrom
lutaml-integration

Conversation

@andrew2net
Copy link
Copy Markdown
Contributor

No description provided.

andrew2net and others added 30 commits February 11, 2025 22:41
Enhance DataFetcher and Parser with error handling and logging features

- Implement `gh_issue_channel` and `log_error` methods in DataFetcher.
- Modify Parser to accept an errors hash and update parsing methods to track errors.
- Update tests to cover new functionality and ensure error handling works as expected.
Each integration test loads and parses index file.

This slows down the tests and creates huge VCRs
github-actions and others added 9 commits May 12, 2026 01:42
3GPP now sits behind Cloudflare, which does not proxy FTP. Port 21 is
unreachable on every Cloudflare address, breaking the scheduled crawler
with Errno::ENETUNREACH. Switch DataFetcher#get_file to a Net::HTTP
HEAD+GET against https://www.3gpp.org/ftp/Information/Databases/3GPPBibliography.csv
and use the Last-Modified header for change detection.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Some rows in the upstream CSV have an empty Responsible Secondary
column. Calling .strip on it raises NoMethodError and aborts the
whole crawler run. Mirror the nil/empty guard already present in
prime_contribs.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
3GPP's published CSV is now ;-delimited (was comma). Without col_sep
the entire row collapses into the first column, blowing up later as
either parser errors or ENAMETOOLONG when the docnumber-derived
filename embeds the whole row.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant