Skip to content

Apply 2.0.1 to dev#161

Merged
sainsachiko merged 8 commits into
devfrom
main
May 15, 2026
Merged

Apply 2.0.1 to dev#161
sainsachiko merged 8 commits into
devfrom
main

Conversation

@sainsachiko

Copy link
Copy Markdown
Contributor
  • Adjust memory for VCF_STATS_REPORT modules

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • Make sure your code lints (nf-core pipelines lint).
  • Ensure the test suite passes (nextflow run . -profile test,docker --outdir <OUTDIR>).
  • Check for unexpected warnings in debug mode (nextflow run . -profile debug,test,docker --outdir <OUTDIR>).
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.
  • README.md is updated (including new tool citations and authors/contributors).

Copilot AI review requested due to automatic review settings May 15, 2026 17:26
@sanger-tolsoft

Copy link
Copy Markdown
Contributor

Warning

Newer version of the nf-core template is available.

Your pipeline is using an old version of the nf-core template: 3.5.2.
Please update your pipeline to the latest version.

For more documentation on how to update your pipeline, please see the nf-core documentation and Synchronisation documentation.

@sainsachiko sainsachiko changed the title Apply 2.0.3 to dev Apply 2.0.1 to dev May 15, 2026
@sainsachiko sainsachiko requested a review from muffato May 15, 2026 17:27
@github-actions

github-actions Bot commented May 15, 2026

Copy link
Copy Markdown

nf-core pipelines lint overall result: Passed ✅ ⚠️

Posted for pipeline commit 6fe0a5f

+| ✅ 167 tests passed       |+
#| ❔  28 tests were ignored |#
!| ❗  13 tests had warnings |!
Details

❗ Test warnings:

  • files_exist - File not found: conf/igenomes_ignored.config
  • nextflow_config - Config manifest.version should end in dev: 2.0.1
  • pipeline_todos - TODO string in nextflow.config: Specify any additional parameters here
  • pipeline_todos - TODO string in main.nf: Optionally add in-text citation tools to this list.
  • pipeline_todos - TODO string in main.nf: Optionally add bibliographic entries to this list.
  • pipeline_todos - TODO string in main.nf: Only uncomment below if logic in toolCitationText/toolBibliographyText has been filled!
  • local_component_structure - pacbio_filter.nf in modules/local should be moved to a TOOL/SUBTOOL/main.nf structure
  • local_component_structure - filter_pacbio.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - input_filter_split.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - align_pacbio.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - deepvariant_caller.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - convert_stats.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - input_merge.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure

❔ Tests ignored:

  • files_exist - File is ignored: CODE_OF_CONDUCT.md
  • files_exist - File is ignored: assets/nf-core-variantcalling_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-variantcalling_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-variantcalling_logo_dark.png
  • files_exist - File is ignored: .github/ISSUE_TEMPLATE/config.yml
  • files_exist - File is ignored: .github/workflows/awstest.yml
  • files_exist - File is ignored: .github/workflows/awsfulltest.yml
  • files_exist - File is ignored: assets/multiqc_config.yml
  • files_exist - File is ignored: conf/igenomes.config
  • nextflow_config - Config variable ignored: manifest.name
  • nextflow_config - Config variable ignored: manifest.homePage
  • nextflow_config - Config default ignored: params.vector_db
  • files_unchanged - File ignored due to lint config: .gitattributes
  • files_unchanged - File ignored due to lint config: LICENSE or LICENSE.md or LICENCE or LICENCE.md
  • files_unchanged - File ignored due to lint config: .github/CONTRIBUTING.md
  • files_unchanged - File ignored due to lint config: .github/ISSUE_TEMPLATE/bug_report.yml
  • files_unchanged - File does not exist: .github/ISSUE_TEMPLATE/config.yml
  • files_unchanged - File ignored due to lint config: .github/PULL_REQUEST_TEMPLATE.md
  • files_unchanged - File ignored due to lint config: .github/workflows/branch.yml
  • files_unchanged - File ignored due to lint config: .github/workflows/linting.yml
  • files_unchanged - File ignored due to lint config: assets/email_template.html
  • files_unchanged - File ignored due to lint config: assets/sendmail_template.txt
  • files_unchanged - File does not exist: assets/nf-core-variantcalling_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-variantcalling_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-variantcalling_logo_dark.png
  • files_unchanged - File ignored due to lint config: .gitignore or .prettierignore
  • actions_awstest - 'awstest.yml' workflow not found: /home/runner/work/variantcalling/variantcalling/.github/workflows/awstest.yml
  • multiqc_config - multiqc_config

✅ Tests passed:

Run details

  • nf-core/tools version 3.5.2
  • Run at 2026-05-15 17:28:10

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR syncs the dev branch with the 2.0.1 patch release metadata and introduces dynamic memory sizing for the DeepVariant vcf_stats_report steps based on input VCF size.

Changes:

  • Add per-input-size memory calculation for VCF_STATS_REPORT and GVCF_STATS_REPORT in the base config.
  • Bump pipeline version references from 2.0.0 to 2.0.1 across Nextflow manifest, RO-Crate metadata, citation, changelog, nf-test snapshots, and nf-core metadata.
  • Minor workflow comment clarification about merging by sample/specimen name.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
workflows/variantcalling.nf Clarifies comment about merge semantics (sample/specimen).
conf/base.config Adds dynamic memory sizing for VCF/GVCF stats report processes.
nextflow.config Bumps manifest version to 2.0.1.
ro-crate-metadata.json Updates published/modified timestamps and versioned URLs to 2.0.1.
CITATION.cff Updates release date/title/version to 2.0.1.
CHANGELOG.md Adds 2.0.1 entry documenting memory adjustment.
.nf-core.yml Updates recorded version to 2.0.1.
tests/default.nf.test.snap Updates expected workflow version string to v2.0.1.
tests/align.nf.test.snap Updates expected workflow version string to v2.0.1.
Comments suppressed due to low confidence (1)

conf/base.config:83

  • Same issue as VCF_STATS_REPORT: if the input file is 0 bytes (possible in stub runs or edge cases), Math.ceil(vcf.size()/...) returns 0 and the memory directive becomes 0.GB, which can make Nextflow error out. Ensure the computed memory is always >= a sensible minimum by clamping the size factor to at least 1.
    withName: GVCF_STATS_REPORT {
        // keep cpus,time from process_single, define memory based on input size
        memory = { 1.GB * Math.ceil( vcf.size()/15000000 ) * task.attempt }
    }

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread conf/base.config
Comment on lines +77 to +82
memory = { 1.GB * Math.ceil( vcf.size()/30000000 ) * task.attempt }
}

withName: GVCF_STATS_REPORT {
// keep cpus,time from process_single, define memory based on input size
memory = { 1.GB * Math.ceil( vcf.size()/15000000 ) * task.attempt }
Comment thread nextflow.config
@sainsachiko sainsachiko merged commit e6a5185 into dev May 15, 2026
33 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants