Broken resource lazy load in 4.78.0

[artemklevtsov]

Hi,

I faced with strange behavior since 4.78.0.

The same start command:

TARGET_NAME=project redpanda-connect -r "benthos/resources/*.yaml" benthos/config.yaml

4.77.0

{"asktime":"2026-02-25T11:23:14+07:00","benthos_version":"4.77.0","levelname":"info","message":"Running main config from specified file","path":"benthos/config.yaml"}
{"asktime":"2026-02-25T11:23:14+07:00","expires_at":"2036-02-23T11:23:14+07:00","levelname":"info","license_org":"","license_type":"open source","message":"Successfully loaded Redpanda license"}
{"asktime":"2026-02-25T11:23:14+07:00","levelname":"info","message":"Listening for HTTP requests at: http://0.0.0.0:4195"}
{"asktime":"2026-02-25T11:23:14+07:00","levelname":"info","message":"Launching a Redpanda Connect instance, use CTRL+C to close"}
{"asktime":"2026-02-25T11:23:14+07:00","label":"project_reader","levelname":"info","message":"Input type generate is now active","path":"root.input_resources"}
{"asktime":"2026-02-25T11:23:14+07:00","label":"","levelname":"info","message":"Output type drop is now active","path":"root.output.fallback.1"}
{"asktime":"2026-02-25T11:23:15+07:00","label":"project_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:23:15+07:00","label":"project_reader","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:23:15+07:00","label":"project_reader","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:23:15+07:00","levelname":"info","message":"Pipeline has terminated. Shutting down the service"}

4.78.0

{"asktime":"2026-02-25T11:25:48+07:00","benthos_version":"4.78.0","levelname":"info","message":"Running main config from specified file","path":"benthos/config.yaml"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"field_reader","levelname":"info","message":"Input type generate is now active","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"","levelname":"info","message":"Input type generate is now active","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"project_reader","levelname":"info","message":"Input type generate is now active","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"","levelname":"info","message":"Input type generate is now active","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:48+07:00","custom_source":true,"endpoint":"sprint","label":"","levelname":"debug","message":"Jira API request","path":"root.input_resources.read_until.input.processors.2","query":{"maxResults":50,"startAt":0}}
{"asktime":"2026-02-25T11:25:48+07:00","label":"","levelname":"info","message":"Input type generate is now active","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"board_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","custom_source":true,"endpoint":"board","label":"","levelname":"debug","message":"Jira API request","path":"root.input_resources.read_until.input.processors.2","query":{"maxResults":50,"startAt":0}}
{"asktime":"2026-02-25T11:25:48+07:00","label":"field_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"issue_main_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"issue_tag_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"issue_link_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"issue_changelog_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"issue_sprint_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"project_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","expires_at":"2036-02-23T11:25:48+07:00","levelname":"info","license_org":"","license_type":"open_source","message":"Successfully loaded Redpanda license"}
{"asktime":"2026-02-25T11:25:48+07:00","levelname":"info","message":"Listening for HTTP requests at: http://0.0.0.0:4195"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"sprint_writer","levelname":"info","message":"Output type sql_insert is now active","path":"root.output_resources"}
{"asktime":"2026-02-25T11:25:48+07:00","levelname":"info","message":"Launching a Redpanda Connect instance, use CTRL+C to close"}
{"asktime":"2026-02-25T11:25:48+07:00","label":"","levelname":"info","message":"Output type drop is now active","path":"root.output.fallback.1"}
{"asktime":"2026-02-25T11:25:48+07:00","custom_source":true,"endpoint":"issue","label":"","levelname":"debug","message":"Jira API request","path":"root.input_resources.read_until.input.processors.3","query":{"expand":["names","changelog"],"jql":"project = \"DASHBRD01\" AND updated \u003e= \"2026-01-29 11:56\" AND updated \u003c= \"2026-02-25 07:25\"","maxResults":100,"startAt":0}}
{"asktime":"2026-02-25T11:25:49+07:00","custom_source":true,"endpoint":"sprint","label":"","levelname":"debug","message":"Jira API request","path":"root.input_resources.read_until.input.processors.2","query":{"maxResults":50,"startAt":50}}
{"asktime":"2026-02-25T11:25:49+07:00","custom_source":true,"endpoint":"board","label":"","levelname":"debug","message":"Jira API request","path":"root.input_resources.read_until.input.processors.2","query":{"maxResults":50,"startAt":50}}
{"asktime":"2026-02-25T11:25:49+07:00","label":"project_reader","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"project_reader","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:49+07:00","levelname":"info","message":"Pipeline has terminated. Shutting down the service"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"field_reader","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"field_reader","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Waiting for pending acks to resolve before shutting down.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:25:49+07:00","label":"","levelname":"debug","message":"Pending acks resolved.","path":"root.input_resources.read_until.input"}
{"asktime":"2026-02-25T11:26:09+07:00","levelname":"warning","message":"Service failed to close resources cleanly within allocated time: resource 'issue_reader' failed to cleanly shutdown: context deadline exceeded. Exiting forcefully and dumping stack trace to stderr"}

Regard.

[Jeffail]

Thanks @artemklevtsov, looks like this is related to recent connectivity testing work that was introduced to the engine. I should have a fix soon.

[Jeffail]

Fix here: redpanda-data/benthos#373