orgs confs

[SergioZSZ]

RESQUI configurations by organization

SKAO

Requested requirement	Indicator	Plugin	Coverage
Software has documentation	software_has_documentation	RSFC	Covered
Software has a license	software_has_license	RSFC	Covered
Software has requirements/dependencies	requirements_specified	RSFC	Covered

Result: the configuration covers all requested requirements.

OSSR

Requested requirement	Indicator	Plugin	Coverage
Descriptive metadata	descriptive_metadata	RSFC	Covered
License	software_has_license	RSFC	Covered
Releases	has_releases	RSFC	Covered
Published as a package	has_published_package	OpenSSFScorecard	Covered
Uses version control	version_control_use	RSFC	Covered
Has a container file	software_is_containerized	RSFC	work in progress

ELIXIR

Requested requirement	Indicator	Plugin	Coverage
Analysis of common vulnerabilities	static_analysis_common_vulnerabilities	OpenSSFScorecard	Covered
Follows versioning standards	versioning_standards_use	RSFC	Covered
Has metadata	descriptive_metadata	RSFC	Covered
Has documentation	software_has_documentation	RSFC	Covered
Has a license	software_has_license	RSFC	Covered
Has sufficient test coverage	software_test_coverage	—	work in progress
Archived in a scholarly registry	archived_in_software_heritage	RSFC	Covered
Listed in a registry	listed_in_registry	OEBFAIR	Not Covered
Has tests	software_has_tests	RSFC	Covered

HSF

Requested requirement	Indicator	Plugin	Coverage
Has communication channels	has_active_communication_channels	—	Not supported
Issues are addressed within a defined time frame	response_timeframe_ok	—	Not suported
Follows versioning standards	versioning_standards_use	RSFC	Covered
Has documentation	software_has_documentation	RSFC	Covered
Has a license	software_has_license	RSFC	Covered
Uses version control	version_control_use	RSFC	Covered
Has issue tracking	support_issue_tracking	RSFC	Not Covered
Provides tests	software_has_tests	RSFC	Covered
Has contribution guidelines	has_contribution_guidelines	RSFC	Covered
Has requirements	requirements_specified	RSFC	Covered

Related to #86

[dgarijo]

For HSF we have https://w3id.org/everse/i/indicators/response_timeframe_ok, but we have no support right now.
For HSF we have https://w3id.org/everse/i/indicators/has_active_communication_channels, but we currently do not have support. Using documentation here is incorrect.
For Elixir we have https://w3id.org/everse/i/indicators/software_test_coverage which is work in progress (with software has tests we can keep it for now)
For OSSR we have https://w3id.org/everse/i/indicators/software_is_containerized which is work in progress in RSFC

[dgarijo]

Please review the PR according to the comments.

[SergioZSZ]

@dgarijo updated

[dgarijo]

Looking good. @kaygraf please have a look and merge if appropriate.

[kaygraf]

Yes looks good - I did a similar implementation in https://github.com/EVERSE-ResearchSoftware/QualityPipelines/tree/86-add-configurations-for-clusters/configurations - with exactly the same results, already tested them against resqui.
My only point: could we please take over the comments in my implementation or add a documentation?
The reason is that we have an inconsistency between the map in https://everse.software/indicators/website/community.html
and our implementation and we should explain it near the configuration itself.
(It is in this PR, but that will get lost by time eventually).

[dgarijo]

oops... yes we should work on the documentation. Apologies, I did not see the configs were there already...

[SergioZSZ]

I have a quick question about the missing indicators listed in the comments:

For elixir, the configuration includes software_has_tests, so I think "software has tests" is covered, while "sufficient test coverage" should still remain as unsupported.

For hsf, I also added software_has_tests and support_issue_tracking. Should "provides tests" and "has issue tracking" be removed from the missing indicators?

[kaygraf]

For software_has_tests I agree, that is implemented. My error: I had a look into configurations/complete.json which seems not to be complete. However,

$ resqui indicators | grep issue
    - has_no_linting_issues

seems not to be implemented (confirmed from /src/resqui/plugins/rsfc.py, where it is absent as well).

[SergioZSZ]

Okay thanks for checking. I will remove it from the HSF configuration and keep "has issue tracking" documented in comments as not covered. I will also remove from the missing indicators the parts of "not implemented software has test"