preparing CMX v4.2.0 for release

Author: Grigori Fursin

CONTRIBUTORS.md

@@ -12,7 +12,7 @@ and contributors listed here in alphabetical order:
 * @Leonard226
 * @Oseltamivir
 * @Submandarine
-* Daniel Altunay
+* Daniel Altunay (FlexAI)
 * Resmi Arjun
 * Omar Benjelloun (Google)
 * Alice Cheng (Nvidia)
@@ -42,6 +42,7 @@ and contributors listed here in alphabetical order:
 * Steve Leak(NERSC) 
 * Amija Maji (Purdue University)
 * Peter Mattson (Google, MLCommons)
+* Agustin Mautone (FlexAI)
 * Kasper Mecklenburg (Arm)
 * Pablo Gonzalez Mesa
 * Thierry Moreau (OctoML)
@@ -72,6 +73,7 @@ and contributors listed here in alphabetical order:
 * Zixian Wang
 * Nathan Wasson
 * Scott Wasson (MLCommons)
+* Aymen Zayet (FlexAI)
 * Haoyang Zhang  (UIUC)
 * Bojian Zheng (University of Toronto)
 * Thomas Zhu (Oxford University)

README.md

@@ -55,7 +55,8 @@ based on user feedback. It is backwards compatible with CM, released along with
 in the [cmind package](https://pypi.org/project/cmind/) and can serve as drop-in replacement 
 for CM and legacy MLPerf automations while providing a simpler and more robust interface.
 
-See the [project page](https://github.com/mlcommons/ck/tree/master/cmx) for more details.
+See the [project page](https://github.com/mlcommons/ck/tree/master/cmx) 
+and [CMX4MLOps automations](https://github.com/mlcommons/ck/tree/master/cmx4mlops) for more details.
 
 ### MLOps and MLPerf automations
 

cm/CHANGES.md

@@ -1,3 +1,6 @@
+## CMX V4.2.0
+   - added flextask wrapper for CMX4MLOps/FlexBench
+
 ## CMX V4.1.4
    - fixed minor bug for "cmx --version"
    - added "cmx pull repo --dir2" to support "dir/dir" directories

cm/cmind/__init__.py

@@ -9,7 +9,7 @@
 # White paper: https://arxiv.org/abs/2406.16791
 # Project contributors: https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md
 
-__version__ = "4.1.4.1"
+__version__ = "4.2.0"
 
 from cmind.core import access
 from cmind.core import x

cm/cmind/cli.py

@@ -526,6 +526,35 @@ def split_flag(flag, array, value=None):
 
     return key, value, array
 
+############################################################
+def run_flex_task(argv = None):
+    """
+    Run Flexible Task to automate FlexBench (MLPerf inference 5.0 submission)
+
+    Args:
+      (argv): system arguments
+
+    Returns:
+      return code from flexible task
+
+
+    """
+
+    # Access CM
+    from cmind.core import CM
+
+    cm = CM()
+
+    if argv is None:
+        argv = sys.argv[1:]
+
+    r = cm.x(['run', 'flex.task'] + argv, out='con')
+
+    if r['return']>0 and (cm.output is None or cm.output == 'con'):
+        cm.errorx(r)
+
+    sys.exit(r['return'])
+
 ###########################################################################
 if __name__ == "__main__":
     run()

cm/pyproject.toml

@@ -102,3 +102,5 @@ cmr = "cmind.cli:run_script"
 cmrd = "cmind.cli:docker_script"
 cmg = "cmind.cli:gui_script"
 cme = "cmind.cli:run_experiment"
+flextask = "cmind.cli:run_flex_task"
+ft = "cmind.cli:run_flex_task"

cmx4mlops/COPYRIGHT.txt

@@ -0,0 +1,5 @@
+© 2024-2025 FlexAI. All Rights Reserved.
+
+License: Apache 2.0 (../LICENSE.md)
+
+Author: Grigori Fursin

cmx4mlops/README.md

@@ -0,0 +1,23 @@
+# CMX automations for MLOps and MLPerf
+
+[![License](https://img.shields.io/badge/License-Apache%202.0-green)](LICENSE.md)
+[![CMX repository](https://img.shields.io/badge/Common%20Metadata%20eXchange-compatible-blue)](https://github.com/mlcommons/ck/tree/master/cmx4mlops)
+[![Powered by CMX](https://img.shields.io/badge/Powered_by-MLCommons%20CMX-blue)](https://pypi.org/project/cmind).
+
+## License
+
+[Apache 2.0](../LICENSE.md)
+
+This project may include code from other related MLCommons projects under the same license.
+
+## Author
+
+[Grigori Fursin](https://cKnowledge.org/gfursin)
+
+We sincerely appreciate all [contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTORS.md) 
+for their invaluable feedback and support!
+
+## Citing this project
+
+If you found the CM, CMX and MLPerf automations helpful, kindly reference this article:
+[ [ArXiv](https://arxiv.org/abs/2406.16791) ]

cmx4mlops/cmr.yaml

@@ -0,0 +1,14 @@
+alias: mlcommons@cmx4mlops
+uid: 84dac8a5f8314c02
+
+git: true
+
+install_python_requirements: false
+
+min_cm_version: 4.2.0
+
+author: "Grigori Fursin"
+
+version: 1.1.0
+
+prefix: repo

cmx4mlops/repo/automation/flex.cache/_cm.yaml

@@ -0,0 +1,17 @@
+alias: flex.cache
+uid: b9d58d0cbecd442b
+
+automation_alias: automation
+automation_uid: bbeb15d8f0a944a4
+
+min_cm_version: 3.4.1
+
+author_and_developer: "Grigori Fursin"
+
+tags:
+- automation
+- flex
+- cache
+
+use:
+  flex.common: "flex.common,21286240620d4ef6"