Add python

[suzuki-shunsuke]

#858
https://github.com/danhper/asdf-python
https://www.python.org/

[borissmidt]

@suzuki-shunsuke
There doesn't seem to be support for python yet in aqua,
Maybe it would be a good idea to support the following builds?

I suspect it isn't possible with the current version of aqua but maybe this type of releases could be used instead:
https://github.com/indygreg/python-build-standalone
https://github.com/indygreg/python-build-standalone/releases/tag/20240726

The issue with python seems to be that it has a lot of system dependencies and that python then has to be rebuild quite regularly.
So the tags are date based and the version is on of the release files.

These builds are used by rye, bazel and some other build tools to download a binary python so it's an unofficial standard.

[suzuki-shunsuke]

Hi, thank you for your suggestion.
I didn't know that project.
I'll take a look.

[suzuki-shunsuke]

https://github.com/indygreg/python-build-standalone/releases/tag/20240726

Hmm. Each release has assets for multiple Python versions (3.10.14, 3.11.9, etc).
aqua can't specify the Python version for now.

e.g.

- name: indygreg/python-build-standalone@20240726 # Can't specify python version

My idea is to enable aqua to specify parameters.

e.g.

- name: indygreg/python-build-standalone@20240726
  with:
    python_version: "3.10.14"

[boris-smidt-klarrio]

It seems rye indexes the releases to know which version it can download from which release.
Each release has to currently maintained version and its latest patch available.

So when updating the release the 'python_version' should also be checked to see if it needs to be updated.

https://github.com/astral-sh/rye/blob/main/rye-devtools/src/rye_devtools/find_downloads.py

[suzuki-shunsuke]

Related:

• Support Node.js (Dynamic $PATH manipulation): Node.js support aqua#2996 (comment)
  • Dynamic $PATH mamipulation is required to enable us to execute tools installed by pip
• Support parameters: feat: add vars aqua#3052

[suzuki-shunsuke]

📝 After we support parameters, aquaproj/aqua#3052
to update parameters such as python_version by aqua update command, we need additional implementation.
I'm not sure if we will address it.
We would add the setting updating python_version to aqua-renovate-config.

[mab]

Maybe you should look into https://github.com/jdx/mise. To me mise is to specify Node, Phyton, Java versions - so languages coming with an own dependency management and Aqua for single binary tools. I see aqua as version manager, I don't see that I could also put configuration next to the version E.g. for python https://mise.jdx.dev/lang/python.html

[boris-smidt-klarrio]

@mab I currently use mise and it is sometimes flaky to get new developers to pick it up. Because its based on ASDF plugins it is hard to add new tools. And some plugins are a bit brittle. Like checkov needed jq installed to work.

To me aqua seems simpler since it only downloads binaries and better on the front of security and managing the 'registry'.

Ideally mise would use the aqua repository by default and have several special install scripts baked in for python, java, ruby and others where it isn't trivial to install these tools.

[suzuki-shunsuke]

WIP

• feat: add indygreg/python-build-standalone #26154
• PIP_TARGET: Node.js support aqua#2996 (comment)

export PIP_TARGET=$(aqua root-dir)/pip-global # location where pip installs tools
export PATH=$PIP_TARGET/bin:$PATH
export PYTHONPATH=$PIP_TARGET # Without this setting, tools installed by pip didn't work

pip install mkdocs
mkdocs -V

I found an issue that even if I change the Python version, seems like mkdocs -V refers to old Python.

1. Install mkdocs with Python 3.11.9
2. Change the Python version to 3.10.14
3. Run mkdocs -V, then it outputs Python 3.11

$ mkdocs -V
mkdocs, version 1.6.0 from /Users/shunsukesuzuki/.local/share/aquaproj-aqua/pip-global/mkdocs (Python 3.11)

I'm not familiar with Python, but Python creates cache *.pyc.

$ ls -lh /Users/shunsukesuzuki/.local/share/aquaproj-aqua/pip-global/mkdocs/__pycache__ 
total 84K
-rw-r--r-- 1 shunsukesuzuki staff  237  8 23 09:02 __init__.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff  20K  8 23 09:02 __main__.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 2.4K  8 23 09:02 exceptions.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 4.7K  8 23 09:02 localization.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff  35K  8 23 09:02 plugins.cpython-311.pyc
-rw-r--r-- 1 shunsukesuzuki staff 8.8K  8 23 09:02 theme.cpython-311.pyc