Problems with pip

I decided to try out the new RISCOS port of python3, so I ditched the old version 2 that I had and installed Python-38 (3.8.8-1) using PackMan.

Generally it seems to work well but I wanted to install a new module, so tried using pip. I installed Python-38-pip from PackMan. But pip gives a load of errors when trying to install anything, including itself.

*python3 -m pip -V
pip 20.0.2 from ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip (python 3.8)

*python3 -m pip install --upgrade pip
Traceback (most recent call last):
  File "ADFS::HardDisc4.$.Apps.Development.!Python3.python38.lib.runpy", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "ADFS::HardDisc4.$.Apps.Development.!Python3.python38.lib.runpy", line 87, in _run_code
    exec(code, run_globals)
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip.__main__/py", line 19, in <module>
    sys.exit(_main())
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.cli.main/py", line 73, in main
    command = create_command(cmd_name, isolated=("--isolated" in cmd_args))
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.commands.__init__/py", line 96, in create_command
    module = importlib.import_module(module_path)
  File "ADFS::HardDisc4.$.Apps.Development.!Python3.python38.lib.importlib.__init__", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 827, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.commands.install/py", line 24, in <module>
    from pip._internal.cli.req_command import RequirementCommand
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.cli.req_command/py", line 15, in <module>
    from pip._internal.index.package_finder import PackageFinder
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.index.package_finder/py", line 21, in <module>
    from pip._internal.index.collector import parse_links
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._internal.index.collector/py", line 12, in <module>
    from pip._vendor import html5lib, requests
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._vendor.requests.__init__/py", line 43, in <module>
    from pip._vendor import urllib3
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._vendor.urllib3.__init__/py", line 7, in <module>
    from .connectionpool import HTTPConnectionPool, HTTPSConnectionPool, connection_from_url
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._vendor.urllib3.connectionpool/py", line 39, in <module>
    from .response import HTTPResponse
  File "ADFS::HardDisc4.$.!BOOT.Resources.!PythonSite.Python38.Site-Packages.pip._vendor.urllib3.response/py", line 3, in <module>
    import zlib
ImportError: File not found

Any ideas what’s wrong please?

ZLib1g, TaskRunner and LibSSL are also required from PackMan.

That seems to have fixed it, thanks!

So upgrading pip was actually a bad idea, I assume that the version from RiscPkg has been tweaked to support RISCOS filenames. When I tried to install another package after upgrading pip, I got a filename related error.

Uninstalling pip and reinstalling didn’t fix this, so I uninstalled everything python related and started again.

The plot thickens…

*pip38 install pyproj
Collecting pyproj
  Downloading pyproj-3.4.1.tar.gz (217 kB)

    ERROR: Command errored out with exit status 1:
     command: 'ADFS::HardDisc4.$.Apps.Development.!Python3.bin.python38' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'ADFS::HardDisc4.$.!BOOT.Resources.!Scrap.ScrapDirs.ScrapDir.pip-install-c1xp2rcq.pyproj.setup/py'"'"'; __file__='"'"'ADFS::HardDisc4.$.!BOOT.Resources.!Scrap.ScrapDirs.ScrapDir.pip-install-c1xp2rcq.pyproj.setup/py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'ADFS::HardDisc4.$.!BOOT.Resources.!Scrap.ScrapDirs.ScrapDir.pip-install-c1xp2rcq.pyproj.pip-egg-info'
         cwd: ADFS::HardDisc4.$.!BOOT.Resources.!Scrap.ScrapDirs.ScrapDir.pip-install-c1xp2rcq.pyproj
    Complete output (6 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "ADFS::HardDisc4.$.!BOOT.Resources.!Scrap.ScrapDirs.ScrapDir.pip-install-c1xp2rcq.pyproj.setup/py", line 23
        retun proj_version
              ^
    SyntaxError: invalid syntax
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Notice the line that raised the SyntaxError – “return” is misspelled. But looking at the source code from “setup.py” in the pyproj package – the last line of what I copied here is line 23…

def get_proj_version(proj_dir: Path) -> str:
    proj_version = os.environ.get("PROJ_VERSION")
    if proj_version:
        return proj_version

Is something really odd going on here or is it just that the printed output from pip is corrupt?

The plot thickens…

It is about to thicken some more…

The ‘retun’ corruption is reproduced here.

Is something really odd going on here or is it just that the printed output from pip is corrupt?

The installation having apparently corrupted something also reintroduces this bug that was fixed in Wimp 5.85.

(FWIW PyProj also fails to install on Raspberry Pi OS, something to do with wheels.)