Python 3.8 - alpha release

Have remove my phyton3 (was alpha 6) installation and have try to install the latest via PackMan.
Installation was successful.
Install ytsearch was successful and works.
Youtube-dl installation gives errors but was in sitepackages.
Folder script I not found.
Youtube-dl stuff is no longer working for me.
Remove Python via PackMan and install the old stuff manually no works. Not sure what the reason is. Maybe it is a cache problem. Any temp files are alive? This morning I have not the time, hope later this day.

Help is welcome.

Youtube-dl stuff is no longer working for me.

Certain python modules won’t load if their dependent shared libraries aren’t installed.

At a minimum for youtube_dl to import the following shared libraries need to be installed using PackMan.

LibFFI6
LibBZ2-1.0
LibSSL
ZLib1g

The packages are all installed via packman. This is not the reason. :-(
P.S.: Will remove all and start at the beginning.

Have removed all I found…
Install new…
YTSearch works again…
“pip” install youtube-dl ends with an error…
…
[?25hInstalling collected packages: youtube-dl
ERROR: Could not install packages due to an EnvironmentError: [Errno 17] File exists: ‘ADFS::Titanium.$.<PythonSite$Dir>’

Witch file is meanig? After uninstall youtube-dl I remove also the Data folder with the youtube-dl content. In Python.38.Site-Packages the youtube-dl folder are removed by uninstall.
Same if I try install…

Try upgrade youtube-dl…

…
Moving to adfs::titanium.$.pythonsite.python38.site-packages.youtube_dl-2020/9/20/dist-info.wheel
from ADFS::Titanium.$.Scrap.ScrapDirs.ScrapDir.pip-uninstall-qpb5v7ee.wheel
ERROR: Could not install packages due to an EnvironmentError: [Errno 17] File exists: ‘ADFS::Titanium.$.<PythonSite$Dir>’

???

I wondering about this…
EnvironmentError: [Errno 17] File exists: ‘ADFS::Titanium.$.<PythonSite$Dir>’

because

PythonSite$Dir is set to

“ADFS::Titanium.$.[Pling]Boot.Resources.[Pling]PythonSites”

So the errormessage path not exist.

Quick question, packages must be working in Python3, but I can’t seem to get my own to work.

To be able to run some of my multi-platform stuff in RISC OS, I’ve had to strip out all of the use of multiprocessing as it isn’t fully implemented on RISC OS. I got tired of this and wrote a riscos.multitasking package containing dummy code, and this is working fine on Python 2.7.16, but I can’t get it to be recognised with 3.8.5-2

I’ve created a riscos directory in the same directory as the python programs which are going to use it, and that is also the current directory. It contains an empty ___init___/py (that’s supposed to be double underscore around init) and a multiprocessing/py containing the code. It’s imported with:-

import riscos.multiprocessing as multiprocessing

ModuleNotFoundError: No module named ‘riscos.multiprocessing’; ‘riscos’ is not a package

I’ve tried the ___init___ and multiprocessing files without the extension, and with filetypes of python2, python3 and text. I’ve also tried putting the riscos directory in to !PythonSite.Site-packages but nothing seems to work. If it wasn’t for Python2 working, I’d be thinking it was me.

Problem solved; it seems in Python3 the name riscos is special. Although there doesn’t seem to be a package called riscos anywhere I can find, renaming mine to riscosutils has fixed it.

there doesn’t seem to be a package called riscos anywhere

It wouldn’t be finding it’s way up from gcc would it? I seen plain riscos used as a definition in old libgtk/glib stuff which surprised me as __riscos__ is the one to use.
Good to see functionality being added to Python, Haven’t looked at anything past the original 2.4 version yet.

It’s probably the ‘posix’ module, which I think gets imported as ‘posix’ on unix, ‘nt’ on Windows and ‘riscos’ on RISC OS.

I’ve kind of ignored / avoided the multiprocessing stuff. There is enough of subprocess to allow pip to work but that’s about it. I am not sure what (if anything) can be done on RISC OS to support multiprocessing.

To reply (somewhat late) to Raik earlier – yes, that’s a known bug. I’ve fixed it here but I’m trying to tidy up the !PythonSite thing to get the Scripts in the right place, and put them on the Run$Path so it should then just be a matter of *pip, *youtube_dl etc.

To reply (somewhat late) to Raik earlier …

Generally no problem. Is nothing I need to survive ;-) So no hurry neded.
Is there something I can do to get it work again? The old installation also no longer works if I remove the new one via PackMan. Looks like there is something in the temp files … all fails with comparable errors. So “game over” for the Titanium. Ok, I can setup a new !Boot but I was hoping there is an other way.

Chris, I don’t need RISC OS to support multiprocessing fully as I have a single tasking fallback, I just need things like mp safe types which are used by the common code not to break, because low level code isn’t implemented.

Incase anyone is interested, what I needed to dummy from multiprocessing:-

• Lock – does nothing but provided ___enter___ ___exit___ acquire and release methods so can be used with ‘with’
• RawValue and Value, just store the value and provides the get_lock method
• Pool – init calls any initialiser function, map calls standard map, close and join do nothing
• JoinableQueue – inherits from standard Queue and provides dummy join method
• Process – calls target immediately
• cpu_count – returns 1

As I mentioned above its conditionally imported if RISC OS is detected. On Python3 sys.platform which I used for recognising other platforms returns ‘riscos’ but annoyingly Python2 returns ‘linux2’ as for real Linux, but what works on both is os.uname()[ 0 ]==“RISC OS”.

I was trawling through some older links, as old information addicts squirrels like me do.
Anyway, this is probably common knowledge among the python aficionados but for those who might find porting python2 code over to python3 to be foreign thing:

https://www.digitalocean.com/community/tutorials/how-to-port-python-2-code-to-python-3

2to3 foo.py

2to3 foo.py

Ah, automated stuff¹

About that…

“2to3 is a Python program that reads Python 2.x source code and applies a series of fixers to transform it into valid Python 3.x code. The standard library contains a rich set of fixers that will handle almost all code”
[my emphasis]

¹ As accurate as the time and effort/brainpower put into the converter and always usually comes with a “doesn’t work for everything” clause in the description.

About that…

All that being said, it does a pretty good job. A lot of things that need to be changed seem to be fairly consistent syntactical tweaks. It’s not like a cross langage converter which can generate indecipherable code. IIRC it converts, and spits out messages for anything that it finds questionable.

That Python 2 to 3 page isn’t the best. Python 2 and 3 continue to support both stdio style (%d) and “{}”.format, what is new in Python 3 (3.4 onwards) is f string e.g. f"{varname}". It also missed out several functions now returning iterators instead if lists, such as range and map. range now works like Python 2’s xrange which is no longer supported. Most uses of map need to be replaced with (list)map to work the same way.

As Tristam says, use 2to3, it does the vast majority of the syntax donkey work for you, although not the map issue.

I’ve uploaded another set of packages that will no doubt break. The big thing here is I’ve split !Python3 into two packages, Python3Base and Python3.8.

Have upgrade via Packman.
Ytsearch and youtubedl install via pip means it was successful.
Ytsearch is working, youtubedl gives a lot of “missing” errors. Update youtubedl via pip gives the “old” error “EnvironmentError: [Errno 17] File exists: ‘ADFS::Titanium.$.<PythonSite$Dir>’”
after the update routine tells me youtubedl uninstall was succesful and install the new one starts.
Is there something I can manually remove or set/unset?

I’ve uploaded a new Python3.8-pip package (20.0.0.2-2) – see if that helps.

Thanks a lot.
Youtube-dl update was successful with this but if I try to use…

Traceback (most recent call last):
File “<YTPlay$Dir>.Resources.youtube-dl”, line 5, in
from youtube_dl import main
File “ADFS::Titanium.$.PythonSite.Python38.Site-Packages.youtube_dl.init/py”, line 15, in
from .options import (
File “ADFS::Titanium.$.PythonSite.Python38.Site-Packages.youtube_dl.options/py”, line 8, in
from .downloader.external import list_external_downloaders
File “ADFS::Titanium.$.PythonSite.Python38.Site-Packages.youtube_dl.downloader.init/py”, line 3, in
from .common import FileDownloader
File “ADFS::Titanium.$.PythonSite.Python38.Site-Packages.youtube_dl.downloader.common/py”, line 9, in
from ..compat import compat_os_name
File “ADFS::Titanium.$.PythonSite.Python38.Site-Packages.youtube_dl.compat/py”, line 7, in
import ctypes
File “ADFS::Titanium.$.Apps.Development.!Python3.Python38.Lib.ctypes.init”, line 7, in
from _ctypes import Union, Structure, Array
ImportError: File not found

What happens if you try to “import _ctypes” from the python prompt?

Often the “File not found” error happens when you are missing a shared library. ctypes needs LibFFI6 from PackMan, and I missed it from the Requirements list.

LibFFI6 and -dev was installed. Is not the reason.

Have downloaded a “clean” HDImage and setup the main parts of my Ti. Than I install Python and the stuff around.

Now I’m back to this point…
Watch the video is working, download ends in a path problem.

I think I will have start again from the beginning too. I have a pi and an SD card I can use :)

I think the main problem was on my side. First steps are a manually installation, than via PackMan. So it is more than possible that old parts and “look at” are alive.
The download problem, I’m not sure. The first part of the filename is stored as a directory and than the rest of the name is not usable. Looks like a “name conversation” problem.
For playing the complete URL is stored in a playlist file, for download youtube-dl handle the details for saving. Maybe a dot to much.
Thanks a lot.

Edit: Download is working if I specify the outputname by —output in the youtube-dl line. So I will change YTPlay, hope soon.

Quick fix. “/” and " " are problematic in title. Will be removed…
RC2 you find here
Uses only Python3. Help file is not changed yet.
Feedback are welcome.
Now I’m in vacation ;-)

New Testvideo ;-) about YTPlay.