updating Youtubedl

About a month ago I stopped being able to run youtube videos from saved URLs, which was working fine up till then using FFmpeg, FFplay, Youtubedl and YTPlay. Python3 is ‘seen’ by the Filer as part of the boot sequence. Presumably Youtube have moved the goalposts, as indeed we were warned would happen: https://www.riscository.com/2020/watching-youtube-videos-on-risc-os/
Is there an updated version of Youtubedl available? My current version is 2020.07.28.
TIA

Assuming you have the latest version of Python3 installed just type,

pip38 install --upgrade youtube-dl

Thanks Chris.

latest version of Python3

!Packman offers:

Python-38
Python-38-pip
Python-Core

Are all required, or if not, which?

All 3 are needed. Depending on the version you have installed already you might need to uninstall first.

About a month ago I stopped being able to run youtube videos from saved URLs, which was working fine up till then using FFmpeg, FFplay, Youtubedl and YTPlay.

If you have install the Python-38 stuff, please try this YTPlay Version. I have changed the ytsearch and youtube-dl install/update routines.

@Chris Gransden
In my developer version I support “download” audio only and convert “on the fly” to mp3. Works with Christopher’s “alpha” ffmpeg 3.0 build but a bit faster wouldt be nice. ;-)
Have try your ffmpeg vpn build but this is not working. Libmp3lame (or an mp3 decoder generally) is missing. Is there/have you a vpn version with this?

Hi Raik

Updating youtube-search gives errors with version 1.4.0 installed.

Successfully installed certifi-2020-12-5 h11-0-12-0 httpcore-0-12-3 httpx-0-16-1 idna-3-1 rfc3986-1-4-0 sniffio-1-2-0 youtube-search-python-1-4-0
Traceback (most recent call last):
File “<YTPlay$Dir>.Resources.my_ytsearch/py”, line 4, in
from youtubesearchpython import SearchVideos
File “SCSI::SSD.$.PythonSite.Python38.Site-Packages.youtubesearchpython.init/py”, line 1, in
from youtubesearchpython.search import Search, VideosSearch, ChannelsSearch, PlaylistsSearch, CustomSearch
File “SCSI::SSD.$.PythonSite.Python38.Site-Packages.youtubesearchpython.search/py”, line 2, in
from youtubesearchpython.internal.search import SearchInternal
File “SCSI::SSD.$.PythonSite.Python38.Site-Packages.youtubesearchpython.internal.search/py”, line 3, in
from youtubesearchpython.handlers.requesthandler import RequestHandler
File “SCSI::SSD.$.PythonSite.Python38.Site-Packages.youtubesearchpython.handlers.requesthandler/py”, line 4, in
import pkg_resources
ModuleNotFoundError: No module named ‘pkg_resources’

If I then specifically install version 1.3.2 again then search works again.

python3 -m pip install youtube-search-python==1.3.2

Hope this helps.

Sorry, my mistake.
Was a typo in the link URL.
Please download again. Should now V3.02.
It should install/update the pkg_resources before install/update youtube-search.
Anytime it needs a second try and a Computer Restart.

Hi Raik,

Thanks downloaded 3.02 and tried to install/update youtube-search.

So first pass get:

Collecting setuptools
Downloading setuptools-53.0.0-py3-none-any.whl (784 kB)

Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 41.2.0.post20200303
Can’t uninstall ‘setuptools’. No files were found to uninstall.
Successfully installed setuptools-53-0-0

So then tried it again and get:

Collecting setuptools
Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 53-0-0
Uninstalling setuptools-53-0-0:
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: ‘scsi::ssd.$.pythonsite.python38.site-packages.setuptools.command.launcher manifest/xml’

So reboot the ARMX6 and try again and get:

Collecting setuptools
Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 41.2.0.post20200303
Can’t uninstall ‘setuptools’. No files were found to uninstall.
Successfully installed setuptools-53-0-0

Quit YTPlay 3.02 and then restart that and try again and get:

Collecting setuptools
Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 53-0-0
Uninstalling setuptools-53-0-0:
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: ‘scsi::ssd.$.pythonsite.python38.site-packages.setuptools.command.launcher manifest/xml’

So Reboot and try again and get:

Collecting setuptools
Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
Attempting uninstall: setuptools
Found existing installation: setuptools 41.2.0.post20200303
Can’t uninstall ‘setuptools’. No files were found to uninstall.
Successfully installed setuptools-53-0-0

So we go round and round in circles.

It looks like it finds an old version and says in installed the latest setuptools but perhaps not correctly?

Update: Checked in the directory scsi::ssd.$.pythonsite.python38.site-packages.setuptools.command and there is a launcher manifest/xml file. It is not seeing it is this a case of the space in the name being a hard or soft space, if I have my terms right?

Mmm, …
The last Info is “Successfully installed setuptools-53-0-0”…
Is there an error message for youtube-search?

After Reboot, have you try to use the search window?

It is possible that the “uninstall error message” will disappears if a new setuptool is available e.g. 54-0-0. I mean it was the same with 52-0-0.

Hi Raik,

Is there an error message for youtube-search?

There does not appear to be an error message for youtube-search.

Using python3 -m pip install youtube-search-python==1.3.2 gives the following:

Installing collected packages: youtube-search-python
Attempting uninstall: youtube-search-python
Found existing installation: youtube-search-python 1-3-2
Uninstalling youtube-search-python-1-3-2:
Successfully uninstalled youtube-search-python-1-3-2
Successfully installed youtube-search-python-1-3-2

So it looks like 1-3-2 is installed and the upgrade has not taken place with YTPlay 3.0.2.

Normally after installing setuptool, the next step is install/upgrade to the latest youtube-search. Is one obey.
Maybe you have to wait a bit longer.
So after you update youtube-search via YTPlay all needed should be installed.
After reboot all should work.
I will take a look if I back at home if it not works for you.

Normally after installing setuptool, the next step is install/upgrade to the latest youtube-search. Is one obey.

So perhaps as it says:

Found existing installation: setuptools 41.2.0.post20200303
Can’t uninstall ‘setuptools’. No files were found to uninstall.

This is causing it not to fully work in the same obey?

Perhaps I have a set of site-packages that is corrupt or needs cleansing?

If you need a copy of my !PythonSite repository then let me know where to send it and I will archive and email it if possible.

There are some path handling issues in Python3.

Upgrading setuptools needs to be done twice as a workaround,

The first one uninstalls the old setuptools. The second then installs it successfully despite the error.

*pip38 install --upgrade setuptools

Collecting setuptools
  Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 53-0-0
    Uninstalling setuptools-53-0-0:
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'scsi::harddisc4.$.!boot.resources.!pythonsite.python38.site-packages.setuptools.command.launcher manifest/xml'

*pip38 install --upgrade setuptools

Collecting setuptools
  Using cached setuptools-53.0.0-py3-none-any.whl (784 kB)
Installing collected packages: setuptools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 41.2.0.post20200303
    Can't uninstall 'setuptools'. No files were found to uninstall.
Successfully installed setuptools-53-0-0

Also 1.4.0 of youtube-search-python errors when run due to path handling issues but 1.3.9 seems OK.

pip38 install --upgrade youtube-search-python==1.3.9

Hi Chris,

Thanks for the feedback and 1.3.9 now installed and working OK.

I guess the path handling issues are there as I have lots of weird named directoiries in PythonSite then but good to know the reason why it would not upgrade.

In my developer version I support “download” audio only and convert “on the fly” to mp3. Works with Christopher’s “alpha” ffmpeg 3.0 build but a bit faster wouldt be nice. ;-)
Have try your ffmpeg vpn build but this is not working. Libmp3lame (or an mp3 decoder generally) is missing. Is there/have you a vpn version with this?

The latest version of ffmpeg is available here. It includes libmp3lame support.

Should be a bit faster than previous versions. Can encode wav to mp3 at 22x real time on a RPi400 @ 2.4GHZ.

I have found a “bug” in my obey. Now generally it works for me.

Have perform pip38 uninstall setuptools
and remove Boot:Resources.!PythonSite.Python38.Site-Packages.setuptools & setuptools/egg-info

Than “my” installer works. Tested on Ti and MX6.

Also 1.4.0 of youtube-search-python errors when run due to path handling issues but 1.3.9 seems OK.

For now, I have “hardcoded” 1.3.9.

Will upload later this evening.

The latest version of ffmpeg is available here. It includes libmp3lame support.

Wow. Use it on my Ti to convert the m4a youtube audio stream to mp3 “on the fly”. Is round about 10x faster than the old ffmpeg

The latest YTPlay you find here.

Hi Raik,

Thanks for the update to YTPlay 3.02a.

I tried to update YouTube-Search and the first time it gave a lot of errors like previously.

So I tried a second time and then it succeeded so as Chris pointed out the initial path handling issue
is there but is fixed if you do an immediate second attempt.

Hope this helps.

Update: Updating youtube-dl doesn’t see the same issues as youtube-search.

All 3 are needed. Depending on the version you have installed already you might need to uninstall first.

Just installed Python-38, Python-38-pip and Python-Core. Attempting to launch a URL via YTPlay (V3.02a) gives the following error:

Python path configuration:
PYTHONHOME = ‘/python/env’
PYTHONPATH = ‘SCSI::240GB_SSD.$.Apps.Video.!Python27.lib.python2/7’
program name = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
isolated = 0
environment = 1
user site = 1
import site = 1
sys.base_executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
sys.base_prefix = ‘/python/env’
sys.base_exec_prefix = ‘/python/env’
sys.executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
sys.prefix = ‘/python/env’
sys.exec_prefix = ‘/python/env’
sys.path = [
‘SCSI::240GB_SSD.$.Apps.Video.!Python27.lib.python2/7’,
‘/python/env.python38.lib’,
‘/python/env.python38.lib.lib-dynload’,
]
Fatal Python error: init_fs_encoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
File "SCSI::240GB_SSD.$.Apps.Video.!Python27.lib.python2/7.encodings._init__/py", line 123
raise CodecRegistryError,\
^
SyntaxError: invalid syntax

Current thread 0×00298e10 (most recent call first):
no Python frame

EDIT: the final line is between <> but won’t display unless I remove them.

Any idea what’s going wrong? TIA

Just installed Python-38, Python-38-pip and Python-Core. Attempting to launch a URL via YTPlay (V3.02a) gives the following error…

Have you try to install youtubedl and youtubesearch via Adjust-click to the Iconbar icon? If it is not sucessful please give a second try. Restart is necessary often after install.
Python3 but not Python 2.7 must be seen by the filer.

Hi Raik: I tried installing youtubedl and youtubesearch by Adjust-clicking the iconbar icon as suggested, The result was error messages as follows:

(For youtubedl)
got PYTHONHOME
Python path configuration:
PYTHONHOME = ‘/python/env’
PYTHONPATH = (not set)
program name = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
isolated = 0
environment = 1
user site = 1
import site = 1
sys.base_executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
sys.base_prefix = ‘/python/env’
sys.base_exec_prefix = ‘/python/env’
sys.executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.Bin.python38’
sys.prefix = ‘/python/env’
sys.exec_prefix = ‘/python/env’
sys.path = [
‘/python/env.python38.lib’,
‘/python/env.python38.lib.lib-dynload’,
]
Fatal Python error: init_fsencoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
ModuleNotFoundError: No module named ‘encodings’

Current thread 0×00298e10 (most recent call first):
no Python frame
EDIT: last line between <>
++++++++++++++++++++

(For youtubesearch)
got PYTHONHOME
Python path configuration:
PYTHONHOME = ‘/python/env’
PYTHONPATH = (not set)
program name = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.bin.python38’
isolated = 0
environment = 1
user site = 1
import site = 1
sys.base_executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.bin.python38’
sys.base_prefix = ‘/python/env’
sys.base_exec_prefix = ‘/python/env’
sys.executable = ‘SCSI::240GB_SSD.$.Apps.Video.!Python3.bin.python38’
sys.prefix = ‘/python/env’
sys.exec_prefix = ‘/python/env’
sys.path = [
‘/python/env.python38.lib’,
‘/python/env.python38.lib.lib-dynload’,
]
Fatal Python error: init_fsencoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
ModuleNotFoundError: No module named ‘encodings’

Current thread 0×00298e10 (most recent call first):
no Python frame
EDIT: last line between <>
++++++++++++++++++++++++++++

EDIT: I’d already removed Python27 to a backup directory and also removed it from the ‘Boot-Look at’ sequence.

Can you try this version please?
Will setup a new Pi4 card tomorrow and try it for myself.

If you perform …
pip38 install —upgrade youtube-search-python==1.3.9
… outside YTPlay, is there also an errormessage?

Will setup a new Pi4 card tomorrow and try it for myself.

I’m doing the same – in case there’s something in my setup that is conflicting with Python or associated components. But in order not to disturb my ‘working’ Pi4 I’m building a clean 5.28 card on my networked Pi1, so it may take a while to get back to you with results from the new version. But I appreciate the help!

Update: using PackMan 0.9.5 beta I downloaded and installed Python-38, Python-38-pip, Python-Core and MPlayer on my clean install of 5.28, together with associated SharedLibs etc. I downloaded and installed YTPlay V3.1 RC1 from Raik’s link (above). Right-clicking the YTPlay icon and selecting ‘Install/update youtube-dl’ produced the following error message:

from pip._internal.cli.main import main File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.cli.main/py”, line 73, in main command = create_command(cmd_name, isolated=(“—isolated” in cmd_args)) File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.commands._init__/py”, line 96, in create_command module = importlib.import_module(module_path) File “SDFS::HardDisc0.$.Apps.Development.!Python3.python38.lib.importlib.init”, line 127, in import_module return bootstrap._gcdimport(name[level:], package, level) File “”, line 1014, in _gcd_import File “”, line 991, in _find_and_load File “”, line 975, in _find_and_load_unlocked File “”, line 671, in _load_unlocked File “”, line 827, in exec_module File “”, line 219, in _call_with_frames_removed File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.commands.install/py”, line 24, in from pip.internal.cli.reqcommand import RequirementCommand File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.cli.reqcommand/py”, line 15, in from pip.internal.index.packagefinder import PackageFinder File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.index.packagefinder/py”, line 21, in from pip.internal.index.collector import parselinks File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.index.collector/py”, line 12, in from pip._vendor import html5lib, requests File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.vendor.requests._init__/py”, line 43, in from pip._vendor import urllib3 File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.vendor.urllib3._init__/py”, line 7, in from .connectionpool import HTTPConnectionPool, HTTPSConnectionPool, connection_from_url File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._vendor.urllib3.connectionpool/py”, line 39, in from .response import HTTPResponse File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._vendor.urllib3.response/py”, line 3, in import zlib

ImportError: File not found

I then opened a task window and typed pip38 install —upgrade youtube-dl at the * prompt. That produced this:

Traceback (most recent call last):
File “SDFS::HardDisc0.$.PythonSite.Scripts.pip38”, line 6, in
from pip.internal.cli.main import main
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.cli.main/py”, line 73, in main
command = create_command(cmd_name, isolated=(“—isolated” in cmd_args))
File "SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.commands._init__/py", line 96, in create_command
module = importlib.import_module(module_path)
File “SDFS::HardDisc0.$.Apps.Development.!Python3.python38.lib.importlib.init”, line 127, in import_module
return bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib.bootstrap>", line 1014, in gcd_import
File "<frozen importlib.bootstrap>", line 991, in find_and_load
File "<frozen importlib.bootstrap>", line 975, in find_and_load_unlocked
File "<frozen importlib.bootstrap>", line 671, in load_unlocked
File “”, line 827, in exec_module
File "<frozen importlib.bootstrap>", line 219, in call_with_frames_removed
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._internal.commands.install/py”, line 24, in
from pip.internal.cli.req_command import RequirementCommand
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.cli.reqcommand/py”, line 15, in
from pip.internal.index.package_finder import PackageFinder
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.index.packagefinder/py”, line 21, in
from pip.internal.index.collector import parse_links
File "SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.internal.index.collector/py", line 12, in
from pip.vendor import html5lib, requests
File "SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip.vendor.requests._init__/py", line 43, in
from pip.vendor import urllib3
File "SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._vendor.urllib3._init__/py", line 7, in
from .connectionpool import HTTPConnectionPool, HTTPSConnectionPool, connection_from_url
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._vendor.urllib3.connectionpool/py”, line 39, in
from .response import HTTPResponse
File “SDFS::HardDisc0.$.PythonSite.Python38.Site-Packages.pip._vendor.urllib3.response/py”, line 3, in
import zlib
ImportError: File not found

++++++++++++++++++++++++++=

The only app installed before Python-38, YTPlay, MPlayer etc on this virgin installation of 5.28 was Netsurf, so I’m at a loss to explain the errors.

EDIT: I have NO idea why the first listing runs on, while the second is correctly formatted: they appear identical in the text editor, and I have no idea how to correct it. Apologies to all….

Make sure the following are also installed using PackMan.

LibSSL
LibFFi6
LibBZ2-1.0
ZLib1g
LibLZMA5