Re: Question about updating python to 3.10

[Adolf Belka <adolf.belka@ipfire.org>]

[-- Attachment #1: Type: text/plain, Size: 4497 bytes --]

Hi Michael,

On 17/12/2021 12:41, Michael Tremer wrote:
> Hello Adolf,
> 
>> On 17 Dec 2021, at 11:55, Adolf Belka <adolf.belka(a)ipfire.org> wrote:
>>
>> Hi All,
>>
>>
>> I am working on updating python from 3.8 to 3.10. Python itself is okay after some other python related programs were also updated due to their older versions not working with 3.10
> 
> Thank you for working on this.
> 
>> I am working through all the programs that reference python-3.8 in their rootfiles, or wherever, to change them to 3.10
>>
>> My question comes with regard to the changes to the rootfiles to ensure they will be included properly in an update.
> 
> We will have to ship everything that puts anything into /usr/lib*/python3.*/site-packages again with the release of Python 3.10.
> 
> This isn’t fun, but not as much of a pain in the rear as shipping a new Perl release.
> 
>> For the addons then when I change the rootfile I am also incrementing the PAK_VER number in the lfs files and that ensures that they will be properly updated.
> 
> Yes. That is required for Pakfire to find a new version.
> 
>> I don't know what to do for the core programs where I have updated the rootfile. The lfs files for these programs don't have a PAK_VER number to increment and the actual package version number is not being changed so I don't know what I need to change in the lfs to ensure that the rootfile changes will be properly included in the update?
> 
> I would say committing everything into a “python-3.10” branch and submitting it all as a patchset is fine. All packages that have been touched in that branch will have to be shipped again which should be easy to identify if it all comes in one large branch.
Okay, that is clear then.Will follow that approach.
> 
>> I would appreciate any help on what I need to do for these programs that have had changes only in their rootfiles.
> 
> Absolutely. Did you find anything that didn’t build yet?

I have not had any problem with python3.10 itself but I found some of 
the older modules would not work with 3.10 so I decided to do a combined 
update to 3.10 plus update modules to latest versions.

I found that after python3-setuptools-scm had run that the next module 
python3-six failed to run due to missing the tomli library. I commented 
out six and reran the build and then python3-dateutil had the same 
problem  and then python3-jmespath

After some investigation I have found that since version 6.0.0 of 
python3-setuptools-scm, tomli has been a required library when it is 
being used by other modules. So running version 6.0.0 of setuptools-scm 
worked with python3.10 and subsequent modules built successfully as 
tomli not needed.

So the obvious fix is to install tomli but that is when I ran into a 
problem. tomli has no setup.py or setup.cfg files in its tarball. The 
only way to build it is using pip.

Apparently, after some searching, setup.py has been deprecated as the 
recommended install method and if setup.py doesn't work the usual fix 
suggestion is to run pip install.


Having searched on pip for a while, it looks like builds using it can 
still be done from tarballs locally without needing to access the 
internet to download the modules.

As pip is installed as part of python3 i tried using that.

I used "python3 -m pip install --root=/ ."  in place of
"python3 setup.py build
  python3 setup.py install --root=/"
for the tomli source.

This failed because tomli requires flit_core to be available.

flit_core also has no setup.py and so I tried to build it with pip 
install. This failed with the error message that tomli was required as a 
dependency. So I added --no-deps to the flit_core pip install line and 
this time flit_core successfully built but the tomli build still came 
back with not finding flit_core.

I have tried a variety of changes to the pip install line but none of 
them has been successful and it has become clear that I am out of my 
depth here and need guidance rather than just trying anything I find 
from a google search. I am not even really clear if pip install is the 
correct approach, except if not then I have no idea how to progress.

Help urgently needed on how I should be approaching this.

Regards,
Adolf.

PS:  I hope everyone had an enjoyable Christmas.


> 
> -Michael
> 
>>
>> Regards,
>>
>> Adolf.
>>
>> -- 
>> Sent from my laptop
>>
> 

-- 
Sent from my laptop