From mboxrd@z Thu Jan 1 00:00:00 1970 From: Adolf Belka To: development@lists.ipfire.org Subject: Re: Results from latest test of pakfire-builder Date: Mon, 27 Nov 2023 09:54:55 +0100 Message-ID: <885cc767-5dc6-43ef-ac6d-52dad5e60886@ipfire.org> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3818996184769252866==" List-Id: --===============3818996184769252866== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi Michael, I decided to try some further update building with IPFire-3.x I tried running an update for xz but it also came up with the ./libtool .... = Bad file descriptor error message as I had with sqlite and described in the p= revious response below. I then restored the nm file and retried the build of xz again. Got the same l= ibtool error. I then tried xfsprogs without any change to the nm file and also got the libt= ool error. I then tried xxhash and it built successfully. So far I have beep and xxhash building successfully and sqlite, xz and xfsprogs having the same libtool error. All above builds were run using sudo :-)) It would be interesting to see if you also get that libtool response with bui= lding sqlite, xz or xfsprogs or if it is something specific about my Arch Lin= ux setup. Regards, Adolf. On 03/11/2023 20:13, Adolf Belka wrote: > Hi Michael, > > On 03/11/2023 16:05, Michael Tremer wrote: >> Hello Adolf, >> >>> On 2 Nov 2023, at 14:24, Adolf Belka wrote: >>> >>> Hi Michael, >>> >>> On 02/11/2023 09:25, Michael Tremer wrote: >>>> Hello Adolf, >>>> I have been looking into this in depth and I cannot find a way to make t= he builder work with all its features unless it is running as root. >>>> So please add a =E2=80=9Csudo=E2=80=9D to the command line and let me kn= ow if that brings you any further. >>> >>> I "know" sudo is required but for some reason I keep forgetting to use it= with pakfire-builder. Sorry. >> >> I added a check to the CLI tool which will simply complain if it is not ru= nning as root. >> >> It would have been great if we could generally run pakfire as non-privileg= ed users, but there are so many obstacles in the way right now that I do not = think that it is a good investment of time to fix those. We are talking about= many weeks of development time, and other things have a higher priority. We = will however never get to a point where pakfire will be able to do all the th= ings as a non-privileged user than root, because the kernel wouldn=E2=80=99t = allow it. >> >>> Maybe a check could be added to give an error if it is being run without = root permissions. >> >> Done. >> >>> Anyway I will try and not repeat this mistake again. >>> >>> I have redone a git pull and build etc with the latest pakfire and then r= etried the pakfire-builder build beep/beep.nm command but with sudo. >> >> Could you run the same thing with strace -o output.log between sudo and pa= kfire-builder? >> >> It looks like something is getting stuck somewhere=E2=80=A6 > > Just tried the same thing again, but via a different network connection and= everything worked completely with no issues. > > I successfully built beep with no issues, so it looks like everything is wo= rking as expected. > > Not sure what happened with the previous attempt when it seemed to get stuc= k. I can't go back and try again on that network connection. > > I also tried building sqlite which failed but that looks to be related to s= omething about sqlite, rather than the pakfire code if I am understanding it = correctly. > > Running build stage 'install' > [=C2=A0=C2=A0 01:08.0316] + '[' -d /build/source/sqlite-autoconf-3430100/ '= ]' > [=C2=A0=C2=A0 01:08.0316] + cd /build/source/sqlite-autoconf-3430100/ > [=C2=A0=C2=A0 01:08.0316] + mkdir -pv /var/tmp/pakfire-buildroot.X58n6n > [=C2=A0=C2=A0 01:08.0317] + make -O DESTDIR=3D/var/tmp/pakfire-buildroot.X5= 8n6n install > [=C2=A0=C2=A0 01:08.0322] make[1]: Entering directory '/build/source/sqlite= -autoconf-3430100' > [=C2=A0=C2=A0 01:08.0326]=C2=A0 /usr/bin/mkdir -p '/var/tmp/pakfire-buildro= ot.X58n6n/usr/lib64' > [=C2=A0=C2=A0 01:08.0328]=C2=A0 /bin/sh ./libtool=C2=A0=C2=A0 --mode=3Dinst= all /usr/bin/install -c =C2=A0libsqlite3.la '/var/tmp/pakfire-buildroot.X58n6= n/usr/lib64' > [=C2=A0=C2=A0 01:08.0353] ./libtool: line 3109: 0: Bad file descriptor > [=C2=A0=C2=A0 01:08.0354] make[1]: *** [Makefile:471: install-libLTLIBRARIE= S] Error 1 > [=C2=A0=C2=A0 01:08.0354] make[1]: Leaving directory '/build/source/sqlite-= autoconf-3430100' > [=C2=A0=C2=A0 01:08.0354] make: *** [Makefile:915: install-am] Error 2 > Build stage 'install' failed with status 2 > Could not build sqlite/sqlite.nm > > > Regards, > > Adolf. > >> >> -Michael >> >>> The following occurred: >>> >>> sudo pakfire-builder build beep/beep.nm >>> Package Database: stable 153k=C2=A0=C2=A0=C2=A0=C2=A0 0B/s 100%% >>> Package Database: testing [--------------------------] 0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 0B/s ETA=C2=A0 : --:--:--=C2=A0=C2=A0 0% >>> >>> Nothing further happened after that. It never changed from 0%. >>> >>> The following was in the logs from the above command and output. >>> >>> pakfire[12076]: Mounting /var/tmp/pakfire-root-SZSk4U from pakfire_ramdis= k (tmpfs - (null)) >>> pakfire[12076]: Ramdisk mounted at /var/tmp/pakfire-root-SZSk4U ((null)) >>> pakfire[12076]: Fetching SUBID from /etc/subuid for root >>> pakfire[12076]: Fetching SUBID from /etc/subgid for root >>> pakfire[12076]: RLIMIT_NOFILE set to 524288 >>> pakfire[12076]: Pakfire initialized at 0x55f5470bdf10 >>> pakfire[12076]:=C2=A0=C2=A0 user=C2=A0=C2=A0 =3D root (0) >>> pakfire[12076]:=C2=A0=C2=A0 group=C2=A0 =3D root (0) >>> pakfire[12076]:=C2=A0=C2=A0 arch=C2=A0=C2=A0 =3D x86_64 (x86_64) >>> pakfire[12076]:=C2=A0=C2=A0 path=C2=A0=C2=A0 =3D /var/tmp/pakfire-root-SZ= Sk4U >>> pakfire[12076]: Reading configuration >>> pakfire[12076]: Reading repository configuration from /var/tmp/pakfire-ro= ot-SZSk4U/etc/pakfire/repos >>> pakfire[12076]:=C2=A0=C2=A0 Distribution: IPFire 3 >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 name=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 =3D IPFire >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 id=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 =3D ipfire >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 version=C2=A0=C2=A0=C2=A0 =3D 3 >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 version_id =3D 3 >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 vendor=C2=A0=C2=A0=C2=A0=C2=A0 = =3D IPFire Project >>> pakfire[12076]:=C2=A0=C2=A0=C2=A0=C2=A0 slogan=C2=A0=C2=A0=C2=A0=C2=A0 = =3D An Open Source Firewall Solution >>> pakfire[12076]: Executing database query: PRAGMA foreign_keys =3D ON >>> pakfire[12076]: Executing database query: PRAGMA case_sensitive_like =3D = ON >>> pakfire[12076]: Could not find last modification timestamp >>> pakfire[12076]: The database was last modified at 0 >>> pakfire[12076]: Executing database query: PRAGMA secure_delete =3D OFF >>> pakfire[12076]: Executing database query: PRAGMA journal_mode =3D WAL >>> pakfire[12076]: Executing database query: BEGIN TRANSACTION >>> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS sett= ings(key TEXT, val TEXT) >>> pakfire[12076]: Executing database query: CREATE UNIQUE INDEX IF NOT EXIS= TS settings_key ON settings(key) >>> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS pack= ages(id=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 INTEGER PRIMARY KEY, name=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 TEXT, evr=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 TEXT, arch TEXT, groups=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, filename=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT= , size=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTE= GER, inst_size=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, digest_type=C2=A0= =C2=A0=C2=A0=C2=A0 INTEGER, digest=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 BLOB, license TEXT, summary=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 TEXT, description=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, uuid=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, vendor=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, build_host TEXT, build_ti= me=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, installed=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 INTEGER, userinstalled=C2=A0=C2=A0 INTEGER, repository=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 TEXT, source_name TEXT, source_evr=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 TEXT, source_arch=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, distribution=C2=A0= =C2=A0=C2=A0 TEXT) >>> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS pack= ages_name ON packages(name) >>> pakfire[12076]: Executing database query: CREATE UNIQUE INDEX IF NOT EXIS= TS packages_uuid ON packages(uuid) >>> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS depe= ndencies(pkg=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 INTEGER, type TEXT, dependency TEXT, FOREIGN KEY (pkg) REFERENCES package= s(id) ON DELETE CASCADE) >>> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS depe= ndencies_pkg_index ON dependencies(pkg) >>> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS file= s(id=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 INTEGER PRIMARY KEY, path=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, pkg=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, size= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 INTEGER, config INTEGER, datafile INTEGER, mode=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, uname=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, gname=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, ctime=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, mtime= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 INTEGER, m= imetype=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, capabilit= ies=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 TEXT, digest_sha2_512=C2=A0=C2=A0 BLOB, dig= est_sha2_256=C2=A0=C2=A0 BLOB, digest_blake2b512 BLOB, digest_blake2s256 BLOB= , digest_sha3_512=C2=A0=C2=A0 BLOB, digest_sha3_256=C2=A0=C2=A0 BLOB, FOREIGN= KEY (pkg) REFERENCES packages(id) ON DELETE CASCADE) >>> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS file= s_pkg_index ON files(pkg) >>> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS file= s_path_index ON files(path) >>> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS scri= ptlets(id=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 INTEGER PRIMARY KEY, pkg=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 INTEGER, type=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 TEXT, scriptlet TEXT, FOREIGN KEY (pkg) REFERENCES package= s(id) ON DELETE CASCADE) >>> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS scri= ptlets_pkg_index ON scriptlets(pkg) >>> pakfire[12076]: Setting arch to 'x86_64' >>> pakfire[12076]: Setting schema to '8' >>> pakfire[12076]: Setting last_modified_at to '1698931504' >>> pakfire[12076]: Executing database query: COMMIT >>> pakfire[12076]: Loading package database... >>> pakfire[12076]: Loading package database completed in 0.2360ms >>> pakfire[12076]: Executing database query: PRAGMA optimize >>> pakfire[12076]: Executing database query: PRAGMA wal_checkpoint =3D TRUNC= ATE >>> pakfire[12076]: Creating repository stable >>> pakfire[12076]: Creating repository testing >>> pakfire[12076]: Creating repository local >>> pakfire[12076]: Repository URL updated: >>> pakfire[12076]:=C2=A0=C2=A0 From: https://pakfire.ipfire.org/files/repos/= ipfire-3/stable/%{arch}/ >>> pakfire[12076]:=C2=A0=C2=A0 To=C2=A0 : https://pakfire.ipfire.org/files/r= epos/ipfire-3/stable/x86_64/ >>> pakfire[12076]: Reading repository metadata from /root/.cache/pakfire/ipf= ire/3/x86_64/stable/repodata/repomd.json... >>> pakfire[12076]: Read package database from /root/.cache/pakfire/ipfire/3/= x86_64/stable/repodata/2023-11-01-1226.1698841581.solv.zst... >>> pakfire[12076]: pool: repo_add_solv took 8 ms >>> pakfire[12076]: pool: repo size: 15 solvables >>> pakfire[12076]: pool: repo memory used: 5 K incore, 1 K idarray >>> pakfire[12076]: Repository URL updated: >>> pakfire[12076]:=C2=A0=C2=A0 From: https://pakfire.ipfire.org/files/repos/= ipfire-3/testing/%{arch}/ >>> pakfire[12076]:=C2=A0=C2=A0 To=C2=A0 : https://pakfire.ipfire.org/files/r= epos/ipfire-3/testing/x86_64/ >>> pakfire[12076]: Reading repository metadata from /root/.cache/pakfire/ipf= ire/3/x86_64/testing/repodata/repomd.json... >>> >>> >>> Nothing further after that last line until I pressed Ctrl C after about 2= minutes. >>> >>> Here are the contents of the directories mentioned for the stable and tes= ting repos. >>> >>> >>> ls -hal /root/.cache/pakfire/ipfire/3/x86_64/stable/repodata/ >>> total 168K >>> drwxr-xr-x 2 root root 4.0K Nov=C2=A0 2 14:25 . >>> drwxr-xr-x 3 root root 4.0K Nov=C2=A0 2 14:25 .. >>> -rw------- 1 root root 153K Nov=C2=A0 2 14:25 2023-11-01-1226.1698841581.= solv.zst >>> -rw------- 1 root root=C2=A0=C2=A0 94 Nov=C2=A0 2 14:25 repomd.json >>> >>> >>> ls -hal /root/.cache/pakfire/ipfire/3/x86_64/testing/repodata/ >>> total 12K >>> drwxr-xr-x 2 root root 4.0K Nov=C2=A0 2 14:25 . >>> drwxr-xr-x 3 root root 4.0K Nov=C2=A0 2 14:25 .. >>> -rw------- 1 root root=C2=A0=C2=A0 94 Nov=C2=A0 2 14:25 repomd.json >>> >>> >>> Hope the above helps. If anything more info required just let me know. >>> >>> Regards, >>> Adolf. >>> >>>> -Michael >>>>> On 30 Oct 2023, at 17:56, Adolf Belka wrote: >>>>> >>>>> Hi Michael, >>>>> >>>>> On 30/10/2023 11:01, Michael Tremer wrote: >>>>>> Hello Adolf, >>>>>> Thanks for giving this a try. Is there anything in the logs? >>>>> >>>>> In the forum I always remind people to look at the logs. On my Arch Lin= ux systems I always search through the logs when I have a problem. >>>>> >>>>> For some reason with this pakfire package I seem to forget to look in t= he logs. >>>>> >>>>> Here is what I found when running pakfire-builder build beep/beep.nm (a= dding --debug made no difference) >>>>> >>>>> pakfire[2137]: Mounting /var/tmp/pakfire-root-KRBTNG from pakfire_ramdi= sk (tmpfs - (null)) >>>>> pakfire[2137]: Could not mount /var/tmp/pakfire-root-KRBTNG: Operation = not permitted >>>>> pakfire[2137]: Could not mount ramdisk at /var/tmp/pakfire-root-KRBTNG = ((null)): Unknown error -1 >>>>> >>>>> Regards, >>>>> >>>>> Adolf. >>>>> >>>>>> You can add =E2=80=94-debug to get some more output. >>>>>> Best, >>>>>> -Michael >>>>>>> On 29 Oct 2023, at 13:23, Adolf Belka wrot= e: >>>>>>> >>>>>>> Hi All, >>>>>>> >>>>>>> I updated my pakfire branch by doing a git pull with all the latest c= hanges and built everything again. >>>>>>> >>>>>>> Then tested out by running sudo pakfire-builder build beep/beep.nm >>>>>>> >>>>>>> Result was again just going to the prompt with nothing happening. >>>>>>> >>>>>>> Ran the commands with gdb and got following result. >>>>>>> >>>>>>> sudo gdb pakfire-builder >>>>>>> GNU gdb (GDB) 13.2 >>>>>>> Copyright (C) 2023 Free Software Foundation, Inc. >>>>>>> License GPLv3+: GNU GPL version 3 or later >>>>>>> This is free software: you are free to change and redistribute it. >>>>>>> There is NO WARRANTY, to the extent permitted by law. >>>>>>> Type "show copying" and "show warranty" for details. >>>>>>> This GDB was configured as "x86_64-pc-linux-gnu". >>>>>>> Type "show configuration" for configuration details. >>>>>>> For bug reporting instructions, please see: >>>>>>> . >>>>>>> Find the GDB manual and other documentation resources online at: >>>>>>> . >>>>>>> >>>>>>> For help, type "help". >>>>>>> Type "apropos word" to search for commands related to "word"... >>>>>>> Reading symbols from pakfire-builder... >>>>>>> (gdb) run build beep/beep.nm >>>>>>> Starting program: /usr/bin/pakfire-builder build beep/beep.nm >>>>>>> [Thread debugging using libthread_db enabled] >>>>>>> Using host libthread_db library "/usr/lib/libthread_db.so.1". >>>>>>> [New Thread 0x7ffff57dd6c0 (LWP 12756)] >>>>>>> [Thread 0x7ffff57dd6c0 (LWP 12756) exited] >>>>>>> [Inferior 1 (process 12752) exited with code 0377] >>>>>>> (gdb) >>>>>>> >>>>>>> >>>>>>> Regards, >>>>>>> Adolf. >>>>>>> >>>>>>> --=20 >>>>>>> Sent from my laptop >>>>>>> >>>>> >>>>> --=20 >>>>> Sent from my laptop >>> >>> --=20 >>> Sent from my laptop >> >> > --===============3818996184769252866==--