From mboxrd@z Thu Jan 1 00:00:00 1970 From: Adolf Belka To: development@lists.ipfire.org Subject: Re: Results from latest test of pakfire-builder Date: Fri, 03 Nov 2023 20:13:46 +0100 Message-ID: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4464449018016183161==" List-Id: --===============4464449018016183161== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi Michael, On 03/11/2023 16:05, Michael Tremer wrote: > Hello Adolf, >=20 >> On 2 Nov 2023, at 14:24, Adolf Belka wrote: >> >> Hi Michael, >> >> On 02/11/2023 09:25, Michael Tremer wrote: >>> Hello Adolf, >>> I have been looking into this in depth and I cannot find a way to make th= e builder work with all its features unless it is running as root. >>> So please add a =E2=80=9Csudo=E2=80=9D to the command line and let me kno= w if that brings you any further. >> >> I "know" sudo is required but for some reason I keep forgetting to use it = with pakfire-builder. Sorry. >=20 > I added a check to the CLI tool which will simply complain if it is not run= ning as root. >=20 > It would have been great if we could generally run pakfire as non-privilege= d users, but there are so many obstacles in the way right now that I do not t= hink that it is a good investment of time to fix those. We are talking about = many weeks of development time, and other things have a higher priority. We w= ill however never get to a point where pakfire will be able to do all the thi= ngs as a non-privileged user than root, because the kernel wouldn=E2=80=99t a= llow it. >=20 >> Maybe a check could be added to give an error if it is being run without r= oot permissions. >=20 > Done. >=20 >> Anyway I will try and not repeat this mistake again. >> >> I have redone a git pull and build etc with the latest pakfire and then re= tried the pakfire-builder build beep/beep.nm command but with sudo. >=20 > Could you run the same thing with strace -o output.log between sudo and pak= fire-builder? >=20 > It looks like something is getting stuck somewhere=E2=80=A6 Just tried the same thing again, but via a different network connection=20 and everything worked completely with no issues. I successfully built beep with no issues, so it looks like everything is=20 working as expected. Not sure what happened with the previous attempt when it seemed to get=20 stuck. I can't go back and try again on that network connection. I also tried building sqlite which failed but that looks to be related=20 to something about sqlite, rather than the pakfire code if I am=20 understanding it correctly. Running build stage 'install' [ 01:08.0316] + '[' -d /build/source/sqlite-autoconf-3430100/ ']' [ 01:08.0316] + cd /build/source/sqlite-autoconf-3430100/ [ 01:08.0316] + mkdir -pv /var/tmp/pakfire-buildroot.X58n6n [ 01:08.0317] + make -O DESTDIR=3D/var/tmp/pakfire-buildroot.X58n6n install [ 01:08.0322] make[1]: Entering directory=20 '/build/source/sqlite-autoconf-3430100' [ 01:08.0326] /usr/bin/mkdir -p=20 '/var/tmp/pakfire-buildroot.X58n6n/usr/lib64' [ 01:08.0328] /bin/sh ./libtool --mode=3Dinstall /usr/bin/install -c=20 libsqlite3.la '/var/tmp/pakfire-buildroot.X58n6n/usr/lib64' [ 01:08.0353] ./libtool: line 3109: 0: Bad file descriptor [ 01:08.0354] make[1]: *** [Makefile:471: install-libLTLIBRARIES] Error 1 [ 01:08.0354] make[1]: Leaving directory=20 '/build/source/sqlite-autoconf-3430100' [ 01:08.0354] make: *** [Makefile:915: install-am] Error 2 Build stage 'install' failed with status 2 Could not build sqlite/sqlite.nm Regards, Adolf. >=20 > -Michael >=20 >> The following occurred: >> >> sudo pakfire-builder build beep/beep.nm >> Package Database: stable 153k 0B/s 100%% >> Package Database: testing [--------------------------] 0 0B/s ETA = : --:--:-- 0% >> >> Nothing further happened after that. It never changed from 0%. >> >> The following was in the logs from the above command and output. >> >> pakfire[12076]: Mounting /var/tmp/pakfire-root-SZSk4U from pakfire_ramdisk= (tmpfs - (null)) >> pakfire[12076]: Ramdisk mounted at /var/tmp/pakfire-root-SZSk4U ((null)) >> pakfire[12076]: Fetching SUBID from /etc/subuid for root >> pakfire[12076]: Fetching SUBID from /etc/subgid for root >> pakfire[12076]: RLIMIT_NOFILE set to 524288 >> pakfire[12076]: Pakfire initialized at 0x55f5470bdf10 >> pakfire[12076]: user =3D root (0) >> pakfire[12076]: group =3D root (0) >> pakfire[12076]: arch =3D x86_64 (x86_64) >> pakfire[12076]: path =3D /var/tmp/pakfire-root-SZSk4U >> pakfire[12076]: Reading configuration >> pakfire[12076]: Reading repository configuration from /var/tmp/pakfire-roo= t-SZSk4U/etc/pakfire/repos >> pakfire[12076]: Distribution: IPFire 3 >> pakfire[12076]: name =3D IPFire >> pakfire[12076]: id =3D ipfire >> pakfire[12076]: version =3D 3 >> pakfire[12076]: version_id =3D 3 >> pakfire[12076]: vendor =3D IPFire Project >> pakfire[12076]: slogan =3D An Open Source Firewall Solution >> pakfire[12076]: Executing database query: PRAGMA foreign_keys =3D ON >> pakfire[12076]: Executing database query: PRAGMA case_sensitive_like =3D ON >> pakfire[12076]: Could not find last modification timestamp >> pakfire[12076]: The database was last modified at 0 >> pakfire[12076]: Executing database query: PRAGMA secure_delete =3D OFF >> pakfire[12076]: Executing database query: PRAGMA journal_mode =3D WAL >> pakfire[12076]: Executing database query: BEGIN TRANSACTION >> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS setti= ngs(key TEXT, val TEXT) >> pakfire[12076]: Executing database query: CREATE UNIQUE INDEX IF NOT EXIST= S settings_key ON settings(key) >> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS packa= ges(id INTEGER PRIMARY KEY, name TEXT, evr = TEXT, arch TEXT, groups TEXT, filename TEXT, size = INTEGER, inst_size INTEGER, digest_type INTEGER, digest = BLOB, license TEXT, summary TEXT, description TEX= T, uuid TEXT, vendor TEXT, build_host TEXT, build_ti= me INTEGER, installed INTEGER, userinstalled INTEGER, repository= TEXT, source_name TEXT, source_evr TEXT, source_arch TEXT,= distribution TEXT) >> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS packa= ges_name ON packages(name) >> pakfire[12076]: Executing database query: CREATE UNIQUE INDEX IF NOT EXIST= S packages_uuid ON packages(uuid) >> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS depen= dencies(pkg INTEGER, type TEXT, dependency TEXT, FOREIGN= KEY (pkg) REFERENCES packages(id) ON DELETE CASCADE) >> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS depen= dencies_pkg_index ON dependencies(pkg) >> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS files= (id INTEGER PRIMARY KEY, path TEXT, pkg = INTEGER, size INTEGER, config INTEGER, datafile IN= TEGER, mode INTEGER, uname TEXT, gname TEXT,= ctime INTEGER, mtime INTEGER, mimetype TEXT,= capabilities TEXT, digest_sha2_512 BLOB, digest_sha2_256 BLOB, dige= st_blake2b512 BLOB, digest_blake2s256 BLOB, digest_sha3_512 BLOB, digest_sh= a3_256 BLOB, FOREIGN KEY (pkg) REFERENCES packages(id) ON DELETE CASCADE) >> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS files= _pkg_index ON files(pkg) >> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS files= _path_index ON files(path) >> pakfire[12076]: Executing database query: CREATE TABLE IF NOT EXISTS scrip= tlets(id INTEGER PRIMARY KEY, pkg INTEGER, type = TEXT, scriptlet TEXT, FOREIGN KEY (pkg) REFERENCES packages(id) ON D= ELETE CASCADE) >> pakfire[12076]: Executing database query: CREATE INDEX IF NOT EXISTS scrip= tlets_pkg_index ON scriptlets(pkg) >> pakfire[12076]: Setting arch to 'x86_64' >> pakfire[12076]: Setting schema to '8' >> pakfire[12076]: Setting last_modified_at to '1698931504' >> pakfire[12076]: Executing database query: COMMIT >> pakfire[12076]: Loading package database... >> pakfire[12076]: Loading package database completed in 0.2360ms >> pakfire[12076]: Executing database query: PRAGMA optimize >> pakfire[12076]: Executing database query: PRAGMA wal_checkpoint =3D TRUNCA= TE >> pakfire[12076]: Creating repository stable >> pakfire[12076]: Creating repository testing >> pakfire[12076]: Creating repository local >> pakfire[12076]: Repository URL updated: >> pakfire[12076]: From: https://pakfire.ipfire.org/files/repos/ipfire-3/st= able/%{arch}/ >> pakfire[12076]: To : https://pakfire.ipfire.org/files/repos/ipfire-3/st= able/x86_64/ >> pakfire[12076]: Reading repository metadata from /root/.cache/pakfire/ipfi= re/3/x86_64/stable/repodata/repomd.json... >> pakfire[12076]: Read package database from /root/.cache/pakfire/ipfire/3/x= 86_64/stable/repodata/2023-11-01-1226.1698841581.solv.zst... >> pakfire[12076]: pool: repo_add_solv took 8 ms >> pakfire[12076]: pool: repo size: 15 solvables >> pakfire[12076]: pool: repo memory used: 5 K incore, 1 K idarray >> pakfire[12076]: Repository URL updated: >> pakfire[12076]: From: https://pakfire.ipfire.org/files/repos/ipfire-3/te= sting/%{arch}/ >> pakfire[12076]: To : https://pakfire.ipfire.org/files/repos/ipfire-3/te= sting/x86_64/ >> pakfire[12076]: Reading repository metadata from /root/.cache/pakfire/ipfi= re/3/x86_64/testing/repodata/repomd.json... >> >> >> Nothing further after that last line until I pressed Ctrl C after about 2 = minutes. >> >> Here are the contents of the directories mentioned for the stable and test= ing repos. >> >> >> ls -hal /root/.cache/pakfire/ipfire/3/x86_64/stable/repodata/ >> total 168K >> drwxr-xr-x 2 root root 4.0K Nov 2 14:25 . >> drwxr-xr-x 3 root root 4.0K Nov 2 14:25 .. >> -rw------- 1 root root 153K Nov 2 14:25 2023-11-01-1226.1698841581.solv.z= st >> -rw------- 1 root root 94 Nov 2 14:25 repomd.json >> >> >> ls -hal /root/.cache/pakfire/ipfire/3/x86_64/testing/repodata/ >> total 12K >> drwxr-xr-x 2 root root 4.0K Nov 2 14:25 . >> drwxr-xr-x 3 root root 4.0K Nov 2 14:25 .. >> -rw------- 1 root root 94 Nov 2 14:25 repomd.json >> >> >> Hope the above helps. If anything more info required just let me know. >> >> Regards, >> Adolf. >> >>> -Michael >>>> On 30 Oct 2023, at 17:56, Adolf Belka wrote: >>>> >>>> Hi Michael, >>>> >>>> On 30/10/2023 11:01, Michael Tremer wrote: >>>>> Hello Adolf, >>>>> Thanks for giving this a try. Is there anything in the logs? >>>> >>>> In the forum I always remind people to look at the logs. On my Arch Linu= x systems I always search through the logs when I have a problem. >>>> >>>> For some reason with this pakfire package I seem to forget to look in th= e logs. >>>> >>>> Here is what I found when running pakfire-builder build beep/beep.nm (ad= ding --debug made no difference) >>>> >>>> pakfire[2137]: Mounting /var/tmp/pakfire-root-KRBTNG from pakfire_ramdis= k (tmpfs - (null)) >>>> pakfire[2137]: Could not mount /var/tmp/pakfire-root-KRBTNG: Operation n= ot permitted >>>> pakfire[2137]: Could not mount ramdisk at /var/tmp/pakfire-root-KRBTNG (= (null)): Unknown error -1 >>>> >>>> Regards, >>>> >>>> Adolf. >>>> >>>>> You can add =E2=80=94-debug to get some more output. >>>>> Best, >>>>> -Michael >>>>>> On 29 Oct 2023, at 13:23, Adolf Belka wrote: >>>>>> >>>>>> Hi All, >>>>>> >>>>>> I updated my pakfire branch by doing a git pull with all the latest ch= anges and built everything again. >>>>>> >>>>>> Then tested out by running sudo pakfire-builder build beep/beep.nm >>>>>> >>>>>> Result was again just going to the prompt with nothing happening. >>>>>> >>>>>> Ran the commands with gdb and got following result. >>>>>> >>>>>> sudo gdb pakfire-builder >>>>>> GNU gdb (GDB) 13.2 >>>>>> Copyright (C) 2023 Free Software Foundation, Inc. >>>>>> License GPLv3+: GNU GPL version 3 or later >>>>>> This is free software: you are free to change and redistribute it. >>>>>> There is NO WARRANTY, to the extent permitted by law. >>>>>> Type "show copying" and "show warranty" for details. >>>>>> This GDB was configured as "x86_64-pc-linux-gnu". >>>>>> Type "show configuration" for configuration details. >>>>>> For bug reporting instructions, please see: >>>>>> . >>>>>> Find the GDB manual and other documentation resources online at: >>>>>> . >>>>>> >>>>>> For help, type "help". >>>>>> Type "apropos word" to search for commands related to "word"... >>>>>> Reading symbols from pakfire-builder... >>>>>> (gdb) run build beep/beep.nm >>>>>> Starting program: /usr/bin/pakfire-builder build beep/beep.nm >>>>>> [Thread debugging using libthread_db enabled] >>>>>> Using host libthread_db library "/usr/lib/libthread_db.so.1". >>>>>> [New Thread 0x7ffff57dd6c0 (LWP 12756)] >>>>>> [Thread 0x7ffff57dd6c0 (LWP 12756) exited] >>>>>> [Inferior 1 (process 12752) exited with code 0377] >>>>>> (gdb) >>>>>> >>>>>> >>>>>> Regards, >>>>>> Adolf. >>>>>> >>>>>> --=20 >>>>>> Sent from my laptop >>>>>> >>>> >>>> --=20 >>>> Sent from my laptop >> >> --=20 >> Sent from my laptop >=20 >=20 --=20 Sent from my laptop --===============4464449018016183161==--