Development February 2021

development@lists.ipfire.org

15 participants
89 discussions

Re: Fireperf: first tests an results
by daniel.weismueller＠ipfire.org 11 Feb '21

11 Feb '21

and again a few results: I configured an OpenVPN N2N and run fireperf through it. Serverside: IPFire Core 153; Intel Xeon 1265L V2; Intel 82580 4x 1GBit Nic; Vodafone GigaCable 1000 MBit down / 50 MBit up Clientside: IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic; Vodafone ADSL2 16MBit down / 1 MBit up Server: fireperf -s -P 10000 -p 63000:63010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~22 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~165-180 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~165-180 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~165-180 cps On both sides the CPU utilization was 1-3%. - Daniel 10. Februar 2021 10:51, daniel.weismueller(a)ipfire.org (mailto:daniel.weismueller@ipfire.org) schrieb: A few more results: I've installed a VM on my Test-IPFire and run the fireperf-server on it. server: Debian 10.8 QEMU VM 4 cores on IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic So here my results: Server: fireperf -s -P 10000 -p 63000:63010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~4000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~22000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~52000-53000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~52000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~52000 cps The cpu utilization within the VM was limited to 2 cores and increased in sync with the cps. In my last test, the utilization was about 55% on both cores on the server. The cpu utilization on the host was limited to 2 cores and increased in sync with the cps. In my last test, the utilization of ther server was about 100% on 2 cores and about 50% on an third core. The cpu utilization on the client was limited to 2 cores and increased in sync with the cps. In my last test, the utilization was about 75% on one core. Because the measurement results with the VM differed significantly from the previous native ones, I rebooted my Test-IPFire and repeated the native tests. These are now more plausible. I think the reboot was probably necessary. ;-) Here are the new results: server: IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic Server: fireperf -s -P 10000 -p 63000:63010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~6000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~35000-40000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~53000-54000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~53000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~52000 cps The cpu utilization was limited to one core and increased in sync with the cps on both sides. In the last test, the utilization of one core was about 85-100% on the server and 75% on the client. We see a very significant increase of the cpu utilization (+150%) on the server. Between running the server natively or in a VM. And also a reduction of the cps by 30% with only one connection and up to 55% with 10 connections. From 100 connections, the bottleneck is obviously somewhere else. - Daniel 10. Februar 2021 08:49, daniel.weismueller(a)ipfire.org (mailto:daniel.weismueller@ipfire.org) schrieb: Another day another result. I've testet my old Raspberry Pi 3 B. ;-) server: IPFire Core 154; Raspberry Pi 3 B; integrated Microchip LAN9514 100 MBit Nic Client: Debian 10.8; Lenovo T440; Intel i5-4300U; Intel I218-LM 1GBit Nic Here are the results: Server: fireperf -s -P 10000 -p 63000:630010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~1000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> crashed and the Pi needs a reboot The cpu utilization was limited to one core. In all my tests, the utilization was about 35-55% on the server and 10-15% on the client. It is noticeable that the Pi could never load a core to 100%. Therefore, the bottleneck must lie somewhere else. In the next days I will test our mini and post the results here. - Daniel 9. Februar 2021 13:53, daniel.weismueller(a)ipfire.org (mailto:daniel.weismueller@ipfire.org) schrieb: Hi guys, today I installed fireperf on my testing IPFire and my Ubuntu PC. server: IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic Michael and I agreed that one more port should be opened per 5000 expected connection per second (cps) So here my results: Server: fireperf -s -P 10000 -p 63000:630010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~5000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~30000-35000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~35000-40000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~40000-45000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~46000-48000 cps The cpu utilization was limited to one core and increased in sync with the cps on both sides. In my last test, the utilization was about 85-100% on the server and 75-95% on the client. In the next days I will test our mini and post the results here. - Daniel

1 0

Re: Fireperf: first tests an results
by daniel.weismueller＠ipfire.org 11 Feb '21

11 Feb '21

A few more results: I've installed a VM on my Test-IPFire and run the fireperf-server on it. server: Debian 10.8 QEMU VM 4 cores on IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic So here my results: Server: fireperf -s -P 10000 -p 63000:63010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~4000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~22000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~52000-53000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~52000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~52000 cps The cpu utilization within the VM was limited to 2 cores and increased in sync with the cps. In my last test, the utilization was about 55% on both cores on the server. The cpu utilization on the host was limited to 2 cores and increased in sync with the cps. In my last test, the utilization of ther server was about 100% on 2 cores and about 50% on an third core. The cpu utilization on the client was limited to 2 cores and increased in sync with the cps. In my last test, the utilization was about 75% on one core. Because the measurement results with the VM differed significantly from the previous native ones, I rebooted my Test-IPFire and repeated the native tests. These are now more plausible. I think the reboot was probably necessary. ;-) Here are the new results: server: IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic Server: fireperf -s -P 10000 -p 63000:63010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~6000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~35000-40000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~53000-54000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~53000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~52000 cps The cpu utilization was limited to one core and increased in sync with the cps on both sides. In the last test, the utilization of one core was about 85-100% on the server and 75% on the client. We see a very significant increase of the cpu utilization (+150%) on the server. Between running the server natively or in a VM. And also a reduction of the cps by 30% with only one connection and up to 55% with 10 connections. From 100 connections, the bottleneck is obviously somewhere else. - Daniel 10. Februar 2021 08:49, daniel.weismueller(a)ipfire.org (mailto:daniel.weismueller@ipfire.org) schrieb: Another day another result. I've testet my old Raspberry Pi 3 B. ;-) server: IPFire Core 154; Raspberry Pi 3 B; integrated Microchip LAN9514 100 MBit Nic Client: Debian 10.8; Lenovo T440; Intel i5-4300U; Intel I218-LM 1GBit Nic Here are the results: Server: fireperf -s -P 10000 -p 63000:630010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~1000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~500-1500 cps strongly fluctuating fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> crashed and the Pi needs a reboot The cpu utilization was limited to one core. In all my tests, the utilization was about 35-55% on the server and 10-15% on the client. It is noticeable that the Pi could never load a core to 100%. Therefore, the bottleneck must lie somewhere else. In the next days I will test our mini and post the results here. - Daniel 9. Februar 2021 13:53, daniel.weismueller(a)ipfire.org (mailto:daniel.weismueller@ipfire.org) schrieb: Hi guys, today I installed fireperf on my testing IPFire and my Ubuntu PC. server: IPFire Core 154; Intel i7 4790; Intel 82571EB/GB 1GBit Nic Client: Ubuntu 20.4; Intel i7 9700; Intel i219-V 1GBit Nic Michael and I agreed that one more port should be opened per 5000 expected connection per second (cps) So here my results: Server: fireperf -s -P 10000 -p 63000:630010 Client: fireperf -c <IP address> -P 1 -x -p 63000:63010 -> ~5000 cps fireperf -c <IP address> -P 10 -x -p 63000:63010 -> ~30000-35000 cps fireperf -c <IP address> -P 100 -x -p 63000:63010 -> ~35000-40000 cps fireperf -c <IP address> -P 1000 -x -p 63000:63010 -> ~40000-45000 cps fireperf -c <IP address> -P 10000 -x -p 63000:63010 -> ~46000-48000 cps The cpu utilization was limited to one core and increased in sync with the cps on both sides. In my last test, the utilization was about 85-100% on the server and 75-95% on the client. In the next days I will test our mini and post the results here. - Daniel

1 0

[PATCH 2/2] python-xattr: Removal of addon
by Adolf Belka 10 Feb '21

10 Feb '21

- Update of attr causes current version of python-xattr to fail to build - Following input from Michael Tremer - This package was orihinally required for pakfire 3 which no longer depends on it - This is a python 2 module. Python 2 is EOL - lfs and rootfile removed from IPFire - make.sh updated to remove python-xattr entry Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- config/rootfiles/packages/python-xattr | 2 - lfs/python-xattr | 82 -------------------------- make.sh | 1 - 3 files changed, 85 deletions(-) delete mode 100644 config/rootfiles/packages/python-xattr delete mode 100644 lfs/python-xattr diff --git a/config/rootfiles/packages/python-xattr b/config/rootfiles/packages/python-xattr deleted file mode 100644 index 747ff5c2a..000000000 --- a/config/rootfiles/packages/python-xattr +++ /dev/null @@ -1,2 +0,0 @@ -usr/lib/python2.7/site-packages/pyxattr-0.5.0-py2.7.egg-info -usr/lib/python2.7/site-packages/xattr.so diff --git a/lfs/python-xattr b/lfs/python-xattr deleted file mode 100644 index a77d22a91..000000000 --- a/lfs/python-xattr +++ /dev/null @@ -1,82 +0,0 @@ -############################################################################### -# # -# IPFire.org - A linux based firewall # -# Copyright (C) 2007-2018 IPFire Team <info(a)ipfire.org> # -# # -# This program is free software: you can redistribute it and/or modify # -# it under the terms of the GNU General Public License as published by # -# the Free Software Foundation, either version 3 of the License, or # -# (at your option) any later version. # -# # -# This program is distributed in the hope that it will be useful, # -# but WITHOUT ANY WARRANTY; without even the implied warranty of # -# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # -# GNU General Public License for more details. # -# # -# You should have received a copy of the GNU General Public License # -# along with this program. If not, see <http://www.gnu.org/licenses/>. # -# # -############################################################################### - -############################################################################### -# Definitions -############################################################################### - -include Config - -VER = 0.5.0 - -THISAPP = pyxattr-$(VER) -DL_FILE = $(THISAPP).tar.gz -DL_FROM = $(URL_IPFIRE) -DIR_APP = $(DIR_SRC)/$(THISAPP) -TARGET = $(DIR_INFO)/$(THISAPP) -PROG = python-xattr -PAK_VER = 1 - -DEPS = - -############################################################################### -# Top-level Rules -############################################################################### - -objects = $(DL_FILE) - -$(DL_FILE) = $(DL_FROM)/$(DL_FILE) - -$(DL_FILE)_MD5 = 0f7ab1e185087329e40f7de218517c84 - -install : $(TARGET) - -check : $(patsubst %,$(DIR_CHK)/%,$(objects)) - -download :$(patsubst %,$(DIR_DL)/%,$(objects)) - -md5 : $(subst %,%_MD5,$(objects)) - -dist: - @$(PAK) - -############################################################################### -# Downloading, checking, md5sum -############################################################################### - -$(patsubst %,$(DIR_CHK)/%,$(objects)) : - @$(CHECK) - -$(patsubst %,$(DIR_DL)/%,$(objects)) : - @$(LOAD) - -$(subst %,%_MD5,$(objects)) : - @$(MD5) - -############################################################################### -# Installation Details -############################################################################### - -$(TARGET) : $(patsubst %,$(DIR_DL)/%,$(objects)) - @$(PREBUILD) - @rm -rf $(DIR_APP) && cd $(DIR_SRC) && tar zxf $(DIR_DL)/$(DL_FILE) - cd $(DIR_APP) && python setup.py install - @rm -rf $(DIR_APP) - @$(POSTBUILD) diff --git a/make.sh b/make.sh index 3c94509d3..4a42246fd 100755 --- a/make.sh +++ b/make.sh @@ -1552,7 +1552,6 @@ buildipfire() { lfsmake2 python-distutils-extra lfsmake2 python-lzma lfsmake2 python-progressbar - lfsmake2 python-xattr lfsmake2 ddns lfsmake2 python3-setuptools lfsmake2 python3-setuptools-scm -- 2.30.0

1 0

[PATCH 1/2] attr: Update to 2.4.48
by Adolf Belka 10 Feb '21

10 Feb '21

- Update attr from 2.4.47 (2013) to 2.4.48 (2018) - Update rootfiles - Changelog in tarball only goes up to 2.4.44 so extracted changes from commits between 2.4.47 and release of 2.4.48 v2.4.48 attr: Fix segmentation fault Andreas Gruenbacher po: update Andreas Gruenbacher setfacl: Include errno.h Andreas Gruenbacher copy_action: drop unused alloca.h include Mike Frysinger include: add uninstall target to fix distcheck Mike Frysinger attr_copy_{fd,file}: sync changes between the files Mike Frysinger xattr.conf: do not copy security.evm Stefan Berger Cleanup visibility of API functions Yury Usishchev Cleanup config.h usage Yury Usishchev Use stdint types consistently Felix Janda walk_tree_rec: Add parentheses to clarify code Andreas Gruenbacher Reintroduce symbols that used to be syscall wrappers Dmitry V. Levin Do not export symbols that are not supposed to be exported Dmitry V. Levin Add explicit symbol versioning for attr_copy_action Dmitry V. Levin ignore configure.lineno Mike Frysinger walk_tree: mark internal variables as static Dmitry V. Levin Remove the attr.5 man page (moved to man-pages) Andreas Gruenbacher Remove <attr/xattr.h> and the syscall wrappers Andreas Gruenbacher Remove the section 2 man pages Andreas Gruenbacher Remove outdated tests from test/attr.test Andreas Gruenbacher Remove test/ext/fs.test Andreas Gruenbacher Add setfattr --raw option Andreas Gruenbacher Properly set and report empty attribute values Andreas Gruenbacher Man pages: Minor fixes Andreas Gruenbacher build: unbreak attr_copy_fd() and attr_copy_file(). Nick Alcock attr: Don't report a NULL attribute name when -l (list) fails Andreas Gruenbacher attr_list / attr_listf: Fix cursor off-by-one error Andreas Gruenbacher Portability fix: <alloca.h> is Linux specific Emmanuel Dreyfus Portability fixes Emmanuel Dreyfus telldir return value and seekdir second parameters are of type long Cristian Rodríguez License fixes Andreas Gruenbacher test: fix cleanup & running as root Mike Frysinger include examples/ in dist tarball Mike Frysinger build: ship a pkgconfig file for libattr Jan Engelhardt build: make use of an aux-dir to stow away helper scripts Jan Engelhardt avoid glibc-specific DECLS defines Mike Frysinger build: drop attrincludedir, use pkgincludedir Jan Engelhardt disable installation of man(2) pages by default Mike Frysinger po: regenerate files after move Mike Frysinger modernize build system Mike Frysinger test: make running parallel/out-of-tree safe Mike Frysinger move gettext logic into misc.h Mike Frysinger punt debian/rpm packaging logic Mike Frysinger Suppress deprecation warnings when building attr and libattr Andreas Gruenbacher Add a default /etc/xattr.conf file Andreas Gruenbacher Mark the Irix compatibility functions as deprecated Andreas Gruenbacher Make attr_get and attr_getf behave as described in the man page Andreas Gruenbacher Use autoreconf rather than autoconf to regenerate the files. Fabrice Bauzac .gitignore: ignore *~ and config.h.in. Fabrice Bauzac Fix ATTR_OP_REMOVE operation in attr_multi() Makefile: rename configure.in to configure.ac Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- config/rootfiles/common/attr | 28 +++++++++++----------------- lfs/attr | 8 +++----- 2 files changed, 14 insertions(+), 22 deletions(-) diff --git a/config/rootfiles/common/attr b/config/rootfiles/common/attr index edfefa7e1..ba3ed7db7 100644 --- a/config/rootfiles/common/attr +++ b/config/rootfiles/common/attr @@ -1,24 +1,31 @@ usr/bin/attr usr/bin/getfattr usr/bin/setfattr +#usr/etc +#usr/etc/xattr.conf #usr/include/attr #usr/include/attr/attributes.h #usr/include/attr/error_context.h #usr/include/attr/libattr.h -#usr/include/attr/xattr.h #usr/lib/libattr.a #usr/lib/libattr.la #usr/lib/libattr.so usr/lib/libattr.so.1 -usr/lib/libattr.so.1.1.0 +usr/lib/libattr.so.1.1.2448 +#usr/lib/pkgconfig/libattr.pc #usr/share/doc/attr -#usr/share/doc/attr/CHANGES.gz +#usr/share/doc/attr/CHANGES #usr/share/doc/attr/COPYING #usr/share/doc/attr/COPYING.LGPL #usr/share/doc/attr/PORTING -#usr/share/doc/attr/README #usr/share/locale/cs/LC_MESSAGES/attr.mo #usr/share/locale/de/LC_MESSAGES/attr.mo +#usr/share/locale/en@boldquot +#usr/share/locale/en@boldquot/LC_MESSAGES +#usr/share/locale/en(a)boldquot/LC_MESSAGES/attr.mo +#usr/share/locale/en@quot +#usr/share/locale/en@quot/LC_MESSAGES +#usr/share/locale/en(a)quot/LC_MESSAGES/attr.mo #usr/share/locale/es/LC_MESSAGES/attr.mo #usr/share/locale/fr/LC_MESSAGES/attr.mo #usr/share/locale/gl/LC_MESSAGES/attr.mo @@ -28,18 +35,6 @@ usr/lib/libattr.so.1.1.0 #usr/share/man/man1/attr.1 #usr/share/man/man1/getfattr.1 #usr/share/man/man1/setfattr.1 -#usr/share/man/man2/fgetxattr.2 -#usr/share/man/man2/flistxattr.2 -#usr/share/man/man2/fremovexattr.2 -#usr/share/man/man2/fsetxattr.2 -#usr/share/man/man2/getxattr.2 -#usr/share/man/man2/lgetxattr.2 -#usr/share/man/man2/listxattr.2 -#usr/share/man/man2/llistxattr.2 -#usr/share/man/man2/lremovexattr.2 -#usr/share/man/man2/lsetxattr.2 -#usr/share/man/man2/removexattr.2 -#usr/share/man/man2/setxattr.2 #usr/share/man/man3/attr_get.3 #usr/share/man/man3/attr_getf.3 #usr/share/man/man3/attr_list.3 @@ -50,4 +45,3 @@ usr/lib/libattr.so.1.1.0 #usr/share/man/man3/attr_removef.3 #usr/share/man/man3/attr_set.3 #usr/share/man/man3/attr_setf.3 -#usr/share/man/man5/attr.5 diff --git a/lfs/attr b/lfs/attr index bdae19a11..f31c0f2b4 100644 --- a/lfs/attr +++ b/lfs/attr @@ -24,10 +24,10 @@ include Config -VER = 2.4.47 +VER = 2.4.48 THISAPP = attr-$(VER) -DL_FILE = $(THISAPP).src.tar.gz +DL_FILE = $(THISAPP).tar.gz DL_FROM = $(URL_IPFIRE) DIR_APP = $(DIR_SRC)/$(THISAPP) TARGET = $(DIR_INFO)/$(THISAPP) @@ -40,7 +40,7 @@ objects = $(DL_FILE) $(DL_FILE) = $(DL_FROM)/$(DL_FILE) -$(DL_FILE)_MD5 = 84f58dec00b60f2dc8fd1c9709291cc7 +$(DL_FILE)_MD5 = bc1e5cb5c96d99b24886f1f527d3bb3d install : $(TARGET) @@ -73,8 +73,6 @@ $(TARGET) : $(patsubst %,$(DIR_DL)/%,$(objects)) cd $(DIR_APP) && ./configure cd $(DIR_APP) && make cd $(DIR_APP) && make install - cd $(DIR_APP) && make install-lib - cd $(DIR_APP) && make install-dev chmod -v 755 /usr/lib/libattr.so @rm -rf $(DIR_APP) @$(POSTBUILD) -- 2.30.0

1 0

[PATCH 3/3] lcd4linux: Update due to autoconf change
by Adolf Belka 09 Feb '21

09 Feb '21

- lcd4linux fails to build with autoconf-2.71 Required running of autoupdate on configure.in and autoreconf to solve files not found errors Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- lfs/lcd4linux | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/lfs/lcd4linux b/lfs/lcd4linux index 198607e25..9121e6fa0 100644 --- a/lfs/lcd4linux +++ b/lfs/lcd4linux @@ -32,7 +32,7 @@ DL_FROM = $(URL_IPFIRE) DIR_APP = $(DIR_SRC)/lcd4linux TARGET = $(DIR_INFO)/$(THISAPP) PROG = lcd4linux -PAK_VER = 6 +PAK_VER = 7 DEPS = dpfhack libmpdclient @@ -78,6 +78,8 @@ $(TARGET) : $(patsubst %,$(DIR_DL)/%,$(objects)) @$(PREBUILD) @rm -rf $(DIR_APP) && cd $(DIR_SRC) && tar axf $(DIR_DL)/$(DL_FILE) $(UPDATE_AUTOMAKE) + cd $(DIR_APP) && autoreconf -v -i + cd $(DIR_APP) && autoupdate -v configure.in cd $(DIR_APP) && ./configure --with-plugins=all,!qnaplog,!dbus --prefix=/usr cd $(DIR_APP) && make $(MAKETUNING) cd $(DIR_APP) && make install -- 2.30.0

1 0

[PATCH 2/3] collectd: Update due to autoconf change
by Adolf Belka 09 Feb '21

09 Feb '21

- collectd fails to build with autoconf-2.71 Required running of autoupdate on configure.in and addition of --with-fp-layout=nothing to configure options Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- lfs/collectd | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/lfs/collectd b/lfs/collectd index 0f99c4ce7..7c9744531 100644 --- a/lfs/collectd +++ b/lfs/collectd @@ -106,6 +106,7 @@ $(TARGET) : $(patsubst %,$(DIR_DL)/%,$(objects)) cd $(DIR_APP) && patch -p1 -i $(DIR_SRC)/src/patches/collectd/silence-openvpn-errors.patch cd $(DIR_APP) && patch -p1 -i $(DIR_SRC)/src/patches/collectd-4.10.9-xfs-compile-fix.patch cd $(DIR_APP) && patch -p1 -i $(DIR_SRC)/src/patches/collectd-4.10-libiptc-build-fixes.patch + cd $(DIR_APP) && autoupdate -v configure.in cd $(DIR_APP) && autoreconf -vfi cd $(DIR_APP)/libltdl && autoreconf -vfi cd $(DIR_APP) && ./configure --prefix=/usr --localstatedir=/var \ @@ -116,7 +117,8 @@ $(TARGET) : $(patsubst %,$(DIR_DL)/%,$(objects)) --enable-{interface,iptables,irq,load,logfile,memory,multimeter} \ --enable-{network,nfs,ntpd,ping,processes,rrdtool,sensors,swap,syslog} \ --enable-{tcpconns,unixsock,users,wireless} \ - --with-librrd=/usr/share/rrdtool-1.2.30 + --with-librrd=/usr/share/rrdtool-1.2.30 \ + --with-fp-layout=nothing cd $(DIR_APP) && make install #collectd-4 does not support parallel build cp -vf $(DIR_SRC)/config/collectd/collectd.* /etc/ mv /etc/collectd.vpn /var/ipfire/ovpn/collectd.vpn -- 2.30.0

1 0

[PATCH 1/3] autoconf: Update to 2.71
by Adolf Belka 09 Feb '21

09 Feb '21

- Update autoconf from 2.69 to 2.71 - Updated rootfile - Changelog Large amount of changes, especially in 2.70 - too many to add in here. Details of changes can be found in the NEWS file in the tarball Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- config/rootfiles/common/autoconf | 8 ++++++-- lfs/autoconf | 4 ++-- 2 files changed, 8 insertions(+), 4 deletions(-) diff --git a/config/rootfiles/common/autoconf b/config/rootfiles/common/autoconf index 3e28ae744..c9aeb7a87 100644 --- a/config/rootfiles/common/autoconf +++ b/config/rootfiles/common/autoconf @@ -10,6 +10,7 @@ #usr/share/autoconf/Autom4te/C4che.pm #usr/share/autoconf/Autom4te/ChannelDefs.pm #usr/share/autoconf/Autom4te/Channels.pm +#usr/share/autoconf/Autom4te/Config.pm #usr/share/autoconf/Autom4te/Configure_ac.pm #usr/share/autoconf/Autom4te/FileUtils.pm #usr/share/autoconf/Autom4te/General.pm @@ -37,6 +38,7 @@ #usr/share/autoconf/autoconf/programs.m4 #usr/share/autoconf/autoconf/specific.m4 #usr/share/autoconf/autoconf/status.m4 +#usr/share/autoconf/autoconf/trailer.m4 #usr/share/autoconf/autoconf/types.m4 #usr/share/autoconf/autom4te.cfg #usr/share/autoconf/autoscan @@ -46,6 +48,10 @@ #usr/share/autoconf/autotest/autotest.m4f #usr/share/autoconf/autotest/general.m4 #usr/share/autoconf/autotest/specific.m4 +#usr/share/autoconf/build-aux +#usr/share/autoconf/build-aux/config.guess +#usr/share/autoconf/build-aux/config.sub +#usr/share/autoconf/build-aux/install-sh #usr/share/autoconf/m4sugar #usr/share/autoconf/m4sugar/foreach.m4 #usr/share/autoconf/m4sugar/m4sh.m4 @@ -61,6 +67,4 @@ #usr/share/man/man1/autoreconf.1 #usr/share/man/man1/autoscan.1 #usr/share/man/man1/autoupdate.1 -#usr/share/man/man1/config.guess.1 -#usr/share/man/man1/config.sub.1 #usr/share/man/man1/ifnames.1 diff --git a/lfs/autoconf b/lfs/autoconf index 4abc8353a..ed77c46ed 100644 --- a/lfs/autoconf +++ b/lfs/autoconf @@ -24,7 +24,7 @@ include Config -VER = 2.69 +VER = 2.71 THISAPP = autoconf-$(VER) DL_FILE = $(THISAPP).tar.xz @@ -39,7 +39,7 @@ objects = $(DL_FILE) $(DL_FILE) = $(DL_FROM)/$(DL_FILE) -$(DL_FILE)_MD5 = 50f97f4159805e374639a73e2636f22e +$(DL_FILE)_MD5 = 12cfa1687ffa2606337efe1a64416106 install : $(TARGET) -- 2.30.0

1 0

[PATCH] unbound: Update to 1.13.1
by Matthias Fischer 09 Feb '21

09 Feb '21

For details see: https://nlnetlabs.nl/projects/unbound/download/#unbound-1-13-1 Signed-off-by: Matthias Fischer <matthias.fischer(a)ipfire.org> --- config/rootfiles/common/unbound | 2 +- lfs/unbound | 6 +++--- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/config/rootfiles/common/unbound b/config/rootfiles/common/unbound index 45fee4460..6d890daf0 100644 --- a/config/rootfiles/common/unbound +++ b/config/rootfiles/common/unbound @@ -11,7 +11,7 @@ etc/unbound/unbound.conf #usr/lib/libunbound.la #usr/lib/libunbound.so usr/lib/libunbound.so.8 -usr/lib/libunbound.so.8.1.11 +usr/lib/libunbound.so.8.1.12 #usr/lib/pkgconfig/libunbound.pc usr/sbin/unbound usr/sbin/unbound-anchor diff --git a/lfs/unbound b/lfs/unbound index 69cb91d73..0bd437481 100644 --- a/lfs/unbound +++ b/lfs/unbound @@ -1,7 +1,7 @@ ############################################################################### # # # IPFire.org - A linux based firewall # -# Copyright (C) 2007-2020 IPFire Team <info(a)ipfire.org> # +# Copyright (C) 2007-2021 IPFire Team <info(a)ipfire.org> # # # # This program is free software: you can redistribute it and/or modify # # it under the terms of the GNU General Public License as published by # @@ -24,7 +24,7 @@ include Config -VER = 1.13.0 +VER = 1.13.1 THISAPP = unbound-$(VER) DL_FILE = $(THISAPP).tar.gz @@ -40,7 +40,7 @@ objects = $(DL_FILE) $(DL_FILE) = $(DL_FROM)/$(DL_FILE) -$(DL_FILE)_MD5 = 5a522f10c65332efe627098d2d24f947 +$(DL_FILE)_MD5 = 0cd660a40d733acc6e7cce43731cac62 install : $(TARGET) -- 2.18.0

1 0

Status of lcd4linux addon
by Adolf Belka (ipfire-dev) 09 Feb '21

09 Feb '21

Hi all, While working to solve the problems with building the latest version of autoconf I also had to have a look at lcd4linux. I solved the build problems but I thought I should let everyone know what I found about the status of this addon, in case you are not aware. I found lcd4linux in Sourceforge but the last version there was 0.10.0 while the current version is a svn version of 0.11.0 There was a link saying "As of 2006-10-08, this project can be found here". I followed the link "http://lcd4linux.bulix.org/" and it redirected to a web site "https://www.bulix.org/" that no longer mentions lcd4linux. I found a link for a download "https://ssl.bulix.org/projects/lcd4linux/attachment/wiki/Download/lcd4linux…" but this comes up with a 404 Not Found error. The same error applies for any part of that URL. It looks like lcd4linux is no longer being supported but also all the download and documentation after version 0.10.0 have been removed. It might be time to consider retiring this addon from IPFire. Regards, Adolf. -- Sent from my laptop

1 0

[PATCH] qpdf: Update to 10.1.0
by Adolf Belka 08 Feb '21

08 Feb '21

- Update qpdf from 10.0.1 to 10.1.0 - Update rootfile - Changelog 2021-01-05 Jay Berkenbilt <ejb(a)ql.org> * 10.1.0: release 2021-01-04 Jay Berkenbilt <ejb(a)ql.org> * When qpdf CLI extracts pages, it now only attempts to remove unreferenced resources from the pages that it is keeping. This change dramatically reduces the time it takes to extract a small number of pages from a large, complex file. * Move getNext()->write() calls in some pipelines to ensure that state gates properly reset even if the next pipeline's write throws an exception (fuzz issue 28262). 2021-01-03 Jay Berkenbilt <ejb(a)ql.org> * Don't include -o nospace with zsh completion setup so file completion works normally. Fixes #473. 2021-01-02 Jay Berkenbilt <ejb(a)ql.org> * Make QPDFPageObjectHelper methods pipeContents, parseContents, and addContentTokenFilter work with form XObjects. * Rename some QPDFPageObjectHelper methods and make them support form XObjects as well as pages. The old names will be preserved from compatibility. - pipePageContents -> pipeContents - parsePageContents -> parseContents * Add QPDFObjectHandle::parseAsContents to apply ParserCallbacks to a form XObject. * QPDFPageObjectHelper::externalizeInlineImages can be called with form XObjects as well as pages. * Bug fix: QPDFPageObjectHelper::externalizeInlineImages was not descending into form XObjects on a page. It now does this by default. In the extremely unlikely event that anyone was actually depending on the old behavior, it is available by passing shallow=true to the externalizeInlineImages call. * Bug fix: QPDFObjectHandle::filterPageContents was broken for pages with an array of content streams. This caused externalize-inline-images to also be broken for this case. 2021-01-01 Jay Berkenbilt <ejb(a)ql.org> * Add methods to QPDFPageObjectHelper: forEachXObject, forEachImage, forEachFormXObject to call a function on each XObject (or image or form XObject) in a page or form XObject, possibly recursing into nested form XObjects. * Add method QPDFPageObjectHelper::getFormXObjects to return a map of keys to form XObjects (non-recursively) from a page or form XObject. * Add method QPDFObjectHandle::isImage to test whether an object is an image. 2020-12-31 Jay Berkenbilt <ejb(a)ql.org> * QPDFPageObjectHelper::removeUnreferencedResources can now be called with a QPDFPageObjectHelper created from a form XObject. The method already recursed into form XObjects. * Rename some QPDFPageObjectHelper methods and make them support form XObjects as well as pages. The old names will be preserved from compatibility. - getPageImages -> getImages - filterPageContents -> filterContents * Add QPDFObjectHandle::isFormXObject to test whether an object is a form XObject. 2020-12-30 Jay Berkenbilt <ejb(a)ql.org> * Add QPDFPageObjectHelper::flattenRotation and --flatten-rotation option to the qpdf CLI. The flattenRotation method removes any /Rotate key from a page dictionary and implements the same rotation by modifying the page's contents such that the various page boxes are altered and the page renders identically. This can be used to work around buggy PDF applications that don't properly handle page rotation. The --flatten-rotation option to the qpdf CLI calls flattenRotation for every page. 2020-12-26 Jay Berkenbilt <ejb(a)ql.org> * Add QPDFObjectHandle::setFilterOnWrite, which can be used to tell QPDFWriter not to filter a stream on output even if it can. You can use this to prevent QPDFWriter from touching a stream (either uncompressing or compressing) that you have optimized or otherwise ensured looks exactly the way you want it, even if decode level or stream compression would otherwise cause QPDFWriter to modify the stream. * Add ostream << for QPDFObjGen. (Don't ask why it took 7.5 years for me to decide to do this.) 2020-12-25 Jay Berkenbilt <ejb(a)ql.org> * Refactor write code to eliminate an extra full traversal of objects in the file and to remove assumptions that preclude stream references from appearing in /DecodeParms of filterable streams. This results in an approximately 8% performance reduction in write times. 2020-12-23 Jay Berkenbilt <ejb(a)ql.org> * Allow library users to provide their own decoders for stream filters by deriving classes from QPDFStreamFilter and registering them using QPDF::registerStreamFilter. Registered stream filters provide code to validate and interpret /DecodeParms for a specific /Filter and also to provide a pipeline that will decode. Note that it is possible to encode to a filter type that is not supported even without this feature. See examples/pdf-custom-filter.cc for an example of using custom stream filters. 2020-12-22 Jay Berkenbilt <ejb(a)ql.org> * Add QPDFObjectHandle::makeDirect(bool allow_streams) -- if allow_streams is true, preserve indirect references to streams rather than throwing an exception. This allows the object to be made as direct as possible while preserving stream references. 2020-12-20 Jay Berkenbilt <ejb(a)ql.org> * Add qpdf_register_progress_reporter method to C API, corresponding to QPDFWriter::registerProgressReporter. Fixes #487. 2020-11-28 Jay Berkenbilt <ejb(a)ql.org> * Add new functions to the C API for manipulating QPDFObjectHandles. The new functions allow creation and modification of objects, which brings a lot of additional power to the C API. See include/qpdf/qpdf-c.h for details and examples/pdf-c-objects.c for a simple example. 2020-11-21 Jay Berkenbilt <ejb(a)ql.org> * 10.0.4: release * Fix QIntC::range_check to handle negative numbers properly (fuzz issue 26994). 2020-11-11 Jay Berkenbilt <ejb(a)ql.org> * Treat a direct page object as a runtime error rather than a logic error since it is actually possible to create a file that has this (fuzz issue 27393). 2020-11-09 Jay Berkenbilt <ejb(a)ql.org> * Handle "." appearing in --pages not preceded by a numeric range as a special case in command-line parsing code. 2020-11-04 Jay Berkenbilt <ejb(a)ql.org> * Ignore the value of the offset/generation field in an xref entry for a deleted object. Also attempt file recovery on lower-level exceptions thrown while reading the xref table. Fixes #482. 2020-10-31 Jay Berkenbilt <ejb(a)ql.org> * 10.0.3: release * Don't enter extension initialization in QPDFWriter on a direct object. Fixes stack overflow in pathological case of /Root being a direct object (fuzz issue 26761). * My previous fix to #449 (handling foreign streams with indirect objects in /Filter and/or /DecodeParms) was incorrect and caused other problems. There is a now a correct fix to the original problem. Fixes #478. 2020-10-27 Jay Berkenbilt <ejb(a)ql.org> * 10.0.2: release 2020-10-25 Jay Berkenbilt <ejb(a)ql.org> * When signing distribution files, generate sha256 checksums instead of md5, sha1, and sha512. sha256 seems to be more widely used, and there's no reason to use md5 or sha1 anymore. * Official Windows releases are now built using the openssl crypto provider. The native provider is still available for selection at runtime using the QPDF_CRYPTO_PROVIDER environment variable. * Bug fix: --no-warn was not suppressing some warnings that might be generated by --split-pages. 2020-10-23 Jay Berkenbilt <ejb(a)ql.org> * Bug fix: when concatenating content streams, insert a newline if needed to prevent the last token from the old stream from being merged with the first token of the new stream. Qpdf was mistakenly concatenating the streams without regard to the specification that content streams are to be broken on token boundaries. Fixes #444. * fix-qdf: handle empty streams better with ignore newline by treating them as empty even though, technically, a blank line would be required inside the Stream. This just makes it easier to add place-holder empty streams while editing qdf files by hand. 2020-10-22 Jay Berkenbilt <ejb(a)ql.org> * Fix memory leak that could occur if objects in object streams were resolved more than once and the objects within the object streams contained circular references. This leak could be triggered when qpdf was run with --object-streams=generate on files that already had object streams containing circular references (fuzz issue 23642). * Add QIntC::range_check for checking to see whether adding two numbers together will cause an overflow. * Fix loop detection problem when traversing page thumbnails during optimization (fuzz issue 23172). 2020-10-21 Jay Berkenbilt <ejb(a)ql.org> * Bug fix: properly handle copying foreign streams that have indirect /Filter or /DecodeParms keys when stream data has been replaced. The circumstances leading to this bug are very unusual but would cause qpdf to either generate an internal error or some other kind of warning situation if it would occur. Fixes #449. * Qpdf's build and CI has been migrated from Azure Pipelines (Azure DevOps) to GitHub Actions. * Remove some fuzz files that triggered Mal/PDFEx-H with some virus scanners. There's plenty of coverage in the fuzz corpus without these files, and it's a nuisance to have virus checkers remove them. Fixes #460. * Ensure that numeric conversion is not affected by the user's global locale setting. Fixes #459. * Add qpdf-<version>-linux-x86_64.zip to the list of built distributions. This is a simple zip file that contains just the qpdf executables and the dependent shared libraries that would not ordinarily be present on a base system. This minimal binary distribution works as is when used as a Lambda layer in AWS and could be suitable for inclusion in a docker image or other standalone Linux/x86_64 environment where you want minimal support for running the qpdf executable. Fixes #352. 2020-10-20 Jay Berkenbilt <ejb(a)ql.org> * Add --warning-exit-0 option to the qpdf command line. When specified, qpdf will exit with a status of 0 rather than 3 when there are warnings without errors. Combine with --no-warn to completely ignore warnings. * Bug fix: fix further cases in which errors were written to stdout. Fixes #438. * Build option: add --disable-rpath option to ./configure, which disables passing -rpath to the linker when building shared libraries with libtool. Fixes #422. 2020-10-16 Jay Berkenbilt <ejb(a)ql.org> * Accept pull request that improves how the Windows native crypto provider is obtained. * Accept pull request that improves performance in processing files in memory. * Accept pull requests that improve openssl configuration and error reporting. * Build using GitHub Actions. The intention is that this will replace Azure Pipelines as the official CI for qpdf for the next release. 2020-10-15 Jay Berkenbilt <ejb(a)ql.org> * Make many minor improvements to the build process and code health, including fixing a lgtm warning and compiler warnings from newer version of gcc and MSVC toolchains. Add several cosmetic improvements to build output in CI. * Added LL_FMT to config.h.in. This is populated automatically by autoconf, but if build with your own build system, you may need to define it as whatever the format string needed by printf for long long is. Usually this is "%lld", but it can be "%I64d" for some older Windows-based compilers. 2020-04-29 Jay Berkenbilt <ejb(a)ql.org> * Bug fix: qpdf --check was writing errors and warnings reported by checkLinearization to stdout instead of stderr. Fixes #438. Signed-off-by: Adolf Belka <adolf.belka(a)ipfire.org> --- config/rootfiles/common/qpdf | 4 ++-- lfs/qpdf | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/config/rootfiles/common/qpdf b/config/rootfiles/common/qpdf index 9f6d18ee6..581ba243f 100644 --- a/config/rootfiles/common/qpdf +++ b/config/rootfiles/common/qpdf @@ -41,6 +41,7 @@ usr/bin/qpdf #usr/include/qpdf/QPDFPageDocumentHelper.hh #usr/include/qpdf/QPDFPageLabelDocumentHelper.hh #usr/include/qpdf/QPDFPageObjectHelper.hh +#usr/include/qpdf/QPDFStreamFilter.hh #usr/include/qpdf/QPDFSystemError.hh #usr/include/qpdf/QPDFTokenizer.hh #usr/include/qpdf/QPDFWriter.hh @@ -50,11 +51,10 @@ usr/bin/qpdf #usr/include/qpdf/RandomDataProvider.hh #usr/include/qpdf/Types.h #usr/include/qpdf/qpdf-c.h -#usr/lib/libqpdf.a #usr/lib/libqpdf.la #usr/lib/libqpdf.so usr/lib/libqpdf.so.28 -usr/lib/libqpdf.so.28.0.1 +usr/lib/libqpdf.so.28.1.0 #usr/lib/pkgconfig/libqpdf.pc #usr/share/doc/qpdf #usr/share/doc/qpdf/qpdf-manual.html diff --git a/lfs/qpdf b/lfs/qpdf index 600454bc3..af934c647 100644 --- a/lfs/qpdf +++ b/lfs/qpdf @@ -24,7 +24,7 @@ include Config -VER = 10.0.1 +VER = 10.1.0 THISAPP = qpdf-$(VER) DL_FILE = $(THISAPP).tar.gz @@ -44,7 +44,7 @@ objects = $(DL_FILE) $(DL_FILE) = $(DL_FROM)/$(DL_FILE) -$(DL_FILE)_MD5 = eb7fb7c6cd5d3036bf4f7a5e3f44d995 +$(DL_FILE)_MD5 = 6d72264ff68a9807418af4d7fc613e95 install : $(TARGET) -- 2.30.0

1 0

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

Development February 2021