From mboxrd@z Thu Jan  1 00:00:00 1970
From: Michael Tremer <michael.tremer@ipfire.org>
To: development@lists.ipfire.org
Subject: Re: squid 5.1 gone stable
Date: Mon, 16 Aug 2021 10:40:52 +0100
Message-ID: <DA5494C5-C748-454A-8EEB-B2256EC5DB6D@ipfire.org>
In-Reply-To: <5451127f-d52d-1cb5-1ea7-92aecffd94b3@ipfire.org>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============2835488003635427850=="
List-Id: <development.lists.ipfire.org>

--===============2835488003635427850==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hello,

> On 15 Aug 2021, at 08:53, Matthias Fischer <matthias.fischer(a)ipfire.org> =
wrote:
>=20
> Hi,
>=20
> On 13.08.2021 11:22, Michael Tremer wrote:
>> Hello,
>>=20
>>> On 7 Aug 2021, at 17:13, Matthias Fischer <matthias.fischer(a)ipfire.org>=
 wrote:
>>>=20
>>> Hi,
>>>=20
>>> ...for the records...: ;-)
>>>=20
>>> Today I tested building 'squid 5.1' with our usual configure options:
>>>=20
>>> ...
>>> --with-dl \
>>> --with-filedescriptors=3D$(( 16384 * 64 )) \
>>> --with-large-files \
>>> --without-gnutls \
>>> ...
>>>=20
>>> No errors in '_build.ipfire.log' for this 'squid' - except:
>>>=20
>>> ...
>>> checking for library containing log... none required
>>> configure: forcing default of 1048576 filedescriptors (user-forced)
>>> checking Default FD_SETSIZE value... 1024
>>> checking for getrlimit... yes
>>> checking for setrlimit... yes
>>> checking Maximum number of filedescriptors we can open... 32768
>>> configure: Default number of filedescriptors: 1048576
>>> ...
>>>=20
>>> So the maximum number of filedescriptors which are possible for 'squid
>>> 5.1' are 32768!?
>>>=20
>>> Ok then. I rebuilt the whole thing with the "maximum":
>>>=20
>>> ...
>>> --with-filedescriptors=3D32768 \
>>> ...
>>>=20
>>> But no change. During starting, 'squid 5.1.' still complains:
>>> ...
>>> NOTICE: Could not increase the number of filedescriptors
>>> With 4096 file descriptors available
>>> ...
>>>=20
>>> This is the value reported by 'ulimit -n' on my IPFire / Core 158.
>>>=20
>>> Currently, only 'squid 4.16' can increase this number under *exactly*
>>> the same environment.
>>>=20
>>> What consequences could it have, respectively!?
>>=20
>> This is the maximum amount of connections squid can open.
>=20
> What makes me wonder: during build, 'squid' says it can open '32768',
> during start its '4096'. If someone knows why, please enlighten me... ;-)

4096 is the default maximum number of files any process can open at the same.

This is to protect the system from going crazy by having too many open files =
(because I think the file descriptor table used to be of a static size in old=
er versions of the kernel).

>> I suppose this is enough and I can live with 32k. We should remove the fie=
ld from the UI then.
>=20
> Me too, but are 4096 enough?

No. I don=E2=80=99t know why the squid team isn=E2=80=99t handling this bette=
r. We are hitting this problem every time we update to a new version.

I suppose this is fine for testing.

You can try adding =E2=80=9Culimit -n 32768=E2=80=9D to the squid init script=
 and then it should be able to open up to 32k files.

-Michael

> Besides, I would wait to push '5.1' - I even didn't see an official
> annoncement yet.
>=20
> Best,
> Matthias


--===============2835488003635427850==--