From mboxrd@z Thu Jan 1 00:00:00 1970 From: Michael Tremer To: development@lists.ipfire.org Subject: Re: Planning out Core Update 117 Date: Tue, 21 Nov 2017 14:42:54 +0000 Message-ID: <1511275374.4838.600.camel@ipfire.org> In-Reply-To: <1510094831.2768.10.camel@ipfire.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7451089145378960581==" List-Id: --===============7451089145378960581== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello, any progress on this? -Michael On Tue, 2017-11-07 at 22:47 +0000, Michael Tremer wrote: > Hi, >=20 > On Tue, 2017-11-07 at 19:41 +0100, Matthias Fischer wrote: > > Hi, > >=20 > > On 07.11.2017 16:05, Michael Tremer wrote: > > > Hi, > > >=20 > > > maybe this function helps: > > >=20 > > > https://git.ipfire.org/?p=3Dipfire-2.x.git;a=3Dcommitdiff;h=3D5190eea24= f9822a63d > > > c5d06d214b48f973b14f29 > >=20 > > Thanks. I'll take a look... > >=20 > > > On Tue, 2017-11-07 at 10:46 +0000, Michael Tremer wrote: > > > > On Mon, 2017-11-06 at 22:09 +0100, Matthias Fischer wrote: > > > > ... > > > > >=20 > > > > > I forgot: Tuning the XZ-parameters... ;-) > > > >=20 > > > > Good that you are bringing this up. So I think what we should do here= is > > > > bringing back XZ compression with -8 so that we do not waste too much > > > > space > > > > when > > > > extracting the image again. > >=20 > > Right now I'm testing how much RAM I need. > >=20 > > Current 'next'-build is running with: > >=20 > > 'lfs/cdrom': > > ... > > export XZ_OPT =3D --threads=3D0 -8 --memory=3D500MiB > > ... > >=20 > > 'lfs/Config': > > ... > > cd /install/packages/package/tmp/ && XZ_OPT=3D"-T0 -8" ... > > ... > >=20 > > I'm waiting for the results. Takes a while. >=20 > You can just run it like this and it will tell you: >=20 > [ms(a)hughes ~]$ xz -vv8 -T0 > xz: Filter chain: -- > lzma2=3Ddict=3D32MiB,lc=3D3,lp=3D0,pb=3D2,mode=3Dnormal,nice=3D64,mf=3Dbt4,= depth=3D0 > xz: Using up to 4 threads. > xz: 2,629 MiB of memory is required. The limiter is disabled. > xz: Decompression will need 33 MiB of memory. > xz: Compressed data cannot be written to a terminal > xz: Try `xz --help' for more information. >=20 > > > > To not run into memory limits we should detect how much memory the bu= ild > > > > host > > > > has and set the memory limit to maybe 80% of that. xz will then > > > > automatically > > > > scale down to a number of parallel processes that it can fit into > > > > memory. > >=20 > > I'm a bit puzzled about this: I tried using '--memory=3D70%' as mentioned > > in the xz man pages, but is seems to have no effect. It looks as if the > > percent parameter isn't recognized and ignored. It always ends up in > > "cannot allocate memory". Any hints on this? Do both 'lfs/cdrom' AND > > 'lfs/Config' need the '--memory'-parameter? >=20 > Yes, but it would be good to have one place where the parameters are > being generated and then we just use them from a variable. >=20 > > > > ... > > > > We will at least need about half a GB which should be a sensible > > > > requirement > > > > for a build system any ways. > >=20 > > Agreed. Because of this I'm testing with '500Mib'. > >=20 > > > > Will you work on this bringing it into the build system?! > >=20 > > "I'll do my very best!" :-)) >=20 > Very well Miss Sophie... >=20 > > Best=E2=84=A2, > > Matthias --===============7451089145378960581== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="signature.asc" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KCmlRSXpCQUFCQ2dBZEZpRUU1L3JXNWwzR0dl Mnlwa3R4Z0hudy8yK1FDUWNGQWxvVU8yNEFDZ2tRZ0hudy8yK1EKQ1FjRitRLy9hQjhaZy9mRGw5 SjBhdk9xclRsdE5RL0oyMjREVWZZd2cyRzVOWUltN0txY2d4RVpsT3VQRjc4eAo0RG9IbjJ6RUds TGVlK2RuYmZZaEVHaW1LNVg3b1h2WG9qaURJZG1pMnVBMXQzdTlQMG9RSm80L3JyRkJPMmtoCjEz aXFxQWIwY3pZbU02K2gyQ0Vud3c0aDE4Z0t6NTNrSURiYUJaNGdJYXhkSjF4a2I4bENtdmZwN0Yz RzVrMmkKaS96WERjMTVwcXNZUDRHWlhtTU4rVnhtdXpGUjRTakg3b0txcXdCYkdzcUNLUFNvalZt MWs1NFloVjVoamgzZApaaEdENGRybHFVU2huUEpMNGZxVVRSOFc5dFhYQ1hZZURPKytLM28yMUdM TTVLTVpsVVhNYlVrcVl0c2g4WjFtCjh1V2hwV0p2VVVtRnArR052dDRxTXN1QzNqSVVjczVkbVVU b2JQenREbTBSV3NYS1M2RVdkalJtYW1IbFlpamcKWkVYNCt6OUVKS21NVmMvU1hXR0hQVmVJdm5G clY4VWJxb01PeVJyRGxMeXJMQUdHVUJCVFBrdldhS3J1Vm5vUQpQYTNubmltNnlIa25oemdCdnhW WVZ6VzFPM1FwdUFzQlRaSTFHdHRmVklGeWpFNGx1VjQzT2pleXoyR0FQQzA4Ck9FVTZNUUJoTGk3 b04vT1NlL0xNL3RaSTE0MFFNbHJRcXVmL29YOUZPWDFqdWlFQlhEOTVqNWxZRXhjdFNXdGsKTFdm cUJiakRkMCtlUFo5OWFEd1pGMGlrOWtHVFlYU01yRzVoOWQzWmJsTVVoQVhqRnpiSkxxdEhrdDZl TjNIYQozS3FyUkZPMy9NMFQ0OUxJL2VGbkd5QlRjYU5VaWwrSE9hMEdaVUtNMDZPMGJZNi83VGc9 Cj03Z21zCi0tLS0tRU5EIFBHUCBTSUdOQVRVUkUtLS0tLQo= --===============7451089145378960581==--