From mboxrd@z Thu Jan 1 00:00:00 1970 From: Michael Tremer To: development@lists.ipfire.org Subject: Re: Planning out Core Update 117 Date: Tue, 07 Nov 2017 22:47:11 +0000 Message-ID: <1510094831.2768.10.camel@ipfire.org> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3250495735608635616==" List-Id: --===============3250495735608635616== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, On Tue, 2017-11-07 at 19:41 +0100, Matthias Fischer wrote: > Hi, >=20 > On 07.11.2017 16:05, Michael Tremer wrote: > > Hi, > >=20 > > maybe this function helps: > >=20 > > https://git.ipfire.org/?p=3Dipfire-2.x.git;a=3Dcommitdiff;h=3D5190eea24f9= 822a63dc5d06d214b48f973b14f29 >=20 > Thanks. I'll take a look... >=20 > > On Tue, 2017-11-07 at 10:46 +0000, Michael Tremer wrote: > > > On Mon, 2017-11-06 at 22:09 +0100, Matthias Fischer wrote: > > > ... > > > >=20 > > > > I forgot: Tuning the XZ-parameters... ;-) > > >=20 > > > Good that you are bringing this up. So I think what we should do here is > > > bringing back XZ compression with -8 so that we do not waste too much s= pace > > > when > > > extracting the image again. >=20 > Right now I'm testing how much RAM I need. >=20 > Current 'next'-build is running with: >=20 > 'lfs/cdrom': > ... > export XZ_OPT =3D --threads=3D0 -8 --memory=3D500MiB > ... >=20 > 'lfs/Config': > ... > cd /install/packages/package/tmp/ && XZ_OPT=3D"-T0 -8" ... > ... >=20 > I'm waiting for the results. Takes a while. You can just run it like this and it will tell you: [ms(a)hughes ~]$ xz -vv8 -T0 xz: Filter chain: --lzma2=3Ddict=3D32MiB,lc=3D3,lp=3D0,pb=3D2,mode=3Dnormal,n= ice=3D64,mf=3Dbt4,depth=3D0 xz: Using up to 4 threads. xz: 2,629 MiB of memory is required. The limiter is disabled. xz: Decompression will need 33 MiB of memory. xz: Compressed data cannot be written to a terminal xz: Try `xz --help' for more information. > > > To not run into memory limits we should detect how much memory the buil= d host > > > has and set the memory limit to maybe 80% of that. xz will then automat= ically > > > scale down to a number of parallel processes that it can fit into memor= y. >=20 > I'm a bit puzzled about this: I tried using '--memory=3D70%' as mentioned > in the xz man pages, but is seems to have no effect. It looks as if the > percent parameter isn't recognized and ignored. It always ends up in > "cannot allocate memory". Any hints on this? Do both 'lfs/cdrom' AND > 'lfs/Config' need the '--memory'-parameter? Yes, but it would be good to have one place where the parameters are being generated and then we just use them from a variable. > > > ... > > > We will at least need about half a GB which should be a sensible requir= ement > > > for a build system any ways. >=20 > Agreed. Because of this I'm testing with '500Mib'. >=20 > > > Will you work on this bringing it into the build system?! >=20 > "I'll do my very best!" :-)) Very well Miss Sophie... > Best=E2=84=A2, > Matthias --===============3250495735608635616== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="signature.asc" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KCmlRSXpCQUFCQ2dBZEZpRUU1L3JXNWwzR0dl Mnlwa3R4Z0hudy8yK1FDUWNGQWxvQ04rOEFDZ2tRZ0hudy8yK1EKQ1FmVFZBLzlFclNxdE5CcW9t OGZzU2lnVTUzV0N0QS9WUzhLN2pHN053eWpzd1EvUHoxcmR5QUtFQ0diYTQ5UgpuSHUvMVBSOTlm eGJROGJhY0tPdVBORlFHbjFFOGVxdzZsWGxkTXJTWnhJNlpKNjNzcnB5ckU0dFBUQnVwZ3hTCkFy QzBqMko2UUo2RmhHNXl1em1pTy9NaW93MmFCSllOOVM3VFg2MldmRGwzM1lNY3ZnRk9sWStOcE9s RXVnYVUKT2FwYmtTNFpNWnhVS1pTMDNUa0gzamE1MUJmNGx6OXZPZE96cm9KQlExZWVQZ0lXSSsv QUJPTE1rQzhVQkNHMQpzejlMSk0rRVpEcW1HWitRaTA5RHRwZnV1M0ViNktWcllOUlhBT1E5L01p LzJmeVgzWktsZlFIRWpoNEtmajJ6CnBNRjB4SldzcFB5UWxWSUdnNHBVUVBDdlFSZEJqbXdKWmpN VnRtSDYxSjNmSXRTeG5xWXJSejhzZG5kYThYU0MKMzNuejhjVWJYRGYzei9YbHFPOXVaKzJnbVZD Y0lmT25IYXZBNjllcmhrMm14UjFsbEVibEVpalRyZWpxR2FIVQpOVGdsMDVSQVp2b2gxMmJvWnJ6 UW1KQjEvYnhQNHlhMHBSVTRCdlJCMlA1NjkrMGJ4aGhBc2p6VTRySGk3dEY1CndCcVUyd2VJK1lQ a2ZIQ2NCSEdFRlFtZTJUVExGYjZJd0g3WC9mT1NsK3hBV0ZLQ2JkMGkvK091ckZZNTdxWG8KY1ZT RlJTRS8zSGlCd0xWbHg5L05heThMZDU0cDJ6aytpa1ZPZjVOTUV3alJqU1pkMHRBbHNneWRldXd4 SkpVbwpVQmtqWkRDUU13c3VxR09IRFA4ZWZiUlZINldibTNEUit0NEYxQVNSSVFra21VMkFjdkU9 Cj14VWJiCi0tLS0tRU5EIFBHUCBTSUdOQVRVUkUtLS0tLQo= --===============3250495735608635616==--