public inbox for development@lists.ipfire.org
 help / color / mirror / Atom feed
From: Matthias Fischer <matthias.fischer@ipfire.org>
To: development@lists.ipfire.org
Subject: Re: Current 'next' won't build => 'cannot allocate memory'
Date: Fri, 25 May 2018 19:21:07 +0200	[thread overview]
Message-ID: <7346e4b7-0b24-0192-5ba9-5cf108704204@ipfire.org> (raw)
In-Reply-To: <d47b679d2322a30c6938b772081a694e5f4225c1.camel@ipfire.org>

[-- Attachment #1: Type: text/plain, Size: 2483 bytes --]

Hi,

On 25.05.2018 15:13, Michael Tremer wrote:
> Hi,
> ...
>> I just looked and waited for what would come out in the end... ;-)
> 
> I think it is working fine now.
> 
> Can you remind me again why we picked 70%? Was there a specific reason? Should
> we go up to 80 or 90%?

7.11.2017 (You):
To not run into memory limits we should detect how much memory the build
host has and set the memory limit to maybe 80% of that.

22.11.2017 (Me):
> Using '9' or '--extreme'-parameter brought no further improvements,
> on the other hand, build time and RAM consumption increased
> strongly. With '-8', minimal RAM consumption was about 680 MiB, using
> '700 Mib' was always safe. So this is the minimum I would recommend.

We set 1024 MB as system requirement and I found that I needed about 700
MB (680 MB) during my first tests.

Right now, 'Devel' is running with the the latest 'squid 4.0.24' patches
and "local xz_memory=$(( HOST_MEM * 9 / 10 ))" => I've set it to 90% -
we'll see how much cores will come into place.

>> ...
>> 
>> Last build went down from ~319 MB
>> (ipfire-2.19.2gb-ext4.i586-full-core121.img.gz) to ~183 MB
>> (ipfire-2.19.2gb-ext4.i586-full-core121.img.xz). Minus -136 MB. Not bad.
> 
> Yes indeed. There is also no serial image any more. That saves extra space :)

I was a bit puzzled as how small the *.img.xz image went. Fascinating.

>> One thing I noticed: building on a 32bit system led to ~553 additional
>> lines in '_build.packages.log', telling me that "xz: Adjusted the number
>> of threads from 8 to 3..." Doesn't hurt me yet. I just noticed.
> 
> Yes that is expected since the systems cannot use too much memory. But we are
> using as many cores as we can which I think is the best.

I'm curious what the 90% might bring.

>> > About the planet post: Has anything changed here? Can we release this?
>> > 
>> >   https://planet.ipfire.org/post/increasing-download-installation-speed-bene
>> > fits-of-a-smaller-iso-image
>> 
>> For me, its ok.
> 
> It needs some values in there because I didn't know how much we would save.
> 
> When should we release this?

WIR. ;-)

Good question. Is it running stable? Will it build on
other/smaller/bigger systems than mine? If we can answer this with a big
"YES", we should be able to release it.

I'll wait until the current building with 90% is finished and report.

But I can't speak for other development machines...

Best,
Matthias

  reply	other threads:[~2018-05-25 17:21 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-05-22 16:31 Matthias Fischer
2018-05-22 18:03 ` Michael Tremer
2018-05-22 19:05   ` Matthias Fischer
2018-05-22 19:57     ` Michael Tremer
2018-05-23 11:18       ` Michael Tremer
2018-05-24 16:54         ` Matthias Fischer
2018-05-25 13:13           ` Michael Tremer
2018-05-25 17:21             ` Matthias Fischer [this message]
2018-05-25 18:20               ` Matthias Fischer
2018-05-26 16:39               ` Matthias Fischer
2018-05-29 19:38                 ` Michael Tremer

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7346e4b7-0b24-0192-5ba9-5cf108704204@ipfire.org \
    --to=matthias.fischer@ipfire.org \
    --cc=development@lists.ipfire.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox