Hello,
I just wanted to post you an update about the build system which we have recently merged.
The whole build process is primarily CPU bound and secondarily IO bound. Some builders have by definition slow storage (the ARM SBCs for example), but also for other reason it does not make sense to run the build on persistent storage. We can keep it in RAM instead which makes accessing files a lot faster and saves write cycles on the media.
Therefore, the make.sh build script is mounting /usr/src in the build environment as a ramdisk. All source will be extracted there and the build will be performed. After the build is done, the whole ramdisk will be destroyed again.
This feature is automatically enabled on all build systems which have 4GB of RAM or more. You can manually disable it with the ENABLE_RAMDISK=off switch in .config.
I hope this brief email makes sense. If you have any questions, feel free to ask.
Best, -Michael
On 13.06.2019 17:17, Michael Tremer wrote:
Hello,
I just wanted to post you an update about the build system which we have recently merged. ...
Therefore, the make.sh build script is mounting /usr/src in the build environment as a ramdisk. All source will be extracted there and the build will be performed. After the build is done, the whole ramdisk will be destroyed again. ... I hope this brief email makes sense...
Yes it does. ;-)
FYI: Last build (Core 133) here completed in 4:22:14.
Significantly faster than before.
Best, Matthias
Cool. What was the time before?
On 15 Jun 2019, at 11:03, Matthias Fischer matthias.fischer@ipfire.org wrote:
On 13.06.2019 17:17, Michael Tremer wrote: Hello,
I just wanted to post you an update about the build system which we have recently merged. ...
Therefore, the make.sh build script is mounting /usr/src in the build environment as a ramdisk. All source will be extracted there and the build will be performed. After the build is done, the whole ramdisk will be destroyed again. ... I hope this brief email makes sense...
Yes it does. ;-)
FYI: Last build (Core 133) here completed in 4:22:14.
Significantly faster than before.
Best, Matthias
Hi,
On 13.06.2019 17:17, Michael Tremer wrote:
Hello,
I just wanted to post you an update about the build system which we have recently merged.
...
I'm bringing this thread up again because beginning with Core 136, I notice a significant deceleration.
Last - clean - build from tonight:
... Checking Logfiles for new Files *** Build finished in 12:28:46 ...
That's a new record. Build time with Core 135 was about 7-8 hours.
Is it the same for others?
Best, Matthias
Hi,
Is that a repeated build?
Do you know which package took extremely long?
The nightly builds seem to be fine at around 4:30 hrs.
-Michael
On 17 Sep 2019, at 12:18, Matthias Fischer matthias.fischer@ipfire.org wrote:
Hi,
On 13.06.2019 17:17, Michael Tremer wrote:
Hello,
I just wanted to post you an update about the build system which we have recently merged.
...
I'm bringing this thread up again because beginning with Core 136, I notice a significant deceleration.
Last - clean - build from tonight:
... Checking Logfiles for new Files *** Build finished in 12:28:46 ...
That's a new record. Build time with Core 135 was about 7-8 hours.
Is it the same for others?
Best, Matthias
If this was the first core136 build it is normal because it has a new toolchain package and this invalidate the ccache so all has to rebuild without cache.
Arne
Am 2019-09-17 22:30, schrieb Michael Tremer:
Hi,
Is that a repeated build?
Do you know which package took extremely long?
The nightly builds seem to be fine at around 4:30 hrs.
-Michael
On 17 Sep 2019, at 12:18, Matthias Fischer matthias.fischer@ipfire.org wrote:
Hi,
On 13.06.2019 17:17, Michael Tremer wrote:
Hello,
I just wanted to post you an update about the build system which we have recently merged.
...
I'm bringing this thread up again because beginning with Core 136, I notice a significant deceleration.
Last - clean - build from tonight:
... Checking Logfiles for new Files *** Build finished in 12:28:46 ...
That's a new record. Build time with Core 135 was about 7-8 hours.
Is it the same for others?
Best, Matthias
On 17.09.2019 22:30, Michael Tremer wrote:
Hi,
Is that a repeated build?
Why did I know you would ask this question... ;-))
No, it was the first.
Do you know which package took extremely long?
No, but I'll take a look - I kept the logs.
The nightly builds seem to be fine at around 4:30 hrs.
I'll see.
-Michael
On 17 Sep 2019, at 12:18, Matthias Fischer matthias.fischer@ipfire.org wrote:
Hi,
On 13.06.2019 17:17, Michael Tremer wrote:
Hello,
I just wanted to post you an update about the build system which we have recently merged.
...
I'm bringing this thread up again because beginning with Core 136, I notice a significant deceleration.
Last - clean - build from tonight:
... Checking Logfiles for new Files *** Build finished in 12:28:46 ...
That's a new record. Build time with Core 135 was about 7-8 hours.
Is it the same for others?
Best, Matthias
-
Arne Fitzenreiter -
Matthias Fischer -
Michael Tremer