Hyperscan crashes in build process

Hyperscan crashes in build process

[ummeegge]

[-- Attachment #1: Type: text/plain, Size: 948 bytes --]

Hi all,
just wanted to report that Hyperscan quits in the current origin/next
build process with

[ 78%] Building CXX object CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle.cpp.o
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o] Error 1
make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o'
make[3]: *** Waiting for unfinished jobs....
make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
make[2]: *** [CMakeFiles/Makefile2:251: CMakeFiles/hs_compile_shared.dir/all] Error 2
make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
make[1]: *** [Makefile:130: all] Error 2
make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2

Best,

Erik

Re: Hyperscan crashes in build process

[Michael Tremer]

[-- Attachment #1: Type: text/plain, Size: 1117 bytes --]

How much memory does your build machine have?

> On 5 Jun 2019, at 16:40, ummeegge <ummeegge(a)ipfire.org> wrote:
> 
> Hi all,
> just wanted to report that Hyperscan quits in the current origin/next
> build process with
> 
> [ 78%] Building CXX object CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle.cpp.o
> c++: fatal error: Killed signal terminated program cc1plus
> compilation terminated.
> make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o] Error 1
> make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o'
> make[3]: *** Waiting for unfinished jobs....
> make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make[2]: *** [CMakeFiles/Makefile2:251: CMakeFiles/hs_compile_shared.dir/all] Error 2
> make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make[1]: *** [Makefile:130: all] Error 2
> make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2
> 
> Best,
> 
> Erik
> 
> 
> 

Re: Hyperscan crashes in build process

[ummeegge]

[-- Attachment #1: Type: text/plain, Size: 1608 bytes --]

On Mi, 2019-06-05 at 17:48 +0100, Michael Tremer wrote:
> Can you upgrade?
Currently, no.

> 
> > On 5 Jun 2019, at 17:32, ummeegge <ummeegge(a)ipfire.org> wrote:
> > 
> > On Mi, 2019-06-05 at 17:31 +0100, Michael Tremer wrote:
> > > How much memory does your build machine have?
> > 
> > 2GB :-) .
> > 
> > > 
> > > > On 5 Jun 2019, at 16:40, ummeegge <ummeegge(a)ipfire.org> wrote:
> > > > 
> > > > Hi all,
> > > > just wanted to report that Hyperscan quits in the current
> > > > origin/next
> > > > build process with
> > > > 
> > > > [ 78%] Building CXX object
> > > > CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle.cpp
> > > > .o
> > > > c++: fatal error: Killed signal terminated program cc1plus
> > > > compilation terminated.
> > > > make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698:
> > > > CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.c
> > > > pp.o
> > > > ] Error 1
> > > > make[3]: *** Deleting file
> > > > 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.
> > > > cpp.
> > > > o'
> > > > make[3]: *** Waiting for unfinished jobs....
> > > > make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > make[2]: *** [CMakeFiles/Makefile2:251:
> > > > CMakeFiles/hs_compile_shared.dir/all] Error 2
> > > > make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > make[1]: *** [Makefile:130: all] Error 2
> > > > make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2
> > > > 
> > > > Best,
> > > > 
> > > > Erik
> > > > 
> > > > 
> > > > 
> > > 
> > > 
> 
> 

Re: Hyperscan crashes in build process

[Michael Tremer]

[-- Attachment #1: Type: text/plain, Size: 1886 bytes --]

How many CPU cores does it have (I assume it is a VM)?

You can disable parallelism then. The build should generally be able to run through with 2GB of RAM because it does that on the ARM boards.

-Michael

> On 6 Jun 2019, at 07:31, ummeegge <ummeegge(a)ipfire.org> wrote:
> 
> On Mi, 2019-06-05 at 17:48 +0100, Michael Tremer wrote:
>> Can you upgrade?
> Currently, no.
> 
>> 
>>> On 5 Jun 2019, at 17:32, ummeegge <ummeegge(a)ipfire.org> wrote:
>>> 
>>> On Mi, 2019-06-05 at 17:31 +0100, Michael Tremer wrote:
>>>> How much memory does your build machine have?
>>> 
>>> 2GB :-) .
>>> 
>>>> 
>>>>> On 5 Jun 2019, at 16:40, ummeegge <ummeegge(a)ipfire.org> wrote:
>>>>> 
>>>>> Hi all,
>>>>> just wanted to report that Hyperscan quits in the current
>>>>> origin/next
>>>>> build process with
>>>>> 
>>>>> [ 78%] Building CXX object
>>>>> CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle.cpp
>>>>> .o
>>>>> c++: fatal error: Killed signal terminated program cc1plus
>>>>> compilation terminated.
>>>>> make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698:
>>>>> CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.c
>>>>> pp.o
>>>>> ] Error 1
>>>>> make[3]: *** Deleting file
>>>>> 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.
>>>>> cpp.
>>>>> o'
>>>>> make[3]: *** Waiting for unfinished jobs....
>>>>> make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>> make[2]: *** [CMakeFiles/Makefile2:251:
>>>>> CMakeFiles/hs_compile_shared.dir/all] Error 2
>>>>> make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>> make[1]: *** [Makefile:130: all] Error 2
>>>>> make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>> make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2
>>>>> 
>>>>> Best,
>>>>> 
>>>>> Erik
>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>> 
>> 
> 

Re: Hyperscan crashes in build process

[ummeegge]

[-- Attachment #1: Type: text/plain, Size: 3746 bytes --]

Hi Michael,

On Do, 2019-06-06 at 08:26 +0100, Michael Tremer wrote:
> How many CPU cores does it have (I assume it is a VM)?
It´s my good old JNC9C -->
https://fireinfo.ipfire.org/profile/72d11e77621ec66ea75d39e3c9b10025e746e5af

> 
> You can disable parallelism then. The build should generally be able
> to run through with 2GB of RAM because it does that on the ARM
> boards.
You mean by commenting the 'MAX_PARALLELISM' line in hyperscan LFS ?
If yes i hyperscan quits nevertheless

[ 81%] Building CXX object CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_instructions.cpp.o
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1776: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_exclusive.cpp.o] Error 1
make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_exclusive.cpp.o'
make[3]: *** Waiting for unfinished jobs....
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o] Error 1
make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o'
make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
make[2]: *** [CMakeFiles/Makefile2:251: CMakeFiles/hs_compile_shared.dir/all] Error 2
make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
make[1]: *** [Makefile:130: all] Error 2
make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2



> 
> -Michael

Best,

Erik


> 
> > On 6 Jun 2019, at 07:31, ummeegge <ummeegge(a)ipfire.org> wrote:
> > 
> > On Mi, 2019-06-05 at 17:48 +0100, Michael Tremer wrote:
> > > Can you upgrade?
> > 
> > Currently, no.
> > 
> > > 
> > > > On 5 Jun 2019, at 17:32, ummeegge <ummeegge(a)ipfire.org> wrote:
> > > > 
> > > > On Mi, 2019-06-05 at 17:31 +0100, Michael Tremer wrote:
> > > > > How much memory does your build machine have?
> > > > 
> > > > 2GB :-) .
> > > > 
> > > > > 
> > > > > > On 5 Jun 2019, at 16:40, ummeegge <ummeegge(a)ipfire.org>
> > > > > > wrote:
> > > > > > 
> > > > > > Hi all,
> > > > > > just wanted to report that Hyperscan quits in the current
> > > > > > origin/next
> > > > > > build process with
> > > > > > 
> > > > > > [ 78%] Building CXX object
> > > > > > CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle
> > > > > > .cpp
> > > > > > .o
> > > > > > c++: fatal error: Killed signal terminated program cc1plus
> > > > > > compilation terminated.
> > > > > > make[3]: ***
> > > > > > [CMakeFiles/hs_compile_shared.dir/build.make:1698:
> > > > > > CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_byteco
> > > > > > de.c
> > > > > > pp.o
> > > > > > ] Error 1
> > > > > > make[3]: *** Deleting file
> > > > > > 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytec
> > > > > > ode.
> > > > > > cpp.
> > > > > > o'
> > > > > > make[3]: *** Waiting for unfinished jobs....
> > > > > > make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > > > make[2]: *** [CMakeFiles/Makefile2:251:
> > > > > > CMakeFiles/hs_compile_shared.dir/all] Error 2
> > > > > > make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > > > make[1]: *** [Makefile:130: all] Error 2
> > > > > > make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
> > > > > > make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1]
> > > > > > Error 2
> > > > > > 
> > > > > > Best,
> > > > > > 
> > > > > > Erik
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > 
> > > > > 
> > > 
> > > 
> 
> 

Re: Hyperscan crashes in build process

[Michael Tremer]

[-- Attachment #1: Type: text/plain, Size: 3876 bytes --]

You should be able to see what parallelism make is using. It should be -j1.

If that is already the case, then you need more RAM to build this.

Best,
-Michael

> On 6 Jun 2019, at 18:39, ummeegge <ummeegge(a)ipfire.org> wrote:
> 
> Hi Michael,
> 
> On Do, 2019-06-06 at 08:26 +0100, Michael Tremer wrote:
>> How many CPU cores does it have (I assume it is a VM)?
> It´s my good old JNC9C -->
> https://fireinfo.ipfire.org/profile/72d11e77621ec66ea75d39e3c9b10025e746e5af
> 
>> 
>> You can disable parallelism then. The build should generally be able
>> to run through with 2GB of RAM because it does that on the ARM
>> boards.
> You mean by commenting the 'MAX_PARALLELISM' line in hyperscan LFS ?
> If yes i hyperscan quits nevertheless
> 
> [ 81%] Building CXX object CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_instructions.cpp.o
> c++: fatal error: Killed signal terminated program cc1plus
> compilation terminated.
> make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1776: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_exclusive.cpp.o] Error 1
> make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_exclusive.cpp.o'
> make[3]: *** Waiting for unfinished jobs....
> c++: fatal error: Killed signal terminated program cc1plus
> compilation terminated.
> make[3]: *** [CMakeFiles/hs_compile_shared.dir/build.make:1698: CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o] Error 1
> make[3]: *** Deleting file 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytecode.cpp.o'
> make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make[2]: *** [CMakeFiles/Makefile2:251: CMakeFiles/hs_compile_shared.dir/all] Error 2
> make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make[1]: *** [Makefile:130: all] Error 2
> make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
> make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1] Error 2
> 
> 
> 
>> 
>> -Michael
> 
> Best,
> 
> Erik
> 
> 
>> 
>>> On 6 Jun 2019, at 07:31, ummeegge <ummeegge(a)ipfire.org> wrote:
>>> 
>>> On Mi, 2019-06-05 at 17:48 +0100, Michael Tremer wrote:
>>>> Can you upgrade?
>>> 
>>> Currently, no.
>>> 
>>>> 
>>>>> On 5 Jun 2019, at 17:32, ummeegge <ummeegge(a)ipfire.org> wrote:
>>>>> 
>>>>> On Mi, 2019-06-05 at 17:31 +0100, Michael Tremer wrote:
>>>>>> How much memory does your build machine have?
>>>>> 
>>>>> 2GB :-) .
>>>>> 
>>>>>> 
>>>>>>> On 5 Jun 2019, at 16:40, ummeegge <ummeegge(a)ipfire.org>
>>>>>>> wrote:
>>>>>>> 
>>>>>>> Hi all,
>>>>>>> just wanted to report that Hyperscan quits in the current
>>>>>>> origin/next
>>>>>>> build process with
>>>>>>> 
>>>>>>> [ 78%] Building CXX object
>>>>>>> CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_castle
>>>>>>> .cpp
>>>>>>> .o
>>>>>>> c++: fatal error: Killed signal terminated program cc1plus
>>>>>>> compilation terminated.
>>>>>>> make[3]: ***
>>>>>>> [CMakeFiles/hs_compile_shared.dir/build.make:1698:
>>>>>>> CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_byteco
>>>>>>> de.c
>>>>>>> pp.o
>>>>>>> ] Error 1
>>>>>>> make[3]: *** Deleting file
>>>>>>> 'CMakeFiles/hs_compile_shared.dir/src/rose/rose_build_bytec
>>>>>>> ode.
>>>>>>> cpp.
>>>>>>> o'
>>>>>>> make[3]: *** Waiting for unfinished jobs....
>>>>>>> make[3]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>>>> make[2]: *** [CMakeFiles/Makefile2:251:
>>>>>>> CMakeFiles/hs_compile_shared.dir/all] Error 2
>>>>>>> make[2]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>>>> make[1]: *** [Makefile:130: all] Error 2
>>>>>>> make[1]: Leaving directory '/usr/src/hyperscan-5.1.1'
>>>>>>> make: *** [hyperscan:80: /usr/src/log/hyperscan-5.1.1]
>>>>>>> Error 2
>>>>>>> 
>>>>>>> Best,
>>>>>>> 
>>>>>>> Erik
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>>> 
>>>> 
>>>> 
>> 
>> 
>