public inbox for development@lists.ipfire.org
 help / color / mirror / Atom feed
From: Michael Tremer <michael.tremer@ipfire.org>
To: development@lists.ipfire.org
Subject: Next steps of IPFire Location
Date: Wed, 18 Nov 2020 19:26:58 +0000	[thread overview]
Message-ID: <FF7781B7-693E-46EF-A421-D312768E59F8@ipfire.org> (raw)

[-- Attachment #1: Type: text/plain, Size: 1614 bytes --]

Hello,

Since there are now so many people involved in this project, I would like to send a little email to report what has happened and what the next steps are going to be…

I have spent (unfortunately) a lot of time to add the ability that we can “flatten the tree” when we export it. That means that no network will overlap with another one and we do not need to care about any orders of iptables rules being added.

That was quite a slow process in Python and since IPFire has to run on small hardware it needed to be ported into C. The tree can now be exported in about 10 seconds on my development box which is running an Intel Xeon E5-2630 processor.

I hope that we can reach acceptable times of only a few minutes on the slowest systems and way under a minute on an average system. To find out about that, I need you help:

I just pushed all changes into the next tree and would everyone who can to install that and report how long this command runs:

  mkdir tmp
  time location export --directory=tmp --format=xt_geoip

It would also be great if you could all check the output if this is still correct. I have done what I could, but I want to have an extra pair of eyes if possible.

If this works well, and no more regressions are being found, I will tag this release and we will close Core Update 153.

We will then roll out all recent changes that make the database better, but had to be held back because the tree needs to be flattened for most use-cases now. All older clients will then no longer receive an updated database any more.

Happy testing.

Best,
-Michael

             reply	other threads:[~2020-11-18 19:26 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-11-18 19:26 Michael Tremer [this message]
2020-11-19 13:10 ` Michael Tremer
2020-11-19 17:48   ` Adolf Belka
2020-11-22 20:06     ` Adolf Belka
2020-11-23 11:15       ` Michael Tremer
2020-11-19 18:49   ` Stefan Schantl
2020-11-20 16:27 ` Peter Müller
2020-11-22 11:59   ` Peter Müller
2020-11-23 11:16     ` Michael Tremer
2020-11-25 20:24       ` Michael Tremer
2020-11-26  7:51         ` Arne Fitzenreiter
2020-11-26 16:21           ` Michael Tremer
2020-11-27  8:03         ` Stefan Schantl
2020-11-27 16:48           ` Michael Tremer
2020-11-28 14:47         ` libloc output for xt_geoip is fine on Core Update 153 Development Build: next/e8ecc81a (was: Re: Next steps of IPFire Location) Peter Müller
2020-12-06 12:35           ` libloc output for xt_geoip is fine on Core Update 153 Development Build: next/e8ecc81a Arne Fitzenreiter
2020-12-06 20:01             ` Michael Tremer
2020-12-07 10:41               ` Adolf Belka
2020-12-07 12:16               ` Arne Fitzenreiter

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=FF7781B7-693E-46EF-A421-D312768E59F8@ipfire.org \
    --to=michael.tremer@ipfire.org \
    --cc=development@lists.ipfire.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox