[PATCH 3/3] importer: Purge any redundant entries

["Peter Müller" <peter.mueller@ipfire.org>]

[-- Attachment #1: Type: text/plain, Size: 1128 bytes --]

When importing inetnums, we might import various small networks
which are not relevant for us as long as they do not have a
different country code than their parent network.

Therefore we delete all these entries to keep the database
smaller without losing any information.

Signed-off-by: Peter Müller <peter.mueller(a)ipfire.org>
---
 src/python/location-importer.in | 7 +++++++
 1 file changed, 7 insertions(+)

diff --git a/src/python/location-importer.in b/src/python/location-importer.in
index fbc402f..ea72790 100644
--- a/src/python/location-importer.in
+++ b/src/python/location-importer.in
@@ -375,6 +375,13 @@ class CLI(object):
 					SELECT _autnums.number, _organizations.name FROM _autnums
 						JOIN _organizations ON _autnums.organization = _organizations.handle
 				ON CONFLICT (number) DO UPDATE SET name = excluded.name;
+
+				--- Purge any redundant entries
+				DELETE FROM networks candidates WHERE EXISTS (
+					SELECT FROM networks
+						WHERE networks.network >> candidates.network
+							AND networks.country = candidates.country
+				);
 			""")
 
 		# Download all extended sources
-- 
2.20.1