- Location - lists.ipfire.org

Mem-leaks in 'test-as.c'
by Gisle Vanem 24 Oct '20

24 Oct '20

Michael Tremer wrote: > First thing to know is that we use reference counting for all objects. > So every pointer that refers to an object has to decrement > the counter when it no longer needs it. The object will be automatically > cleaned up after nothing needs it any more. In 'test-as.c', I get a huge amount of leaks in MSVC debug-mode. Since 'loc_database_enumerator_unref()' just unreferences itself and not the 'as' (working as designed?) IMHO it should be: --- a/test-as.c 2020-10-19 17:35:01 +++ b/test-as.c 2020-10-24 10:01:57 @@ -111,12 +111,17 @@ while (as) { printf("Found AS%d: %s\n", loc_as_get_number(as), loc_as_get_name(as)); - err = loc_database_enumerator_next_as(enumerator, &as); + struct loc_as* as_next; + + err = loc_database_enumerator_next_as(enumerator, &as_next); if (err) { fprintf(stderr, "Could not enumerate next AS\n"); exit(EXIT_FAILURE); } + loc_as_unref(as); + as = as_next; } loc_database_enumerator_unref(enumerator); With that patch, no reported leaks. Could be leaks in 'libloc' itself too; haven't checked yet. -- --gv

1 0

Planned patches for Core Update 152 and handling location filter issues in Core Update 151 (was: Re: Upcoming Core Update 151)
by Peter Müller 23 Oct '20

23 Oct '20

Hello Michael, hello *, I am currently working on a new version of the Tor add-on, which should be done in a couple of hours and can IMHO safely be merged in Core Update 152. :-) Regarding Core Update 151 (hence the location list CC'ed): Are you planning to include your commits made to libloc today and yesterday into this update as well? Or are those not necessary on the client-side and we ship them with a new version of libloc? Speaking about the location database: My understanding of handling bugs #12499 to #12501 is currently the following: 1. We continue to generate location databases using the extended sources. 2. A fix for the location filter issue (#12499) is already included in Core Update 151. 3. As soon as we feel confident about the inetnum patchset I submitted the other day (i. e. after some successful Q/A testing), we release a new version of libloc and publish databases in a new fashion (inetnum data where we have it, and extended sources otherwise). >From my point of view, the last step will break systems still running on Core Update 150 and having the location filter enabled. Those should not be too much, but since we can never be sure, we could 1. Urge all users to install Core Update 151 as fast as possible once it has been released. 2. Give them some time (2 weeks, maybe longer) until we switch to the new database format. 3. Prohibit location downloads from user-agents we can correlate to Core Update 150 systems left over. This requires Core Update 151 systems to come with a different user-agent. Is this procedure fine? Or am I missing something? Thanks, and best regards, Peter Müller > Hello, > > So since Core Update 151 has been available for testing for a while and because we have received a lot of positive feedback, we are planning a release quite soon. > > This also means that Core Update 152 is ready to be closed for any further changes. We will soon merge it into master unless somebody has some urgent changes that need to be included in it. Please raise your hand now. > > Everyone have a lovely weekend. > > Best, > -Michael > >> On 2 Oct 2020, at 16:51, Michael Tremer <michael.tremer(a)ipfire.org> wrote: >> >> Hello everyone, >> >> I have been in charge of merging together Core Update 151. >> >> I would like to accept patches until (and including Monday). After that I would like to close it and only accept any fixes for newly introduced bugs. >> >> If anyone has anything urgent, please let me know. Otherwise everything else will be merged into Core Update 152. >> >> Thank you all for your hard work on this Core Update. It has a large number of contributors which makes me happy :) >> >> Have a lovely weekend, >> -Michael >

1 0

[PATCH] overrides/override-{a{1,3},other}.txt: weekly batch of override updates
by Peter Müller 23 Oct '20

23 Oct '20

A large chunk of anycast networks within the RIPE area has been added this time. Signed-off-by: Peter Müller <peter.mueller(a)ipfire.org> --- overrides/override-a1.txt | 27 +- overrides/override-a3.txt | 1316 +++++++++++++++++++++++++++++++++- overrides/override-other.txt | 17 +- 3 files changed, 1302 insertions(+), 58 deletions(-) diff --git a/overrides/override-a1.txt b/overrides/override-a1.txt index d4fe379..a9fdf96 100644 --- a/overrides/override-a1.txt +++ b/overrides/override-a1.txt @@ -137,6 +137,7 @@ aut-num: AS209623 descr: David Craig remarks: (Rogue) VPN provider is-anonymous-proxy: yes +country: EU aut-num: AS210083 descr: Privex Inc. @@ -869,24 +870,14 @@ descr: BGRVPN remarks: VPN provider is-anonymous-proxy: yes -net: 173.244.36.0/24 -descr: Private Internet Access -remarks: VPN provider -is-anonymous-proxy: yes - -net: 173.244.42.0/24 -descr: ExpressVPN -remarks: VPN provider -is-anonymous-proxy: yes - -net: 173.244.48.0/24 -descr: Private Internet Access -remarks: VPN provider +net: 173.244.32.0/19 +descr: LogicWeb Inc. / BGRVPN / Private Internet Access / VPNetworks / CookieProxy / etc. pp. +remarks: large IP chunk mostly used by VPN providers is-anonymous-proxy: yes -net: 173.244.55.0/24 -descr: VPN Consumer Network -remarks: VPN provider +net: 173.239.192.0/18 +descr: LogicWeb Inc. / BGRVPN / Private Internet Access / VPNetworks / CookieProxy / etc. pp. +remarks: large IP chunk mostly used by VPN providers is-anonymous-proxy: yes net: 173.245.202.0/23 @@ -985,7 +976,7 @@ remarks: VPN provider is-anonymous-proxy: yes net: 185.244.28.0/22 -descr: Freedom of Speech VPN / nVPN / David Craig / ... +descr: Angelo Kreikamp trading as Forhosting / Freedom of Speech VPN / nVPN / David Craig / ... remarks: (Rogue) VPN provider is-anonymous-proxy: yes @@ -1115,7 +1106,7 @@ remarks: VPN and open proxy provider is-anonymous-proxy: yes net: 194.5.96.0/22 -descr: Privacy Online / Danilenko, Artyom / ... +descr: Angelo Kreikamp trading as Forhosting / Privacy Online / Danilenko, Artyom / ... remarks: (Rogue) VPN provider is-anonymous-proxy: yes diff --git a/overrides/override-a3.txt b/overrides/override-a3.txt index 26acb64..eb17927 100644 --- a/overrides/override-a3.txt +++ b/overrides/override-a3.txt @@ -14,11 +14,22 @@ descr: University of Pennsylvania remarks: Generic anycast network is-anycast: yes +aut-num: AS2591 +descr: IMPLETEC TECHNOLOGIES LTD +remarks: Generic anycast network, RIR contact data contain garbage :-/ +is-anycast: yes +country: EU + aut-num: AS4935 descr: DirectNIC, Ltd. remarks: Generic anycast network [high confidence, but not proofed] is-anycast: yes +aut-num: AS31529 +descr: DENIC eG +remarks: TLD operator's anycast network +is-anycast: yes + aut-num: AS33463 descr: Citigroup remarks: Public anycast DNS resolver network [high confidence, but not proofed] @@ -61,12 +72,12 @@ is-anycast: yes aut-num: AS61005 descr: OpenTLD BV -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS61007 descr: OpenTLD BV -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS62766 @@ -76,17 +87,17 @@ is-anycast: yes aut-num: AS134389 descr: AusRegistry -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS134393 descr: AusRegistry -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS134396 descr: AusRegistry -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS198794 @@ -136,7 +147,7 @@ is-anycast: yes aut-num: AS210004 descr: Stichting Internet Domeinregistratie Nederland (SIDN) -remarks: Generic anycast network +remarks: TLD operator's anycast network is-anycast: yes aut-num: AS396981 @@ -154,6 +165,16 @@ descr: Cloudflare, Inc. remarks: Public anycast DNS resolver is-anycast: yes +net: 2.58.58.0/24 +descr: Hybula B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 5.254.74.0/24 +descr: VOXILITY LLC +remarks: Generic anycast network +is-anycast: yes + net: 8.8.4.0/24 descr: Google LLC remarks: Public anycast DNS resolver @@ -169,68 +190,1295 @@ descr: Quad9 remarks: Public anycast DNS resolver is-anycast: yes +net: 37.72.151.0/24 +descr: LWLcom GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 37.209.192.0/23 +descr: ARI Registry Services Limited +remarks: TLD operator's anycast network +is-anycast: yes + +net: 37.209.194.0/23 +descr: ARI Registry Services Limited +remarks: TLD operator's anycast network +is-anycast: yes + +net: 37.209.196.0/23 +descr: ARI Registry Services Limited +remarks: TLD operator's anycast network +is-anycast: yes + +net: 37.209.198.0/23 +descr: ARI Registry Services Limited +remarks: TLD operator's anycast network +is-anycast: yes + +net: 37.218.244.0/24 +descr: Greenhost BV +remarks: Generic anycast network +is-anycast: yes + +net: 45.9.11.0/24 +descr: Tianhai InfoTech +remarks: Generic anycast network +is-anycast: yes + +net: 45.12.120.0/24 +descr: Maximilian Schieder trading as Zeug e.K. +remarks: Generic anycast network +is-anycast: yes + +net: 45.67.12.0/24 +descr: Net Stack Ltd. +remarks: Generic anycast network +is-anycast: yes + +net: 45.87.160.0/24 +descr: Smart Internet Solutions UG (haftungsbeschraenkt) +remarks: Generic anycast network +is-anycast: yes + +net: 45.91.19.0/24 +descr: Mimecast +remarks: Generic anycast network +is-anycast: yes + +net: 45.95.54.0/24 +descr: Jan Philipp Waldecker trading as LUMASERV Systems +remarks: Generic anycast network +is-anycast: yes + +net: 45.132.10.0/24 +descr: Servada V.O.F +remarks: Generic anycast network +is-anycast: yes + +net: 45.137.236.0/24 +descr: Link Connectivity Limited +remarks: Generic anycast network +is-anycast: yes + +net: 45.138.104.0/22 +descr: WEDOS Internet, a.s. +remarks: Generic anycast network +is-anycast: yes + +net: 45.150.151.0/24 +descr: Random Labs SASU +remarks: Generic anycast network +is-anycast: yes + +net: 46.255.120.0/24 +descr: Robtex Anycast Network +remarks: Generic anycast network +is-anycast: yes + +net: 62.138.132.0/23 +descr: Host Europe GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 77.55.124.0/24 +descr: Nazwa.pl Sp.z.o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 78.24.214.0/24 +descr: CONTINENT 8 TECHNOLOGIES PLC +remarks: Generic anycast network +is-anycast: yes + +net: 79.143.48.0/24 +descr: Samir Jafferali +remarks: Generic anycast network +is-anycast: yes + +net: 79.143.249.0/24 +descr: Absolight +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 79.170.183.0/24 +descr: ITsynergy Limited +remarks: Generic anycast network +is-anycast: yes + +net: 80.70.216.0/24 +descr: Dalenys Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 80.78.134.0/24 +descr: SurfBouncer Anycast Network by Cheyenne Technologies LLC +remarks: Generic anycast network +is-anycast: yes + +net: 80.83.179.0/24 +descr: anycast.io +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 80.83.184.0/24 +descr: anycast.io +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 80.83.188.0/24 +descr: anycast.io +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 80.86.188.0/24 +descr: anycast.io +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 80.91.56.0/24 +descr: Sfera Networks s.r.l. +remarks: Generic anycast network +is-anycast: yes + +net: 80.91.57.0/24 +descr: Sfera Networks s.r.l. +remarks: Generic anycast network +is-anycast: yes + +net: 80.93.170.0/24 +descr: Nuco Technologies Ltd. +remarks: Generic anycast network +is-anycast: yes + +net: 80.245.103.0/24 +descr: Vitec MV A/S +remarks: Generic anycast network +is-anycast: yes + +net: 81.91.254.0/24 +descr: vXtream Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 81.92.94.0/24 +descr: NAMESHIELD SAS +remarks: Generic anycast network +is-anycast: yes + +net: 81.92.95.0/24 +descr: NAMESHIELD SAS +remarks: Generic anycast network +is-anycast: yes + +net: 81.89.224.0/24 +descr: DTS Systeme GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 81.161.227.0/24 +descr: Equivoip Limited +remarks: Generic anycast network +is-anycast: yes + +net: 83.136.39.0/24 +descr: nic.at GmbH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 83.166.143.0/24 +descr: Infomaniak Network SA +remarks: Generic anycast network +is-anycast: yes + +net: 83.235.74.0/23 +descr: Ote SA (Hellenic Telecommunications Organisation) +remarks: Generic anycast network +is-anycast: yes + +net: 83.235.76.0/24 +descr: Ote SA (Hellenic Telecommunications Organisation) +remarks: Generic anycast network +is-anycast: yes + +net: 84.2.40.0/21 +descr: Magyar Telekom plc. +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 84.33.33.0/24 +descr: INCUBATEC GmbH - Srl +remarks: Generic anycast network +is-anycast: yes + +net: 84.245.96.0/24 +descr: SK-NIC, a.s. +remarks: TLD operator's anycast network +is-anycast: yes + +net: 85.208.69.0/24 +descr: Three Fourteen SASU +remarks: Generic anycast network +is-anycast: yes + +net: 85.209.184.0/24 +descr: Securepoint GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 85.209.241.0/24 +descr: CVD Sp. z o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 85.209.242.0/23 +descr: CVD Sp. z o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 85.236.159.0/24 +descr: PlanetHoster Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 87.117.96.0/23 +descr: Soluciones Corporativas IP, SL +remarks: Generic anycast network +is-anycast: yes + +net: 88.212.8.0/24 +descr: ANTIK Telecom s.r.o +remarks: Generic anycast network +is-anycast: yes + +net: 88.218.206.0/24 +descr: ALICE CAT RESEARCH LTD (?) +remarks: Generic anycast network +is-anycast: yes + +net: 89.42.232.0/24 +descr: EvoWise SRL +remarks: Generic anycast network +is-anycast: yes + +net: 89.42.233.0/24 +descr: EvoWise SRL +remarks: Generic anycast network +is-anycast: yes + +net: 89.207.190.0/23 +descr: nexperteam BV +remarks: Generic anycast network +is-anycast: yes + +net: 90.255.255.0/24 +descr: Vodafone Limited +remarks: Generic anycast network +is-anycast: yes + +net: 91.151.23.0/24 +descr: Profihost AG +remarks: Generic anycast network +is-anycast: yes + +net: 91.188.224.0/24 +descr: HOSTERION SRL +remarks: Generic anycast network +is-anycast: yes + +net: 91.188.225.0/24 +descr: HOSTERION SRL +remarks: Generic anycast network +is-anycast: yes + +net: 91.231.63.0/24 +descr: Leissner Data AB +remarks: Generic anycast network +is-anycast: yes + +net: 91.233.217.0/24 +descr: LLC IVI.RU +remarks: Generic anycast network +is-anycast: yes + +net: 91.233.218.0/24 +descr: LLC IVI.RU +remarks: Generic anycast network +is-anycast: yes + +net: 91.236.182.0/24 +descr: Brillant Auto Kft. / Undernet +remarks: Generic anycast network +is-anycast: yes + net: 91.239.100.0/24 descr: Thomas Steen Rasmussen / UncensoredDNS / censurfridns.dk remarks: Public anycast DNS resolver is-anycast: yes -net: 149.112.120.0/21 -descr: Canadian Internet Registration Authority (CIRA) +net: 92.223.95.0/24 +descr: G-Core Labs S.A. remarks: Generic anycast network is-anycast: yes -net: 170.52.0.0/21 -descr: subspace -remarks: Generic anycast network [high confidence, but not proofed] +net: 92.242.133.0/24 +descr: Barefruit Ltd. +remarks: Generic anycast network is-anycast: yes -net: 185.89.134.0/24 -descr: Isset +net: 92.242.134.0/24 +descr: Barefruit Ltd. remarks: Generic anycast network is-anycast: yes -net: 185.143.232.0/22 -descr: Noyan Abr Arvan Co. +net: 92.242.140.0/24 +descr: Barefruit Ltd. remarks: Generic anycast network is-anycast: yes -net: 185.151.140.0/22 -descr: DENIC eG +net: 92.242.142.0/24 +descr: Barefruit Ltd. remarks: Generic anycast network is-anycast: yes -net: 185.184.222.0/24 -descr: xTom / dns.sb -remarks: Public anycast DNS resolver +net: 92.242.144.0/24 +descr: Barefruit Ltd. +remarks: Generic anycast network is-anycast: yes -net: 185.228.168.0/22 -descr: Daniel Cid +net: 92.242.154.0/24 +descr: Barefruit Ltd. remarks: Generic anycast network is-anycast: yes -net: 185.222.221.0/24 -descr: xTom / dns.sb -remarks: Public anycast DNS resolver +net: 92.242.155.0/24 +descr: Barefruit Ltd. +remarks: Generic anycast network is-anycast: yes -net: 185.222.222.0/24 -descr: xTom / dns.sb -remarks: Public anycast DNS resolver +net: 93.62.29.0/24 +descr: Fastweb SpA +remarks: Generic anycast network is-anycast: yes -net: 196.55.0.0/24 -descr: Epik Network +net: 93.174.255.0/24 +descr: Heidmar UK Limited remarks: Generic anycast network is-anycast: yes -net: 196.216.168.0/24 -descr: AfriNIC Anycast Services +net: 93.191.218.0/24 +descr: Keytrade Bank remarks: Generic anycast network is-anycast: yes -net: 212.102.32.0/24 -descr: CDN77 +net: 94.152.254.0/24 +descr: KEI.PL Sp. z o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 94.152.255.0/24 +descr: KEI.PL Sp. z o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 95.87.100.0/24 +descr: Vision247 +remarks: Generic anycast network +is-anycast: yes + +net: 95.177.2.0/24 +descr: Griffin Internet Infrastructure Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 94.199.248.0/24 +descr: VikingHost +remarks: Generic anycast network +is-anycast: yes + +net: 109.72.143.0/24 +descr: GPC Services AG +remarks: Generic anycast network +is-anycast: yes + +net: 109.74.27.0/24 +descr: Lars Erik Reuterborg Larsson +remarks: Generic anycast network +is-anycast: yes + +net: 109.105.149.0/24 +descr: Innova Co S.A.R.L. +remarks: Generic anycast network +is-anycast: yes + +net: 109.163.224.0/24 +descr: Voxility S.R.L. +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 109.233.152.0/24 +descr: New Work SE / Xing +remarks: Generic anycast network +is-anycast: yes + +net: 109.233.178.0/24 +descr: Kantonsschule Zug +remarks: Generic anycast network +is-anycast: yes + +net: 130.185.120.0/24 +descr: Softqloud GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 145.0.0.0/24 +descr: SURFnet BV +remarks: Generic anycast network +is-anycast: yes + +net: 145.90.8.0/24 +descr: Universiteit Twente +remarks: Generic anycast network +is-anycast: yes + +net: 145.100.118.0/24 +descr: Universiteit Twente +remarks: Generic anycast network +is-anycast: yes + +net: 146.66.127.0/24 +descr: SiteGround Hosting EOOD +remarks: Generic anycast network +is-anycast: yes + +net: 149.112.120.0/21 +descr: Canadian Internet Registration Authority (CIRA) +remarks: Generic anycast network +is-anycast: yes + +net: 151.249.124.0/23 +descr: Domeneshop AS +remarks: Generic anycast network +is-anycast: yes + +net: 151.249.126.0/24 +descr: Domeneshop AS +remarks: Generic anycast network +is-anycast: yes + +net: 152.89.172.0/24 +descr: NAMESHIELD SAS +remarks: Generic anycast network +is-anycast: yes + +net: 153.92.2.0/24 +descr: Hostinger International Limited +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.0.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.1.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.2.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.3.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.4.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.5.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.14.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 164.138.15.0/24 +descr: ProstoDNS +remarks: Generic anycast network +is-anycast: yes + +net: 170.52.0.0/21 +descr: subspace +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 178.23.20.0/24 +descr: Communications Regulatory Authority +remarks: Generic anycast network +is-anycast: yes + +net: 185.20.53.0/24 +descr: Exascale Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.20.54.0/24 +descr: Exascale Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.21.168.0/24 +descr: OpenTLD BV +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.21.169.0/24 +descr: OpenTLD BV +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.21.170.0/24 +descr: OpenTLD BV +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.21.171.0/24 +descr: OpenTLD BV +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.22.111.0/24 +descr: PlanetHoster Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 185.24.64.0/24 +descr: CentralNic Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 185.24.67.0/24 +descr: CentralNic Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 185.24.255.0/24 +descr: DRK Networks +remarks: Generic anycast network +is-anycast: yes + +net: 185.26.208.0/24 +descr: KTN (?) +remarks: Generic anycast network +is-anycast: yes + +net: 185.28.94.0/24 +descr: Comcast International Holdings UK Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.28.195.0/24 +descr: Gransy s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.28.247.0/24 +descr: K&T Neutech Oy / Planeetta Internet Oy +remarks: Generic anycast network +is-anycast: yes + +net: 185.32.70.0/24 +descr: More Ltd (?) +remarks: Generic anycast network +is-anycast: yes + +net: 185.38.240.0/24 +descr: Roller Network LLC +remarks: Generic anycast network +is-anycast: yes + +net: 185.38.108.0/24 +descr: NEROSO Inst., s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.45.147.0/24 +descr: UGO LLC ANYCAST +remarks: Generic anycast network +is-anycast: yes + +net: 185.45.208.0/24 +descr: Onecom Global Communications LTD Anycast Services +remarks: Generic anycast network +is-anycast: yes + +net: 185.58.212.0/22 +descr: mono solutions ApS +remarks: Generic anycast network +is-anycast: yes + +net: 185.60.250.0/24 +descr: Jimdo GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.68.196.0/24 +descr: Anycast 0 loss B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.68.197.0/24 +descr: Anycast 0 loss B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.68.198.0/24 +descr: Anycast 0 loss B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.68.199.0/24 +descr: Anycast 0 loss B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.74.47.0/24 +descr: Innova Media d.o.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.77.72.0/23 +descr: Claranet +remarks: Generic anycast network +is-anycast: yes + +net: 185.80.196.0/24 +descr: ARIA VID RAYAN CO.LTD. +remarks: Generic anycast network +is-anycast: yes + +net: 185.82.40.0/24 +descr: item Industrietechnik GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.82.42.0/24 +descr: item Industrietechnik GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.82.145.0/24 +descr: Cloud Center Finland Oy +remarks: Generic anycast network +is-anycast: yes + +net: 185.83.5.0/24 +descr: Foundation Eesti Interneti Sihtasutus +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.89.134.0/24 +descr: Isset BV +remarks: Generic anycast network +is-anycast: yes + +net: 185.93.142.0/24 +descr: retarus GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.94.67.0/24 +descr: "CFC Group" LLC +remarks: Generic anycast network +is-anycast: yes + +net: 185.96.95.0/24 +descr: Paragon Internet Group Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.102.216.0/24 +descr: CDN77 +remarks: Generic anycast network +is-anycast: yes + +net: 185.103.200.0/24 +descr: Wanwire B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.103.203.0/24 +descr: Wanwire B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.109.139.0/24 +descr: Clearhost +remarks: Generic anycast network +is-anycast: yes + +net: 185.109.242.0/24 +descr: EDSI-Tech Sarl +remarks: Generic anycast network +is-anycast: yes + +net: 185.121.177.0/24 +descr: FuslVZ OpenNIC Anycast DNS Resolver +remarks: Public anycast DNS resolver +is-anycast: yes + +net: 185.125.108.0/24 +descr: HOSTERION SRL +remarks: Generic anycast network +is-anycast: yes + +net: 185.130.160.0/22 +descr: mono solutions ApS +remarks: Generic anycast network +is-anycast: yes + +net: 185.139.156.0/24 +descr: Jonas Pasche / Uberspace +remarks: Generic anycast network +is-anycast: yes + +net: 185.140.82.0/24 +descr: GMO GlobalSign Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 185.142.34.0/23 +descr: MIRholding B.V. +remarks: Generic anycast network +is-anycast: yes + +net: 185.143.80.0/24 +descr: Digital Systems Ltd. +remarks: Generic anycast network +is-anycast: yes + +net: 185.143.232.0/22 +descr: Noyan Abr Arvan Co. +remarks: Generic anycast network +is-anycast: yes + +net: 185.151.140.0/22 +descr: DENIC eG +remarks: TLD operator's anycast network +is-anycast: yes + +net: 185.151.204.0/24 +descr: Adjust GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.154.217.0/24 +descr: Evowise SRL +remarks: Generic anycast network +is-anycast: yes + +net: 185.154.218.0/24 +descr: Evowise SRL +remarks: Generic anycast network +is-anycast: yes + +net: 185.167.176.0/24 +descr: Name SRS AB +remarks: Generic anycast network +is-anycast: yes + +net: 185.173.18.0/24 +descr: XINDI Networks SRL +remarks: Generic anycast network +is-anycast: yes + +net: 185.177.217.0/24 +descr: Adman LLC +remarks: Generic anycast network +is-anycast: yes + +net: 185.179.80.0/24 +descr: Reliable Software, Ltd. +remarks: Generic anycast network +is-anycast: yes + +net: 185.184.222.0/24 +descr: xTom / dns.sb +remarks: Public anycast DNS resolver +is-anycast: yes + +net: 185.187.152.0/24 +descr: Rage4 Networks Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.190.82.0/24 +descr: The Little Moe New, LLC [good grief...] +remarks: Generic anycast network +is-anycast: yes + +net: 185.195.117.0/24 +descr: Exascale Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.195.118.0/24 +descr: Exascale Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.199.174.0/24 +descr: HOSTERION SRL +remarks: Generic anycast network +is-anycast: yes + +net: 185.222.19.0/24 +descr: Kadfire Limited +remarks: Generic anycast network +is-anycast: yes + +net: 185.222.221.0/24 +descr: xTom / dns.sb +remarks: Public anycast DNS resolver +is-anycast: yes + +net: 185.222.222.0/24 +descr: xTom / dns.sb +remarks: Public anycast DNS resolver +is-anycast: yes + +net: 185.228.168.0/22 +descr: Daniel Cid / Cleanbrowsing +remarks: Generic anycast network +is-anycast: yes + +net: 185.234.214.0/24 +descr: Misaka Network, Inc. +remarks: Generic anycast network +is-anycast: yes + +net: 185.235.37.0/24 +descr: LEMARIT GmbH +remarks: Generic anycast network +is-anycast: yes + +net: 185.253.213.0/24 +descr: AfterMarket.pl +remarks: Generic anycast network +is-anycast: yes + +net: 185.253.214.0/24 +descr: AfterMarket.pl +remarks: Generic anycast network +is-anycast: yes + +net: 185.255.240.0/24 +descr: LiveSport s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.255.241.0/24 +descr: LiveSport s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.255.242.0/24 +descr: LiveSport s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 185.255.243.0/24 +descr: LiveSport s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 188.95.39.0/24 +descr: Nordiska Servercentralen AB +remarks: Generic anycast network +is-anycast: yes + +net: 188.168.15.0/24 +descr: Joint Stock Company TransTeleCom +remarks: Generic anycast network +is-anycast: yes + +net: 188.244.98.0/24 +descr: Misaka Network, Inc. +remarks: Generic anycast network +is-anycast: yes + +net: 192.88.83.0/24 +descr: FidoNet +remarks: Public anycast DNS resolver +is-anycast: yes + +net: 192.165.107.0/24 +descr: EasyTelecom Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 193.0.9.0/24 +descr: RIPE NCC +remarks: Generic anycast network +is-anycast: yes + +net: 193.16.234.0/24 +descr: Unilogic Networks AnyCast LAN +remarks: Generic anycast network +is-anycast: yes + +net: 193.19.224.0/24 +descr: Sucuri Inc. +remarks: Generic anycast network +is-anycast: yes + +net: 193.19.225.0/24 +descr: Sucuri Inc. +remarks: Generic anycast network +is-anycast: yes + +net: 193.29.206.0/24 +descr: NIC.CZ +remarks: TLD operator's anycast network +is-anycast: yes + +net: 193.36.104.0/24 +descr: Rayhaan Ahmad Jaufeerally +remarks: Generic anycast network +is-anycast: yes + +net: 193.46.3.0/24 +descr: SAP SE Global Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 193.58.251.0/24 +descr: SkyDNS Ltd. +remarks: Generic anycast network +is-anycast: yes + +net: 193.105.183.0/24 +descr: InTouch NV - LISP Test Network +remarks: Generic anycast network +is-anycast: yes + +net: 193.160.88.0/23 +descr: AAGlenn Internetworking Company +remarks: Generic anycast network, tampers with RIR data +is-anycast: yes +country: NL + +net: 193.232.82.0/24 +descr: MSK-IX +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.0.0/24 +descr: DENIC eG +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.2.0/24 +descr: TM Domain Registry Ltd +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.5.0/24 +descr: SIDN +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.6.0/24 +descr: Domain Name Registration Belgie +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.7.0/24 +descr: EURid nameserver anycast mesh +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.8.0/24 +descr: Institute of Mathematics and Computer Science of University of Latvia +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.9.0/24 +descr: AFNIC (Association Francaise pour le Nommage Internet en Cooperation) +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.10.0/24 +descr: nic.at GmbH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.11.0/24 +descr: DENIC eG +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.12.0/24 +descr: CZ.NIC, z.s.p.o. +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.13.0/24 +descr: CZ.NIC, z.s.p.o. +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.14.0/24 +descr: CZ.NIC, z.s.p.o. +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.16.0/24 +descr: Registro del ccTLD it - IIT-CNR +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.17.0/24 +descr: SWITCH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.23.0/24 +descr: Fondation RESTENA +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.24.0/24 +descr: nic.at GmbH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.25.0/24 +descr: nic.at GmbH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.26.0/24 +descr: nic.at GmbH +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.28.0/24 +descr: SIDN +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.29.0/24 +descr: SIDN +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.30.0/24 +descr: SIDN +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.31.0/24 +descr: SIDN +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.36.0/24 +descr: AFNIC (Association Francaise pour le Nommage Internet en Cooperation) +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.37.0/24 +descr: Domain Name Registration Belgie +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.42.0/24 +descr: Fondation RESTENA +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.43.0/24 +descr: Domain Name Registration Belgie +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.44.0/24 +descr: Domain Name Registration Belgie +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.48.0/24 +descr: Institute of Mathematics and Computer Science of University of Latvia +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.49.0/24 +descr: Institute of Mathematics and Computer Science of University of Latvia +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.0.50.0/24 +descr: Institute of Mathematics and Computer Science of University of Latvia +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.50.111.0/24 +descr: 4b42 UG +remarks: Generic anycast network with a lot of /32 RIR records across various countries worldwide +is-anycast: yes +country: EU + +net: 194.110.250.0/24 +descr: KDA WEB SERVICES LTD +remarks: Generic anycast network +is-anycast: yes + +net: 194.161.154.0/24 +descr: AT&T +remarks: Generic anycast network +is-anycast: yes + +net: 194.169.218.0/24 +descr: CentralNic Ltd +remarks: TLD operator's anycast network +is-anycast: yes + +net: 194.171.194.0/24 +descr: SURFnet BV +remarks: Generic anycast network +is-anycast: yes + +net: 194.246.96.0/24 +descr: DENIC eG +remarks: TLD operator's anycast network +is-anycast: yes + +net: 195.12.51.0/24 +descr: M247 +remarks: Generic anycast network +is-anycast: yes + +net: 195.12.159.0/24 +descr: SK-NIC +remarks: Generic anycast network +is-anycast: yes + +net: 195.46.39.0/24 +descr: SafeDNS, Inc. +remarks: Generic anycast network +is-anycast: yes + +net: 195.80.153.0/24 +descr: SAFECLOUDBOX +remarks: Generic anycast network +is-anycast: yes + +net: 195.85.200.0/24 +descr: iRC-Hispano anycast proyect +remarks: Generic anycast network [high confidence, but not proofed] +is-anycast: yes + +net: 195.206.121.0/24 +descr: One.com A/S +remarks: Generic anycast network +is-anycast: yes + +net: 195.246.120.0/24 +descr: GleSYS AB +remarks: Generic anycast network +is-anycast: yes + +net: 196.55.0.0/24 +descr: Epik Network +remarks: Generic anycast network +is-anycast: yes + +net: 195.211.52.0/24 +descr: NetArt Group s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 195.226.217.0/24 +descr: Ignum s.r.o. +remarks: Generic anycast network +is-anycast: yes + +net: 196.216.168.0/24 +descr: AfriNIC Anycast Services +remarks: Generic anycast network +is-anycast: yes + +net: 212.18.248.0/24 +descr: CentralNic Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 212.18.249.0/24 +descr: CentralNic Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 212.18.251.0/24 +descr: CentralNic Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 212.102.32.0/24 +descr: CDN77 +remarks: Generic anycast network +is-anycast: yes + +net: 213.80.98.0/24 +descr: Bahnhof AB +remarks: Generic anycast network +is-anycast: yes + +net: 213.108.247.0/24 +descr: FTSOC LTD +remarks: Generic anycast network +is-anycast: yes + +net: 213.180.141.0/24 +descr: Grupa Onet.pl SA +remarks: Generic anycast network +is-anycast: yes + +net: 213.184.84.0/24 +descr: Lucas Rolff trading as Hosting4Real +remarks: Generic anycast network +is-anycast: yes + +net: 213.230.255.0/24 +descr: Netcalibre Ltd +remarks: Generic anycast network +is-anycast: yes + +net: 213.248.216.0/21 +descr: Nominet UK +remarks: Generic anycast network +is-anycast: yes + +net: 217.19.215.0/24 +descr: IDC_Anycast +remarks: Generic anycast network +is-anycast: yes + +net: 217.61.252.0/24 +descr: SIEL, INFORMACIJSKE RESITVE, D.O.O. +remarks: Generic anycast network +is-anycast: yes + +net: 217.75.109.0/24 +descr: Port80 AB remarks: Generic anycast network is-anycast: yes diff --git a/overrides/override-other.txt b/overrides/override-other.txt index 67b7024..ce936aa 100644 --- a/overrides/override-other.txt +++ b/overrides/override-other.txt @@ -28,6 +28,11 @@ descr: IP Interactive UG (haftungsbeschraenkt) remarks: ISP located in BG, but RIR data for announced prefixes contain garbage country: BG +aut-num: AS37518 +descr: Fiber Grid Inc. +remarks: tampers with RIR data, traces back to SE +country: SE + aut-num: AS40034 descr: Confluence Networks Inc. remarks: fake offshore location (VG), traces back to Austin, TX, US @@ -45,8 +50,8 @@ country: EU aut-num: AS42831 descr: UKSERVERS -remarks: ISP located in UK, but some RIR data for announced prefixes contain garbage -country: UK +remarks: ISP located in GB, but some RIR data for announced prefixes contain garbage +country: GB aut-num: AS48090 descr: PPTECHNOLOGY LIMITED @@ -130,7 +135,7 @@ country: NL net: 5.252.32.0/22 descr: StormWall s.r.o. -remarks: claims to be located in DE, but traces back to somewhere in central Europe +remarks: claims to be located in DE, but traces back to somewhere else in central Europe country: EU net: 31.220.0.0/22 @@ -194,9 +199,9 @@ remarks: fake offshore location (BZ), traces back to US country: US net: 185.244.29.0/24 -descr: Gerber EDV / David Craig -remarks: bulletproof ISP, fake location (KP), traces back to SG -country: SG +descr: NINAZU VPN Service / Gerber EDV / David Craig +remarks: bulletproof ISP, fake location (SC), traces back to GB +country: GB net: 193.29.12.0/22 descr: Bunea TELECOM SRL -- 2.26.2

1 0

Re: What generates database.db from database.txt?
by Michael Tremer 22 Oct '20

22 Oct '20

Hi, > On 21 Oct 2020, at 14:58, Gisle Vanem <gisle.vanem(a)gmail.com> wrote: > >>> OPENSSL_Uplink(640BC6B0,08): no OPENSSL_Applink >> I have absolutely no idea how to fix this unfortunately. > > It cannot easily be solve unless libloc.dll, _location.pyd > and the Python .dll use the same CRT. And a CRT is what? >> This is a small bug where we do not raise the error message with Python. > > Why not? Not very user friendly to have such obscure abort. This is not intended. I need to know what error is happening at what point. We catch the usual ones like “file does not exist”, or the file simply has some content that we did not expect. Potentially, windows is retuning a different error code somewhere which we didn’t catch. >>> Check yourself if the 'location-2020-05-15.db.xz' is still in the archive. >> Did you extract the file? > > Duh! Yes. Just double-checking. > BTW, what's up with test-network.c and IPv4 addresses? > I did this patch: > > --- a/test-network.c 2020-10-19 17:35:01 > +++ b/test-network.c 2020-10-21 14:02:41 > @@ -26,6 +26,8 @@ > #include <loc/network.h> > #include <loc/writer.h> > > +#define IPV4_TEST > + > int main(int argc, char** argv) { > int err; > > @@ -116,7 +118,7 @@ > } > > size_t nodes = loc_network_tree_count_nodes(tree); > - printf("The tree has %zu nodes\n", nodes); > + printf("The tree has %zu IPv6-only nodes\n", nodes); > > // Check subnet function > err = loc_network_is_subnet_of(network1, network2); > @@ -160,6 +162,23 @@ > // Set ASN > loc_network_set_asn(network4, 1024); > > +#ifdef IPV4_TEST > + struct loc_network* network5; > + err = loc_writer_add_network(writer, &network5, "1.2.3.4/16"); > + if (err) { > + fprintf(stderr, "Could not add IPv4 network\n"); > + exit(EXIT_FAILURE); > + } > + > + // Set country code > + loc_network_set_country_code(network4, "ZZ"); I assume you meant to set the country code for network5? > + > + // Set ASN > + loc_network_set_asn(network4, 1234); Same as above. > + loc_network_tree_dump(tree); > + printf("The tree has %zu IPv4/6-mixed nodes\n", loc_network_tree_count_nodes(tree)); > +#endif > + > FILE* f = tmpfile(); > if (!f) { > fprintf(stderr, "Could not open file for writing: %s\n", strerror(errno)); > @@ -203,6 +222,15 @@ > } > loc_network_unref(network1); > > +#ifdef IPV4_TEST > + err = loc_database_lookup_from_string(db, "1.2.3.4", &network5); > + if (err) { > + fprintf(stderr, "Could not look up 1.2.3.4\n"); > + exit(EXIT_FAILURE); > + } > + loc_network_unref(network5); > +#endif > + > loc_unref(ctx); > fclose(f); > > --------- > > But I get some errors from 'loc_parse_address()'. > So maybe it's better to check for an IPv4 first? > With this: > https://github.com/gvanem/wsock-trace/commit/4dc6dc6e09aa024fdcedf1a87dd3f5… I do not really understand, again, what you are trying to achieve here. IPv6 and IPv4 addresses can easily be mixed in the same database. You are adding "1.2.3.4/16” which actually should have been written as "1.2.0.0/16”. The database will automatically convert this into “1.2.0.0/16” for you. The result of loc_parse_address() should be the same no matter which one you are trying first (IPv6 or IPv4). In my code, I always put IPv6 first. Clearly “struct in6_addr” is defined differently in Windows and therefore the latter part of those changes might be required. There will be other places in the code that read from that structure bit by bit to put the IP address into the tree. It is quite likely, that this will go wrong too and therefore loc_database_lookup won’t find the correct entry. > it works much better (no errors from inet_pton()). > But the node-count is stuck at 49: > > libloc: loc_new: ctx 049D4CF8 created > libloc: __loc_network_tree_dump: 2001:db8::/32 > libloc: __loc_network_tree_dump: 2001:db8:ffff::/48 > The tree has 49 IPv6-only nodes > libloc: __loc_network_tree_dump: 2001:db8::/32 > libloc: __loc_network_tree_dump: 2001:db8:ffff::/48 > The tree has 49 IPv/6-mixed nodes > libloc: loc_database_read_as_section_v1: Read 0 ASes from the database > libloc: loc_database_read_network_nodes_section_v1: Read 207 network nodes from the database > libloc: loc_database_read_networks_section_v1: Read 3 networks from the database > libloc: loc_database_read_countries_section_v1: Read 0 countries from the database > libloc: loc_database_read: Opened database in 14.0000ms > > Are we not supposed to add both AF_INET+AF_INET6 addresses to > the same tree? Yes. Best, -Michael P.S. Please do not forget to keep the list copied in your replies. > -- > --gv

1 0

[PATCH 1/8] Revert "Revert "Revert "Revert "importer: Import raw sources for inetnum's again""""
by Peter Müller 21 Oct '20

21 Oct '20

This reverts commit 44341478233115b26bb27fdb24da5b0a1eedb173. Signed-off-by: Peter Müller <peter.mueller(a)ipfire.org> --- src/python/importer.py | 14 ++++---- src/python/location-importer.in | 63 +++++++++++++++++++++++++++++++++ 2 files changed, 70 insertions(+), 7 deletions(-) diff --git a/src/python/importer.py b/src/python/importer.py index de20f37..f19db4b 100644 --- a/src/python/importer.py +++ b/src/python/importer.py @@ -30,8 +30,8 @@ WHOIS_SOURCES = ( "https://ftp.afrinic.net/pub/pub/dbase/afrinic.db.gz", # Asia Pacific Network Information Centre - #"https://ftp.apnic.net/apnic/whois/apnic.db.inet6num.gz", - #"https://ftp.apnic.net/apnic/whois/apnic.db.inetnum.gz", + "https://ftp.apnic.net/apnic/whois/apnic.db.inet6num.gz", + "https://ftp.apnic.net/apnic/whois/apnic.db.inetnum.gz", #"https://ftp.apnic.net/apnic/whois/apnic.db.route6.gz", #"https://ftp.apnic.net/apnic/whois/apnic.db.route.gz", "https://ftp.apnic.net/apnic/whois/apnic.db.aut-num.gz", @@ -45,8 +45,8 @@ WHOIS_SOURCES = ( # XXX ??? # Réseaux IP Européens - #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.inet6num.gz", - #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.inetnum.gz", + "https://ftp.ripe.net/ripe/dbase/split/ripe.db.inet6num.gz", + "https://ftp.ripe.net/ripe/dbase/split/ripe.db.inetnum.gz", #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.route6.gz", #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.route.gz", "https://ftp.ripe.net/ripe/dbase/split/ripe.db.aut-num.gz", @@ -55,10 +55,10 @@ WHOIS_SOURCES = ( EXTENDED_SOURCES = ( # African Network Information Centre - "https://ftp.afrinic.net/pub/stats/afrinic/delegated-afrinic-extended-latest", + #"https://ftp.afrinic.net/pub/stats/afrinic/delegated-afrinic-extended-latest", # Asia Pacific Network Information Centre - "https://ftp.apnic.net/apnic/stats/apnic/delegated-apnic-extended-latest", + #"https://ftp.apnic.net/apnic/stats/apnic/delegated-apnic-extended-latest", # American Registry for Internet Numbers "https://ftp.arin.net/pub/stats/arin/delegated-arin-extended-latest", @@ -67,7 +67,7 @@ EXTENDED_SOURCES = ( "http://ftp.lacnic.net/pub/stats/lacnic/delegated-lacnic-extended-latest", # Réseaux IP Européens - "https://ftp.ripe.net/pub/stats/ripencc/delegated-ripencc-extended-latest", + #"https://ftp.ripe.net/pub/stats/ripencc/delegated-ripencc-extended-latest", ) class Downloader(object): diff --git a/src/python/location-importer.in b/src/python/location-importer.in index e87d378..b220eaf 100644 --- a/src/python/location-importer.in +++ b/src/python/location-importer.in @@ -395,6 +395,10 @@ class CLI(object): if line.startswith("aut-num:"): return self._parse_autnum_block(block) + # inetnum + if line.startswith("inet6num:") or line.startswith("inetnum:"): + return self._parse_inetnum_block(block) + # organisation elif line.startswith("organisation:"): return self._parse_org_block(block) @@ -424,6 +428,65 @@ class CLI(object): autnum.get("asn"), autnum.get("org"), ) + def _parse_inetnum_block(self, block): + logging.debug("Parsing inetnum block:") + + inetnum = {} + for line in block: + logging.debug(line) + + # Split line + key, val = split_line(line) + + if key == "inetnum": + start_address, delim, end_address = val.partition("-") + + # Strip any excess space + start_address, end_address = start_address.rstrip(), end_address.strip() + + # Convert to IP address + try: + start_address = ipaddress.ip_address(start_address) + end_address = ipaddress.ip_address(end_address) + except ValueError: + logging.warning("Could not parse line: %s" % line) + return + + # Set prefix to default + prefix = 32 + + # Count number of addresses in this subnet + num_addresses = int(end_address) - int(start_address) + if num_addresses: + prefix -= math.log(num_addresses, 2) + + inetnum["inetnum"] = "%s/%.0f" % (start_address, prefix) + + elif key == "inet6num": + inetnum[key] = val + + elif key == "country": + if val == "UNITED STATES": + val = "US" + + inetnum[key] = val.upper() + + # Skip empty objects + if not inetnum: + return + + network = ipaddress.ip_network(inetnum.get("inet6num") or inetnum.get("inetnum"), strict=False) + + # Bail out in case we have processed a non-public IP network + if network.is_private: + logging.warning("Skipping non-globally routable network: %s" % network) + return + + self.db.execute("INSERT INTO networks(network, country) \ + VALUES(%s, %s) ON CONFLICT (network) DO UPDATE SET country = excluded.country", + "%s" % network, inetnum.get("country"), + ) + def _parse_org_block(self, block): org = {} for line in block: -- 2.20.1

1 7

What generates database.db from database.txt?
by Gisle Vanem 21 Oct '20

21 Oct '20

Hello list, my ports post. I'm on Windows and have little interest in installing IPFire or do any Linux related. But the 'libloc' library caught my interest. So I did a port to MSVC, MinGW and clang-cl (x86 only) in a hurry. Running all the 'test-*' programs, it worked seemingly well. Until I built the Python3 module and played with e.g. 'location dump' and 'verify'. Nothing worked :-( So I reckon the .db file is hosed somehow. AFAICS, it's not an issue with structure packing or 'fopen(path, "r")'. Anyway, I want to regenerate 'database.db' from 'database.txt' 'countries.txt' and the 'override' files myself. But how? According to the git log at: git://git.ipfire.org/location/location-database.git there once was a 'compile-database' script. Not now. -- --gv

2 7

[PATCH] Add overrides for RFC1918
by Michael Tremer 15 Oct '20

15 Oct '20

Because of RIPE (or somebody else) adding 192.168.0.0/15, we are classifying those addresses as EU. This renders whole networks inaccessible and therefore we are adding those networks with a faked country until we find a better solution. Signed-off-by: Michael Tremer <michael.tremer(a)ipfire.org> --- overrides/override-rfc1918.txt | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) create mode 100644 overrides/override-rfc1918.txt diff --git a/overrides/override-rfc1918.txt b/overrides/override-rfc1918.txt new file mode 100644 index 0000000..768ea92 --- /dev/null +++ b/overrides/override-rfc1918.txt @@ -0,0 +1,18 @@ +# +# override-rfc1918 [.txt] +# +# This files contains networks from RFC1918 (and other similar standards) +# which are added to the database with special attributes +# + +net: 10.0.0.0/8 +descr: Private address space from RFC1918 +country: XX + +net: 172.16.0.0/12 +descr: Private address space from RFC1918 +country: XX + +net: 192.168.0.0/16 +descr: Private address space from RFC1918 +country: XX -- 2.20.1

1 1

[PATCH 1/2] Revert "Revert "importer: Import raw sources for inetnum's again""
by Peter Müller 12 Oct '20

12 Oct '20

This reverts commit 92f6abf4e272672bb0a71cfe991261b95ebe2fef. --- src/python/importer.py | 14 ++++---- src/python/location-importer.in | 63 +++++++++++++++++++++++++++++++++ 2 files changed, 70 insertions(+), 7 deletions(-) diff --git a/src/python/importer.py b/src/python/importer.py index de20f37..f19db4b 100644 --- a/src/python/importer.py +++ b/src/python/importer.py @@ -30,8 +30,8 @@ WHOIS_SOURCES = ( "https://ftp.afrinic.net/pub/pub/dbase/afrinic.db.gz", # Asia Pacific Network Information Centre - #"https://ftp.apnic.net/apnic/whois/apnic.db.inet6num.gz", - #"https://ftp.apnic.net/apnic/whois/apnic.db.inetnum.gz", + "https://ftp.apnic.net/apnic/whois/apnic.db.inet6num.gz", + "https://ftp.apnic.net/apnic/whois/apnic.db.inetnum.gz", #"https://ftp.apnic.net/apnic/whois/apnic.db.route6.gz", #"https://ftp.apnic.net/apnic/whois/apnic.db.route.gz", "https://ftp.apnic.net/apnic/whois/apnic.db.aut-num.gz", @@ -45,8 +45,8 @@ WHOIS_SOURCES = ( # XXX ??? # Réseaux IP Européens - #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.inet6num.gz", - #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.inetnum.gz", + "https://ftp.ripe.net/ripe/dbase/split/ripe.db.inet6num.gz", + "https://ftp.ripe.net/ripe/dbase/split/ripe.db.inetnum.gz", #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.route6.gz", #"https://ftp.ripe.net/ripe/dbase/split/ripe.db.route.gz", "https://ftp.ripe.net/ripe/dbase/split/ripe.db.aut-num.gz", @@ -55,10 +55,10 @@ WHOIS_SOURCES = ( EXTENDED_SOURCES = ( # African Network Information Centre - "https://ftp.afrinic.net/pub/stats/afrinic/delegated-afrinic-extended-latest", + #"https://ftp.afrinic.net/pub/stats/afrinic/delegated-afrinic-extended-latest", # Asia Pacific Network Information Centre - "https://ftp.apnic.net/apnic/stats/apnic/delegated-apnic-extended-latest", + #"https://ftp.apnic.net/apnic/stats/apnic/delegated-apnic-extended-latest", # American Registry for Internet Numbers "https://ftp.arin.net/pub/stats/arin/delegated-arin-extended-latest", @@ -67,7 +67,7 @@ EXTENDED_SOURCES = ( "http://ftp.lacnic.net/pub/stats/lacnic/delegated-lacnic-extended-latest", # Réseaux IP Européens - "https://ftp.ripe.net/pub/stats/ripencc/delegated-ripencc-extended-latest", + #"https://ftp.ripe.net/pub/stats/ripencc/delegated-ripencc-extended-latest", ) class Downloader(object): diff --git a/src/python/location-importer.in b/src/python/location-importer.in index 77952f2..e3a07a0 100644 --- a/src/python/location-importer.in +++ b/src/python/location-importer.in @@ -393,6 +393,10 @@ class CLI(object): if line.startswith("aut-num:"): return self._parse_autnum_block(block) + # inetnum + if line.startswith("inet6num:") or line.startswith("inetnum:"): + return self._parse_inetnum_block(block) + # organisation elif line.startswith("organisation:"): return self._parse_org_block(block) @@ -422,6 +426,65 @@ class CLI(object): autnum.get("asn"), autnum.get("org"), ) + def _parse_inetnum_block(self, block): + logging.debug("Parsing inetnum block:") + + inetnum = {} + for line in block: + logging.debug(line) + + # Split line + key, val = split_line(line) + + if key == "inetnum": + start_address, delim, end_address = val.partition("-") + + # Strip any excess space + start_address, end_address = start_address.rstrip(), end_address.strip() + + # Convert to IP address + try: + start_address = ipaddress.ip_address(start_address) + end_address = ipaddress.ip_address(end_address) + except ValueError: + logging.warning("Could not parse line: %s" % line) + return + + # Set prefix to default + prefix = 32 + + # Count number of addresses in this subnet + num_addresses = int(end_address) - int(start_address) + if num_addresses: + prefix -= math.log(num_addresses, 2) + + inetnum["inetnum"] = "%s/%.0f" % (start_address, prefix) + + elif key == "inet6num": + inetnum[key] = val + + elif key == "country": + if val == "UNITED STATES": + val = "US" + + inetnum[key] = val.upper() + + # Skip empty objects + if not inetnum: + return + + network = ipaddress.ip_network(inetnum.get("inet6num") or inetnum.get("inetnum"), strict=False) + + # Bail out in case we have processed a non-public IP network + if network.is_private: + logging.warning("Skipping non-globally routable network: %s" % network) + return + + self.db.execute("INSERT INTO networks(network, country) \ + VALUES(%s, %s) ON CONFLICT (network) DO UPDATE SET country = excluded.country", + "%s" % network, inetnum.get("country"), + ) + def _parse_org_block(self, block): org = {} for line in block: -- 2.20.1

1 1

[PATCH] overrides/override-{a[1-3],other}.txt: weekly batch of override updates
by Peter Müller 05 Oct '20

05 Oct '20

Signed-off-by: Peter Müller <peter.mueller(a)ipfire.org> --- overrides/override-a1.txt | 52 +++++++++++++++++------------------- overrides/override-a2.txt | 10 +++++++ overrides/override-a3.txt | 10 +++++++ overrides/override-other.txt | 40 +++++++++++++++++++++++++++ 4 files changed, 84 insertions(+), 28 deletions(-) diff --git a/overrides/override-a1.txt b/overrides/override-a1.txt index 9f64dd8..d4fe379 100644 --- a/overrides/override-a1.txt +++ b/overrides/override-a1.txt @@ -38,6 +38,11 @@ descr: VPN de Mexico, S.A. de C.V. remarks: VPN provider is-anonymous-proxy: yes +aut-num: AS34962 +descr: Epik Network +remarks: VPN provider +is-anonymous-proxy: yes + aut-num: AS35029 descr: WebLine LTD remarks: (Rogue) VPN provider @@ -55,6 +60,12 @@ descr: Asiamax Ltd. VPN remarks: VPN provider is-anonymous-proxy: yes +aut-num: AS43233 +descr: VPS 404 Ltd. +remarks: VPN provider [high confidence, but not proofed] located in ES +is-anonymous-proxy: yes +country: ES + aut-num: AS45792 descr: Layer 3 VPN ASN remarks: VPN provider @@ -132,6 +143,11 @@ descr: Privex Inc. remarks: VPN and Tor relay provider is-anonymous-proxy: yes +aut-num: AS212987 +descr: NekoCloud Solutions Limited +remarks: VPN provider [high confidence, but not proofed] +is-anonymous-proxy: yes + aut-num: AS394087 descr: Secure Internet LLC / PureVPN remarks: VPN provider @@ -322,6 +338,11 @@ descr: GZ Systems Limited / PureVPN remarks: VPN provider is-anonymous-proxy: yes +net: 45.9.12.0/22 +descr: VPNHost SIA +remarks: VPN provider +is-anonymous-proxy: yes + net: 45.12.144.0/22 descr: VPNHost SIA remarks: VPN provider @@ -1123,29 +1144,9 @@ descr: Canar VPN Range remarks: VPN provider is-anonymous-proxy: yes -net: 196.52.50.0/24 -descr: BGRVPN -remarks: VPN provider -is-anonymous-proxy: yes - -net: 196.53.164.0/22 -descr: BGRVPN -remarks: VPN provider -is-anonymous-proxy: yes - -net: 196.53.82.0/24 -descr: VPNetworks -remarks: VPN provider -is-anonymous-proxy: yes - -net: 196.53.83.0/24 -descr: VPNetworks -remarks: VPN provider -is-anonymous-proxy: yes - -net: 196.54.53.0/24 -descr: BGRVPN -remarks: VPN provider +net: 196.52.0.0/14 +descr: LogicWeb Inc. / BGRVPN / Private Internet Access / VPNetworks / CookieProxy / etc. pp. +remarks: large IP chunk mostly used by VPN providers is-anonymous-proxy: yes net: 197.221.161.0/24 @@ -1288,11 +1289,6 @@ descr: OVPN Integritet AB remarks: VPN provider is-anonymous-proxy: yes -net: 217.115.10.128/28 -descr: Chaos Computer Club e.V. -remarks: Tor relay provider -is-anonymous-proxy: yes - net: 217.148.75.0/24 descr: ITNow S.A. VPN pool / CAXIA remarks: VPN provider diff --git a/overrides/override-a2.txt b/overrides/override-a2.txt index 88783d8..8f03159 100644 --- a/overrides/override-a2.txt +++ b/overrides/override-a2.txt @@ -227,6 +227,11 @@ descr: Alpha Sattelite Network remarks: Satellite Internet provider is-satellite-provider: yes +aut-num: AS203770 +descr: Matooma SAS +remarks: Satellite Internet provider +is-satellite-provider: yes + aut-num: AS393582 descr: VIDEO DIRECT SATELLITE & ENTERTAINMENT / WisperISP remarks: Satellite Internet provider @@ -927,6 +932,11 @@ descr: Satellite Solutions Worldwide Ltd remarks: Satellite Internet provider is-satellite-provider: yes +net: 145.249.96.0/21 +descr: Media Broadcast Satellite GmbH +remarks: Satellite Internet provider +is-satellite-provider: yes + net: 154.73.28.0/22 descr: RAWAFED Libya remarks: Satellite Internet provider diff --git a/overrides/override-a3.txt b/overrides/override-a3.txt index e692f4c..26acb64 100644 --- a/overrides/override-a3.txt +++ b/overrides/override-a3.txt @@ -184,6 +184,11 @@ descr: subspace remarks: Generic anycast network [high confidence, but not proofed] is-anycast: yes +net: 185.89.134.0/24 +descr: Isset +remarks: Generic anycast network +is-anycast: yes + net: 185.143.232.0/22 descr: Noyan Abr Arvan Co. remarks: Generic anycast network @@ -214,6 +219,11 @@ descr: xTom / dns.sb remarks: Public anycast DNS resolver is-anycast: yes +net: 196.55.0.0/24 +descr: Epik Network +remarks: Generic anycast network +is-anycast: yes + net: 196.216.168.0/24 descr: AfriNIC Anycast Services remarks: Generic anycast network diff --git a/overrides/override-other.txt b/overrides/override-other.txt index f8e6799..67b7024 100644 --- a/overrides/override-other.txt +++ b/overrides/override-other.txt @@ -13,6 +13,11 @@ # Please keep this file sorted. # +aut-num: AS12025 +descr: Iron Mountain Data Center +remarks: ISP located in US, but some RIR data for announced prefixes contain garbage +country: US + aut-num: AS24700 descr: Yes Networks Unlimited Ltd remarks: traces to UA, but some RIR entries seem to contain garbage (VG) @@ -33,11 +38,26 @@ descr: Bunea TELECOM SRL remarks: ISP located in RO, but some RIR data for announced prefixes contain garbage country: RO +aut-num: AS42745 +descr: Safe Value Limited +remarks: tampers with RIR data, traces back to somewhere in central Europe +country: EU + +aut-num: AS42831 +descr: UKSERVERS +remarks: ISP located in UK, but some RIR data for announced prefixes contain garbage +country: UK + aut-num: AS48090 descr: PPTECHNOLOGY LIMITED remarks: bulletproof ISP (related to AS204655) located in NL country: NL +aut-num: AS51558 +descr: Smart Telecom S.A.R.L +remarks: tampers with RIR data, traces back to RU +country: RU + aut-num: AS56611 descr: REBA Communications BV remarks: bulletproof ISP (related to AS202425) located in NL @@ -103,6 +123,16 @@ descr: Private Internet Hosting LTD remarks: bulletproof ISP located in RU country: RU +aut-num: AS213373 +descr: IP Connect Inc. +remarks: fake offshore location (SC), traces back to NL +country: NL + +net: 5.252.32.0/22 +descr: StormWall s.r.o. +remarks: claims to be located in DE, but traces back to somewhere in central Europe +country: EU + net: 31.220.0.0/22 descr: Amarutu Technology Ltd. / KoDDoS / ESecurity remarks: fake offshore location (BZ), traces back to NL @@ -143,6 +173,11 @@ descr: QWARTA LLC remarks: fake location (US), WHOIS contact and traceroutes point to RU country: RU +net: 103.197.148.0/22 +descr: I.C.S. Trabia-Network S.R.L. +remarks: fake offshore location (HK), traces back to MD +country: MD + net: 178.239.20.0/24 descr: Anthony Marshall / Game Hosting Net / FlokiNET Ltd. remarks: fake location (BA), traces back to RO @@ -187,3 +222,8 @@ net: 2a02:e00:ffe9::/48 descr: Bradler & Krantz GmbH & Co. KG remarks: allocated to DE, but actually announced from GB country: GB + +net: 2a05:9f06::/31 +descr: Sibyl System LTD +remarks: RIR data contain garbage +country: NL -- 2.26.2

1 0

[PATCH v2 1/3] location-importer.in: avoid violating NOT NULL constraints during JOIN
by Peter Müller 24 Sep '20

24 Sep '20

Signed-off-by: Peter Müller <peter.mueller(a)ipfire.org> --- src/python/location-importer.in | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/python/location-importer.in b/src/python/location-importer.in index f5ae4a9..77952f2 100644 --- a/src/python/location-importer.in +++ b/src/python/location-importer.in @@ -360,7 +360,7 @@ class CLI(object): ON COMMIT DROP; CREATE UNIQUE INDEX _autnums_number ON _autnums(number); - CREATE TEMPORARY TABLE _organizations(handle text, name text) + CREATE TEMPORARY TABLE _organizations(handle text, name text NOT NULL) ON COMMIT DROP; CREATE UNIQUE INDEX _organizations_handle ON _organizations(handle); """) @@ -373,7 +373,7 @@ class CLI(object): self.db.execute(""" INSERT INTO autnums(number, name) SELECT _autnums.number, _organizations.name FROM _autnums - LEFT JOIN _organizations ON _autnums.organization = _organizations.handle + JOIN _organizations ON _autnums.organization = _organizations.handle ON CONFLICT (number) DO UPDATE SET name = excluded.name; """) -- 2.26.2

2 3

2024

2023

2022

2021

2020

2019

2018

2017

Location