From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail02.haj.ipfire.org (localhost [IPv6:::1]) by mail02.haj.ipfire.org (Postfix) with ESMTP id 4cPjgD6Zskz2xWj for ; Sun, 14 Sep 2025 09:34:48 +0000 (UTC) Received: from mail01.ipfire.org (mail01.haj.ipfire.org [172.28.1.202]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519) (Client CN "mail01.haj.ipfire.org", Issuer "R13" (verified OK)) by mail02.haj.ipfire.org (Postfix) with ESMTPS id 4cPjg93S1Jz2xHd for ; Sun, 14 Sep 2025 09:34:45 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail01.ipfire.org (Postfix) with ESMTPSA id 4cPjg90Bmrz6p; Sun, 14 Sep 2025 09:34:44 +0000 (UTC) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=ipfire.org; s=202003ed25519; t=1757842485; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qHYBUEWpVX9MG45adn8WFVXoE6KBxyBKfGWXQusJI6s=; b=5VTLjiXflahy5U3bqyvAzcc59BMa9U/XkqCNGC8MDC8N58eI85vjzZorAIqe6/XfEU/HUD 23e7UrSIQylT0KAQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfire.org; s=202003rsa; t=1757842485; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qHYBUEWpVX9MG45adn8WFVXoE6KBxyBKfGWXQusJI6s=; b=hKx1IenfMk227XZopYH//DH/efsK/01F5kEi2AoSRI+B2q+UMUNL/7JAJGY8BpjRGN89Yo Y+jhT/2xSTuZxL2zK1mumDAXJxmn9yVB5AUwcEL/zcs5YNu1GLWscYigmiJOrwajibi0YJ czluRcsiirTlU3vtG/xFgyq559pWWCbYB0fd00y5ASoPh92WU0RTqWl7FoEScXQ/q0KxAG D1TQAAy7RLFush+r7j8iV33DN7vAdk1527Ra8fUXbEAhmON+DLin6q/Q+gPlo8pzE4D6P5 tZZiYmEgQTTDxhd6B8Lw8BUlUdp/Cjx7y3TmJD50vW03RaWEqsDabjiaC6aRQw== Content-Type: text/plain; charset=utf-8 Precedence: list List-Id: List-Subscribe: , List-Unsubscribe: , List-Post: List-Help: Sender: Mail-Followup-To: Mime-Version: 1.0 Subject: Re: GIT is down... From: Michael Tremer In-Reply-To: <4bc8479b-df45-41e1-ad27-99875620ed27@ipfire.org> Date: Sun, 14 Sep 2025 10:34:44 +0100 Cc: Matthias Fischer , "IPFire: Development-List" Content-Transfer-Encoding: quoted-printable Message-Id: <3076F215-4F2B-4BE9-9021-451FC36D2D6F@ipfire.org> References: <4bc8479b-df45-41e1-ad27-99875620ed27@ipfire.org> To: Adolf Belka Hello everyone, I have added a ton of caching to this over the last months. It really = helps, but it cannot produce any wonders. git.ipfire.org is pushing out over 2 TiB of = data every month. Doesn=E2=80=99t sound a lot, but for so tiny HTML = pages, that is a lot of requests. There is a large cache in front of the = gitweb CGI scripts, but the crawlers barely come back to visit the same = page again so it does not help too much with the bot requests. It does = however help us really well with the regular clients because the index = page, summary page of the individual repositories and even the latest = commits are all coming from the cache. If anyone has any other ideas how to improve this all, please let me = know. -Michael > On 14 Sep 2025, at 09:42, Adolf Belka wrote: >=20 > Hi Matthias, >=20 > On 14/09/2025 10:28, Matthias Fischer wrote: >> Good morning, >> sorry to say, GIT (git.ipfire.org) is down. >> ***SNIP*** >> Oops, Something Went Wrong >> 503 =E2=80=90 Service Unavailable >> ***SNAP*** >=20 > No it is up nut it is being heavily crawled by bots again and this is = basically causing a DoS. >=20 > You just have to wait for the crawling to ease off. It is frustrating = though but not so easy to block. That is the internet for you these = days. >=20 > Regards, >=20 > Adolf. >=20 >> Best >> Matthias >=20 >=20