dnscheck: query recursive resolvers directly, not the system one
The PTR check reported a correctly published record as wrong. The lookups
went through the container's resolver (127.0.0.11) which forwards to the
host's systemd-resolved, and systemd-resolved synthesises the reverse
lookup of the machine's own addresses from the local hostname rather than
asking public DNS. On the production host that meant
81.30.105.2 -> magenta-pink-heliotrope16786 (does not match)
while public DNS has had 81.30.105.2 -> selfpost.mixfed.ru all along.
These checks exist to report what a receiving mail server sees, so they
now dial recursive resolvers themselves, defaulting to 1.1.1.1, 8.8.8.8
and 9.9.9.9 and overridable with SELFPOST_DNS_RESOLVERS. The e2e stand
sets it to its CoreDNS, which the `dns:` directive alone no longer covers.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
@@ -5,6 +5,19 @@ Format follows [Keep a Changelog](https://keepachangelog.com/en/1.1.0/); version
|
|||||||
|
|
||||||
## [Unreleased]
|
## [Unreleased]
|
||||||
|
|
||||||
|
### Fixed
|
||||||
|
|
||||||
|
- panel: the PTR (reverse DNS) check no longer reports a correctly published
|
||||||
|
record as wrong. The checks went through the container's own resolver, which
|
||||||
|
forwards to the host's systemd-resolved — and systemd-resolved answers the
|
||||||
|
reverse lookup of the machine's own IP from the local hostname instead of
|
||||||
|
asking public DNS. A server with `81.30.105.2 → selfpost.example.com` in DNS
|
||||||
|
was told its PTR pointed at the provider-assigned hostname. All four
|
||||||
|
deliverability checks (PTR, SPF, DKIM, DMARC) now query recursive resolvers
|
||||||
|
directly, so the panel reports what a receiving mail server actually sees.
|
||||||
|
Set `SELFPOST_DNS_RESOLVERS` if outbound port 53 is closed or you run your
|
||||||
|
own recursor; it defaults to 1.1.1.1, 8.8.8.8 and 9.9.9.9.
|
||||||
|
|
||||||
### Changed
|
### Changed
|
||||||
|
|
||||||
- panel: the three monitoring pages now live at URLs that match their nav
|
- panel: the three monitoring pages now live at URLs that match their nav
|
||||||
|
|||||||
@@ -38,6 +38,7 @@ func serveHTTP(ctx context.Context, cfg config, st *store.Store) error {
|
|||||||
OpenDKIMSocket: cfg.opendkimSocket,
|
OpenDKIMSocket: cfg.opendkimSocket,
|
||||||
JournalSocket: cfg.journalSocket,
|
JournalSocket: cfg.journalSocket,
|
||||||
SessionIdleDays: cfg.sessionIdleDays,
|
SessionIdleDays: cfg.sessionIdleDays,
|
||||||
|
DNSResolvers: cfg.dnsResolvers,
|
||||||
}, cfg.setupTokenPath)
|
}, cfg.setupTokenPath)
|
||||||
if err != nil {
|
if err != nil {
|
||||||
return err
|
return err
|
||||||
|
|||||||
@@ -23,6 +23,7 @@ import (
|
|||||||
|
|
||||||
"codeberg.org/mix/selfpost/internal/backup"
|
"codeberg.org/mix/selfpost/internal/backup"
|
||||||
"codeberg.org/mix/selfpost/internal/buildinfo"
|
"codeberg.org/mix/selfpost/internal/buildinfo"
|
||||||
|
"codeberg.org/mix/selfpost/internal/dnscheck"
|
||||||
"codeberg.org/mix/selfpost/internal/logtail"
|
"codeberg.org/mix/selfpost/internal/logtail"
|
||||||
"codeberg.org/mix/selfpost/internal/store"
|
"codeberg.org/mix/selfpost/internal/store"
|
||||||
)
|
)
|
||||||
@@ -61,6 +62,7 @@ type config struct {
|
|||||||
submissionEnabled bool
|
submissionEnabled bool
|
||||||
trustedProxies []*net.IPNet
|
trustedProxies []*net.IPNet
|
||||||
sessionIdleDays int
|
sessionIdleDays int
|
||||||
|
dnsResolvers []string
|
||||||
|
|
||||||
// Read-only inputs to the panel's status page: the certificate Postfix
|
// Read-only inputs to the panel's status page: the certificate Postfix
|
||||||
// serves and the two milter sockets it connects to. The defaults mirror
|
// serves and the two milter sockets it connects to. The defaults mirror
|
||||||
@@ -107,6 +109,9 @@ func loadConfig() config {
|
|||||||
// Sliding session idle timeout (spec 7.6.6, plan B.1). Non-positive/invalid
|
// Sliding session idle timeout (spec 7.6.6, plan B.1). Non-positive/invalid
|
||||||
// falls back to the 7-day default inside internal/web.
|
// falls back to the 7-day default inside internal/web.
|
||||||
sessionIdleDays: envInt("PANEL_SESSION_IDLE_DAYS", 7),
|
sessionIdleDays: envInt("PANEL_SESSION_IDLE_DAYS", 7),
|
||||||
|
// Recursive resolvers the deliverability checks query directly. Empty
|
||||||
|
// means dnscheck's public defaults; a closed network names its own here.
|
||||||
|
dnsResolvers: dnscheck.ParseResolvers(os.Getenv("SELFPOST_DNS_RESOLVERS")),
|
||||||
|
|
||||||
tlsCertFile: envDefault("TLS_CERT_FILE", "/etc/postfix/tls/fullchain.pem"),
|
tlsCertFile: envDefault("TLS_CERT_FILE", "/etc/postfix/tls/fullchain.pem"),
|
||||||
opendkimSocket: envDefault("OPENDKIM_SOCKET", "/run/opendkim/opendkim.sock"),
|
opendkimSocket: envDefault("OPENDKIM_SOCKET", "/run/opendkim/opendkim.sock"),
|
||||||
|
|||||||
@@ -22,6 +22,15 @@ SEND_LOG_RETENTION_DAYS=90
|
|||||||
# monitoring screens does not count as activity, only navigation/actions do.
|
# monitoring screens does not count as activity, only navigation/actions do.
|
||||||
PANEL_SESSION_IDLE_DAYS=7
|
PANEL_SESSION_IDLE_DAYS=7
|
||||||
|
|
||||||
|
# Comma-separated resolvers the panel's deliverability checks (PTR, SPF, DKIM,
|
||||||
|
# DMARC) query directly. They deliberately skip this host's own resolver: with
|
||||||
|
# systemd-resolved the reverse lookup of the server's IP answers with the local
|
||||||
|
# hostname instead of the PTR record published in public DNS, which made the
|
||||||
|
# panel report a correct PTR as wrong. Leave unset for the public defaults
|
||||||
|
# (1.1.1.1, 8.8.8.8, 9.9.9.9); set it if outbound port 53 is closed or you run
|
||||||
|
# your own recursor, e.g. SELFPOST_DNS_RESOLVERS=10.0.0.2:53
|
||||||
|
# SELFPOST_DNS_RESOLVERS=
|
||||||
|
|
||||||
# Comma-separated CIDRs (bare IPs allowed) of reverse proxies allowed to
|
# Comma-separated CIDRs (bare IPs allowed) of reverse proxies allowed to
|
||||||
# supply X-Forwarded-For for login/setup rate-limiting. Leave unset unless
|
# supply X-Forwarded-For for login/setup rate-limiting. Leave unset unless
|
||||||
# you know the exact address of your reverse proxy — trusting the wrong
|
# you know the exact address of your reverse proxy — trusting the wrong
|
||||||
|
|||||||
@@ -41,6 +41,10 @@ services:
|
|||||||
SEND_LOG_RETENTION_DAYS: "${SEND_LOG_RETENTION_DAYS:-90}"
|
SEND_LOG_RETENTION_DAYS: "${SEND_LOG_RETENTION_DAYS:-90}"
|
||||||
# Sliding idle timeout for the panel login session, in days (spec 7.6.6).
|
# Sliding idle timeout for the panel login session, in days (spec 7.6.6).
|
||||||
PANEL_SESSION_IDLE_DAYS: "${PANEL_SESSION_IDLE_DAYS:-7}"
|
PANEL_SESSION_IDLE_DAYS: "${PANEL_SESSION_IDLE_DAYS:-7}"
|
||||||
|
# Resolvers the panel's PTR/SPF/DKIM/DMARC checks query directly, so they
|
||||||
|
# report what the internet sees rather than what this host's own stub
|
||||||
|
# resolver synthesises. Empty uses public defaults.
|
||||||
|
SELFPOST_DNS_RESOLVERS: "${SELFPOST_DNS_RESOLVERS:-}"
|
||||||
volumes:
|
volumes:
|
||||||
# All persistent state lives under /data (spec 9): SQLite DB, DKIM keys,
|
# All persistent state lives under /data (spec 9): SQLite DB, DKIM keys,
|
||||||
# sasldb2, sender map, setup token. Back this up (panel button or the
|
# sasldb2, sender map, setup token. Back this up (panel button or the
|
||||||
|
|||||||
@@ -103,10 +103,11 @@ type cached[T any] struct {
|
|||||||
expires time.Time
|
expires time.Time
|
||||||
}
|
}
|
||||||
|
|
||||||
// New returns a Checker using the process resolver and the package's default
|
// New returns a Checker querying the given recursive resolvers (empty means
|
||||||
// timeout and cache lifetimes.
|
// DefaultResolvers) with the package's default timeout and cache lifetimes.
|
||||||
func New() *Checker {
|
// The lookups deliberately bypass the system resolver — see externalResolver.
|
||||||
return newChecker(net.DefaultResolver, lookupTimeout, serverTTL, domainTTL)
|
func New(resolvers []string) *Checker {
|
||||||
|
return newChecker(newExternalResolver(resolvers), lookupTimeout, serverTTL, domainTTL)
|
||||||
}
|
}
|
||||||
|
|
||||||
func newChecker(r resolver, timeout, srvTTL, domTTL time.Duration) *Checker {
|
func newChecker(r resolver, timeout, srvTTL, domTTL time.Duration) *Checker {
|
||||||
|
|||||||
@@ -0,0 +1,112 @@
|
|||||||
|
package dnscheck
|
||||||
|
|
||||||
|
import (
|
||||||
|
"context"
|
||||||
|
"errors"
|
||||||
|
"net"
|
||||||
|
"strings"
|
||||||
|
)
|
||||||
|
|
||||||
|
// DefaultResolvers are the recursive resolvers the checks query when the
|
||||||
|
// deployment does not name its own (SELFPOST_DNS_RESOLVERS). Three independent
|
||||||
|
// operators, so one being unreachable from the host does not blind the checks.
|
||||||
|
var DefaultResolvers = []string{"1.1.1.1:53", "8.8.8.8:53", "9.9.9.9:53"}
|
||||||
|
|
||||||
|
// externalResolver talks to a fixed list of recursive resolvers directly
|
||||||
|
// instead of going through the system resolver.
|
||||||
|
//
|
||||||
|
// That detour is deliberate: these checks answer "what does a receiving mail
|
||||||
|
// server see about us?", and the machine's own stub resolver is the one place
|
||||||
|
// where the answer differs. systemd-resolved — which a Docker container reaches
|
||||||
|
// through the embedded 127.0.0.11 forwarder — synthesises a PTR record for the
|
||||||
|
// host's own addresses out of the local hostname, never asking public DNS. A
|
||||||
|
// server whose reverse DNS was published correctly therefore had its
|
||||||
|
// provider-assigned hostname reported back to the panel, and the FCrDNS check
|
||||||
|
// failed a record that was in fact right.
|
||||||
|
//
|
||||||
|
// This bypasses the resolvers in /etc/resolv.conf, not /etc/hosts: Go still
|
||||||
|
// consults the hosts file first, as any local program would.
|
||||||
|
type externalResolver struct {
|
||||||
|
servers []*net.Resolver
|
||||||
|
}
|
||||||
|
|
||||||
|
// newExternalResolver builds a resolver over addrs ("host" or "host:port"). An
|
||||||
|
// empty list falls back to DefaultResolvers.
|
||||||
|
func newExternalResolver(addrs []string) *externalResolver {
|
||||||
|
if len(addrs) == 0 {
|
||||||
|
addrs = DefaultResolvers
|
||||||
|
}
|
||||||
|
e := &externalResolver{}
|
||||||
|
for _, a := range addrs {
|
||||||
|
addr := withDefaultPort(a)
|
||||||
|
e.servers = append(e.servers, &net.Resolver{
|
||||||
|
PreferGo: true,
|
||||||
|
Dial: func(ctx context.Context, network, _ string) (net.Conn, error) {
|
||||||
|
var d net.Dialer
|
||||||
|
return d.DialContext(ctx, network, addr)
|
||||||
|
},
|
||||||
|
})
|
||||||
|
}
|
||||||
|
return e
|
||||||
|
}
|
||||||
|
|
||||||
|
func (e *externalResolver) LookupTXT(ctx context.Context, name string) ([]string, error) {
|
||||||
|
return queryEach(e.servers, func(r *net.Resolver) ([]string, error) { return r.LookupTXT(ctx, name) })
|
||||||
|
}
|
||||||
|
|
||||||
|
func (e *externalResolver) LookupIPAddr(ctx context.Context, host string) ([]net.IPAddr, error) {
|
||||||
|
return queryEach(e.servers, func(r *net.Resolver) ([]net.IPAddr, error) { return r.LookupIPAddr(ctx, host) })
|
||||||
|
}
|
||||||
|
|
||||||
|
func (e *externalResolver) LookupAddr(ctx context.Context, addr string) ([]string, error) {
|
||||||
|
return queryEach(e.servers, func(r *net.Resolver) ([]string, error) { return r.LookupAddr(ctx, addr) })
|
||||||
|
}
|
||||||
|
|
||||||
|
func (e *externalResolver) LookupMX(ctx context.Context, name string) ([]*net.MX, error) {
|
||||||
|
return queryEach(e.servers, func(r *net.Resolver) ([]*net.MX, error) { return r.LookupMX(ctx, name) })
|
||||||
|
}
|
||||||
|
|
||||||
|
// queryEach asks each resolver in turn and stops at the first one that
|
||||||
|
// answers. "No such name" is an answer — only a resolver that cannot be
|
||||||
|
// reached, or that times out, moves the query on to the next one.
|
||||||
|
func queryEach[T any](servers []*net.Resolver, ask func(*net.Resolver) (T, error)) (T, error) {
|
||||||
|
var zero T
|
||||||
|
var lastErr error
|
||||||
|
for _, r := range servers {
|
||||||
|
v, err := ask(r)
|
||||||
|
if err == nil {
|
||||||
|
return v, nil
|
||||||
|
}
|
||||||
|
var dnsErr *net.DNSError
|
||||||
|
if errors.As(err, &dnsErr) && dnsErr.IsNotFound {
|
||||||
|
return zero, err
|
||||||
|
}
|
||||||
|
lastErr = err
|
||||||
|
}
|
||||||
|
if lastErr == nil {
|
||||||
|
lastErr = errors.New("no DNS resolver configured")
|
||||||
|
}
|
||||||
|
return zero, lastErr
|
||||||
|
}
|
||||||
|
|
||||||
|
// withDefaultPort appends the DNS port to a bare address, so the environment
|
||||||
|
// variable can name a resolver as plainly as "1.1.1.1".
|
||||||
|
func withDefaultPort(addr string) string {
|
||||||
|
if _, _, err := net.SplitHostPort(addr); err == nil {
|
||||||
|
return addr
|
||||||
|
}
|
||||||
|
return net.JoinHostPort(addr, "53")
|
||||||
|
}
|
||||||
|
|
||||||
|
// ParseResolvers reads a comma-separated resolver list, as it arrives from the
|
||||||
|
// environment. Blank entries are skipped; an empty result means "use
|
||||||
|
// DefaultResolvers".
|
||||||
|
func ParseResolvers(s string) []string {
|
||||||
|
var out []string
|
||||||
|
for _, part := range strings.Split(s, ",") {
|
||||||
|
if p := strings.TrimSpace(part); p != "" {
|
||||||
|
out = append(out, p)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
return out
|
||||||
|
}
|
||||||
@@ -0,0 +1,100 @@
|
|||||||
|
package dnscheck
|
||||||
|
|
||||||
|
import (
|
||||||
|
"context"
|
||||||
|
"errors"
|
||||||
|
"net"
|
||||||
|
"testing"
|
||||||
|
)
|
||||||
|
|
||||||
|
func TestWithDefaultPort(t *testing.T) {
|
||||||
|
cases := map[string]string{
|
||||||
|
"1.1.1.1": "1.1.1.1:53",
|
||||||
|
"1.1.1.1:5353": "1.1.1.1:5353",
|
||||||
|
"dns.example.com": "dns.example.com:53",
|
||||||
|
"2606:4700:4700::": "[2606:4700:4700::]:53",
|
||||||
|
"[::1]:5353": "[::1]:5353",
|
||||||
|
}
|
||||||
|
for in, want := range cases {
|
||||||
|
if got := withDefaultPort(in); got != want {
|
||||||
|
t.Errorf("withDefaultPort(%q) = %q, want %q", in, got, want)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
func TestParseResolvers(t *testing.T) {
|
||||||
|
got := ParseResolvers(" 1.1.1.1 , ,8.8.8.8:53,")
|
||||||
|
want := []string{"1.1.1.1", "8.8.8.8:53"}
|
||||||
|
if len(got) != len(want) {
|
||||||
|
t.Fatalf("got %q, want %q", got, want)
|
||||||
|
}
|
||||||
|
for i := range want {
|
||||||
|
if got[i] != want[i] {
|
||||||
|
t.Fatalf("got %q, want %q", got, want)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if r := ParseResolvers(""); len(r) != 0 {
|
||||||
|
t.Errorf("empty string parsed to %q, want nothing", r)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
func TestNewExternalResolverFallsBackToDefaults(t *testing.T) {
|
||||||
|
if n := len(newExternalResolver(nil).servers); n != len(DefaultResolvers) {
|
||||||
|
t.Errorf("resolver count = %d, want %d (the defaults)", n, len(DefaultResolvers))
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// The checks must reach the second resolver when the first is unreachable, but
|
||||||
|
// must not second-guess an authoritative "no such name" — otherwise a domain
|
||||||
|
// that genuinely lacks a record costs one timeout per configured resolver.
|
||||||
|
func TestQueryEachTriesTheNextResolverOnlyOnFailure(t *testing.T) {
|
||||||
|
servers := []*net.Resolver{{}, {}, {}}
|
||||||
|
|
||||||
|
asked := 0
|
||||||
|
got, err := queryEach(servers, func(*net.Resolver) (string, error) {
|
||||||
|
asked++
|
||||||
|
if asked < 3 {
|
||||||
|
return "", &net.DNSError{Err: "timed out", IsTimeout: true}
|
||||||
|
}
|
||||||
|
return "answer", nil
|
||||||
|
})
|
||||||
|
if err != nil || got != "answer" {
|
||||||
|
t.Fatalf("got (%q, %v), want (\"answer\", nil)", got, err)
|
||||||
|
}
|
||||||
|
if asked != 3 {
|
||||||
|
t.Errorf("asked %d resolvers, want 3", asked)
|
||||||
|
}
|
||||||
|
|
||||||
|
asked = 0
|
||||||
|
_, err = queryEach(servers, func(*net.Resolver) (string, error) {
|
||||||
|
asked++
|
||||||
|
return "", notFound("absent.example")
|
||||||
|
})
|
||||||
|
var dnsErr *net.DNSError
|
||||||
|
if !errors.As(err, &dnsErr) || !dnsErr.IsNotFound {
|
||||||
|
t.Fatalf("err = %v, want a not-found DNSError", err)
|
||||||
|
}
|
||||||
|
if asked != 1 {
|
||||||
|
t.Errorf("NXDOMAIN asked %d resolvers, want 1 — it is an answer, not a failure", asked)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// The reason this package does not use net.DefaultResolver: systemd-resolved
|
||||||
|
// answers PTR queries for the machine's own addresses out of the local
|
||||||
|
// hostname, which is not what the rest of the internet sees. The dial hook must
|
||||||
|
// therefore ignore the address the standard resolver picked from
|
||||||
|
// /etc/resolv.conf and connect to the configured one.
|
||||||
|
func TestExternalResolverDialsOnlyTheConfiguredAddress(t *testing.T) {
|
||||||
|
e := newExternalResolver([]string{"192.0.2.53"})
|
||||||
|
if len(e.servers) != 1 {
|
||||||
|
t.Fatalf("servers = %d, want 1", len(e.servers))
|
||||||
|
}
|
||||||
|
conn, err := e.servers[0].Dial(context.Background(), "udp", "127.0.0.53:53")
|
||||||
|
if err != nil {
|
||||||
|
t.Fatalf("dial: %v", err)
|
||||||
|
}
|
||||||
|
defer conn.Close()
|
||||||
|
if got := conn.RemoteAddr().String(); got != "192.0.2.53:53" {
|
||||||
|
t.Errorf("connected to %q, want 192.0.2.53:53 (the system resolver won)", got)
|
||||||
|
}
|
||||||
|
}
|
||||||
+6
-1
@@ -63,6 +63,11 @@ type Config struct {
|
|||||||
// session expires (env PANEL_SESSION_IDLE_DAYS, plan B.1). Non-positive
|
// session expires (env PANEL_SESSION_IDLE_DAYS, plan B.1). Non-positive
|
||||||
// falls back to the 7-day default.
|
// falls back to the 7-day default.
|
||||||
SessionIdleDays int
|
SessionIdleDays int
|
||||||
|
// DNSResolvers are the recursive resolvers the deliverability checks query
|
||||||
|
// (env SELFPOST_DNS_RESOLVERS). Empty uses dnscheck.DefaultResolvers. The
|
||||||
|
// checks must not go through the system resolver — see dnscheck's
|
||||||
|
// externalResolver — so this is how a closed network points them at its own.
|
||||||
|
DNSResolvers []string
|
||||||
}
|
}
|
||||||
|
|
||||||
// Server is the panel HTTP application.
|
// Server is the panel HTTP application.
|
||||||
@@ -105,7 +110,7 @@ func New(st *store.Store, domains *domain.Service, apps *app.Service, cfg Config
|
|||||||
// Published-DNS checks for the status page and the domain pages. The
|
// Published-DNS checks for the status page and the domain pages. The
|
||||||
// checker caches its own results, so page views do not each pay for a
|
// checker caches its own results, so page views do not each pay for a
|
||||||
// round of lookups (phase 13).
|
// round of lookups (phase 13).
|
||||||
dns: dnscheck.New(),
|
dns: dnscheck.New(cfg.DNSResolvers),
|
||||||
// Setup: a handful of attempts per minute per IP is plenty for a
|
// Setup: a handful of attempts per minute per IP is plenty for a
|
||||||
// legitimate admin and blunts automated probing (spec 7.6.1).
|
// legitimate admin and blunts automated probing (spec 7.6.1).
|
||||||
setupLimiter: newRateLimiter(10, time.Minute),
|
setupLimiter: newRateLimiter(10, time.Minute),
|
||||||
|
|||||||
@@ -30,6 +30,10 @@ services:
|
|||||||
SELFPOST_HOSTNAME: mail.e2e.test
|
SELFPOST_HOSTNAME: mail.e2e.test
|
||||||
# Plain HTTP panel for the test client — no reverse proxy in this stand.
|
# Plain HTTP panel for the test client — no reverse proxy in this stand.
|
||||||
PANEL_COOKIE_SECURE: "false"
|
PANEL_COOKIE_SECURE: "false"
|
||||||
|
# The panel's deliverability checks query resolvers directly rather than
|
||||||
|
# the container's own (see internal/dnscheck), so the fake zone has to be
|
||||||
|
# named here too — `dns:` below only redirects the system resolver.
|
||||||
|
SELFPOST_DNS_RESOLVERS: 10.77.0.10:53
|
||||||
# High enough that the whole suite's other ~10 sends (positive path,
|
# High enough that the whole suite's other ~10 sends (positive path,
|
||||||
# level-2 test, the various rejected attempts) never trip it by
|
# level-2 test, the various rejected attempts) never trip it by
|
||||||
# accident — only the dedicated level-1 test (negative check 4, which
|
# accident — only the dedicated level-1 test (negative check 4, which
|
||||||
|
|||||||
Reference in New Issue
Block a user