==> Checking deps /usr/sbin/unbound /usr/sbin/hyperfine dig: using custom build at bind9/bin/dig/dig kdig: using custom build at knot-dns/src/kdig /usr/sbin/drill resolve: using custom build at hickory-dns/target/release/resolve dog: using custom build at dog/target/release/dog doggo: using custom build at doggo/doggo q: using custom build at q/q ==> Starting Unbound ==> Benchmarks for A domain.tld. Benchmark 1: bind9/bin/dig/dig -p 2253 +short A domain.tld @127.0.0.1 Time (mean ± σ): 12.2 ms ± 3.5 ms [User: 8.8 ms, System: 4.0 ms] Range (min … max): 8.5 ms … 22.5 ms 211 runs Benchmark 2: knot-dns/src/kdig -p 2253 +short A domain.tld @127.0.0.1 Time (mean ± σ): 3.7 ms ± 0.1 ms [User: 2.8 ms, System: 1.3 ms] Range (min … max): 3.5 ms … 4.3 ms 807 runs Benchmark 3: /usr/sbin/drill -p 2253 -Q A domain.tld @127.0.0.1 Time (mean ± σ): 2.7 ms ± 0.4 ms [User: 1.9 ms, System: 0.7 ms] Range (min … max): 2.2 ms … 5.2 ms 620 runs Benchmark 4: hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t A domain.tld Time (mean ± σ): 1.9 ms ± 0.1 ms [User: 1.2 ms, System: 1.3 ms] Range (min … max): 1.8 ms … 6.2 ms 1599 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 5: dog/target/release/dog -n 127.0.0.1:2253 -t A domain.tld Time (mean ± σ): 285.3 µs ± 11.8 µs [User: 187.1 µs, System: 40.6 µs] Range (min … max): 260.2 µs … 444.5 µs 10208 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 6: doggo/doggo -n 127.0.0.1:2253 --short -t A domain.tld Time (mean ± σ): 1.6 ms ± 0.1 ms [User: 0.7 ms, System: 1.0 ms] Range (min … max): 1.5 ms … 2.0 ms 1771 runs Benchmark 7: q/q -s 127.0.0.1:2253 -r -t A domain.tld Time (mean ± σ): 1.7 ms ± 0.1 ms [User: 0.8 ms, System: 1.0 ms] Range (min … max): 1.6 ms … 2.2 ms 1741 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Summary dog/target/release/dog -n 127.0.0.1:2253 -t A domain.tld ran 5.77 ± 0.33 times faster than doggo/doggo -n 127.0.0.1:2253 --short -t A domain.tld 5.87 ± 0.32 times faster than q/q -s 127.0.0.1:2253 -r -t A domain.tld 6.61 ± 0.50 times faster than hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t A domain.tld 9.47 ± 1.57 times faster than /usr/sbin/drill -p 2253 -Q A domain.tld @127.0.0.1 12.96 ± 0.62 times faster than knot-dns/src/kdig -p 2253 +short A domain.tld @127.0.0.1 42.90 ± 12.40 times faster than bind9/bin/dig/dig -p 2253 +short A domain.tld @127.0.0.1 ==> Benchmarks for AAAA domain.tld. Benchmark 1: bind9/bin/dig/dig -p 2253 +short AAAA domain.tld @127.0.0.1 Time (mean ± σ): 12.6 ms ± 3.9 ms [User: 9.2 ms, System: 4.0 ms] Range (min … max): 8.7 ms … 22.8 ms 196 runs Benchmark 2: knot-dns/src/kdig -p 2253 +short AAAA domain.tld @127.0.0.1 Time (mean ± σ): 3.7 ms ± 0.1 ms [User: 2.8 ms, System: 1.4 ms] Range (min … max): 3.5 ms … 4.1 ms 793 runs Benchmark 3: /usr/sbin/drill -p 2253 -Q AAAA domain.tld @127.0.0.1 Time (mean ± σ): 4.1 ms ± 1.2 ms [User: 2.9 ms, System: 1.1 ms] Range (min … max): 2.2 ms … 6.2 ms 911 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 4: hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t AAAA domain.tld Time (mean ± σ): 1.9 ms ± 0.4 ms [User: 1.3 ms, System: 1.2 ms] Range (min … max): 1.8 ms … 14.7 ms 1616 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 5: dog/target/release/dog -n 127.0.0.1:2253 -t AAAA domain.tld Time (mean ± σ): 285.1 µs ± 14.1 µs [User: 187.1 µs, System: 40.7 µs] Range (min … max): 261.6 µs … 592.2 µs 10402 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 6: doggo/doggo -n 127.0.0.1:2253 --short -t AAAA domain.tld Time (mean ± σ): 1.6 ms ± 0.1 ms [User: 0.7 ms, System: 1.0 ms] Range (min … max): 1.5 ms … 2.2 ms 1721 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 7: q/q -s 127.0.0.1:2253 -r -t AAAA domain.tld Time (mean ± σ): 1.7 ms ± 0.1 ms [User: 0.7 ms, System: 1.0 ms] Range (min … max): 1.6 ms … 2.2 ms 1764 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Summary dog/target/release/dog -n 127.0.0.1:2253 -t AAAA domain.tld ran 5.76 ± 0.36 times faster than doggo/doggo -n 127.0.0.1:2253 --short -t AAAA domain.tld 5.86 ± 0.35 times faster than q/q -s 127.0.0.1:2253 -r -t AAAA domain.tld 6.65 ± 1.56 times faster than hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t AAAA domain.tld 12.96 ± 0.71 times faster than knot-dns/src/kdig -p 2253 +short AAAA domain.tld @127.0.0.1 14.53 ± 4.40 times faster than /usr/sbin/drill -p 2253 -Q AAAA domain.tld @127.0.0.1 44.17 ± 13.84 times faster than bind9/bin/dig/dig -p 2253 +short AAAA domain.tld @127.0.0.1 ==> Benchmarks for MX domain.tld. Benchmark 1: bind9/bin/dig/dig -p 2253 +short MX domain.tld @127.0.0.1 Time (mean ± σ): 11.9 ms ± 2.6 ms [User: 8.7 ms, System: 3.8 ms] Range (min … max): 8.7 ms … 18.2 ms 271 runs Benchmark 2: knot-dns/src/kdig -p 2253 +short MX domain.tld @127.0.0.1 Time (mean ± σ): 3.7 ms ± 0.1 ms [User: 2.8 ms, System: 1.3 ms] Range (min … max): 3.5 ms … 4.0 ms 803 runs Benchmark 3: /usr/sbin/drill -p 2253 -Q MX domain.tld @127.0.0.1 Time (mean ± σ): 4.0 ms ± 0.5 ms [User: 2.8 ms, System: 1.1 ms] Range (min … max): 2.4 ms … 4.5 ms 1224 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 4: hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t MX domain.tld Time (mean ± σ): 1.9 ms ± 0.1 ms [User: 1.2 ms, System: 1.3 ms] Range (min … max): 1.8 ms … 3.1 ms 1580 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 5: dog/target/release/dog -n 127.0.0.1:2253 -t MX domain.tld Time (mean ± σ): 287.4 µs ± 13.4 µs [User: 187.5 µs, System: 41.8 µs] Range (min … max): 264.4 µs … 549.2 µs 10046 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 6: doggo/doggo -n 127.0.0.1:2253 --short -t MX domain.tld Time (mean ± σ): 1.6 ms ± 0.1 ms [User: 0.7 ms, System: 1.0 ms] Range (min … max): 1.5 ms … 2.1 ms 1768 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 7: q/q -s 127.0.0.1:2253 -r -t MX domain.tld Time (mean ± σ): 1.7 ms ± 0.1 ms [User: 0.8 ms, System: 1.0 ms] Range (min … max): 1.6 ms … 2.2 ms 1788 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Summary dog/target/release/dog -n 127.0.0.1:2253 -t MX domain.tld ran 5.72 ± 0.33 times faster than doggo/doggo -n 127.0.0.1:2253 --short -t MX domain.tld 5.83 ± 0.33 times faster than q/q -s 127.0.0.1:2253 -r -t MX domain.tld 6.57 ± 0.38 times faster than hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t MX domain.tld 12.86 ± 0.65 times faster than knot-dns/src/kdig -p 2253 +short MX domain.tld @127.0.0.1 14.09 ± 1.77 times faster than /usr/sbin/drill -p 2253 -Q MX domain.tld @127.0.0.1 41.44 ± 9.30 times faster than bind9/bin/dig/dig -p 2253 +short MX domain.tld @127.0.0.1 ==> Benchmarks for CNAME mail.domain.tld. Benchmark 1: bind9/bin/dig/dig -p 2253 +short A mail.domain.tld @127.0.0.1 Time (mean ± σ): 13.8 ms ± 4.4 ms [User: 9.9 ms, System: 4.6 ms] Range (min … max): 8.8 ms … 23.1 ms 159 runs Benchmark 2: knot-dns/src/kdig -p 2253 +short A mail.domain.tld @127.0.0.1 Time (mean ± σ): 3.7 ms ± 0.1 ms [User: 2.8 ms, System: 1.3 ms] Range (min … max): 3.5 ms … 4.2 ms 809 runs Benchmark 3: /usr/sbin/drill -p 2253 -Q A mail.domain.tld @127.0.0.1 Time (mean ± σ): 3.2 ms ± 1.0 ms [User: 2.2 ms, System: 0.9 ms] Range (min … max): 2.2 ms … 6.5 ms 1328 runs Benchmark 4: hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t A mail.domain.tld Time (mean ± σ): 2.0 ms ± 0.9 ms [User: 1.3 ms, System: 1.3 ms] Range (min … max): 1.8 ms … 35.1 ms 1589 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 5: dog/target/release/dog -n 127.0.0.1:2253 -t A mail.domain.tld Time (mean ± σ): 283.5 µs ± 16.7 µs [User: 186.4 µs, System: 39.6 µs] Range (min … max): 257.3 µs … 1241.4 µs 10893 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 6: doggo/doggo -n 127.0.0.1:2253 --short -t A mail.domain.tld Time (mean ± σ): 1.6 ms ± 0.1 ms [User: 0.7 ms, System: 1.1 ms] Range (min … max): 1.5 ms … 2.0 ms 1738 runs Benchmark 7: q/q -s 127.0.0.1:2253 -r -t A mail.domain.tld Time (mean ± σ): 1.7 ms ± 0.1 ms [User: 0.8 ms, System: 1.0 ms] Range (min … max): 1.6 ms … 2.0 ms 1750 runs Summary dog/target/release/dog -n 127.0.0.1:2253 -t A mail.domain.tld ran 5.80 ± 0.40 times faster than doggo/doggo -n 127.0.0.1:2253 --short -t A mail.domain.tld 5.89 ± 0.39 times faster than q/q -s 127.0.0.1:2253 -r -t A mail.domain.tld 6.98 ± 3.16 times faster than hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t A mail.domain.tld 11.27 ± 3.53 times faster than /usr/sbin/drill -p 2253 -Q A mail.domain.tld @127.0.0.1 13.01 ± 0.82 times faster than knot-dns/src/kdig -p 2253 +short A mail.domain.tld @127.0.0.1 48.80 ± 15.68 times faster than bind9/bin/dig/dig -p 2253 +short A mail.domain.tld @127.0.0.1 ==> Benchmarks for TXT txt.domain.tld. Benchmark 1: bind9/bin/dig/dig -p 2253 +short TXT txt.domain.tld @127.0.0.1 Time (mean ± σ): 10.9 ms ± 3.1 ms [User: 7.8 ms, System: 3.5 ms] Range (min … max): 9.2 ms … 23.6 ms 217 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 2: knot-dns/src/kdig -p 2253 +short TXT txt.domain.tld @127.0.0.1 Time (mean ± σ): 3.8 ms ± 0.1 ms [User: 2.8 ms, System: 1.4 ms] Range (min … max): 3.6 ms … 4.5 ms 798 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 3: /usr/sbin/drill -p 2253 -Q TXT txt.domain.tld @127.0.0.1 Time (mean ± σ): 2.6 ms ± 0.1 ms [User: 1.9 ms, System: 0.6 ms] Range (min … max): 2.5 ms … 3.1 ms 1159 runs Benchmark 4: hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t TXT txt.domain.tld Time (mean ± σ): 2.0 ms ± 0.2 ms [User: 1.3 ms, System: 1.3 ms] Range (min … max): 1.9 ms … 7.0 ms 1523 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 5: dog/target/release/dog -n 127.0.0.1:2253 -t TXT txt.domain.tld Time (mean ± σ): 383.8 µs ± 14.6 µs [User: 231.2 µs, System: 70.2 µs] Range (min … max): 356.5 µs … 640.9 µs 7669 runs Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options. Benchmark 6: doggo/doggo -n 127.0.0.1:2253 --short -t TXT txt.domain.tld Time (mean ± σ): 1.8 ms ± 0.1 ms [User: 0.7 ms, System: 1.1 ms] Range (min … max): 1.6 ms … 2.3 ms 1735 runs Benchmark 7: q/q -s 127.0.0.1:2253 -r -t TXT txt.domain.tld Time (mean ± σ): 1.8 ms ± 0.1 ms [User: 0.8 ms, System: 1.1 ms] Range (min … max): 1.7 ms … 2.2 ms 1683 runs Summary dog/target/release/dog -n 127.0.0.1:2253 -t TXT txt.domain.tld ran 4.63 ± 0.27 times faster than doggo/doggo -n 127.0.0.1:2253 --short -t TXT txt.domain.tld 4.70 ± 0.24 times faster than q/q -s 127.0.0.1:2253 -r -t TXT txt.domain.tld 5.23 ± 0.45 times faster than hickory-dns/target/release/resolve -n 127.0.0.1:2253 -t TXT txt.domain.tld 6.78 ± 0.31 times faster than /usr/sbin/drill -p 2253 -Q TXT txt.domain.tld @127.0.0.1 9.85 ± 0.45 times faster than knot-dns/src/kdig -p 2253 +short TXT txt.domain.tld @127.0.0.1 28.39 ± 8.20 times faster than bind9/bin/dig/dig -p 2253 +short TXT txt.domain.tld @127.0.0.1 ==> All done ==> Stopping Unbound