Gigabyte GA-MA74GM-S2H - FreeBSD

Hardware info on main page.

This machine runs the amd64 version of FreeBSD.

Currently running:

root@kg-f2:~ # freebsd-version -ku
13.1-RELEASE-p3
13.1-RELEASE-p5

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.1-RELEASE-p3 FreeBSD 13.1-RELEASE-p3 GENERIC amd64

was:

root@kg-f2# uname -a
FreeBSD kg-f2.kg4.no 8.4-STABLE FreeBSD 8.4-STABLE #6 r296141: Sat Feb 27 20:38:47 CET 2016     root@kg-f2.kg4.no:/usr/obj/usr/src/sys/GENERIC  amd64

was:

root@kg-f2# uname -a
FreeBSD kg-f2.kg4.no 8.2-STABLE FreeBSD 8.2-STABLE #5: Fri Jun  3 17:20:39 CEST 2011     root@kg-f2.kg4.no:/usr/obj/usr/src/sys/GENERIC  amd64

The machine boots from the zroot pool, on the ada5 and ada6 drives:

root@kg-f2:~ # gpart show -p ada5
=>        40  1953525088    ada5  GPT  (932G)
          40        1024  ada5p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada5p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada5p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

root@kg-f2:~ # gpart show -p ada6
=>        40  1953525088    ada6  GPT  (932G)
          40        1024  ada6p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada6p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada6p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

old: the machine boots from the zroot pool, on the ada1 and ada2 drives:

root@kg-f2# gpart show
=>       34  488397101  ada1  GPT  (232G)
         34        128     1  freebsd-boot  (64k)
        162    8388608     2  freebsd-swap  (4.0G)
    8388770  125829120     3  freebsd-zfs  (60G)
  134217890  354179245        - free -  (168G)

=>       34  488397101  ada2  GPT  (232G)
         34        128     1  freebsd-boot  (64k)
        162    8388608     2  freebsd-swap  (4.0G)
    8388770  125829120     3  freebsd-zfs  (60G)
  134217890  354179245        - free -  (168G)

Archives: 2009, 2010, 2011, 2012, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022,

Links

RAID calculators ZFS RAID (RAIDZ) Calculator - Capacity ServeTheHome Raid Calculator jro.io OpenZFS Capacity Calculator, FreeBSD Handbook: ZFS,

Work log

2024-04--14: zroot - pkg - install Python 3.9

Apr 14 21:23:06 kg-f2 pkg[22094]: mpdecimal-2.5.1 installed
Apr 14 21:23:06 kg-f2 pkg[22094]: libffi-3.4.4 installed
Apr 14 21:23:06 kg-f2 pkg[22094]: readline-8.2.7 installed
Apr 14 21:23:06 kg-f2 pkg[22094]: gettext-runtime-0.22.3 installed
Apr 14 21:23:09 kg-f2 pkg[22094]: python39-3.9.18 installed
Apr 14 21:23:10 kg-f2 pkg[22094]: python3-3_3 installed
Apr 14 21:23:10 kg-f2 pkg[22094]: python-3.9_3,2 installed

mostly for ansible.

2024-04-14: zroot - pkg - upgrade

Apr 14 21:19:28 kg-f2 pkg[20729]: pkg upgraded: 1.20.8 -> 1.20.9 
Apr 14 21:21:14 kg-f2 pkg[20759]: libnghttp2 upgraded: 1.57.0 -> 1.58.0 
Apr 14 21:21:14 kg-f2 pkg[20759]: libpsl upgraded: 0.21.2_3 -> 0.21.2_4 
Apr 14 21:21:15 kg-f2 pkg[20759]: curl upgraded: 8.4.0 -> 8.6.0 
Apr 14 21:21:23 kg-f2 pkg[20759]: ca_root_nss upgraded: 3.93 -> 3.93_2 

2024-04-13: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:06:23 with 0 errors on Sat Apr 13 12:07:30 2024
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2024-04-13: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:01:03 with 0 errors on Sat Apr 13 03:02:14 2024
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2024-04-06: zroot - reboot, FreeBSD 13.2-release-p11 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p11
13.2-RELEASE-p11

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p11 FreeBSD 13.2-RELEASE-p11 GENERIC amd64

2024-04-06: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
[..]
The following files will be updated as part of updating to
13.2-RELEASE-p11:
/bin/freebsd-version
/boot/kernel/if_wg.ko
/boot/kernel/kernel
/usr/lib/debug/boot/kernel/if_wg.ko.debug
/usr/lib/debug/boot/kernel/kernel.debug
/usr/lib/libprivateunbound.a
/usr/lib/libprivateunbound.so.5
/usr/lib/libprivateunbound_p.a
/usr/lib32/libprivateunbound.a
/usr/lib32/libprivateunbound.so.5
/usr/lib32/libprivateunbound_p.a
/usr/sbin/local-unbound
/usr/sbin/local-unbound-anchor
/usr/sbin/local-unbound-checkconf
/usr/sbin/local-unbound-control

WARNING: FreeBSD 13.2-RELEASE-p10 is approaching its End-of-Life date.
It is strongly recommended that you upgrade to a newer
release within the next 2 months.

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2024-03-09: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:11:08 with 0 errors on Sat Mar  9 12:17:03 2024
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2024-03-09: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:01:02 with 0 errors on Sat Mar  9 03:07:01 2024
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2024-02-17: zroot - reboot, FreeBSD 13.2-release-p10 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p10
13.2-RELEASE-p10

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p10 FreeBSD 13.2-RELEASE-p10 GENERIC amd64

2024-02-17: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
[..]
The following files will be updated as part of updating to
13.2-RELEASE-p10:
/bin/freebsd-version
/boot/kernel/kernel
/etc/defaults/rc.conf
/etc/periodic/daily/480.leapfile-ntpd
[..]
/var/db/etcupdate/current/etc/defaults/rc.conf
/var/db/etcupdate/current/etc/periodic/daily/480.leapfile-ntpd
/var/db/mergemaster.mtree

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2024-02-03: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:14:04 with 0 errors on Sat Feb  3 12:34:00 2024
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2024-02-03: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:59 with 0 errors on Sat Feb  3 03:20:59 2024
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2024-01-04: zroot - reboot, FreeBSD 13.2-release-p9 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p8
13.2-RELEASE-p9

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p8 FreeBSD 13.2-RELEASE-p8 GENERIC amd64

2024-01-04: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
[..]
The following files will be updated as part of updating to
13.2-RELEASE-p9:
/bin/freebsd-version
/usr/bin/slogin
/usr/bin/ssh
/usr/bin/ssh-keyscan
/usr/lib/libprivatessh.a
/usr/lib/libprivatessh.so.5
/usr/lib/libprivatessh_p.a
/usr/lib32/libprivatessh.a
/usr/lib32/libprivatessh.so.5
/usr/lib32/libprivatessh_p.a
/usr/libexec/ssh-keysign
/usr/sbin/sshd

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2023-12-30: zroot - zfs - latest scrub of pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:01:01 with 0 errors on Sat Dec 30 03:17:19 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-12-16: zroot - reboot, FreeBSD 13.2-release-p8 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p8
13.2-RELEASE-p8

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p8 FreeBSD 13.2-RELEASE-p8 GENERIC amd64

2023-12-16: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching metadata signature for 13.2-RELEASE from update1.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata patches.. done.
Applying metadata patches... done.
Inspecting system... done.
Preparing to download files... done.
Fetching 6 patches.... done.
Applying patches... done.
The following files will be updated as part of updating to
13.2-RELEASE-p8:
/bin/freebsd-version
/boot/kernel/kernel
/boot/kernel/nfscl.ko
/usr/include/fs/nfs/nfs_var.h
/usr/lib/debug/boot/kernel/kernel.debug
/usr/lib/debug/boot/kernel/nfscl.ko.debug

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2023-12-09: zroot - reboot, FreeBSD 13.2-release-p7 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p4
13.2-RELEASE-p7

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p4 FreeBSD 13.2-RELEASE-p4 GENERIC amd64

2023-12-09: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
[..]
The following files will be updated as part of updating to
13.2-RELEASE-p7:
/bin/freebsd-version
/boot/kernel/pf.ko
/boot/kernel/zfs.ko
/lib/libzpool.so.2
/rescue/[
/rescue/bectl
/rescue/bsdlabel
/rescue/bunzip2
/rescue/bzcat
/rescue/bzip2
/rescue/camcontrol
/rescue/cat
/rescue/ccdconfig
/rescue/chflags
/rescue/chgrp
/rescue/chio
/rescue/chmod
/rescue/chown
/rescue/chroot
/rescue/clri
/rescue/cp
/rescue/csh
/rescue/date
/rescue/dd
/rescue/devfs
/rescue/df
/rescue/dhclient
/rescue/disklabel
/rescue/dmesg
/rescue/dump
/rescue/dumpfs
/rescue/dumpon
/rescue/echo
/rescue/ed
/rescue/ex
/rescue/expr
/rescue/fastboot
/rescue/fasthalt
/rescue/fdisk
/rescue/fsck
/rescue/fsck_4.2bsd
/rescue/fsck_ffs
/rescue/fsck_msdosfs
/rescue/fsck_ufs
/rescue/fsdb
/rescue/fsirand
/rescue/gbde
/rescue/geom
/rescue/getfacl
/rescue/glabel
/rescue/gpart
/rescue/groups
/rescue/gunzip
/rescue/gzcat
/rescue/gzip
/rescue/halt
/rescue/head
/rescue/hostname
/rescue/id
/rescue/ifconfig
/rescue/init
/rescue/ipf
/rescue/iscsictl
/rescue/iscsid
/rescue/kenv
/rescue/kill
/rescue/kldconfig
/rescue/kldload
/rescue/kldstat
/rescue/kldunload
/rescue/ldconfig
/rescue/less
/rescue/link
/rescue/ln
/rescue/ls
/rescue/lzcat
/rescue/lzma
/rescue/md5
/rescue/mdconfig
/rescue/mdmfs
/rescue/mkdir
/rescue/mknod
/rescue/more
/rescue/mount
/rescue/mount_cd9660
/rescue/mount_msdosfs
/rescue/mount_nfs
/rescue/mount_nullfs
/rescue/mount_udf
/rescue/mount_unionfs
/rescue/mt
/rescue/mv
/rescue/nc
/rescue/newfs
/rescue/newfs_msdos
/rescue/nos-tun
/rescue/pgrep
/rescue/ping
/rescue/ping6
/rescue/pkill
/rescue/poweroff
/rescue/ps
/rescue/pwd
/rescue/rcorder
/rescue/rdump
/rescue/realpath
/rescue/reboot
/rescue/red
/rescue/rescue
/rescue/restore
/rescue/rm
/rescue/rmdir
/rescue/route
/rescue/routed
/rescue/rrestore
/rescue/rtquery
/rescue/rtsol
/rescue/savecore
/rescue/sed
/rescue/setfacl
/rescue/sh
/rescue/shutdown
/rescue/sleep
/rescue/spppcontrol
/rescue/stty
/rescue/swapon
/rescue/sync
/rescue/sysctl
/rescue/tail
/rescue/tar
/rescue/tcsh
/rescue/tee
/rescue/test
/rescue/tunefs
/rescue/umount
/rescue/unlink
/rescue/unlzma
/rescue/unxz
/rescue/unzstd
/rescue/vi
/rescue/whoami
/rescue/xz
/rescue/xzcat
/rescue/zcat
/rescue/zdb
/rescue/zfs
/rescue/zpool
/rescue/zstd
/rescue/zstdcat
/rescue/zstdmt
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.asan-i386.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.asan-i386.so
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.asan-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.asan-x86_64.so
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.cfi-i386.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.cfi-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.cfi_diag-i386.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.cfi_diag-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.dd-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.msan-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.stats-i386.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.stats-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.tsan-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.ubsan_standalone-i386.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.ubsan_standalone-x86_64.a
/usr/lib/clang/14.0.5/lib/freebsd/libclang_rt.xray-x86_64.a
/usr/lib/debug/boot/kernel/pf.ko.debug
/usr/lib/debug/boot/kernel/zfs.ko.debug
/usr/lib/libzpool.a
/usr/lib32/libzpool.a
/usr/lib32/libzpool.so.2

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2023-11-25: zroot - zfs - latest scrub of pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:03:59 with 0 errors on Sat Nov 25 12:05:04 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-11-25: zroot - zfs - latest scrub of pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:53 with 0 errors on Sat Nov 25 03:02:02 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-11-18: zroot - reboot, FreeBSD 13.2-release-p5 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p4
13.2-RELEASE-p5

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p4 FreeBSD 13.2-RELEASE-p4 GENERIC amd64

that's all for now.

2023-11-18: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching metadata signature for 13.2-RELEASE from update1.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata patches.. done.
Applying metadata patches... done.
Fetching 2 metadata files... done.
Inspecting system... done.
Preparing to download files... done.
Fetching 22 patches.....10....20. done.
Applying patches... done.
The following files will be updated as part of updating to
13.2-RELEASE-p5:
/bin/freebsd-version
/lib/casper/libcap_net.so.1
/lib/libc.so.7
/rescue/[
/rescue/bectl
/rescue/bsdlabel
/rescue/bunzip2
/rescue/bzcat
/rescue/bzip2
/rescue/camcontrol
/rescue/cat
/rescue/ccdconfig
/rescue/chflags
/rescue/chgrp
/rescue/chio
/rescue/chmod
/rescue/chown
/rescue/chroot
/rescue/clri
/rescue/cp
/rescue/csh
/rescue/date
/rescue/dd
/rescue/devfs
/rescue/df
/rescue/dhclient
/rescue/disklabel
/rescue/dmesg
/rescue/dump
/rescue/dumpfs
/rescue/dumpon
/rescue/echo
/rescue/ed
/rescue/ex
/rescue/expr
/rescue/fastboot
/rescue/fasthalt
/rescue/fdisk
/rescue/fsck
/rescue/fsck_4.2bsd
/rescue/fsck_ffs
/rescue/fsck_msdosfs
/rescue/fsck_ufs
/rescue/fsdb
/rescue/fsirand
/rescue/gbde
/rescue/geom
/rescue/getfacl
/rescue/glabel
/rescue/gpart
/rescue/groups
/rescue/gunzip
/rescue/gzcat
/rescue/gzip
/rescue/halt
/rescue/head
/rescue/hostname
/rescue/id
/rescue/ifconfig
/rescue/init
/rescue/ipf
/rescue/iscsictl
/rescue/iscsid
/rescue/kenv
/rescue/kill
/rescue/kldconfig
/rescue/kldload
/rescue/kldstat
/rescue/kldunload
/rescue/ldconfig
/rescue/less
/rescue/link
/rescue/ln
/rescue/ls
/rescue/lzcat
/rescue/lzma
/rescue/md5
/rescue/mdconfig
/rescue/mdmfs
/rescue/mkdir
/rescue/mknod
/rescue/more
/rescue/mount
/rescue/mount_cd9660
/rescue/mount_msdosfs
/rescue/mount_nfs
/rescue/mount_nullfs
/rescue/mount_udf
/rescue/mount_unionfs
/rescue/mt
/rescue/mv
/rescue/nc
/rescue/newfs
/rescue/newfs_msdos
/rescue/nos-tun
/rescue/pgrep
/rescue/ping
/rescue/ping6
/rescue/pkill
/rescue/poweroff
/rescue/ps
/rescue/pwd
/rescue/rcorder
/rescue/rdump
/rescue/realpath
/rescue/reboot
/rescue/red
/rescue/rescue
/rescue/restore
/rescue/rm
/rescue/rmdir
/rescue/route
/rescue/routed
/rescue/rrestore
/rescue/rtquery
/rescue/rtsol
/rescue/savecore
/rescue/sed
/rescue/setfacl
/rescue/sh
/rescue/shutdown
/rescue/sleep
/rescue/spppcontrol
/rescue/stty
/rescue/swapon
/rescue/sync
/rescue/sysctl
/rescue/tail
/rescue/tar
/rescue/tcsh
/rescue/tee
/rescue/test
/rescue/tunefs
/rescue/umount
/rescue/unlink
/rescue/unlzma
/rescue/unxz
/rescue/unzstd
/rescue/vi
/rescue/whoami
/rescue/xz
/rescue/xzcat
/rescue/zcat
/rescue/zdb
/rescue/zfs
/rescue/zpool
/rescue/zstd
/rescue/zstdcat
/rescue/zstdmt
/sbin/devd
/sbin/init
/usr/lib/libc.a
/usr/lib/libc_p.a
/usr/lib/libc_pic.a
/usr/lib/libregex.a
/usr/lib/libregex.so.1
/usr/lib/libregex_p.a
/usr/lib32/libc.a
/usr/lib32/libc.so.7
/usr/lib32/libc_p.a
/usr/lib32/libc_pic.a
/usr/lib32/libcap_net.so.1
/usr/lib32/libregex.a
/usr/lib32/libregex.so.1
/usr/lib32/libregex_p.a
/usr/sbin/freebsd-update
/usr/sbin/nologin

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 838.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2023-10-28: zroot - pkg - upgrade

Oct 28 18:59:12 kg-f2 pkg[43840]: pkg upgraded: 1.19.1_1 -> 1.20.8 
Oct 28 18:59:31 kg-f2 pkg[43861]: libnghttp2 upgraded: 1.52.0 -> 1.57.0 
Oct 28 18:59:31 kg-f2 pkg[43861]: libssh2 upgraded: 1.10.0_1,3 -> 1.11.0,3 
Oct 28 18:59:32 kg-f2 pkg[43861]: libpsl upgraded: 0.21.2_2 -> 0.21.2_3 
Oct 28 18:59:32 kg-f2 pkg[43861]: smartmontools upgraded: 7.3 -> 7.4 
Oct 28 18:59:32 kg-f2 pkg[43861]: curl upgraded: 8.1.1 -> 8.4.0 
Oct 28 18:59:33 kg-f2 pkg[43861]: ca_root_nss upgraded: 3.89 -> 3.93 

2023-10-21: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:12:29 with 0 errors on Sat Oct 21 12:13:35 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-10-21: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:49 with 0 errors on Sat Oct 21 03:01:59 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-10-10: zroot, freebsd-update install (I forgot that the other day)

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

reboot, and now FreeBSD 13.2-release-p4 really is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p4
13.2-RELEASE-p4

2023-10-08: zroot - reboot, FreeBSD 13.2-release-p4 is in

root@kg-f2:~ # freebsd-version -ku
13.2-RELEASE-p4
13.1-RELEASE-p9

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.2-RELEASE-p4 FreeBSD 13.2-RELEASE-p4 GENERIC amd64

2023-10-08: zroot - freebsd-update upgrade to 13.2-RELEASE

root@kg-f2:~ # freebsd-update -r 13.2-RELEASE upgrade
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 2 mirrors found.
Fetching metadata signature for 13.1-RELEASE from update1.freebsd.org... done.
Fetching metadata index... done.
Fetching 1 metadata files... done.
Inspecting system... done.

The following components of FreeBSD seem to be installed:
kernel/generic kernel/generic-dbg world/base world/lib32

The following components of FreeBSD do not seem to be installed:
world/base-dbg world/lib32-dbg

Does this look reasonable (y/n)? y
[..]
The following files will be removed as part of updating to
13.2-RELEASE-p4:
The following files will be added as part of updating to
13.2-RELEASE-p4:
The following files will be updated as part of updating to
13.2-RELEASE-p4:
[..]
/var/db/etcupdate/log
/var/db/mergemaster.mtree
/var/db/services.db
To install the downloaded upgrades, run "/usr/sbin/freebsd-update install".

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...
Kernel updates have been installed.  Please reboot and run
"/usr/sbin/freebsd-update install" again to finish installing updates.

reboot, then

2023-10-08: zroot - reboot, FreeBSD 13.1-release-p9 is in

root@kg-f2:~ # freebsd-version -ku
13.1-RELEASE-p9
13.1-RELEASE-p9

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.1-RELEASE-p9 FreeBSD 13.1-RELEASE-p9 GENERIC amd64

2023-10-08: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 2 mirrors found.
Fetching metadata signature for 13.1-RELEASE from update2.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata patches.. done.
Applying metadata patches... done.
Inspecting system... done.
Preparing to download files... done.
Fetching 77 patches.....10....20....30....40....50....60....70... done.
Applying patches... done.
Fetching 1 files...  done.
The following files will be added as part of updating to
13.1-RELEASE-p9:
/usr/share/zoneinfo/America/Ciudad_Juarez
The following files will be updated as part of updating to
13.1-RELEASE-p9:
/bin/freebsd-version
/boot/kernel/if_ena.ko
/boot/kernel/if_ix.ko
/boot/kernel/kernel
/boot/kernel/mpr.ko
/boot/loader
/boot/loader.efi
/boot/loader_4th
/boot/loader_4th.efi
/boot/loader_lua
/boot/loader_lua.efi
/boot/loader_simp
/boot/loader_simp.efi
/boot/pxeboot
/boot/zfsloader
/etc/ssh/sshd_config
/lib/geom/geom_eli.so
/lib/libcrypto.so.111
/rescue/[
/rescue/bectl
/rescue/bsdlabel
/rescue/bunzip2
/rescue/bzcat
/rescue/bzip2
/rescue/camcontrol
/rescue/cat
/rescue/ccdconfig
/rescue/chflags
/rescue/chgrp
/rescue/chio
/rescue/chmod
/rescue/chown
/rescue/chroot
/rescue/clri
/rescue/cp
/rescue/csh
/rescue/date
/rescue/dd
/rescue/devfs
/rescue/df
/rescue/dhclient
/rescue/disklabel
/rescue/dmesg
/rescue/dump
/rescue/dumpfs
/rescue/dumpon
/rescue/echo
/rescue/ed
/rescue/ex
/rescue/expr
/rescue/fastboot
/rescue/fasthalt
/rescue/fdisk
/rescue/fsck
/rescue/fsck_4.2bsd
/rescue/fsck_ffs
/rescue/fsck_msdosfs
/rescue/fsck_ufs
/rescue/fsdb
/rescue/fsirand
/rescue/gbde
/rescue/geom
/rescue/getfacl
/rescue/glabel
/rescue/gpart
/rescue/groups
/rescue/gunzip
/rescue/gzcat
/rescue/gzip
/rescue/halt
/rescue/head
/rescue/hostname
/rescue/id
/rescue/ifconfig
/rescue/init
/rescue/ipf
/rescue/iscsictl
/rescue/iscsid
/rescue/kenv
/rescue/kill
/rescue/kldconfig
/rescue/kldload
/rescue/kldstat
/rescue/kldunload
/rescue/ldconfig
/rescue/less
/rescue/link
/rescue/ln
/rescue/ls
/rescue/lzcat
/rescue/lzma
/rescue/md5
/rescue/mdconfig
/rescue/mdmfs
/rescue/mkdir
/rescue/mknod
/rescue/more
/rescue/mount
/rescue/mount_cd9660
/rescue/mount_msdosfs
/rescue/mount_nfs
/rescue/mount_nullfs
/rescue/mount_udf
/rescue/mount_unionfs
/rescue/mt
/rescue/mv
/rescue/nc
/rescue/newfs
/rescue/newfs_msdos
/rescue/nos-tun
/rescue/pgrep
/rescue/ping
/rescue/ping6
/rescue/pkill
/rescue/poweroff
/rescue/ps
/rescue/pwd
/rescue/rcorder
/rescue/rdump
/rescue/realpath
/rescue/reboot
/rescue/red
/rescue/rescue
/rescue/restore
/rescue/rm
/rescue/rmdir
/rescue/route
/rescue/routed
/rescue/rrestore
/rescue/rtquery
/rescue/rtsol
/rescue/savecore
/rescue/sed
/rescue/setfacl
/rescue/sh
/rescue/shutdown
/rescue/sleep
/rescue/spppcontrol
/rescue/stty
/rescue/swapon
/rescue/sync
/rescue/sysctl
/rescue/tail
/rescue/tar
/rescue/tcsh
/rescue/tee
/rescue/test
/rescue/tunefs
/rescue/umount
/rescue/unlink
/rescue/unlzma
/rescue/unxz
/rescue/unzstd
/rescue/vi
/rescue/whoami
/rescue/xz
/rescue/xzcat
/rescue/zcat
/rescue/zdb
/rescue/zfs
/rescue/zpool
/rescue/zstd
/rescue/zstdcat
/rescue/zstdmt
/usr/bin/openssl
/usr/bin/slogin
/usr/bin/ssh
/usr/include/openssl/bnerr.h
/usr/include/openssl/x509v3.h
/usr/lib/debug/boot/kernel/if_ena.ko.debug
/usr/lib/debug/boot/kernel/if_ix.ko.debug
/usr/lib/debug/boot/kernel/kernel.debug
/usr/lib/debug/boot/kernel/mpr.ko.debug
/usr/lib/libcrypto.a
/usr/lib/libcrypto_p.a
/usr/lib/libfetch.a
/usr/lib/libfetch.so.6
/usr/lib/libfetch_p.a
/usr/lib/libpam.a
/usr/lib/libprivatessh.a
/usr/lib/libprivatessh.so.5
/usr/lib/libprivatessh_p.a
/usr/lib/pam_krb5.so.6
/usr/lib32/geom/geom_eli.so
/usr/lib32/libcrypto.a
/usr/lib32/libcrypto.so.111
/usr/lib32/libcrypto_p.a
/usr/lib32/libfetch.a
/usr/lib32/libfetch.so.6
/usr/lib32/libfetch_p.a
/usr/lib32/libpam.a
/usr/lib32/libprivatessh.a
/usr/lib32/libprivatessh.so.5
/usr/lib32/libprivatessh_p.a
/usr/lib32/pam_krb5.so.6
/usr/libexec/ssh-keysign
/usr/libexec/ssh-pkcs11-helper
/usr/sbin/bhyve
/usr/sbin/hostapd
/usr/sbin/rpc.tlsservd
/usr/sbin/sshd
/usr/sbin/wpa_supplicant
/usr/share/man/man5/sshd_config.5.gz
/usr/share/man/man8/pam_krb5.8.gz
/usr/share/zoneinfo/Africa/Cairo
/usr/share/zoneinfo/Africa/Casablanca
/usr/share/zoneinfo/Africa/El_Aaiun
/usr/share/zoneinfo/America/Bogota
/usr/share/zoneinfo/America/Cambridge_Bay
/usr/share/zoneinfo/America/Godthab
/usr/share/zoneinfo/America/Inuvik
/usr/share/zoneinfo/America/Iqaluit
/usr/share/zoneinfo/America/Nuuk
/usr/share/zoneinfo/America/Ojinaga
/usr/share/zoneinfo/America/Pangnirtung
/usr/share/zoneinfo/America/Rankin_Inlet
/usr/share/zoneinfo/America/Resolute
/usr/share/zoneinfo/America/Whitehorse
/usr/share/zoneinfo/America/Yellowknife
/usr/share/zoneinfo/Asia/Gaza
/usr/share/zoneinfo/Asia/Hebron
/usr/share/zoneinfo/Asia/Kuala_Lumpur
/usr/share/zoneinfo/Asia/Singapore
/usr/share/zoneinfo/Canada/Yukon
/usr/share/zoneinfo/Egypt
/usr/share/zoneinfo/Europe/Kirov
/usr/share/zoneinfo/Europe/Volgograd
/usr/share/zoneinfo/Singapore
/usr/share/zoneinfo/zone.tab
/usr/share/zoneinfo/zone1970.tab
/var/db/etcupdate/current/etc/ssh/sshd_config
/var/db/mergemaster.mtree
WARNING: FreeBSD 13.1-RELEASE-p3 HAS PASSED ITS END-OF-LIFE DATE.
Any security issues discovered after Mon Jul 31 02:00:00 CEST 2023
will not have been corrected.

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
Scanning //usr/local/share/certs for certificates...
 done.

2023-09-16: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:11:47 with 0 errors on Sat Sep 16 12:24:07 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-09-16: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:32 with 0 errors on Sat Sep 16 03:12:58 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-08-12: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:13:05 with 0 errors on Sat Aug 12 12:45:40 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-08-12: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:32 with 0 errors on Sat Aug 12 03:33:12 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-07-08: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:10:34 with 0 errors on Sat Jul  8 12:11:41 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-07-08: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:19 with 0 errors on Sat Jul  8 03:01:30 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-06-03: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:14:23 with 0 errors on Sat Jun  3 12:15:29 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-06-03: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:32 with 0 errors on Sat Jun  3 03:01:43 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-05-29: zroot - pkg - install curl

May 29 18:51:05 kg-f2 pkg[51634]: pkg upgraded: 1.19.0 -> 1.19.1_1 
May 29 18:51:18 kg-f2 pkg[51653]: indexinfo-0.3.1 installed
May 29 18:51:18 kg-f2 pkg[51653]: libunistring-1.1 installed
May 29 18:51:18 kg-f2 pkg[51653]: libidn2-2.3.4 installed
May 29 18:51:18 kg-f2 pkg[51653]: libnghttp2-1.52.0 installed
May 29 18:51:18 kg-f2 pkg[51653]: libssh2-1.10.0_1,3 installed
May 29 18:51:18 kg-f2 pkg[51653]: libpsl-0.21.2_2 installed
May 29 18:51:18 kg-f2 pkg[51653]: ca_root_nss-3.89 installed
May 29 18:51:19 kg-f2 pkg[51653]: curl-8.1.1 installed

2023-04-29: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2                                                
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:15:23 with 0 errors on Sat Apr 29 12:39:36 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-04-29: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:31 with 0 errors on Sat Apr 29 03:24:49 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-04-01: zroot - pkg - install ncftp3

Apr  1 17:00:50 kg-f2 pkg[13647]: ncftp-3.2.6_2 installed

2023-03-25: zroot - latest scrub result for pool z2

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
  scan: scrub repaired 0B in 09:14:39 with 0 errors on Sat Mar 25 12:15:45 2023
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

2023-03-25: zroot - latest scrub result for pool zroot

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0B in 00:00:18 with 0 errors on Sat Mar 25 03:01:28 2023
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-03-24: zroot - configure for automatic scrub every 35 days. Create a /etc/periodic.conf file, with contents:

# zfs
daily_status_zfs_enable="YES"
daily_scrub_zfs_enable="YES"

this works out because the interval is set as 35 days in the defaults:

root@kg-f2:~ # grep daily_scrub /etc/defaults/periodic.conf 
daily_scrub_zfs_enable="NO"
daily_scrub_zfs_pools=""            # empty string selects all pools
daily_scrub_zfs_default_threshold="35"      # days between scrubs
#daily_scrub_zfs_${poolname}_threshold="35" # pool specific threshold

it is the daily_scrub_zfs_default_threshold variable. Also added daily status of the zfs pools.

2023-02-11: zroot - create the storage pool

root@kg-f2:~ # zpool create z2 raidz2 /dev/ada0p1 /dev/ada1p1 /dev/ada2p1 /dev/ada3p1 /dev/ada4p1

check it

root@kg-f2:~ # zpool status z2
  pool: z2
 state: ONLINE
config:

    NAME        STATE     READ WRITE CKSUM
    z2          ONLINE       0     0     0
      raidz2-0  ONLINE       0     0     0
        ada0p1  ONLINE       0     0     0
        ada1p1  ONLINE       0     0     0
        ada2p1  ONLINE       0     0     0
        ada3p1  ONLINE       0     0     0
        ada4p1  ONLINE       0     0     0

errors: No known data errors

is it mounted?

root@kg-f2:~ # df -h /z2
Filesystem    Size    Used   Avail Capacity  Mounted on
z2             32T    171K     32T     0%    /z2

good.

2023-02-11: zroot - try out the create pool command before doing anything. raidz2 first

root@kg-f2:~ # zpool create -n z2 raidz2 /dev/ada0p1 /dev/ada1p1 /dev/ada2p1 /dev/ada3p1 /dev/ada4p1
would create 'z2' with the following layout:

    z2
      raidz2
        ada0p1
        ada1p1
        ada2p1
        ada3p1
        ada4p1

and a raidz3 too

root@kg-f2:~ # zpool create -n z2 raidz3 /dev/ada0p1 /dev/ada1p1 /dev/ada2p1 /dev/ada3p1 /dev/ada4p1
would create 'z2' with the following layout:

    z2
      raidz3
        ada0p1
        ada1p1
        ada2p1
        ada3p1
        ada4p1

that's funny.

2023-02-11: zroot - storage drives, check and set up check

root@kg-f2:~ # gpart show -p ada0
gpart: No such geom: ada0.
root@kg-f2:~ # gpart show -p ada1
gpart: No such geom: ada1.
root@kg-f2:~ # gpart show -p ada2
gpart: No such geom: ada2.
root@kg-f2:~ # gpart show -p ada3
gpart: No such geom: ada3.
root@kg-f2:~ # gpart show -p ada4
gpart: No such geom: ada4.

they are blank, creta GPT and add freebsd-zfs to each drive

root@kg-f2:~ # gpart create -s GPT ada0
ada0 created
root@kg-f2:~ # gpart add -t freebsd-zfs ada0
ada0p1 added
root@kg-f2:~ # gpart create -s GPT ada1
ada1 created
root@kg-f2:~ # gpart add -t freebsd-zfs ada1
ada1p1 added
root@kg-f2:~ # gpart create -s GPT ada2
ada2 created
root@kg-f2:~ # gpart add -t freebsd-zfs ada2
ada2p1 added
root@kg-f2:~ # gpart create -s GPT ada3
ada3 created
root@kg-f2:~ # gpart add -t freebsd-zfs ada3
ada3p1 added
root@kg-f2:~ # gpart create -s GPT ada4
ada4 created
root@kg-f2:~ # gpart add -t freebsd-zfs ada4
ada4p1 added

check

root@kg-f2:~ # gpart show -p ada0 ada1 ada2 ada3 ada4
=>         40  23437770672    ada0  GPT  (11T)
           40  23437770672  ada0p1  freebsd-zfs  (11T)

=>         40  23437770672    ada1  GPT  (11T)
           40  23437770672  ada1p1  freebsd-zfs  (11T)

=>         40  23437770672    ada2  GPT  (11T)
           40  23437770672  ada2p1  freebsd-zfs  (11T)

=>         40  23437770672    ada3  GPT  (11T)
           40  23437770672  ada3p1  freebsd-zfs  (11T)

=>         40  23437770672    ada4  GPT  (11T)
           40  23437770672  ada4p1  freebsd-zfs  (11T)

2023-02-11: zroot - pkg - install smartmontools

Feb 11 14:11:34 kg-f2 pkg[1014]: smartmontools-7.3 installed

and configure it

root@kg-f2:~ # cp -v /usr/local/etc/smartd.conf.sample /usr/local/etc/smartd.conf
/usr/local/etc/smartd.conf.sample -> /usr/local/etc/smartd.conf

enable it in /etc/rc.conf

root@kg-f2:~ # sysrc smartd_enable="YES"
smartd_enable:  -> YES

start the service and check that it runs

root@kg-f2:~ # service smartd start
Starting smartd.

root@kg-f2:~ # service smartd status
smartd is running as pid 1084.

2023-02-11: zroot - pkg - install pkg

root@kg-f2:~ # pkg install pkg
The package management tool is not yet installed on your system.
Do you want to fetch and install it now? [y/N]: y
Bootstrapping pkg from pkg+http://pkg.FreeBSD.org/FreeBSD:13:amd64/quarterly, please wait...
Verifying signature with trusted certificate pkg.freebsd.org.2013102301... done
Installing pkg-1.19.0...
Extracting pkg-1.19.0: 100%
Updating FreeBSD repository catalogue...
Fetching meta.conf: 100%    163 B   0.2kB/s    00:01    
Fetching packagesite.pkg: 100%    6 MiB   6.8MB/s    00:01    
Processing entries: 100%
FreeBSD repository update completed. 32413 packages processed.
All repositories are up to date.
Updating database digests format: 100%
Checking integrity... done (0 conflicting)
The most recent versions of packages are already installed

check which version we are on

root@kg-f2:~ # pkg -vv | grep url
    url             : "pkg+http://pkg.FreeBSD.org/FreeBSD:13:amd64/quarterly",

2023-02-11: zroot - system file system layout and usage

root@kg-f2:~ # df -h
Filesystem            Size    Used   Avail Capacity  Mounted on
zroot/ROOT/default    891G    1.2G    890G     0%    /
devfs                 1.0K    1.0K      0B   100%    /dev
zroot/tmp             890G     96K    890G     0%    /tmp
zroot/usr/home        890G    136K    890G     0%    /usr/home
zroot/usr/ports       890G     96K    890G     0%    /usr/ports
zroot/usr/src         890G     96K    890G     0%    /usr/src
zroot/var/crash       890G     96K    890G     0%    /var/crash
zroot/var/audit       890G     96K    890G     0%    /var/audit
zroot/var/log         890G    256K    890G     0%    /var/log
zroot                 890G     96K    890G     0%    /zroot
zroot/var/tmp         890G     96K    890G     0%    /var/tmp
zroot/var/mail        890G     96K    890G     0%    /var/mail

2023-02-11: zroot - the system pool is a zfs mirror

root@kg-f2:~ # zpool status zroot
  pool: zroot
 state: ONLINE
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada5p3  ONLINE       0     0     0
        ada6p3  ONLINE       0     0     0

errors: No known data errors

2023-02-11: zroot - swap is a geom mirror

root@kg-f2:~ # swapinfo -h
Device              Size     Used    Avail Capacity
/dev/mirror/swap     8.0G       0B     8.0G     0%

root@kg-f2:~ # geom mirror status
       Name    Status  Components
mirror/swap  COMPLETE  ada5p2 (ACTIVE)
                       ada6p2 (ACTIVE)

2023-02-11: zroot - with the storage drives connected to the Marvell controller, the system drives got reassigned

root@kg-f2:~ # gpart show -p ada5
=>        40  1953525088    ada5  GPT  (932G)
          40        1024  ada5p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada5p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada5p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

root@kg-f2:~ # gpart show -p ada6
=>        40  1953525088    ada6  GPT  (932G)
          40        1024  ada6p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada6p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada6p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

2023-02-05: zroot - reboot, FreeBSD 13.1-release-p5 is in

root@kg-f2:~ # freebsd-version -ku
13.1-RELEASE-p3
13.1-RELEASE-p5

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.1-RELEASE-p3 FreeBSD 13.1-RELEASE-p3 GENERIC amd64

that's it for now.

2023-02-05: zroot - freebsd-update fetch

root@kg-f2:~ # freebsd-update fetch
src component not installed, skipped
[..]
The following files will be removed as part of updating to
13.1-RELEASE-p5:
/usr/share/zoneinfo/SystemV
The following files will be added as part of updating to
13.1-RELEASE-p5:
/usr/share/zoneinfo/Europe/Kyiv
/usr/share/zoneinfo/GMT
The following files will be updated as part of updating to
13.1-RELEASE-p5:
[..]
/var/db/etcupdate/current/etc/mtree/BSD.usr.dist
/var/db/etcupdate/log
/var/db/mergemaster.mtree

install

root@kg-f2:~ # freebsd-update install
src component not installed, skipped
Creating snapshot of existing boot environment... done.
Installing updates...Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
 done.

2023-02-05: zroot - I installed FreeBSD 13.1-release on a pair of 1 TB drives I had laying around

root@kg-f2:~ # freebsd-version -ku
13.1-RELEASE
13.1-RELEASE

kernel

root@kg-f2:~ # uname -a
FreeBSD kg-f2.kg4.no 13.1-RELEASE FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64

the pool looks like this

root@kg-f2:~ # zpool status
  pool: zroot
 state: ONLINE
config:

    NAME        STATE     READ WRITE CKSUM
    zroot       ONLINE       0     0     0
      mirror-0  ONLINE       0     0     0
        ada0p3  ONLINE       0     0     0
        ada1p3  ONLINE       0     0     0

(the storage pool is not connected at this time) and the boot drives are partitioned like this

root@kg-f2:~ # gpart show -p ada0
=>        40  1953525088    ada0  GPT  (932G)
          40        1024  ada0p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada0p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada0p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

root@kg-f2:~ # gpart show -p ada1
=>        40  1953525088    ada1  GPT  (932G)
          40        1024  ada1p1  freebsd-boot  (512K)
        1064         984          - free -  (492K)
        2048    16777216  ada1p2  freebsd-swap  (8.0G)
    16779264  1936744448  ada1p3  freebsd-zfs  (924G)
  1953523712        1416          - free -  (708K)

all from the auto-zfs of the FreeBSD installer. Nice!

2023-02-05: document a few things before throwing in new system disks and installing a brand new os. /boot/loader.conf

ahci_load="YES"
zfs_load="YES"
vfs.root.mountfrom="zfs:zroot"
#vfs.zfs.arc_max="2048M"
siis_load="YES"
amdtemp_load="YES"
# testing without MSI
hw.pci.enable_msix="0"
hw.pci.enable_msi="0"

/etc/sysctl.conf

kern.timecounter.hardware=ACPI-safe
#machdep.acpi_timer_freq=3577045
machdep.acpi_timer_freq=3570847
kern.module_path=/boot/kernel;/boot/modules;/usr/local/modules

/etc/profile

EXINIT="set showmode"; export EXINIT
LANG="en_US.ISO8859-1"; export LANG
G_FILENAME_ENCODING=ISO-8859-1; export G_FILENAME_ENCODING

/etc/rc.conf

# 
font8x14="iso-8x14"
font8x16="iso-8x16"
font8x8="iso-8x8"
keymap="norwegian.iso"
zfs_enable="YES"
hostname="kg-f2.kg4.no"
ifconfig_re0="DHCP"
# dumpdev
dumpdev="AUTO"
# inetd, for ftp server
inetd_enable="YES"
# sshd
sshd_enable="YES"
# ntp
ntpd_enable="YES"
ntpd_sync_on_start="YES"
# smartd
smartd_enable="YES"
# enable FUSE kernel module
fusefs_enable="YES"

/etc/fstab

# Device mountpoint FStype Options Dump Pass#
/dev/gpt/swap0   none   swap  sw  0  0
/dev/gpt/swap1   none   swap  sw  0  0

user and group info

root@kg-f2# pw usershow tingo
tingo:*:1001:1001::0:0:Torfinn Ingolfsen (f2):/home/tingo:/bin/sh
root@kg-f2# pw groupshow users
users:*:1001:

/etc/dhclient.conf

send dhcp-client-identifier "kg-f2.kg4.no";

2023-02-05: I booted from a FreeBSD 13.1 install usb stick to verify that all hardware is seen. Everything looks ok, and zpool import list both the zroot and storage pools.

2023-02-05: there, the pool backed up to the extra drive now

root@kg-f2# df -h /storage /mnt
Filesystem     Size    Used   Avail Capacity  Mounted on
storage        3.6T    3.5T     31G    99%    /storage
/dev/ada7p1     14T    3.5T    9.4T    27%    /mnt

2023-02-04: try with a used 16TB drive instead

Feb  4 17:14:23 kg-f2 kernel: ada7 at ahcich2 bus 0 scbus2 target 0 lun 0
Feb  4 17:14:23 kg-f2 kernel: ada7: <ST16000NM001G-2KK103 SN04> ATA-11 SATA 3.x device
Feb  4 17:14:23 kg-f2 kernel: ada7: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
Feb  4 17:14:23 kg-f2 kernel: ada7: Command Queueing enabled
Feb  4 17:14:23 kg-f2 kernel: ada7: 15259648MB (31251759104 512 byte sectors: 16H 63S/T 16383C)

check it

root@kg-f2# gpart show -p ada7
=>         40  31251759024    ada7  GPT  (14T)
           40  31251759024  ada7p1  freebsd-zfs  (14T)

that has to go

root@kg-f2# gpart delete -i 1 ada7
ada7p1 deleted

add a ufs partition instead

root@kg-f2# gpart add -t freebsd-ufs ada7
ada7p1 added

create filesystem

root@kg-f2# newfs -U /dev/ada7p1
/dev/ada7p1: 15259648.0MB (31251759016 sectors) block size 16384, fragment size 2048
    using 83060 cylinder groups of 183.72MB, 11758 blks, 23552 inodes.
    with soft updates
super-block backups (for fsck -b #) at:
 160, 376416, 752672, 1128928, 1505184, 1881440, 2257696, 2633952, 3010208, 3386464, 3762720, 4138976, 4515232, 4891488,
 5267744, 5644000, 6020256, 6396512, 6772768, 7149024, 7525280, 7901536, 8277792, 8654048, 9030304, 9406560, 9782816, 10159072,
 10535328, 10911584, 11287840, 11664096, 12040352, 12416608, 12792864, 13169120, 13545376, 13921632, 14297888, 14674144,
[..]

unfortunately, that was a bad disk drive. So try with another. A brand new one this time Check

root@kg-f2# gpart show -p ada7
gpart: No such geom: ada7.

create GPT layout

root@kg-f2# gpart create -s GPT ada7
ada7 created

add freebsd-ufs partition

root@kg-f2# gpart add -t freebsd-ufs ada7
ada7p1 added

verify

root@kg-f2# gpart show -p ada7
=>         34  31251759037    ada7  GPT  (14T)
           34            6          - free -  (3.0k)
           40  31251759024  ada7p1  freebsd-ufs  (14T)
  31251759064            7          - free -  (3.5k)

create a filesystem

root@kg-f2# newfs -U /dev/ada7p1
[..]
 31245050912, 31245427168, 31245803424, 31246179680, 31246555936, 31246932192, 31247308448, 31247684704, 31248060960,
 31248437216, 31248813472, 31249189728, 31249565984, 31249942240, 31250318496, 31250694752, 31251071008, 31251447264

mount and check

root@kg-f2# mount /dev/ada7p1 /mnt

root@kg-f2# df -h /mnt
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ada7p1     14T    4.0k     13T     0%    /mnt

ok, that one works.

2023-02-04: I added a 4TB drive temporarily as backup drive. From /var/log messages

Feb  4 16:36:20 kg-f2 kernel: ada7 at ahcich2 bus 0 scbus2 target 0 lun 0
Feb  4 16:36:20 kg-f2 kernel: ada7: <ST4000DM000-1F2168 CC52> ATA-8 SATA 3.x device
Feb  4 16:36:20 kg-f2 kernel: ada7: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
Feb  4 16:36:20 kg-f2 kernel: ada7: Command Queueing enabled
Feb  4 16:36:20 kg-f2 kernel: ada7: 3815447MB (7814037168 512 byte sectors: 16H 63S/T 16383C)
Feb  4 16:36:20 kg-f2 kernel: ada7: quirks=0x1<4K>

check it

root@kg-f2# gpart show -p ada7
gpart: No such geom: ada7.

set it up as GPT

root@kg-f2# gpart create -s GPT ada7
ada7 created

add a freebsd-ufs partition

root@kg-f2# gpart add -t freebsd-ufs ada7
ada7p1 added

how does it look now?

root@kg-f2# gpart show -p ada7
=>        34  7814037101    ada7  GPT  (3.7T)
          34           6          - free -  (3.0k)
          40  7814037088  ada7p1  freebsd-ufs  (3.7T)
  7814037128           7          - free -  (3.5k)

add filesystem

root@kg-f2# newfs -U /dev/ada7p1
[..]
 7809193440, 7809569696, 7809945952, 7810322208, 7810698464, 7811074720, 7811450976, 7811827232, 7812203488, 7812579744,
 7812956000, 7813332256, 7813708512

mount it

root@kg-f2# mount /dev/ada7p1 /mnt

space check

root@kg-f2# df -h /mnt
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ada7p1    3.5T    4.0k    3.2T     0%    /mnt

ok, it is not big enough.

2023-02-04: run a smartctl helth check on all drives

root@kg-f2# smartctl -H /dev/ada0
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada1
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada2
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada3
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada4
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada5
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

root@kg-f2# smartctl -H /dev/ada6
smartctl 6.4 2015-06-04 r4109 [FreeBSD 8.4-STABLE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

good.

2023-02-04: I replaced the ST-Lab A-360 controller with a Marvell 88SE9215-based one, the result still works. zpool status - root pool

root@kg-f2# zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0 in 0h7m with 0 errors on Wed Jan 18 03:57:43 2023
config:

    NAME           STATE     READ WRITE CKSUM
    zroot          ONLINE       0     0     0
      mirror-0     ONLINE       0     0     0
        gpt/disk0  ONLINE       0     0     0
        gpt/disk1  ONLINE       0     0     0

errors: No known data errors

storage pool

root@kg-f2# zpool status storage
  pool: storage
 state: ONLINE
status: One or more devices are configured to use a non-native block size.
    Expect reduced performance.
action: Replace affected devices with devices that support the
    configured block size, or migrate data to a properly configured
    pool.
  scan: scrub repaired 0 in 3h55m with 0 errors on Tue Jan 31 07:38:53 2023
config:

    NAME        STATE     READ WRITE CKSUM
    storage     ONLINE       0     0     0
      raidz1-0  ONLINE       0     0     0
        ada3    ONLINE       0     0     0
        ada4    ONLINE       0     0     0
        ada5    ONLINE       0     0     0
        ada6    ONLINE       0     0     0  block size: 512B configured, 4096B native
        ada0    ONLINE       0     0     0

errors: No known data errors

drive ada0 is now connected to the new controller

root@kg-f2# dmesg | grep ada0
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SAMSUNG HD103SJ 1AJ100E4> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)

more info on main page.

2023-02-04: shutdown the machine to some work on the hardware.

2023-01-31: scrub - latest result for pool storage

root@kg-f2# zpool status storage
  pool: storage
 state: ONLINE
status: One or more devices are configured to use a non-native block size.
    Expect reduced performance.
action: Replace affected devices with devices that support the
    configured block size, or migrate data to a properly configured
    pool.
  scan: scrub repaired 0 in 3h55m with 0 errors on Tue Jan 31 07:38:53 2023
config:

    NAME        STATE     READ WRITE CKSUM
    storage     ONLINE       0     0     0
      raidz1-0  ONLINE       0     0     0
        ada3    ONLINE       0     0     0
        ada4    ONLINE       0     0     0
        ada5    ONLINE       0     0     0
        ada6    ONLINE       0     0     0  block size: 512B configured, 4096B native
        ada0    ONLINE       0     0     0

errors: No known data errors

2023-01-18: scrub - latest result for pool zroot

root@kg-f2# zpool status zroot
  pool: zroot
 state: ONLINE
  scan: scrub repaired 0 in 0h7m with 0 errors on Wed Jan 18 03:57:43 2023
config:

    NAME           STATE     READ WRITE CKSUM
    zroot          ONLINE       0     0     0
      mirror-0     ONLINE       0     0     0
        gpt/disk0  ONLINE       0     0     0
        gpt/disk1  ONLINE       0     0     0

errors: No known data errors