music3 - squeezebox server

guest os: FreeBSD / amd64

cpu: 1

memory size 768 MB (was: 512 MB)

storage boot: file - 20 GB

storage data: file - 60 GB

usage: new squeezebox server, replacement for vbox-v5.

Logitech Media Server: 7.9.1

tmux commands: ls - list session, attach - t ,

tmux keys: ctrl-B command key, ctrl-b i information, ctrl-b t time, ctrl-b d detach,

back to virtual machines page.

History

This machine was originally named bhyve_bvm5.

Work log

2024-06-08: ntp - timecounter is wrong again

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

change it

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET

I put it in /etc/sysctl.conf

root@bvm5# tail -1 /etc/sysctl.conf
kern.timecounter.hardware=HPET

2024-03-27: ntp - a while later

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
*kg-omni1.kg4.no 194.239.208.213  3 u   68  128  377    0.708  +52.482   6.635

2024-03-27: ntp struggles these last few days

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 129.240.2.6      3 u   15   64  377    0.507  +219937 101887.

checking timecounter

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

quality-wise that is the worst one

root@bvm5# dmesg | grep quality
Event timer "LAPIC" quality 600
Timecounter "TSC" frequency 1399160919 Hz quality 1000
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "HPET" frequency 16777216 Hz quality 950
Event timer "HPET" frequency 16777216 Hz quality 550
Event timer "HPET1" frequency 16777216 Hz quality 450
Event timer "HPET2" frequency 16777216 Hz quality 450
Event timer "HPET3" frequency 16777216 Hz quality 450
Event timer "HPET4" frequency 16777216 Hz quality 450
Event timer "HPET5" frequency 16777216 Hz quality 450
Event timer "HPET6" frequency 16777216 Hz quality 450
Event timer "HPET7" frequency 16777216 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900

select a better one

root@bvm5# sysctl kern.timecounter.hardware=HPET1
kern.timecounter.hardware: TSC
sysctl: kern.timecounter.hardware=HPET1: Invalid argument

ok, try HPET then

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET

lets see if that makes ntp happy.

2021-09-10: ntp struggles:

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 192.36.143.130   2 u    9   64  377    1.867  +127032 16117.9

checking kern.timecounter.hardware gives

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

ouch! Check quality settings

root@bvm5# dmesg | grep quality
Event timer "LAPIC" quality 600
Timecounter "TSC" frequency 1097170997 Hz quality 1000
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "HPET" frequency 16777216 Hz quality 950
Event timer "HPET" frequency 16777216 Hz quality 550
Event timer "HPET1" frequency 16777216 Hz quality 450
Event timer "HPET2" frequency 16777216 Hz quality 450
Event timer "HPET3" frequency 16777216 Hz quality 450
Event timer "HPET4" frequency 16777216 Hz quality 450
Event timer "HPET5" frequency 16777216 Hz quality 450
Event timer "HPET6" frequency 16777216 Hz quality 450
Event timer "HPET7" frequency 16777216 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900

select HPET

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET

wait and see if ntp improves.

2021-03-13: the machine still reports this in the root shell / console

root@bvm5# Your locale was detected as C, you may have problems with non-Latin filenames.  Consider changing your LANG variable to the correct locale, i.e. en_US.utf8
Build signature doesn't match environment
Environment open failed: DB_VERSION_MISMATCH: Database environment version mismatch

not sure what the DB problem is.

2021-03-12: bvm5 - vtbd0p3 -ports - install p5-IO-Socket-SSL

Mar 12 17:38:31 bvm5 pkg-static: p5-Net-SSLeay-1.88 installed
Mar 12 17:38:40 bvm5 pkg-static: p5-Mozilla-CA-20200520 installed
Mar 12 17:39:06 bvm5 pkg-static: p5-Socket6-0.29 installed
Mar 12 17:39:13 bvm5 pkg-static: p5-IO-Socket-INET6-2.72_1 installed
Mar 12 17:39:23 bvm5 pkg-static: p5-IO-Socket-SSL-2.070 installed

lets see if the complaints stop.

2021-03-12: bvm5 - vtbd0p3 - logitechmediaserver - complains about missing p5-IO-Socket-SSL package

root@bvm5# tail /var/log/logitechmediaserver/server.log
Mar 10 00:00:00 bvm5 newsyslog[7777]: logfile turned over due to size>100K
[21-03-10 23:47:09.5988] Slim::Networking::Repositories::__ANON__ (146) Failed to fetch http://repos.squeezecommunity.org/extensions.xml: Can't connect to https URL lack of IO::Socket::SSL: https://github.com/LMS-Community/lms-plugin-repository/raw/master/extensions.xml
[21-03-11 21:53:24.5268] Slim::Networking::Repositories::__ANON__ (146) Failed to fetch http://repos.squeezecommunity.org/extensions.xml: Can't connect to https URL lack of IO::Socket::SSL: https://github.com/LMS-Community/lms-plugin-repository/raw/master/extensions.xml
[21-03-11 23:47:09.5317] Slim::Networking::Repositories::__ANON__ (146) Failed to fetch http://repos.squeezecommunity.org/extensions.xml: Can't connect to https URL lack of IO::Socket::SSL: https://github.com/LMS-Community/lms-plugin-repository/raw/master/extensions.xml

ok.

2021-03-09: bvm5 - vtbd0p3 - ports - logitechmediaserver, ok it seems that bug 240397 is relevant. Applied patch in attachment 207299 manually to pkg-plist, and then I could build and install logitechmediaserver. Nice!

Mar  9 23:41:41 bvm5 pkg-static: logitechmediaserver-7.9.2.g2018.12.10 installed

ok

2021-03-09: bvm5 - vtbd0p3 - ports - reinstall gmake

Mar  9 18:36:39 bvm5 pkg: gmake-4.3_2 deinstalled
Mar  9 18:36:41 bvm5 pkg-static: gmake-4.3_2 installed

ok

2021-03-09: bvm5 - reboot the machine

2021-03-09: bvm5 - vtbd0p3 - ports - logitechmediaserver failed to install again.

2021-03-08: bvm5 - vtbd0p3 - ports - try to install logitechmediaserver again

Mar  8 11:09:37 bvm5 pkg-static: py37-setuptools-44.0.0 installed
Mar  8 11:17:48 bvm5 pkg-static: ninja-1.10.2,2 installed
Mar  8 11:18:07 bvm5 pkg-static: meson-0.57.1 installed
Mar  8 11:21:02 bvm5 pkg-static: liblz4-1.9.3,1 installed
Mar  8 11:27:10 bvm5 pkg-static: zstd-1.4.8 installed
Mar  8 11:30:01 bvm5 pkg-static: rsync-3.2.3 installed
Mar  8 11:34:42 bvm5 pkg-static: gperf-3.1 installed
Mar  8 11:45:07 bvm5 pkg-static: freetype2-2.10.4 installed
Mar  8 11:57:37 bvm5 pkg-static: expat-2.2.10 installed
Mar  8 11:59:30 bvm5 pkg-static: fontconfig-2.13.93,1 installed
Mar  8 12:12:11 bvm5 pkg-static: png-1.6.37_1 installed
Mar  8 12:12:47 bvm5 pkg-static: jbigkit-2.1_1 installed
Mar  8 12:18:10 bvm5 pkg-static: py37-sphinxcontrib-applehelp-1.0.2 installed
Mar  8 12:18:23 bvm5 pkg-static: py37-sphinxcontrib-devhelp-1.0.2 installed
Mar  8 12:18:34 bvm5 pkg-static: py37-sphinxcontrib-jsmath-1.0.1 installed
Mar  8 12:18:47 bvm5 pkg-static: py37-sphinxcontrib-htmlhelp-1.0.3 installed
Mar  8 12:19:01 bvm5 pkg-static: py37-sphinxcontrib-serializinghtml-1.1.4 installed
Mar  8 12:19:15 bvm5 pkg-static: py37-sphinxcontrib-qthelp-1.0.3 installed
Mar  8 12:21:17 bvm5 pkg-static: py37-markupsafe-1.1.1_1 installed
Mar  8 12:21:55 bvm5 pkg-static: py37-pytz-2020.5,1 installed
Mar  8 12:22:13 bvm5 pkg-static: py37-Babel-2.9.0 installed
Mar  8 12:22:20 bvm5 pkg-static: py37-Jinja2-2.11.2_1 installed
Mar  8 12:22:47 bvm5 pkg-static: py37-pygments-2.7.2 installed
Mar  8 12:23:16 bvm5 pkg-static: py37-docutils-0.16 installed
Mar  8 12:32:23 bvm5 pkg-static: py37-cython-0.29.21 installed
Mar  8 12:33:15 bvm5 pkg-static: py37-pystemmer-2.0.0.1 installed
Mar  8 12:33:21 bvm5 pkg-static: py37-snowballstemmer-1.2.1 installed
Mar  8 12:33:32 bvm5 pkg-static: py37-alabaster-0.7.6 installed
Mar  8 12:33:43 bvm5 pkg-static: py37-imagesize-1.1.0 installed
Mar  8 12:34:01 bvm5 pkg-static: py37-certifi-2020.12.5 installed
Mar  8 12:34:16 bvm5 pkg-static: py37-chardet-3.0.4_3 installed
Mar  8 12:34:29 bvm5 pkg-static: py37-idna-2.10 installed
Mar  8 12:34:51 bvm5 pkg-static: py37-pysocks-1.7.1 installed
Mar  8 12:35:39 bvm5 pkg-static: py37-pycparser-2.20 installed
Mar  8 12:35:46 bvm5 pkg-static: py37-cffi-1.14.5 installed
Mar  8 12:38:13 bvm5 pkg-static: py37-six-1.15.0 installed
Mar  8 12:38:33 bvm5 pkg-static: py37-cryptography-2.9.2 installed
Mar  8 12:38:46 bvm5 pkg-static: py37-openssl-19.1.0,1 installed
Mar  8 12:38:52 bvm5 pkg-static: py37-urllib3-1.25.11,1 installed
Mar  8 12:38:58 bvm5 pkg-static: py37-requests-2.22.0_2 installed
Mar  8 12:39:18 bvm5 pkg-static: py37-pyparsing-2.4.7 installed
Mar  8 12:39:23 bvm5 pkg-static: py37-packaging-20.9 installed
Mar  8 12:40:01 bvm5 pkg-static: ca_root_nss-3.61 installed
Mar  8 12:40:27 bvm5 pkg-static: py37-sphinx-3.4.3,1 installed
Mar  8 12:47:23 bvm5 pkg-static: libnghttp2-1.43.0 installed
Mar  8 12:56:46 bvm5 pkg-static: curl-7.75.0 installed
Mar  8 13:00:07 bvm5 pkg-static: jsoncpp-1.9.4 installed
Mar  8 13:01:19 bvm5 pkg-static: libtool-2.4.6_1 installed
Mar  8 13:04:38 bvm5 pkg-static: libuv-1.41.0 installed
Mar  8 13:07:46 bvm5 pkg-static: rhash-1.4.1 installed
Mar  8 13:19:53 bvm5 pkg-static: libarchive-3.5.1,1 installed
Mar  8 16:54:54 bvm5 pkg-static: cmake-3.19.6 installed
Mar  8 16:59:00 bvm5 pkg-static: jpeg-turbo-2.0.6 installed
Mar  8 17:04:05 bvm5 pkg-static: tiff-4.2.0 installed
Mar  8 17:04:38 bvm5 pkg-static: giflib-5.2.1 installed
Mar  8 17:12:18 bvm5 pkg-static: webp-1.2.0 installed
Mar  8 17:14:47 bvm5 pkg-static: libgd-2.3.1,1 installed
Mar  8 19:06:21 bvm5 pkg-static: yasm-1.3.0 installed
Mar  8 19:08:05 bvm5 pkg-static: mac-3.99.4.5.7_1 installed
Mar  8 19:13:14 bvm5 pkg-static: faad2-2.8.8,1 installed
Mar  8 19:13:58 bvm5 pkg-static: libogg-1.3.4,4 installed
Mar  8 19:19:58 bvm5 pkg-static: flac-1.3.3 installed
Mar  8 19:23:23 bvm5 pkg-static: lame-3.100_2 installed
Mar  8 19:24:00 bvm5 pkg-static: libltdl-2.4.6 installed
Mar  8 19:24:36 bvm5 pkg-static: libao-1.2.0_5 installed
Mar  8 19:25:09 bvm5 pkg-static: gsm-1.0.19 installed
Mar  8 19:29:37 bvm5 pkg-static: gsed-4.8 installed
Mar  8 19:30:12 bvm5 pkg-static: libid3tag-0.15.1b_2 installed
Mar  8 19:31:20 bvm5 pkg-static: libmad-0.15.1b_7 installed
Mar  8 19:37:38 bvm5 pkg-static: opus-1.3.1 installed
Mar  8 19:39:23 bvm5 pkg-static: opusfile-0.12 installed
Mar  8 19:48:44 bvm5 pkg-static: libvorbis-1.3.7_2,3 installed
Mar  8 19:54:26 bvm5 pkg-static: libsndfile-1.0.31 installed
Mar  8 20:02:34 bvm5 pkg-static: sox-14.4.2_5 installed

ok, so logitechmediaserver fails to install, and complains about some perl module. Hm, let me re-install perl and the p5-modules installed

Mar  8 23:12:23 bvm5 pkg-static: perl5-5.32.1_1 deinstalled
Mar  8 23:12:48 bvm5 pkg-static: perl5-5.32.1_1 installed
Mar  8 23:14:54 bvm5 pkg: p5-Unicode-EastAsianWidth-12.0 deinstalled
Mar  8 23:14:56 bvm5 pkg-static: p5-Unicode-EastAsianWidth-12.0 installed
Mar  8 23:15:43 bvm5 pkg: p5-Text-Unidecode-1.30 deinstalled
Mar  8 23:15:45 bvm5 pkg-static: p5-Text-Unidecode-1.30 installed
Mar  8 23:17:01 bvm5 pkg: p5-Locale-libintl-1.32 deinstalled
Mar  8 23:17:04 bvm5 pkg-static: p5-Locale-libintl-1.32 installed
Mar  8 23:17:50 bvm5 pkg: p5-Locale-gettext-1.07 deinstalled
Mar  8 23:17:52 bvm5 pkg-static: p5-Locale-gettext-1.07 installed

ok. Now - will logitechmediaserver build and install?

2021-03-08: bvm5 - vtbd0p3 - ports - install python37

Mar  8 10:26:09 bvm5 pkg-static: readline-8.1.0 installed
Mar  8 10:47:28 bvm5 pkg-static: python37-3.7.10 installed

ok, so that last 'freebsd-update install' helped.

2021-03-08: bvm5 - vtbd0p3 - freebsd-update - run install once more

root@bvm5# freebsd-update install
src component not installed, skipped
Installing updates... done.

verify

root@bvm5# freebsd-update install
src component not installed, skipped
No updates are available to install.
Run '/usr/sbin/freebsd-update fetch' first.

ok

2021-03-08: bvm5 - vtbd0p3 - ports - install portupgrade continues

Mar  8 00:37:05 bvm5 pkg-static: ruby27-gems-3.0.8 installed
Mar  8 00:37:20 bvm5 pkg-static: rubygem-rdoc-6.3.0 installed
Mar  8 01:01:55 bvm5 pkg-static: db5-5.3.28_7 installed
Mar  8 01:10:30 bvm5 pkg-static: ruby27-bdb-0.6.6_8 installed
Mar  8 10:17:48 bvm5 pkg-static: portupgrade-2.4.16,2 installed

ok

2021-03-07: bvm5 - vtbd0p3 - ports - install portupgrade

Mar  7 22:30:20 bvm5 pkg-static: autoconf-wrapper-20131203 installed
Mar  7 22:30:23 bvm5 pkg-static: autoconf-2.69_3 installed
Mar  7 22:30:58 bvm5 pkg-static: automake-1.16.3 installed
Mar  7 22:32:20 bvm5 pkg-static: libyaml-0.2.5 installed
Mar  7 22:34:02 bvm5 pkg-static: libedit-3.1.20191231,1 installed
Mar  7 22:37:30 bvm5 pkg-static: libunwind-20201110 installed
Mar  7 23:26:34 bvm5 pkg-static: ruby-2.7.2_1,1 installed

ok

2021-03-07: bvm5 - vtbd0p3 - ports - install logitechmediaserver

Mar  7 19:01:23 bvm5 pkg-static: dialog4ports-0.1.6 installed
Mar  7 19:05:10 bvm5 pkg-static: indexinfo-0.3.1 installed
Mar  7 19:05:15 bvm5 pkg-static: gettext-runtime-0.21 installed
Mar  7 19:06:37 bvm5 pkg-static: gmake-4.3_2 installed
Mar  7 19:52:16 bvm5 pkg-static: perl5-5.32.1_1 installed
Mar  7 19:55:44 bvm5 pkg-static: nasm-2.15.05,1 installed
Mar  7 20:25:09 bvm5 pkg-static: libtextstyle-0.21 installed
Mar  7 20:50:31 bvm5 pkg-static: gettext-tools-0.21 installed
Mar  7 20:50:44 bvm5 pkg-static: p5-Locale-gettext-1.07 installed
Mar  7 20:50:53 bvm5 pkg-static: help2man-1.48.1 installed
Mar  7 20:54:00 bvm5 pkg-static: libiconv-1.16 installed
Mar  7 20:54:36 bvm5 pkg-static: p5-Locale-libintl-1.32 installed
Mar  7 20:54:50 bvm5 pkg-static: p5-Text-Unidecode-1.30 installed
Mar  7 20:54:59 bvm5 pkg-static: p5-Unicode-EastAsianWidth-12.0 installed
Mar  7 20:59:48 bvm5 pkg-static: texinfo-6.7_4,1 installed
Mar  7 21:02:49 bvm5 pkg-static: m4-1.4.18_1,1 installed
Mar  7 21:08:22 bvm5 pkg-static: bison-3.7.5,1 installed
Mar  7 21:15:16 bvm5 pkg-static: bash-5.1.4_1 installed
Mar  7 21:16:07 bvm5 pkg-static: xxhash-0.8.0 installed
Mar  7 21:22:32 bvm5 pkg-static: pkgconf-1.7.3,1 installed
Mar  7 21:23:18 bvm5 pkg-static: libffi-3.3_1 installed

but python37 fails to install ('make install'), complains about not finding readline.so (and it isn't in the directory where it looks for it)

2021-03-07: bvm5 - vtbd0p3 - pkg - remove all other packages

Mar  7 18:45:10 bvm5 pkg: logitechmediaserver-7.9.1.g2017.07.11 deinstalled
Mar  7 18:46:39 bvm5 pkg: automake-1.15.1 deinstalled
Mar  7 18:46:39 bvm5 pkg: help2man-1.47.5 deinstalled
Mar  7 18:46:40 bvm5 pkg: autoconf-2.69_1 deinstalled
Mar  7 18:46:40 bvm5 pkg: p5-Locale-gettext-1.07 deinstalled
Mar  7 18:46:41 bvm5 pkg: perl5-5.24.3 deinstalled
Mar  7 18:47:15 bvm5 pkg: portupgrade-2.4.15,2 deinstalled
Mar  7 18:47:49 bvm5 pkg: libgd-2.2.4_1,1 deinstalled
Mar  7 18:47:49 bvm5 pkg: ruby23-bdb-0.6.6_5 deinstalled
Mar  7 18:47:49 bvm5 pkg: webp-0.6.0_4 deinstalled
Mar  7 18:47:49 bvm5 pkg: rsync-3.1.2_7 deinstalled
Mar  7 18:48:00 bvm5 pkg: ruby-2.3.5_1,1 deinstalled
Mar  7 18:48:01 bvm5 pkg: shorten-3.6.1 deinstalled
Mar  7 18:48:01 bvm5 pkg: sox-14.4.2_3 deinstalled
Mar  7 18:48:01 bvm5 pkg: tiff-4.0.9 deinstalled
Mar  7 18:48:01 bvm5 pkg: yasm-1.3.0 deinstalled
Mar  7 18:48:53 bvm5 pkg: fontconfig-2.12.1,1 deinstalled
Mar  7 18:48:54 bvm5 pkg: autoconf-wrapper-20131203 deinstalled
Mar  7 18:48:54 bvm5 pkg: automake-wrapper-20131203 deinstalled
Mar  7 18:48:54 bvm5 pkg: bash-4.4.12_3 deinstalled
Mar  7 18:48:54 bvm5 pkg: bison-3.0.4,1 deinstalled
Mar  7 18:48:54 bvm5 pkg: db5-5.3.28_6 deinstalled
Mar  7 18:48:54 bvm5 pkg: dialog4ports-0.1.6 deinstalled
Mar  7 18:48:54 bvm5 pkg: expat-2.2.1 deinstalled
Mar  7 18:50:51 bvm5 pkg: gettext-tools-0.19.8.1 deinstalled
Mar  7 18:50:51 bvm5 pkg: gmake-4.2.1_1 deinstalled
Mar  7 18:50:51 bvm5 pkg: libsndfile-1.0.28 deinstalled
Mar  7 18:50:51 bvm5 pkg: libtool-2.4.6 deinstalled
Mar  7 18:50:51 bvm5 pkg: flac-1.3.2 deinstalled
Mar  7 18:50:51 bvm5 pkg: gettext-runtime-0.19.8.1_1 deinstalled
Mar  7 18:50:51 bvm5 pkg: libffi-3.2.1_1 deinstalled
Mar  7 18:50:51 bvm5 pkg: libvorbis-1.3.5_1,3 deinstalled
Mar  7 18:50:51 bvm5 pkg: m4-1.4.18,1 deinstalled
Mar  7 18:50:52 bvm5 pkg: opusfile-0.10 deinstalled
Mar  7 18:50:52 bvm5 pkg: faad2-2.8.6,1 deinstalled
Mar  7 18:50:52 bvm5 pkg: freetype2-2.8_1 deinstalled
Mar  7 18:50:52 bvm5 pkg: giflib-5.1.4 deinstalled
Mar  7 18:50:52 bvm5 pkg: gsm-1.0.13_2 deinstalled
Mar  7 18:50:52 bvm5 pkg: indexinfo-0.3.1 deinstalled
Mar  7 18:50:52 bvm5 pkg: jbigkit-2.1_1 deinstalled
Mar  7 18:50:52 bvm5 pkg: jpeg-turbo-1.5.2 deinstalled
Mar  7 18:50:52 bvm5 pkg: lame-3.100 deinstalled
Mar  7 18:50:52 bvm5 pkg: libao-1.2.0_3 deinstalled
Mar  7 18:50:52 bvm5 pkg: libedit-3.1.20170329_2,1 deinstalled
Mar  7 18:50:52 bvm5 pkg: libiconv-1.14_11 deinstalled
Mar  7 18:50:52 bvm5 pkg: libid3tag-0.15.1b_1 deinstalled
Mar  7 18:50:52 bvm5 pkg: libltdl-2.4.6 deinstalled
Mar  7 18:50:52 bvm5 pkg: libmad-0.15.1b_6 deinstalled
Mar  7 18:50:53 bvm5 pkg: libogg-1.3.3,4 deinstalled
Mar  7 18:50:53 bvm5 pkg: libunwind-20170113_1 deinstalled
Mar  7 18:50:53 bvm5 pkg: libyaml-0.1.6_2 deinstalled
Mar  7 18:51:18 bvm5 pkg: mac-3.99.4.5.7 deinstalled
Mar  7 18:51:18 bvm5 pkg: nasm-2.13.01,1 deinstalled
Mar  7 18:51:18 bvm5 pkg: opus-1.2.1 deinstalled
Mar  7 18:51:18 bvm5 pkg: pkgconf-1.3.10,1 deinstalled
Mar  7 18:51:18 bvm5 pkg: png-1.6.34 deinstalled

ok

2021-03-07: bvm5 - vtbd0p3 - ports - upgrade pkg

Mar  7 18:44:09 bvm5 pkg-static: pkg-1.10.1 deinstalled
Mar  7 18:44:12 bvm5 pkg-static: pkg-1.16.3 installed

ok

2021-03-07: bvm5 - vtbd0p3 - ports - get an updated ports tree onto the machine via portsnap fetch; portsnap update. Which took a while.

2021-03-07: bvm5 - vtbd0p3 - FreeBSD 11.4-release-p8 is in

root@bvm5# freebsd-version -ku
11.4-RELEASE-p8
11.4-RELEASE-p8

kernel

root@bvm5# uname -a
FreeBSD bvm5.kg4.no 11.4-RELEASE-p8 FreeBSD 11.4-RELEASE-p8 #0: Tue Feb 23 09:04:22 UTC 2021     root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC  amd64

ok

2021-03-07: bvm5 - vtbd0p3 - freebsd-update - upgrade

root@bvm5# freebsd-update upgrade -r 11.4-RELEASE
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching metadata signature for 10.4-RELEASE from update4.freebsd.org... done.
[..]
The following components of FreeBSD seem to be installed:
kernel/generic world/base

The following components of FreeBSD do not seem to be installed:
world/doc world/games world/lib32

Does this look reasonable (y/n)? y
[..]
Attempting to automatically merge changes in files... done.

The following file could not be merged automatically: /etc/ntp.conf
Press Enter to edit this file in /usr/bin/vi and resolve the conflicts
manually...
[..]
The following files are affected by updates, but no changes have
been downloaded because the files have been modified locally:
/.profile
/root/.profile
The following files will be removed as part of updating to 11.4-RELEASE-p8:
The following files will be added as part of updating to 11.4-RELEASE-p8:
The following files will be updated as part of updating to 11.4-RELEASE-p8:
/var/db/mergemaster.mtree
/var/empty
/var/yp/Makefile.dist
To install the downloaded upgrades, run "/usr/sbin/freebsd-update install".

install

root@bvm5# freebsd-update install
src component not installed, skipped
Installing updates...
Kernel updates have been installed.  Please reboot and run
"/usr/sbin/freebsd-update install" again to finish installing updates.

reboot, then

root@bvm5# freebsd-update install
src component not installed, skipped
Installing updates...
Completing this upgrade requires removing old shared object files.
Please rebuild all installed 3rd party software (e.g., programs
installed from the ports tree) and then run "/usr/sbin/freebsd-update install"
again to finish installing updates.

ok

2020-09-13: bvm5 - memory increased from 512 MB to 768 MB (add 256).

2020-06-21: bvm5 - the virtual machine gets renamed to 'music3' as part of my move to vm-bhyve

root@kg-vm3# pwd
/zs/vms
root@kg-vm3# mv bvm5 music3

add a config file

root@kg-vm3# more music3/music3.conf
loader="bhyveload"
cpu="1"
memory="512M"
network0_type="virtio-net"
network0_switch="public"
disk0_type="virtio-blk"
disk0_name="guest-bvm5-boot.img"
disk1_type="virtio-blk"
disk0_name="guest-bvm5-data.img"

test it - ok, the config file was wrong, fixed the line for the additional disk

root@kg-vm3# more music3/music3.conf
loader="bhyveload"
cpu="1"
memory="512M"
network0_type="virtio-net"
network0_switch="public"
disk0_type="virtio-blk"
disk0_name="guest-bvm5-boot.img"
disk1_type="virtio-blk"
disk1_name="guest-bvm5-data.img"
uuid="0081e5b9-b3c2-11ea-ba3f-600292b5cd2c"
network0_mac="58:9c:fc:0a:2c:a1"

better now? yes, from the logfile music3/vm-bhyve.log

Jun 21 15:26:41: bhyveload -m 512M -e autoboot_delay=3 -d /zs/vms/music3/guest-bvm5-boot.img music3
Jun 21 15:26:44:  [bhyve options: -c 1 -m 512M -AHP -U 0081e5b9-b3c2-11ea-ba3f-600292b5cd2c -u]
Jun 21 15:26:44:  [bhyve devices: -s 0,hostbridge -s 31,lpc -s 4:0,virtio-blk,/zs/vms/music3/guest-bvm5-boot.img -s 4:1,virtio-blk,/zs/vms/music3/guest-bvm5-data.img -s 5:0,virtio-net,tap10,mac=58:9c:fc:0a:2c:a1]
Jun 21 15:26:44:  [bhyve console: -l com1,stdio]
Jun 21 15:26:44: starting bhyve (run 1)

good. Curently running vm's

root@kg-vm3# vm list
NAME    DATASTORE  LOADER     CPU  MEMORY  VNC  AUTOSTART  STATE
music3  default    bhyveload  1    512M    -    No         Running (11953)
trap2   default    bhyveload  1    256M    -    No         Running (10299)
tv      default    bhyveload  2    1536M   -    No         Running (9278)
wiki    default    bhyveload  2    1024M   -    No         Running (8672)

ok

2019-11-27: clock trouble - again. I should find a permanent solution one of these days.

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 185.41.243.30    3 u   58   64  377    3.007  3073304 128398.

check timecounter.hardware

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

change it

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET
root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: HPET

now ntpd should manage to catch up.

2019-11-25: powered on after power outage.

2019-08-23: clock trouble again:

root@bvm5# date; ntpq -p
fre 23 aug 2019 00:37:14 CEST
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 194.58.205.148   2 u    1   64  377    1.403  3260148 97404.4

check which timecounter the machine uses

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

yep, that's the wrong one. Change and verify

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET
root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: HPET

now let's hope ntpd gets back on track.

2019-03-22: the clock looks better now:

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 192.36.143.130   2 u   53   64    1    0.670  -263.97  61.853
root@bvm5# date
fre 22 mar 2019 09:30:59 CET

ok.

2019-03-21: the clock is falling out of sync again

root@bvm5# ntpq -p
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 kg-omni1.kg4.no 192.36.143.130   2 u    5   64  377    0.548  39374.4 16797.3

is it wrong timecounter again?

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

yes. Change it and verify

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET
root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: HPET

wait a bit, and see if ntpd catches on. Check that tomorrow.

2018-10-14: bvm5 - status

root@bvm5# date;swapinfo -h;echo " ";tvlm;echo " ";tvls;echo " ";df -h;echo " ";uptime;echo " ";ps ax | grep -v grep | grep ddc;ps ax | grep -v grep | grep smartd;ps ax | grep -v grep | grep natd;service logitechmediaserver status
s�n 14 okt 2018 21:41:12 CEST
Device          1K-blocks     Used    Avail Capacity
/dev/vtbd0p2      1048576     107M     917M    10%

Aug  6 11:14:15 bvm5 kernel: to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
Aug  6 11:14:15 bvm5 kernel: ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior.
Aug  6 11:14:15 bvm5 kernel: Consider tuning vm.kmem_size and vm.kmem_size_max
Aug  6 11:14:15 bvm5 kernel: in /boot/loader.conf.
Aug  6 11:14:15 bvm5 kernel: ZFS filesystem version: 5
Aug  6 11:14:15 bvm5 kernel: ZFS storage pool version: features support (5000)
Aug 18 12:35:58 bvm5 kernel: Warning: memory type solaris leaked memory on destroy (2 allocations, 256 bytes leaked).
Aug 19 21:39:46 bvm5 sshd[96976]: error: PAM: authentication error for illegal user tinfo from kg-core1.kg4.no
Aug 19 21:39:52 bvm5 last message repeated 2 times
Sep 12 23:31:23 bvm5 su: tingo to root on /dev/pts/0

Nov 27 21:51:12 bvm5 newsyslog[416]: logfile first created

Filesystem      Size    Used   Avail Capacity  Mounted on
/dev/vtbd0p3     18G    3,5G     13G    21%    /
devfs           1,0K    1,0K      0B   100%    /dev
/dev/vtbd1p1     58G     27G     26G    51%    /storage

 9:41pm  up 89 days,  1:44, 1 user, load averages: 0,30 0,33 0,26

logitechmediaserver is running as pid 621.

(ignore the zfs messages, it was just me testing something).

the server works, even if it uses a bit of swap.

2018-08-01: bvm5 - time has been getting way off for this machine since the last reboot. ntpd can't keep up. after checking another bhyve vm, I noticed that it used HPET as timesource. For some reason, this one did not:

root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: TSC

change it, and verify

root@bvm5# sysctl kern.timecounter.hardware=HPET
kern.timecounter.hardware: TSC -> HPET
root@bvm5# sysctl kern.timecounter.hardware
kern.timecounter.hardware: HPET

next, I restarted ntpd, we'll see how it goes. Many hours later:

root@bvm5# date;ntpq -p
ons  1 aug 2018 10:11:14 CEST
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
*kg-omni1.kg4.no 192.36.143.130   2 u   21   64    1    0.563  -281.95 166.046

still synced.

2017-12-10: bvm5 - LMS - SB3 - sometimes the song display is "one song behind" what is actually playing. "Fixed" by skipping to next song ("next") on the web interface.

2017-12-03: bvm5 - status

root@bvm5# date;swapinfo -h;echo " ";tvlm;echo " ";tvls;echo " ";df -h;echo " ";uptime;echo " ";ps ax | grep -v grep | grep ddc;ps ax | grep -v grep | grep smartd;ps ax | grep -v grep | grep natd;service logitechmediaserver status
søn  3 des 2017 16:09:52 CET
Device          1K-blocks     Used    Avail Capacity
/dev/vtbd0p2      1048576     103M     921M    10%

Nov 30 09:46:05 bvm5 kernel: atkbd0: [GIANT-LOCKED]
Nov 30 09:46:05 bvm5 kernel: ppc0: cannot reserve I/O port range
Nov 30 09:46:05 bvm5 kernel: Timecounters tick every 10.000 msec
Nov 30 09:46:05 bvm5 kernel: usb_needs_explore_all: no devclass
Nov 30 09:46:05 bvm5 kernel: random: unblocking device.
Nov 30 09:46:05 bvm5 kernel: Timecounter "TSC" frequency 1039826047 Hz quality 1000
Nov 30 09:46:05 bvm5 kernel: Trying to mount root from ufs:/dev/vtbd0p3 [rw]...
Nov 30 09:46:05 bvm5 kernel: vtnet0: link state changed to UP
Nov 30 09:46:06 bvm5 ntpd[588]: ntpd 4.2.8p10-a (1): Starting
Nov 30 08:46:34 bvm5 su: tingo to root on /dev/pts/0

Nov 27 21:51:12 bvm5 newsyslog[416]: logfile first created

Filesystem      Size    Used   Avail Capacity  Mounted on
/dev/vtbd0p3     18G    2,9G     14G    17%    /
devfs           1,0K    1,0K      0B   100%    /dev
/dev/vtbd1p1     58G     27G     27G    50%    /storage

 4:09pm  up 3 days,  7:24, 1 user, load averages: 0,33 0,24 0,21

logitechmediaserver is running as pid 618.

ok.

2017-12-03: bvm5 - the machine is using a bit of swap, I should increase the memory of the machine.

root@bvm5# date;swapinfo -h;echo " ";uptime
søn  3 des 2017 16:07:07 CET
Device          1K-blocks     Used    Avail Capacity
/dev/vtbd0p2      1048576     103M     921M    10%

 4:07pm  up 3 days,  7:21, 1 user, load averages: 0,27 0,23 0,21

ok.

2017-11-30: bvm5 - logitechmediaserver - volume setting - I compared volume setting with Squeezebox Server 7.5.4 (the old vbox-v5), which was higher. After changing volume setting for the two players in logitechmediaserver, it is the same as the old one. Good.

2017-11-29: bvm5 - logitechmediaserver - playback volume is lower than with Squeezebox Server 7.5.4. For now I just increase the volume. 2017-11-29: bvm5 - logitechmediaserver - scanning of the music library works.

2017-11-28: bvm5 - I fixed /etc/dhclient.conf so that this machine now takes the ip address of the old kg-v5 machine. logitechmediaserver finds the players, things appears to work.

2017-11-28: bvm5 - logitechmediaserver - I tested the web interface, moved music files into /storage/music/ - it shows up.

2017-11-28: bvm5 - ports - install logitechmediaserver

Nov 28 18:19:02 bvm5 pkg-static: nasm-2.13.01,1 installed
Nov 28 18:21:38 bvm5 pkg-static: bison-3.0.4,1 installed
Nov 28 18:24:54 bvm5 pkg-static: bash-4.4.12_3 installed
Nov 28 18:27:31 bvm5 pkg-static: libiconv-1.14_11 installed
Nov 28 18:28:55 bvm5 pkg-static: rsync-3.1.2_7 installed
Nov 28 18:32:16 bvm5 pkg-static: jbigkit-2.1_1 installed
Nov 28 18:34:27 bvm5 pkg-static: jpeg-turbo-1.5.2 installed
Nov 28 18:37:06 bvm5 pkg-static: tiff-4.0.9 installed
Nov 28 18:41:47 bvm5 pkg-static: png-1.6.34 installed
Nov 28 18:45:28 bvm5 pkg-static: freetype2-2.8_1 installed
Nov 28 18:47:05 bvm5 pkg-static: expat-2.2.1 installed
Nov 28 18:48:49 bvm5 pkg-static: fontconfig-2.12.1,1 installed
Nov 28 18:56:11 bvm5 pkg-static: giflib-5.1.4 installed
Nov 28 18:59:15 bvm5 pkg-static: webp-0.6.0_4 installed
Nov 28 19:00:39 bvm5 pkg-static: libgd-2.2.4_1,1 installed
Nov 28 19:59:40 bvm5 pkg-static: yasm-1.3.0 installed
Nov 28 20:00:26 bvm5 pkg-static: mac-3.99.4.5.7 installed
Nov 28 20:01:37 bvm5 pkg-static: libtool-2.4.6 installed
Nov 28 20:04:34 bvm5 pkg-static: faad2-2.8.6,1 installed
Nov 28 20:05:49 bvm5 pkg-static: libogg-1.3.3,4 installed
Nov 28 20:08:32 bvm5 pkg-static: flac-1.3.2 installed
Nov 28 20:10:26 bvm5 pkg-static: lame-3.100 installed
Nov 28 20:11:02 bvm5 pkg-static: shorten-3.6.1 installed
Nov 28 20:15:28 bvm5 pkg-static: libltdl-2.4.6 installed
Nov 28 20:15:43 bvm5 pkg-static: gsm-1.0.13_2 installed
Nov 28 20:16:08 bvm5 pkg-static: libid3tag-0.15.1b_1 installed
Nov 28 20:17:11 bvm5 pkg-static: libmad-0.15.1b_6 installed
Nov 28 20:20:57 bvm5 pkg-static: opus-1.2.1 installed
Nov 28 20:22:23 bvm5 pkg-static: opusfile-0.10 installed
Nov 28 20:23:57 bvm5 pkg-static: libvorbis-1.3.5_1,3 installed
Nov 28 20:26:27 bvm5 pkg-static: libsndfile-1.0.28 installed
Nov 28 20:27:07 bvm5 pkg-static: libao-1.2.0_3 installed
Nov 28 20:32:29 bvm5 pkg-static: sox-14.4.2_3 installed
Nov 28 20:32:58 bvm5 pkg-static: logitechmediaserver-7.9.1.g2017.07.11 installed

pkg-message

*************************************************************************
Note on security settings:

The slimserver service is wide open, and by default there is no password.
You can control access to your music collection by pointing your web
browser to http://localhost:9000/, and then choosing:

Server Settings -> Security
*************************************************************************

ok. 2017-11-28: bvm5 - ports - install portupgrade

Nov 28 15:42:12 bvm5 pkg-static: dialog4ports-0.1.6 installed
Nov 28 15:43:20 bvm5 pkg-static: indexinfo-0.3.1 installed
Nov 28 15:43:22 bvm5 pkg-static: libffi-3.2.1_1 installed
Nov 28 15:48:25 bvm5 pkg-static: m4-1.4.18,1 installed
Nov 28 15:51:19 bvm5 pkg-static: gettext-runtime-0.19.8.1_1 installed
Nov 28 16:06:11 bvm5 pkg-static: gettext-tools-0.19.8.1 installed
Nov 28 16:36:48 bvm5 pkg-static: perl5-5.24.3 installed
Nov 28 16:37:16 bvm5 pkg-static: p5-Locale-gettext-1.07 installed
Nov 28 16:57:06 bvm5 pkg-static: gmake-4.2.1_1 installed
Nov 28 16:57:14 bvm5 pkg-static: help2man-1.47.5 installed
Nov 28 16:57:43 bvm5 pkg-static: autoconf-wrapper-20131203 installed
Nov 28 16:57:46 bvm5 pkg-static: autoconf-2.69_1 installed
Nov 28 16:58:06 bvm5 pkg-static: automake-wrapper-20131203 installed
Nov 28 16:58:08 bvm5 pkg-static: automake-1.15.1 installed
Nov 28 16:58:52 bvm5 pkg-static: libyaml-0.1.6_2 installed
Nov 28 16:59:50 bvm5 pkg-static: libedit-3.1.20170329_2,1 installed
Nov 28 17:07:29 bvm5 pkg-static: pkgconf-1.3.10,1 installed
Nov 28 17:09:20 bvm5 pkg-static: libunwind-20170113_1 installed
Nov 28 17:41:13 bvm5 pkg-static: ruby-2.3.5_1,1 installed
Nov 28 18:03:17 bvm5 pkg-static: db5-5.3.28_6 installed
Nov 28 18:07:22 bvm5 pkg-static: ruby23-bdb-0.6.6_5 installed
Nov 28 18:07:25 bvm5 pkg-static: portupgrade-2.4.15,2 installed

ok

2017-11-28: bvm5 - ports - get a ports tree onto the machine via portsnap fetch; portsnap extract.

2017-11-28: bvm5 - pkg - install pkg

root@bvm5# pkg info
The package management tool is not yet installed on your system.
Do you want to fetch and install it now? [y/N]: y
Bootstrapping pkg from pkg+http://pkg.FreeBSD.org/FreeBSD:10:amd64/quarterly, please wait...
Verifying signature with trusted certificate pkg.freebsd.org.2013102301... done
Installing pkg-1.10.1...
Extracting pkg-1.10.1: 100%
pkg-1.10.1                     Package manager

check to see if the logitech mediaserver is in packages

root@bvm5# pkg search logitech
pkg: Repository FreeBSD missing. 'pkg update' required
pkg: Repository FreeBSD load error: access repo file(/var/db/pkg/repo-FreeBSD.sqlite) failed: No such file or directory
nuvolaplayer-logitech-media-server-2.1 Logitech Media Server integration for Nuvola Player
root@bvm5# pkg search logitech
nuvolaplayer-logitech-media-server-2.1 Logitech Media Server integration for Nuvola Player

nope.

2017-11-28: bvm5 - after a reboot, the machine now runs FreeBSD 10.4-release-p3.

root@bvm5# freebsd-version -ku
10.4-RELEASE-p3
10.4-RELEASE-p3
root@bvm5# uname -a
FreeBSD bvm5.kg4.no 10.4-RELEASE-p3 FreeBSD 10.4-RELEASE-p3 #0: Tue Nov 14 09:43:55 UTC 2017     root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC  amd64

ok.

2017-11-28: bvm5 - run freebsd-update

fetch

root@bvm5:~ # freebsd-update fetch
src component not installed, skipped
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching public key from update4.freebsd.org... done.
Fetching metadata signature for 10.4-RELEASE from update4.freebsd.org... done.
Fetching metadata index... done.
Fetching 2 metadata files... done.
Inspecting system... done.
Preparing to download files... done.
Fetching 33 patches.....10....20....30. done.
Applying patches... done.
The following files will be updated as part of updating to 10.4-RELEASE-p3:
/bin/freebsd-version
/boot/boot1.efi
/boot/boot1.efifat
/boot/kernel/kernel
/boot/kernel/kernel.symbols
/boot/kernel/mqueuefs.ko
/boot/kernel/mqueuefs.ko.symbols
/boot/kernel/sem.ko
/boot/kernel/sem.ko.symbols
/usr/sbin/hostapd
/usr/sbin/wpa_supplicant
/usr/share/zoneinfo/Africa/Juba
/usr/share/zoneinfo/Africa/Khartoum
/usr/share/zoneinfo/Africa/Windhoek
/usr/share/zoneinfo/America/Adak
/usr/share/zoneinfo/America/Anchorage
/usr/share/zoneinfo/America/Detroit
/usr/share/zoneinfo/America/Grand_Turk
/usr/share/zoneinfo/America/Juneau
/usr/share/zoneinfo/America/Metlakatla
/usr/share/zoneinfo/America/Nome
/usr/share/zoneinfo/America/Sitka
/usr/share/zoneinfo/America/Yakutat
/usr/share/zoneinfo/Asia/Famagusta
/usr/share/zoneinfo/Asia/Kolkata
/usr/share/zoneinfo/Asia/Yangon
/usr/share/zoneinfo/Asia/Yerevan
/usr/share/zoneinfo/Europe/Dublin
/usr/share/zoneinfo/Pacific/Apia
/usr/share/zoneinfo/Pacific/Fiji
/usr/share/zoneinfo/Pacific/Midway
/usr/share/zoneinfo/Pacific/Pago_Pago
/usr/share/zoneinfo/Pacific/Tongatapu
/usr/share/zoneinfo/zone.tab

install

root@bvm5:~ # freebsd-update install
src component not installed, skipped
Installing updates... done.

and do a reboot.

2017-11-28: bvm5 - add data disk

create gpt

root@bvm5:~ # gpart show -p vtbd1
gpart: No such geom: vtbd1.
root@bvm5:~ # gpart create -s GPT vtbd1
vtbd1 created
root@bvm5:~ # gpart show -p vtbd1
=>       34  125829053  vtbd1  GPT  (60G)
         34  125829053         - free -  (60G)

add a freebsd-ufs partition

root@bvm5:~ # gpart add -t freebsd-ufs vtbd1
vtbd1p1 added
root@bvm5:~ # gpart show -p vtbd1
=>       34  125829053    vtbd1  GPT  (60G)
         34         30           - free -  (15K)
         64  125828992  vtbd1p1  freebsd-ufs  (60G)
  125829056         31           - free -  (16K)

give it a filesystem

root@bvm5:~ # newfs -U /dev/vtbd1p1
/dev/vtbd1p1: 61439.9MB (125828992 sectors) block size 32768, fragment size 4096
    using 99 cylinder groups of 626.09MB, 20035 blks, 80256 inodes.
    with soft updates
super-block backups (for fsck_ffs -b #) at:
 192, 1282432, 2564672, 3846912, 5129152, 6411392, 7693632, 8975872, 10258112, 11540352, 12822592, 14104832, 15387072, 16669312, 17951552,
 19233792, 20516032, 21798272, 23080512, 24362752, 25644992, 26927232, 28209472, 29491712, 30773952, 32056192, 33338432, 34620672, 35902912,
 37185152, 38467392, 39749632, 41031872, 42314112, 43596352, 44878592, 46160832, 47443072, 48725312, 50007552, 51289792, 52572032, 53854272,
 55136512, 56418752, 57700992, 58983232, 60265472, 61547712, 62829952, 64112192, 65394432, 66676672, 67958912, 69241152, 70523392, 71805632,
 73087872, 74370112, 75652352, 76934592, 78216832, 79499072, 80781312, 82063552, 83345792, 84628032, 85910272, 87192512, 88474752, 89756992,
 91039232, 92321472, 93603712, 94885952, 96168192, 97450432, 98732672, 100014912, 101297152, 102579392, 103861632, 105143872, 106426112,
 107708352, 108990592, 110272832, 111555072, 112837312, 114119552, 115401792, 116684032, 117966272, 119248512, 120530752, 121812992, 123095232,
 124377472, 125659712

create a mountpoint

root@bvm5:~ # mkdir /storage
root@bvm5:~ # chmod g+w /storage

mount it

root@bvm5:~ # mount /dev/vtbd1p1 /storage

and add to /etc/fstab.

2017-11-28: vm3 - and now I can start bvm5 with both disks attached:

root@kg-vm3# pgrep -lf bvm5
4874 bhyve: bhyve_bvm5
4863 sh -c echo $PPID >/var/run/bhyve_bvm5.pid; while true; do /usr/sbin/bhyvectl --vm=bhyve_bvm5 --destroy; /usr/sbin/bhyveload -m 512 -d /zs/vms/bvm5/guest-bvm5-boot.img bhyve_bvm5 && /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,tap4 -s 2:0,virtio-blk,/zs/vms/bvm5/guest-bvm5-boot.img  -s 2:1,virtio-blk,/zs/vms/bvm5/guest-bvm5-data.img  -s 31,lpc -l com1,stdio bhyve_bvm5 || break; done

good. Also shows up in dev:

root@bvm5:~ # ls -l /dev/vtbd*
crw-r-----  1 root  operator  0x4c Nov 28 14:02 /dev/vtbd0
crw-r-----  1 root  operator  0x4e Nov 28 14:02 /dev/vtbd0p1
crw-r-----  1 root  operator  0x4f Nov 28 15:02 /dev/vtbd0p2
crw-r-----  1 root  operator  0x50 Nov 28 15:02 /dev/vtbd0p3
crw-r-----  1 root  operator  0x4d Nov 28 14:02 /dev/vtbd1

ok.

2017-11-28: vm3 - I added support for diskdev2 to the bhyve script. Here's the diff

root@kg-vm3# diff -u /home/tingo/work/bhyve_org /usr/local/etc/rc.d/bhyve
--- /home/tingo/work/bhyve_org    2016-02-20 17:49:48.153677000 +0100
+++ /usr/local/etc/rc.d/bhyve    2017-11-28 14:12:50.284584000 +0100
@@ -53,6 +53,10 @@
         eval bhyve_diskdev="\${${_session}_diskdev:-${bhyve_diskdev}}"
         eval bhyve_ncpu="\${${_session}_ncpu:-${bhyve_ncpu}}"
         eval bhyve_memsize="\${${_session}_memsize:-${bhyve_memsize}}"
+        eval bhyve_diskdev2="\${${_session}_diskdev2}"
+        if [ ! -z "${bhyve_diskdev2}" ]; then
+            bhyve_disk2=" -s 2:1,virtio-blk,${bhyve_diskdev2} "
+        fi
     else
         echo "$0: extra argument ignored"
     fi
@@ -141,6 +145,6 @@
     rm -f ${pidfile}
 }

-command_args="new-session -ds ${_session} \"sh -c 'echo \\\$PPID >${pidfile}; while true; do /usr/sbin/bhyvectl --vm=${_session} --destroy; /usr/sbin/bhyveload -m ${bhyve_memsize} -d ${bhyve_diskdev} ${_session} && /usr/sbin/bhyve -c ${bhyve_ncpu} -m ${bhyve_memsize} -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,${bhyve_tapdev} -s 2:0,virtio-blk,${bhyve_diskdev} -s 31,lpc -l com1,stdio ${_session} || break; done'\""
+command_args="new-session -ds ${_session} \"sh -c 'echo \\\$PPID >${pidfile}; while true; do /usr/sbin/bhyvectl --vm=${_session} --destroy; /usr/sbin/bhyveload -m ${bhyve_memsize} -d ${bhyve_diskdev} ${_session} && /usr/sbin/bhyve -c ${bhyve_ncpu} -m ${bhyve_memsize} -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,${bhyve_tapdev} -s 2:0,virtio-blk,${bhyve_diskdev} ${bhyve_disk2} -s 31,lpc -l com1,stdio ${_session} || break; done'\""

 run_rc_command "$1"

ok.

2017-11-27: vm3 - start bvm5

root@kg-vm3# service bhyve start bvm5
Starting bhyve.

verify

root@kg-vm3# service bhyve status
===> bhyve profile: bvm1
bhyve_bvm1 is running.
===> bhyve profile: bvm2
bhyve_bvm2 is running.
===> bhyve profile: bvm3
bhyve_bvm3 is running.
===> bhyve profile: bvm4
bhyve_bvm4 is running.
===> bhyve profile: bvm5
bhyve_bvm5 is running.

how does it look?

root@kg-vm3# pgrep -lf bvm5
2054 bhyve: bhyve_bvm5
2050 sh -c echo $PPID >/var/run/bhyve_bvm5.pid; while true; do /usr/sbin/bhyvectl --vm=bhyve_bvm5 --destroy; /usr/sbin/bhyveload -m 512 -d /zs/vms/bvm5/guest-bvm5-boot.img bhyve_bvm5 && /usr/sbin/bhyve -c 1 -m 512 -AI -H -P -g 0 -s 0:0,hostbridge -s 1:0,virtio-net,tap4 -s 2:0,virtio-blk,/zs/vms/bvm5/guest-bvm5-boot.img -s 31,lpc -l com1,stdio bhyve_bvm5 || break; done

as suspected, no data disk there.

2017-11-27: vm3 - test

root@kg-vm3# service bhyve status
===> bhyve profile: bvm1
bhyve_bvm1 is running.
===> bhyve profile: bvm2
bhyve_bvm2 is running.
===> bhyve profile: bvm3
bhyve_bvm3 is running.
===> bhyve profile: bvm4
bhyve_bvm4 is running.
===> bhyve profile: bvm5
bhyve_bvm5 is not running.

ok.

2017-11-27: vm3 - add bvm5 to /etc/rc.conf.local

root@kg-vm3# grep bvm5 /etc/rc.conf.local
bhyve_profiles="bvm1 bvm2 bvm3 bvm4 bvm5"
bhyve_bvm5_tapdev="tap4"
bhyve_bvm5_diskdev="/zs/vms/bvm5/guest-bvm5-boot.img"
bhyve_bvm5_diskdev2="/zs/vms/bvm5/guest-bvm5-data.img"
bhyve_bvm5_ncpu="1"
bhyve_bvm5_memsize="512"

512M is default memory size. diskdev2 is currently not supported.

2017-11-27: vm3 - install bvm5 machine

root@kg-vm3# sh /usr/share/examples/bhyve/vmrun.sh -c 1 -t tap4 -d /zs/vms/bvm5/guest-bvm5-boot.img -d /zs/vms/bvm5/guest-bvm5-data.img -i -I /zs/tingo/dl/bsd/FreeBSD-10.4-RELEASE-amd64-disc1.iso bhyve_bvm5

the guest boots and install starts. Selection and changes: xterm, Install, Norwegian ISO-8859-1 keymap, bvm5.kg4.no, unselect games, lib32, ports, disk guided, vtbd0 (20G), entire disk, gpt, I change the setup so I have 1G swap first, and 19G root after, net dhcp, services sshd, ntpd, dumpdev, set timezone. On exit, it reboots, just select "reboot" from the boot menu.

2017-11-27: vm3 - set up bvm5 machine (1 cpu, 512 M, 20 G + 60 G data, tap4)

create a directory for the guest

root@kg-vm3# cd /zs/vms
root@kg-vm3# mkdir bvm5

create files for virtual disks

boot

root@kg-vm3# truncate -s 20G bvm5/guest-bvm5-boot.img

data

root@kg-vm3# truncate -s 60G bvm5/guest-bvm5-data.img

verify

root@kg-vm3# ls -lh bvm5
total 192
-rw-r--r--  1 root  wheel    20G Nov 27 20:07 guest-bvm5-boot.img
-rw-r--r--  1 root  wheel    60G Nov 27 20:07 guest-bvm5-data.img

ok

2017-11-27: setting up a new Squeezebox server, so I can take vbox-v5 offline. Trying to move everything off the VirtualBox host.