ASRock B450M Pro4 R2.0 - FreeBSD

Hardware info on main page.

locaal - running FreeBSD amd64

Links

github skeeto/illume - scriptable command line program for LLM interfacing, null program - Everything I've learned so far about running local LLMs,

local links

Work log

2024-11-16: ada0p2 - rust - another hidapi example

tingo@locaal:~/work/rm750/hidapitest $ sudo target/debug/examples/dump_descriptors
Printing all available hid devices:
  HP USB Optical Mouse (Interface 0):
    [5, 1, 9, 2, 161, 1, 9, 1, 161, 0, 5, 9, 25, 1, 41, 3, 21, 0, 37, 1, 149, 8, 117, 1, 129, 2, 5, 1, 9, 48, 9, 49, 9, 56, 21, 129, 37, 127, 117, 8, 149, 3, 129, 6, 192, 192]
  HP Elite USB Keyboard (Interface 0):
    [5, 1, 9, 6, 161, 1, 5, 7, 25, 224, 41, 231, 21, 0, 37, 1, 149, 8, 117, 1, 129, 2, 149, 1, 117, 8, 129, 1, 5, 8, 25, 1, 41, 3, 149, 3, 117, 1, 145, 2, 149, 5, 117, 1, 145, 1, 5, 7, 25, 0, 42, 255, 0, 21, 0, 38, 255, 0, 149, 6, 117, 8, 129, 0, 192]
  HP Elite USB Keyboard (Interface 1):
    [5, 1, 9, 128, 161, 1, 133, 1, 25, 129, 41, 131, 21, 0, 37, 1, 117, 1, 149, 3, 129, 2, 149, 5, 129, 1, 192, 5, 12, 9, 1, 161, 1, 133, 2, 21, 0, 38, 255, 2, 25, 0, 42, 255, 2, 117, 16, 149, 1, 129, 0, 192]
  RM-Series C-Link Adapter (Interface 0):
    [6, 0, 255, 9, 1, 161, 1, 117, 8, 21, 0, 38, 255, 0, 149, 8, 9, 1, 129, 2, 149, 8, 9, 2, 145, 2, 192]

2024-11-14: ada0p2 - rust - hidapi example

tingo@locaal:~/work/rm750/hidapitest $ sudo cargo run --example lshid
   Compiling hidapitest v0.1.0 (/usr/home/tingo/work/rm750/hidapitest)
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.13s
     Running `target/debug/examples/lshid`
Printing all available hid devices:
VID: 0461, PID: 4e8d, Serial: <COULD NOT FETCH>, Product name: HP USB Optical Mouse, Interface: 0
VID: 03f0, PID: 034a, Serial: <COULD NOT FETCH>, Product name: HP Elite USB Keyboard, Interface: 0
VID: 03f0, PID: 034a, Serial: <COULD NOT FETCH>, Product name: HP Elite USB Keyboard, Interface: 1
VID: 1b1c, PID: 0c06, Serial: <COULD NOT FETCH>, Product name: RM-Series C-Link Adapter, Interface: 0

so that part works.

2024-11-14: ada0p2 - devd - set up a config file for the Corsair C-Link interface

root@locaal:~ # cat /usr/local/etc/devd/corsairlink.conf
# allow non-root users to have access to the Corsair C-Link interface
#
#
notify 100 {
        match "system" "USB";
        match "subsystem" "DEVICE";
        match "type" "ATTACH";
        match "vendor" "0x1b1c";
        match "product" "0x0c06";
# Please uncomment the line below and change the group name to suit
# your own needs.
        action "chgrp operator /dev/$cdev && chmod 660 /dev/$cdev";
};

and restart the devd service

root@locaal:~ # service devd restart
Stopping devd.
Waiting for PIDS: 664.
Starting devd.

2024-11-14: ada0p2 - rust - create the new rmc package

tingo@locaal:~/work/rm750 $ cargo new rmc --bin
    Creating binary (application) `rmc` package
note: see more `Cargo.toml` keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html

2024-11-14: ada0p2 - rust - install rust via rustup

tingo@locaal:~ $ curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
[..]
Welcome to Rust!

This will download and install the official compiler for the Rust
programming language, and its package manager, Cargo.

Rustup metadata and toolchains will be installed into the Rustup
home directory, located at:

  /home/tingo/.rustup

This can be modified with the RUSTUP_HOME environment variable.

The Cargo home directory is located at:

  /home/tingo/.cargo

This can be modified with the CARGO_HOME environment variable.

The cargo, rustc, rustup and other commands will be added to
Cargo's bin directory, located at:

  /home/tingo/.cargo/bin

This path will then be added to your PATH environment variable by
modifying the profile file located at:

  /home/tingo/.profile

You can uninstall at any time with rustup self uninstall and
these changes will be reverted.

Current installation options:


   default host triple: x86_64-unknown-freebsd
     default toolchain: stable (default)
               profile: default
  modify PATH variable: yes

1) Proceed with standard installation (default - just press enter)
2) Customize installation
3) Cancel installation
>1
[..]
info: default toolchain set to 'stable-x86_64-unknown-freebsd'

  stable-x86_64-unknown-freebsd installed - rustc 1.82.0 (f6e511eec 2024-10-15)


Rust is installed now. Great!

To get started you may need to restart your current shell.
This would reload your PATH environment variable to include
Cargo's bin directory ($HOME/.cargo/bin).

To configure your current shell, you need to source
the corresponding env file under $HOME/.cargo.

This is usually done by running one of the following (note the leading DOT):
. "$HOME/.cargo/env"            # For sh/bash/zsh/ash/dash/pdksh
source "$HOME/.cargo/env.fish"  # For fish

do that.

tingo@locaal:~ $ . ~/.cargo/env
tingo@locaal:~ $ which cargo
/home/tingo/.cargo/bin/cargo

good.

2024-11-14: ada0p2 - Corsair RM-750 and usbhidctl output

root@locaal:~ # dmesg | grep uhid
uhid0 on uhub1
uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0
uhid1 on uhub0
uhid1: <Chicony HP Elite USB Keyboard, class 0/0, rev 1.10/1.21, addr 2> on usbus1
uhid1: detached
uhid0: detached
uhid0 on uhub1
uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0
uhid1 on uhub0
uhid1: <Chicony HP Elite USB Keyboard, class 0/0, rev 1.10/1.21, addr 2> on usbus1

usbconfig

root@locaal:~ # usbconfig
ugen1.1: <AMD XHCI root HUB> at usbus1, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen0.1: <AMD XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen1.2: <PixArt HP USB Optical Mouse> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen1.3: <Chicony HP Elite USB Keyboard> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA)

usbhidctl output

root@locaal:~ # usbhidctl -f uhid0 -a
Microsoft:0x0001.Microsoft:0x0001=6
Microsoft:0x0001.Microsoft:0x0001=173
Microsoft:0x0001.Microsoft:0x0001=0
Microsoft:0x0001.Microsoft:0x0001=0
Microsoft:0x0001.Microsoft:0x0001=166
Microsoft:0x0001.Microsoft:0x0001=132
Microsoft:0x0001.Microsoft:0x0001=0
Microsoft:0x0001.Microsoft:0x0001=0

Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0
Microsoft:0x0001.Microsoft:0x0002=0

2024-11-09: ada0p2 - pkg - install py311-pytorch py311-pytorch-lightning py311-torchvision py311-torchaudio

Nov  9 02:11:20 locaal pkg[38579]: libgpg-error-1.50 installed
Nov  9 02:11:20 locaal pkg[38579]: libtasn1-4.19.0_1 installed
Nov  9 02:11:20 locaal pkg[38579]: libassuan-3.0.1 installed
Nov  9 02:11:20 locaal pkg[38579]: nettle-3.10_1 installed
Nov  9 02:11:20 locaal pkg[38579]: pinentry-curses-1.3.1 installed
Nov  9 02:11:20 locaal pkg[38579]: p11-kit-0.25.5 installed
Nov  9 02:11:20 locaal pkg[38579]: libksba-1.6.7 installed
Nov  9 02:11:21 locaal pkg[38579]: gnutls-3.8.7.1 installed
Nov  9 02:11:21 locaal pkg[38579]: pinentry-1.3.1 installed
Nov  9 02:11:21 locaal pkg[38579]: npth-1.7 installed
Nov  9 02:11:21 locaal pkg[38579]: libgcrypt-1.11.0 installed
Nov  9 02:11:21 locaal pkg[38579]: sqlite3-3.46.1,1 installed
Nov  9 02:11:21 locaal pkg[38579]: libfmt-10.2.1 installed
Nov  9 02:11:21 locaal pkg[38579]: gnupg-2.4.5_1 installed
Nov  9 02:11:22 locaal pkg[38579]: icu-74.2_1,1 installed
Nov  9 02:11:22 locaal pkg[38579]: libcjson-1.7.18_2 installed
Nov  9 02:11:22 locaal pkg[38579]: gpgme-1.23.2_1 installed
Nov  9 02:11:22 locaal pkg[38579]: libdatrie-0.2.13_2 installed
Nov  9 02:11:22 locaal pkg[38579]: minizip-1.3.1 installed
Nov  9 02:11:22 locaal pkg[38579]: libpaper-1.1.28_1 installed
Nov  9 02:11:22 locaal pkg[38579]: libaec-1.1.3 installed
Nov  9 02:11:22 locaal pkg[38579]: nspr-4.36 installed
Nov  9 02:11:23 locaal pkg[38579]: geos-3.13.0 installed
Nov  9 02:11:23 locaal pkg[38579]: spdlog-1.14.1 installed
Nov  9 02:11:23 locaal pkg[38579]: nss-3.106 installed
Nov  9 02:11:23 locaal pkg[38579]: libthai-0.1.29_1 installed
Nov  9 02:11:23 locaal pkg[38579]: psutils-1.17_6 installed
Nov  9 02:11:24 locaal pkg[38579]: py311-pytz-2024.2,1 installed
Nov  9 02:11:24 locaal pkg[38579]: cairo-1.17.4_2,3 installed
Nov  9 02:11:24 locaal pkg[38579]: poppler-data-0.4.12 installed
Nov  9 02:11:24 locaal pkg[38579]: gpgme-cpp-1.23.2_1 installed
Nov  9 02:11:24 locaal pkg[38579]: librttopo-1.1.0 installed
Nov  9 02:11:24 locaal pkg[38579]: libxslt-1.1.37_1 installed
Nov  9 02:11:25 locaal pkg[38579]: hdf5-1.12.2_2,1 installed
Nov  9 02:11:35 locaal pkg[38579]: boost-libs-1.85.0 installed
Nov  9 02:11:35 locaal pkg[38579]: py311-appdirs-1.4.4_1 installed
Nov  9 02:11:35 locaal pkg[38579]: libcbor-0.11.0 installed
Nov  9 02:11:35 locaal pkg[38579]: freexl-2.0.0 installed
Nov  9 02:11:35 locaal pkg[38579]: proj-9.4.1,1 installed
Nov  9 02:11:35 locaal pkg[38579]: pkgconf-2.3.0,1 installed
Nov  9 02:11:35 locaal pkg[38579]: uriparser-0.9.6 installed
Nov  9 02:11:35 locaal pkg[38579]: uchardet-0.0.8_1 installed
Nov  9 02:11:35 locaal pkg[38579]: level-zero-1.17.45 installed
Nov  9 02:11:35 locaal pkg[38579]: cyrus-sasl-2.1.28_5 installed
Nov  9 02:11:36 locaal pkg[38579]: qhull-8.0.2_3,1 installed
Nov  9 02:11:36 locaal pkg[38579]: groff-1.23.0_3 installed
Nov  9 02:11:36 locaal pkg[38579]: libgd-2.3.3_13,1 installed
Nov  9 02:11:36 locaal pkg[38579]: libgeotiff-1.7.3_1 installed
Nov  9 02:11:36 locaal pkg[38579]: py311-fs2-2.4.16 installed
Nov  9 02:11:36 locaal pkg[38579]: py311-brotli-1.1.0 installed
Nov  9 02:11:37 locaal pkg[38579]: hwloc2-2.11.2 installed
Nov  9 02:11:37 locaal pkg[38579]: py311-lxml-4.9.3 installed
Nov  9 02:11:37 locaal pkg[38579]: poppler-24.02.0_1 installed
Nov  9 02:11:37 locaal pkg[38579]: py311-zopfli-0.2.3 installed
Nov  9 02:11:37 locaal pkg[38579]: libltdl-2.4.7 installed
Nov  9 02:11:38 locaal pkg[38579]: spatialite-5.1.0_2 installed
Nov  9 02:11:38 locaal pkg[38579]: json-c-0.18 installed
Nov  9 02:11:38 locaal pkg[38579]: netcdf-4.9.2_1 installed
Nov  9 02:11:38 locaal pkg[38579]: py311-unicodedata2-15.1.0_1 installed
Nov  9 02:11:38 locaal pkg[38579]: libfido2-1.15.0 installed
Nov  9 02:11:39 locaal pkg[38579]: pango-1.52.2_1 installed
Nov  9 02:11:39 locaal pkg[38579]: jansson-2.14 installed
Nov  9 02:11:39 locaal pkg[38579]: xerces-c3-3.2.5 installed
Nov  9 02:11:39 locaal pkg[38579]: libkml-1.3.0_27 installed
Nov  9 02:11:40 locaal pkg[38579]: postgresql16-client-16.4 installed
Nov  9 02:11:41 locaal pkg[38579]: openldap26-client-2.6.8 installed
Nov  9 02:11:41 locaal pkg[38579]: sfcgal-1.5.2_1 installed
Nov  9 02:11:41 locaal pkg[38579]: py311-python-dateutil-2.9.0 installed
Nov  9 02:11:41 locaal pkg[38579]: lua54-5.4.7 installed
Nov  9 02:11:41 locaal pkg[38579]: onetbb-2021.13.0 installed
Nov  9 02:11:41 locaal pkg[38579]: librdkafka-2.3.0 installed
Nov  9 02:11:41 locaal pkg[38579]: py311-tornado-6.4 installed
Nov  9 02:11:42 locaal pkg[38579]: graphviz-12.0.0 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-kiwisolver-1.4.5,1 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-contourpy-1.3.0 installed
Nov  9 02:11:42 locaal pkg[38579]: libsysinfo-0.0.3_3 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-pyparsing-3.1.4 installed
Nov  9 02:11:42 locaal pkg[38579]: libjwt-1.17.2 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-sqlite3-3.11.10_7 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-bottleneck-1.3.8_1 installed
Nov  9 02:11:42 locaal pkg[38579]: py311-pluggy-1.5.0 installed
Nov  9 02:11:42 locaal pkg[38579]: libyaml-0.2.5 installed
Nov  9 02:11:42 locaal pkg[38579]: munge-0.5.16 installed
Nov  9 02:11:43 locaal pkg[38579]: py311-fonttools-4.51.0 installed
Nov  9 02:11:43 locaal pkg[38579]: py311-cycler-0.12.1 installed
Nov  9 02:11:43 locaal pkg[38579]: gdal-3.9.2_1 installed
Nov  9 02:11:43 locaal pkg[38579]: check-0.15.2_1 installed
Nov  9 02:11:44 locaal pkg[38579]: py311-tzdata-2024.2 installed
Nov  9 02:11:44 locaal pkg[38579]: mysql80-client-8.0.39 installed
Nov  9 02:11:44 locaal pkg[38579]: py311-numexpr-2.10.1 installed
Nov  9 02:11:44 locaal pkg[38579]: py311-importlib-resources-6.4.5 installed
Nov  9 02:11:44 locaal pkg[38579]: py311-gmpy2-2.2.1 installed
Nov  9 02:11:45 locaal pkg[38579]: slurm-wlm-23.11.7_3 installed
Nov  9 02:11:45 locaal pkg[38579]: py311-markupsafe-2.1.5_1 installed
Nov  9 02:11:46 locaal pkg[38579]: py311-matplotlib-3.8.0_1 installed
Nov  9 02:11:46 locaal pkg[38579]: py311-pydot-3.0.2 installed
Nov  9 02:11:47 locaal pkg[38579]: py311-Babel-2.16.0 installed
Nov  9 02:11:47 locaal pkg[38579]: py311-gdal-3.9.2 installed
Nov  9 02:11:48 locaal pkg[38579]: protobuf-28.2,1 installed
Nov  9 02:11:48 locaal pkg[38579]: py311-mpmath-1.3.0_1 installed
Nov  9 02:11:51 locaal pkg[38579]: py311-pandas-2.0.3_2,1 installed
Nov  9 02:11:51 locaal pkg[38579]: py311-scikit-sparse-0.4.8_9 installed
Nov  9 02:11:51 locaal pkg[38579]: py311-pyyaml-6.0.1 installed
Nov  9 02:11:51 locaal pkg[38579]: py311-pysocks-1.7.1_1 installed
Nov  9 02:11:51 locaal pkg[38579]: py311-pygraphviz-1.6 installed
Nov  9 02:11:52 locaal pkg[38579]: py311-dill-0.3.9 installed
Nov  9 02:11:55 locaal pkg[38579]: py311-sympy-1.11.1_2 installed
Nov  9 02:11:55 locaal pkg[38579]: pthreadpool-0.1.126 installed
Nov  9 02:11:55 locaal pkg[38579]: blis-0.9.0_2 installed
Nov  9 02:11:55 locaal pkg[38579]: py311-typing-extensions-4.12.2 installed
Nov  9 02:11:55 locaal pkg[38579]: py311-Jinja2-3.1.4 installed
Nov  9 02:11:56 locaal pkg[38579]: py311-networkx-3.3_1,2 installed
Nov  9 02:11:57 locaal pkg[38579]: py311-filelock-3.16.1 installed
Nov  9 02:11:57 locaal pkg[38579]: py311-charset-normalizer-3.3.2_1 installed
Nov  9 02:11:57 locaal pkg[38579]: sleef-3.5.1.62 installed
Nov  9 02:11:57 locaal pkg[38579]: openmpi4-4.1.6_1 installed
Nov  9 02:11:57 locaal pkg[38579]: py311-urllib3-1.26.20,1 installed
Nov  9 02:11:57 locaal pkg[38579]: onnx-1.16.2_5 installed
Nov  9 02:11:58 locaal pkg[38579]: py311-joblib-1.3.2_1 installed
Nov  9 02:12:18 locaal pkg[38579]: py311-pytorch-2.4.1_1 installed
Nov  9 02:12:18 locaal pkg[38579]: py311-mypy_extensions-1.0.0 installed
Nov  9 02:12:18 locaal pkg[38579]: py311-psutil-6.0.0 installed
Nov  9 02:12:18 locaal pkg[38579]: py311-click-8.1.7 installed
Nov  9 02:12:18 locaal pkg[38579]: py311-requests-2.32.3 installed
Nov  9 02:12:19 locaal pkg[38579]: py311-regex-2024.7.24 installed
Nov  9 02:12:19 locaal pkg[38579]: py311-tqdm-4.66.5 installed
Nov  9 02:12:19 locaal pkg[38579]: py311-types-setuptools-75.1.0.20240917 installed
Nov  9 02:12:21 locaal pkg[38579]: py311-nltk-3.8.1,2 installed
Nov  9 02:12:24 locaal pkg[38579]: py311-mypy-1.11.2 installed
Nov  9 02:12:25 locaal pkg[38579]: py311-torchvision-0.19.1 installed
Nov  9 02:12:25 locaal pkg[38579]: py311-lightning-utilities-0.11.2 installed
Nov  9 02:12:25 locaal pkg[38579]: py311-fsspec-2024.9.0 installed
Nov  9 02:12:26 locaal pkg[38579]: py311-torchmetrics-0.11.4 installed
Nov  9 02:12:27 locaal pkg[38579]: py311-torchaudio-2.2.1_5 installed
Nov  9 02:12:28 locaal pkg[38579]: py311-pytorch-lightning-2.3.3 installed

2024-11-09: ada0p2 - setting up Fooocus

tingo@locaal:~/work/ai/Fooocus $ . fooocus_env/bin/activate
(fooocus_env) tingo@locaal:~/work/ai/Fooocus $ which python
/usr/home/tingo/work/ai/Fooocus/fooocus_env/bin/python

then

(fooocus_env) tingo@locaal:~/work/ai/Fooocus $ pip install -r requirements_versions.txt
Collecting torchsde==0.2.6 (from -r requirements_versions.txt (line 1))
  Using cached torchsde-0.2.6-py3-none-any.whl.metadata (5.3 kB)
Collecting einops==0.8.0 (from -r requirements_versions.txt (line 2))
  Using cached einops-0.8.0-py3-none-any.whl.metadata (12 kB)
Collecting transformers==4.42.4 (from -r requirements_versions.txt (line 3))
  Using cached transformers-4.42.4-py3-none-any.whl.metadata (43 kB)
Collecting safetensors==0.4.3 (from -r requirements_versions.txt (line 4))
  Using cached safetensors-0.4.3.tar.gz (69 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting accelerate==0.32.1 (from -r requirements_versions.txt (line 5))
  Using cached accelerate-0.32.1-py3-none-any.whl.metadata (18 kB)
Collecting pyyaml==6.0.1 (from -r requirements_versions.txt (line 6))
  Using cached PyYAML-6.0.1.tar.gz (125 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pillow==10.4.0 (from -r requirements_versions.txt (line 7))
  Using cached pillow-10.4.0.tar.gz (46.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting scipy==1.14.0 (from -r requirements_versions.txt (line 8))
  Using cached scipy-1.14.0.tar.gz (58.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
   exit code: 1
  ╰─> [54 lines of output]
      + meson setup /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy/meson-python-native-file.ini
      The Meson build system
      Version: 1.6.0
      Source dir: /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d
      Build dir: /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy
      Build type: native build
      Project name: scipy
      Project version: 1.14.0
      C compiler for the host machine: cc (clang 18.1.6 "FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)")
      C linker for the host machine: cc ld.lld 18.1.6
      C++ compiler for the host machine: c++ (clang 18.1.6 "FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)")
      C++ linker for the host machine: c++ ld.lld 18.1.6
      Cython compiler for the host machine: cython (cython 3.0.11)
      Host machine cpu family: x86_64
      Host machine cpu: x86_64
      Program python found: YES (/usr/home/tingo/work/ai/Fooocus/fooocus_env/bin/python3.11)
      Did not find pkg-config by name 'pkg-config'
      Found pkg-config: NO
      Run-time dependency python found: YES 3.11
      Program cython found: YES (/tmp/pip-build-env-naiwqvsl/overlay/bin/cython)
      Compiler for C supports arguments -Wno-unused-but-set-variable: YES
      Compiler for C supports arguments -Wno-unused-function: YES
      Compiler for C supports arguments -Wno-conversion: YES
      Compiler for C supports arguments -Wno-misleading-indentation: YES
      Library m found: YES

      ../meson.build:84:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']]
      The following exception(s) were encountered:
      Running `gfortran --help` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'"
      Running `flang-new --help` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang-new --version` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang-new -V` gave "[Errno 2] No such file or directory: 'flang-new'"
      Running `flang --help` gave "[Errno 2] No such file or directory: 'flang'"
      Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'"
      Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'"
      Running `nvfortran --help` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'"
      Running `pgfortran --help` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'"
      Running `ifort --help` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'"
      Running `ifx --help` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'"
      Running `g95 --help` gave "[Errno 2] No such file or directory: 'g95'"
      Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'"
      Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'"

      A full log can be found at /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy/meson-logs/meson-log.txt
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[notice] A new release of pip is available: 24.0 -> 24.3.1
[notice] To update, run: pip install --upgrade pip

fix up gfortran

root@locaal:~ # ln -s /usr/local/bin/gfortran13 /usr/local/bin/gfortran

retry

(fooocus_env) tingo@locaal:~/work/ai/Fooocus $ pip install -r requirements_versions.txt
Collecting torchsde==0.2.6 (from -r requirements_versions.txt (line 1))
  Using cached torchsde-0.2.6-py3-none-any.whl.metadata (5.3 kB)
Collecting einops==0.8.0 (from -r requirements_versions.txt (line 2))
  Using cached einops-0.8.0-py3-none-any.whl.metadata (12 kB)
Collecting transformers==4.42.4 (from -r requirements_versions.txt (line 3))
  Using cached transformers-4.42.4-py3-none-any.whl.metadata (43 kB)
Collecting safetensors==0.4.3 (from -r requirements_versions.txt (line 4))
  Using cached safetensors-0.4.3.tar.gz (69 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting accelerate==0.32.1 (from -r requirements_versions.txt (line 5))
  Using cached accelerate-0.32.1-py3-none-any.whl.metadata (18 kB)
Collecting pyyaml==6.0.1 (from -r requirements_versions.txt (line 6))
  Using cached PyYAML-6.0.1.tar.gz (125 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pillow==10.4.0 (from -r requirements_versions.txt (line 7))
  Using cached pillow-10.4.0.tar.gz (46.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting scipy==1.14.0 (from -r requirements_versions.txt (line 8))
  Using cached scipy-1.14.0.tar.gz (58.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting tqdm==4.66.4 (from -r requirements_versions.txt (line 9))
  Downloading tqdm-4.66.4-py3-none-any.whl.metadata (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 5.6 MB/s eta 0:00:00
Collecting psutil==6.0.0 (from -r requirements_versions.txt (line 10))
  Downloading psutil-6.0.0.tar.gz (508 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 508.1/508.1 kB 14.3 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pytorch_lightning==2.3.3 (from -r requirements_versions.txt (line 11))
  Downloading pytorch_lightning-2.3.3-py3-none-any.whl.metadata (21 kB)
Collecting omegaconf==2.3.0 (from -r requirements_versions.txt (line 12))
  Downloading omegaconf-2.3.0-py3-none-any.whl.metadata (3.9 kB)
Collecting gradio==3.41.2 (from -r requirements_versions.txt (line 13))
  Downloading gradio-3.41.2-py3-none-any.whl.metadata (17 kB)
Collecting pygit2==1.15.1 (from -r requirements_versions.txt (line 14))
  Downloading pygit2-1.15.1.tar.gz (768 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 768.8/768.8 kB 41.8 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting opencv-contrib-python-headless==4.10.0.84 (from -r requirements_versions.txt (line 15))
  Downloading opencv-contrib-python-headless-4.10.0.84.tar.gz (150.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.5/150.5 MB 5.1 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting httpx==0.27.0 (from -r requirements_versions.txt (line 16))
  Downloading httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB)
ERROR: Ignored the following versions that require a different python version: 1.6.2 Requires-Python >=3.7,<3.10; 1.6.3 Requires-Python >=3.7,<3.10; 1.7.0 Requires-Python >=3.7,<3.10; 1.7.1 Requires-Python >=3.7,<3.10; 1.7.2 Requires-Python >=3.7,<3.11; 1.7.3 Requires-Python >=3.7,<3.11; 1.8.0 Requires-Python >=3.8,<3.11; 1.8.0rc1 Requires-Python >=3.8,<3.11; 1.8.0rc2 Requires-Python >=3.8,<3.11; 1.8.0rc3 Requires-Python >=3.8,<3.11; 1.8.0rc4 Requires-Python >=3.8,<3.11; 1.8.1 Requires-Python >=3.8,<3.11
ERROR: Could not find a version that satisfies the requirement onnxruntime==1.18.1 (from versions: none)
ERROR: No matching distribution found for onnxruntime==1.18.1

[notice] A new release of pip is available: 24.0 -> 24.3.1
[notice] To update, run: pip install --upgrade pip

2024-11-09: ada0p2 - pkg - install some things

Nov  9 00:09:10 locaal pkg[1323]: py311-maturin-1.7.4 installed
Nov  9 00:15:08 locaal pkg[1357]: rust-1.81.0 installed
Nov  9 00:21:18 locaal pkg[1763]: libuv-1.49.0 installed
Nov  9 00:21:18 locaal pkg[1763]: jsoncpp-1.9.6_1 installed
Nov  9 00:21:18 locaal pkg[1763]: rhash-1.4.4_1 installed
Nov  9 00:21:23 locaal pkg[1763]: cmake-core-3.30.5 installed
Nov  9 00:28:34 locaal pkg[3922]: gmp-6.3.0 installed
Nov  9 00:28:34 locaal pkg[3922]: mpfr-4.2.1,1 installed
Nov  9 00:28:34 locaal pkg[3922]: mpc-1.3.1_1 installed
Nov  9 00:28:38 locaal pkg[3922]: binutils-2.43.1,1 installed
Nov  9 00:28:44 locaal pkg[3922]: gcc13-13.3.0 installed
Nov  9 00:28:44 locaal pkg[3922]: openblas-0.3.27,2 installed
Nov  9 00:28:44 locaal pkg[3922]: suitesparse-config-7.7.0_1 installed
Nov  9 00:28:44 locaal pkg[3922]: suitesparse-ccolamd-3.3.3 installed
Nov  9 00:28:44 locaal pkg[3922]: suitesparse-amd-3.3.2 installed
Nov  9 00:28:45 locaal pkg[3922]: suitesparse-camd-3.3.2 installed
Nov  9 00:28:45 locaal pkg[3922]: suitesparse-colamd-3.3.3 installed
Nov  9 00:28:45 locaal pkg[3922]: suitesparse-cholmod-5.2.1_1 installed
Nov  9 00:28:45 locaal pkg[3922]: suitesparse-umfpack-6.3.3_1 installed
Nov  9 00:28:48 locaal pkg[3922]: py311-numpy-1.26.4_2,1 installed
Nov  9 00:28:48 locaal pkg[3922]: blas-3.12.0_1 installed
Nov  9 00:28:55 locaal pkg[3922]: py311-scipy-1.11.1_1,1 installed
Nov  9 00:47:56 locaal pkg[13687]: py311-idna-3.10 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-hpack-4.0.0 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-sniffio-1.3.1 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-hyperframe-6.0.0 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-anyio-4.6.0 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-certifi-2024.8.30 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-h2-4.1.0 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-h11-0.14.0 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-httpcore-1.0.5 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-socksio-1.0.0_1 installed
Nov  9 00:47:57 locaal pkg[13687]: py311-httpx-0.27.2 installed
Nov  9 00:54:57 locaal pkg[16615]: abseil-20240722.0 installed
Nov  9 00:54:58 locaal pkg[16615]: onnxruntime-1.18.2_1 installed
Nov  9 01:20:04 locaal pkg[26201]: ninja-1.11.1,4 installed

2024-11-08: ada0p2 - reboot, FreeBSD 13.4-release-p2 is in

root@locaal:~ # freebsd-version -ku
13.4-RELEASE-p1
13.4-RELEASE-p2

kernel

root@locaal:~ # uname -a
FreeBSD locaal 13.4-RELEASE-p1 FreeBSD 13.4-RELEASE-p1 GENERIC amd64

2024-11-08: ada0p2 - freebsd-update fetch

root@locaal:~ # freebsd-update fetch
src component not installed, skipped
[..]
The following files will be updated as part of updating to
13.4-RELEASE-p2:
/bin/freebsd-version
/boot/kernel/ctl.ko
/boot/kernel/kernel
/lib/libnv.so.0
/rescue/[
/rescue/bectl
/rescue/bsdlabel
/rescue/bunzip2
/rescue/bzcat
/rescue/bzip2
/rescue/camcontrol
/rescue/cat
/rescue/ccdconfig
/rescue/chflags
/rescue/chgrp
/rescue/chio
/rescue/chmod
/rescue/chown
/rescue/chroot
/rescue/clri
/rescue/cp
/rescue/csh
/rescue/date
/rescue/dd
/rescue/devfs
/rescue/df
/rescue/dhclient
/rescue/disklabel
/rescue/dmesg
/rescue/dump
/rescue/dumpfs
/rescue/dumpon
/rescue/echo
/rescue/ed
/rescue/ex
/rescue/expr
/rescue/fastboot
/rescue/fasthalt
/rescue/fdisk
/rescue/fetch
/rescue/fsck
/rescue/fsck_4.2bsd
/rescue/fsck_ffs
/rescue/fsck_msdosfs
/rescue/fsck_ufs
/rescue/fsdb
/rescue/fsirand
/rescue/gbde
/rescue/geom
/rescue/getfacl
/rescue/glabel
/rescue/gpart
/rescue/groups
/rescue/gunzip
/rescue/gzcat
/rescue/gzip
/rescue/halt
/rescue/head
/rescue/hostname
/rescue/id
/rescue/ifconfig
/rescue/init
/rescue/ipf
/rescue/iscsictl
/rescue/iscsid
/rescue/kenv
/rescue/kill
/rescue/kldconfig
/rescue/kldload
/rescue/kldstat
/rescue/kldunload
/rescue/ldconfig
/rescue/less
/rescue/link
/rescue/ln
/rescue/ls
/rescue/lzcat
/rescue/lzma
/rescue/md5
/rescue/mdconfig
/rescue/mdmfs
/rescue/mkdir
/rescue/mknod
/rescue/more
/rescue/mount
/rescue/mount_cd9660
/rescue/mount_msdosfs
/rescue/mount_nfs
/rescue/mount_nullfs
/rescue/mount_udf
/rescue/mount_unionfs
/rescue/mt
/rescue/mv
/rescue/nc
/rescue/newfs
/rescue/newfs_msdos
/rescue/nos-tun
/rescue/pgrep
/rescue/ping
/rescue/ping6
/rescue/pkill
/rescue/poweroff
/rescue/ps
/rescue/pwd
/rescue/rcorder
/rescue/rdump
/rescue/realpath
/rescue/reboot
/rescue/red
/rescue/rescue
/rescue/restore
/rescue/rm
/rescue/rmdir
/rescue/route
/rescue/routed
/rescue/rrestore
/rescue/rtquery
/rescue/rtsol
/rescue/savecore
/rescue/sed
/rescue/setfacl
/rescue/sh
/rescue/shutdown
/rescue/sleep
/rescue/spppcontrol
/rescue/stty
/rescue/swapon
/rescue/sync
/rescue/sysctl
/rescue/tail
/rescue/tar
/rescue/tcsh
/rescue/tee
/rescue/test
/rescue/tunefs
/rescue/umount
/rescue/unlink
/rescue/unlzma
/rescue/unxz
/rescue/unzstd
/rescue/vi
/rescue/whoami
/rescue/xz
/rescue/xzcat
/rescue/zcat
/rescue/zdb
/rescue/zfs
/rescue/zpool
/rescue/zstd
/rescue/zstdcat
/rescue/zstdmt
/usr/bin/fetch
/usr/lib/libnv.a
/usr/lib/libnv_p.a
/usr/lib32/libnv.a
/usr/lib32/libnv.so.0
/usr/lib32/libnv_p.a
/usr/sbin/bhyve

install

root@locaal:~ # freebsd-update install
src component not installed, skipped
Installing updates...
Restarting sshd after upgrade
Performing sanity check on sshd configuration.
Stopping sshd.
Waiting for PIDS: 1054.
Performing sanity check on sshd configuration.
Starting sshd.
Scanning //usr/share/certs/blacklisted for certificates...
Scanning //usr/share/certs/trusted for certificates...
 done.

2024-11-08: ada0p2 - ollama - pull another model

tingo@locaal:~ $ ollama pull llama3.2:1b
pulling manifest 
pulling 74701a8c35f6... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.3 GB                         
pulling 966de95ca8a6... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.4 KB                         
pulling fcc5a6bec9da... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 7.7 KB                         
pulling a70ff7e570d9... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 6.0 KB                         
pulling 4f659a1e86d7... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
success 

show what we have

tingo@locaal:~ $ ollama list
NAME            ID              SIZE    MODIFIED       
llama3.2:1b     baf6a787fdff    1.3 GB  30 seconds ago  
mistral:latest  f974a74358d6    4.1 GB  17 minutes ago  

try to run it

tingo@locaal:~ $ ollama run llama3.2:1b
Error: Post "http://127.0.0.1:11434/api/chat": EOF

try again

tingo@locaal:~ $ ollama run llama3.2:1b
>>> /set verbose
Set 'verbose' mode.

that worked. Do a query

>>> why is the sky blue
The sky appears blue to us because of a phenomenon called Rayleigh scattering, named after the British physicist Lord Rayleigh. He discovered that when sunlight 
enters Earth's atmosphere, it encounters tiny molecules of gases such as nitrogen and oxygen.

These molecules scatter the light in all directions, but they scatter shorter (blue) wavelengths more than longer (red) wavelengths. This is because the smaller 
molecules are more effective at scattering the blue light.

As a result, the blue light is distributed throughout the atmosphere, giving the sky its blue color. The amount of scattering that occurs depends on the altitude 
and density of the atmospheric gases. At sea level, where most people live, the sky appears blue due to Rayleigh scattering from the ground and higher altitudes. 

However, as you go higher into the atmosphere, the concentration of molecules decreases, and the shorter wavelengths (like blue and violet) are not scattered as 
much, which is why the sky appears more red or orange at higher altitudes.

total duration:       3.16908962s
load duration:        60.885314ms
prompt eval count:    30 token(s)
prompt eval duration: 316.333ms
prompt eval rate:     94.84 tokens/s
eval count:           198 token(s)
eval duration:        2.74121s
eval rate:            72.23 tokens/s

2024-11-08: ada0p2 - ollama - in the second terminal, I run the mistral model

tingo@locaal:~ $ ollama run mistral
pulling manifest 
pulling ff82381e2bea... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 4.1 GB                         
pulling 43070e2d4e53... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏  11 KB                         
pulling 491dfa501e59... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏  801 B                         
pulling ed11eda7790d... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏   30 B                         
pulling 42347cd80dc8... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
success 
Error: Post "http://127.0.0.1:11434/api/chat": EOF

ok, it didn't like that. In the first terminal, a lot happened

[GIN] 2024/11/08 - 21:31:57 | 200 |       34.56µs |       127.0.0.1 | HEAD     "/"
[GIN] 2024/11/08 - 21:31:57 | 404 |     171.688µs |       127.0.0.1 | POST     "/api/show"
time=2024-11-08T21:31:59.104+01:00 level=INFO source=download.go:175 msg="downloading ff82381e2bea in 42 100 MB part(s)"
time=2024-11-08T21:32:42.117+01:00 level=INFO source=download.go:175 msg="downloading 43070e2d4e53 in 1 11 KB part(s)"
time=2024-11-08T21:32:44.213+01:00 level=INFO source=download.go:175 msg="downloading 491dfa501e59 in 1 801 B part(s)"
time=2024-11-08T21:32:46.419+01:00 level=INFO source=download.go:175 msg="downloading ed11eda7790d in 1 30 B part(s)"
time=2024-11-08T21:32:48.441+01:00 level=INFO source=download.go:175 msg="downloading 42347cd80dc8 in 1 485 B part(s)"
[GIN] 2024/11/08 - 21:32:52 | 200 | 54.830670798s |       127.0.0.1 | POST     "/api/pull"
[GIN] 2024/11/08 - 21:32:52 | 200 |    6.039215ms |       127.0.0.1 | POST     "/api/show"
time=2024-11-08T21:32:53.395+01:00 level=DEBUG source=sched.go:181 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=0x1482cc0 gpu_count=1
time=2024-11-08T21:32:53.400+01:00 level=DEBUG source=sched.go:219 msg="loading first model" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:32:53.400+01:00 level=DEBUG source=memory.go:101 msg=evaluating library=vulkan gpu_count=1 available="[12.2 GiB]"
time=2024-11-08T21:32:53.401+01:00 level=INFO source=sched.go:710 msg="new model will fit in available VRAM in single GPU, loading" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 gpu=0 parallel=1 available=13142851584 required="4.8 GiB"
time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=gpu_bsd.go:111 msg=gpu_bsd.go::GetCPUMem::GetCPUMem total_memory=34242666496 free_memory=26264035328 free_swap=4069965824
time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=server.go:101 msg="system memory" total="31.9 GiB" free="24.5 GiB" free_swap="3.8 GiB"
time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=memory.go:101 msg=evaluating library=vulkan gpu_count=1 available="[12.2 GiB]"
time=2024-11-08T21:32:53.402+01:00 level=INFO source=memory.go:309 msg="offload to vulkan" layers.requested=-1 layers.model=33 layers.offload=33 layers.split="" memory.available="[12.2 GiB]" memory.required.full="4.8 GiB" memory.required.partial="4.8 GiB" memory.required.kv="256.0 MiB" memory.required.allocations="[4.8 GiB]" memory.weights.total="3.9 GiB" memory.weights.repeating="3.8 GiB" memory.weights.nonrepeating="105.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="185.0 MiB"
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server
time=2024-11-08T21:32:53.402+01:00 level=INFO source=server.go:393 msg="starting llama server" cmd="/tmp/ollama2644925853/runners/vulkan/ollama_llama_server --model /home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 --ctx-size 2048 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --verbose --parallel 1 --port 36729"
time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=server.go:410 msg=subprocess environment="[PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/home/tingo/bin LD_LIBRARY_PATH=/tmp/ollama2644925853/runners/vulkan:/tmp/ollama2644925853/runners]"
time=2024-11-08T21:32:53.405+01:00 level=INFO source=sched.go:445 msg="loaded runners" count=1
time=2024-11-08T21:32:53.405+01:00 level=INFO source=server.go:593 msg="waiting for llama runner to start responding"
time=2024-11-08T21:32:53.405+01:00 level=INFO source=server.go:627 msg="waiting for server to become available" status="llm server error"
INFO [main] build info | build=0 commit="unknown" tid="0x827f86000" timestamp=1731097973
INFO [main] system info | n_threads=6 n_threads_batch=-1 system_info="AVX = 0 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 0 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | " tid="0x827f86000" timestamp=1731097973 total_threads=12
INFO [main] HTTP server listening | hostname="127.0.0.1" n_threads_http="11" port="36729" tid="0x827f86000" timestamp=1731097973
llama_model_loader: loaded meta data with 25 key-value pairs and 291 tensors from /home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = llama
llama_model_loader: - kv   1:                               general.name str              = Mistral-7B-Instruct-v0.3
llama_model_loader: - kv   2:                          llama.block_count u32              = 32
llama_model_loader: - kv   3:                       llama.context_length u32              = 32768
llama_model_loader: - kv   4:                     llama.embedding_length u32              = 4096
llama_model_loader: - kv   5:                  llama.feed_forward_length u32              = 14336
llama_model_loader: - kv   6:                 llama.attention.head_count u32              = 32
llama_model_loader: - kv   7:              llama.attention.head_count_kv u32              = 8
llama_model_loader: - kv   8:                       llama.rope.freq_base f32              = 1000000.000000
llama_model_loader: - kv   9:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
llama_model_loader: - kv  10:                          general.file_type u32              = 2
llama_model_loader: - kv  11:                           llama.vocab_size u32              = 32768
llama_model_loader: - kv  12:                 llama.rope.dimension_count u32              = 128
llama_model_loader: - kv  13:                       tokenizer.ggml.model str              = llama
llama_model_loader: - kv  14:                         tokenizer.ggml.pre str              = default
llama_model_loader: - kv  15:                      tokenizer.ggml.tokens arr[str,32768]   = ["<unk>", "<s>", "</s>", "[INST]", "[...
llama_model_loader: - kv  16:                      tokenizer.ggml.scores arr[f32,32768]   = [0.000000, 0.000000, 0.000000, 0.0000...
llama_model_loader: - kv  17:                  tokenizer.ggml.token_type arr[i32,32768]   = [2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ...
llama_model_loader: - kv  18:                tokenizer.ggml.bos_token_id u32              = 1
llama_model_loader: - kv  19:                tokenizer.ggml.eos_token_id u32              = 2
llama_model_loader: - kv  20:            tokenizer.ggml.unknown_token_id u32              = 0
llama_model_loader: - kv  21:               tokenizer.ggml.add_bos_token bool             = true
llama_model_loader: - kv  22:               tokenizer.ggml.add_eos_token bool             = false
llama_model_loader: - kv  23:                    tokenizer.chat_template str              = {{ bos_token }}{% for message in mess...
llama_model_loader: - kv  24:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:   65 tensors
llama_model_loader: - type q4_0:  225 tensors
llama_model_loader: - type q6_K:    1 tensors
llm_load_vocab: special tokens cache size = 771
llm_load_vocab: token to piece cache size = 0.1731 MB
llm_load_print_meta: format           = GGUF V3 (latest)
llm_load_print_meta: arch             = llama
llm_load_print_meta: vocab type       = SPM
llm_load_print_meta: n_vocab          = 32768
llm_load_print_meta: n_merges         = 0
llm_load_print_meta: vocab_only       = 0
llm_load_print_meta: n_ctx_train      = 32768
llm_load_print_meta: n_embd           = 4096
llm_load_print_meta: n_layer          = 32
llm_load_print_meta: n_head           = 32
llm_load_print_meta: n_head_kv        = 8
llm_load_print_meta: n_rot            = 128
llm_load_print_meta: n_swa            = 0
llm_load_print_meta: n_embd_head_k    = 128
llm_load_print_meta: n_embd_head_v    = 128
llm_load_print_meta: n_gqa            = 4
llm_load_print_meta: n_embd_k_gqa     = 1024
llm_load_print_meta: n_embd_v_gqa     = 1024
llm_load_print_meta: f_norm_eps       = 0.0e+00
llm_load_print_meta: f_norm_rms_eps   = 1.0e-05
llm_load_print_meta: f_clamp_kqv      = 0.0e+00
llm_load_print_meta: f_max_alibi_bias = 0.0e+00
llm_load_print_meta: f_logit_scale    = 0.0e+00
llm_load_print_meta: n_ff             = 14336
llm_load_print_meta: n_expert         = 0
llm_load_print_meta: n_expert_used    = 0
llm_load_print_meta: causal attn      = 1
llm_load_print_meta: pooling type     = 0
llm_load_print_meta: rope type        = 0
llm_load_print_meta: rope scaling     = linear
llm_load_print_meta: freq_base_train  = 1000000.0
llm_load_print_meta: freq_scale_train = 1
llm_load_print_meta: n_ctx_orig_yarn  = 32768
llm_load_print_meta: rope_finetuned   = unknown
llm_load_print_meta: ssm_d_conv       = 0
llm_load_print_meta: ssm_d_inner      = 0
llm_load_print_meta: ssm_d_state      = 0
llm_load_print_meta: ssm_dt_rank      = 0
llm_load_print_meta: model type       = 7B
llm_load_print_meta: model ftype      = Q4_0
llm_load_print_meta: model params     = 7.25 B
llm_load_print_meta: model size       = 3.83 GiB (4.54 BPW) 
llm_load_print_meta: general.name     = Mistral-7B-Instruct-v0.3
llm_load_print_meta: BOS token        = 1 '<s>'
llm_load_print_meta: EOS token        = 2 '</s>'
llm_load_print_meta: UNK token        = 0 '<unk>'
llm_load_print_meta: LF token         = 781 '<0x0A>'
llm_load_print_meta: max token length = 48
time=2024-11-08T21:32:53.698+01:00 level=INFO source=server.go:627 msg="waiting for server to become available" status="llm server loading model"
ggml_vulkan: Found 1 Vulkan devices:
Vulkan0: NVIDIA GeForce RTX 3060 (NVIDIA) | uma: 0 | fp16: 1 | warp size: 32
llm_load_tensors: ggml ctx size =    0.27 MiB
llm_load_tensors: offloading 32 repeating layers to GPU
llm_load_tensors: offloading non-repeating layers to GPU
llm_load_tensors: offloaded 33/33 layers to GPU
llm_load_tensors:        CPU buffer size =    72.00 MiB
llm_load_tensors: NVIDIA GeForce RTX 3060 buffer size =  3850.02 MiB
time=2024-11-08T21:33:26.724+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.02"
time=2024-11-08T21:33:27.017+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.11"
time=2024-11-08T21:33:27.310+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.24"
time=2024-11-08T21:33:27.562+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.44"
time=2024-11-08T21:33:27.855+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.60"
time=2024-11-08T21:33:28.148+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.80"
time=2024-11-08T21:33:28.439+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.99"
llama_new_context_with_model: n_ctx      = 2048
llama_new_context_with_model: n_batch    = 512
llama_new_context_with_model: n_ubatch   = 512
llama_new_context_with_model: flash_attn = 0
llama_new_context_with_model: freq_base  = 1000000.0
llama_new_context_with_model: freq_scale = 1
llama_kv_cache_init: NVIDIA GeForce RTX 3060 KV buffer size =   256.00 MiB
llama_new_context_with_model: KV self size  =  256.00 MiB, K (f16):  128.00 MiB, V (f16):  128.00 MiB
llama_new_context_with_model: Vulkan_Host  output buffer size =     0.14 MiB
llama_new_context_with_model: NVIDIA GeForce RTX 3060 compute buffer size =   164.00 MiB
llama_new_context_with_model: Vulkan_Host compute buffer size =    12.01 MiB
llama_new_context_with_model: graph nodes  = 1030
llama_new_context_with_model: graph splits = 2
time=2024-11-08T21:33:28.732+01:00 level=DEBUG source=server.go:638 msg="model load progress 1.00"
DEBUG [initialize] initializing slots | n_slots=1 tid="0x827f86000" timestamp=1731098008
DEBUG [initialize] new slot | n_ctx_slot=2048 slot_id=0 tid="0x827f86000" timestamp=1731098008
INFO [main] model loaded | tid="0x827f86000" timestamp=1731098008
DEBUG [update_slots] all slots are idle and system prompt is empty, clear the KV cache | tid="0x827f86000" timestamp=1731098008
DEBUG [process_single_task] slot data | n_idle_slots=1 n_processing_slots=0 task_id=0 tid="0x827f86000" timestamp=1731098008
time=2024-11-08T21:33:28.985+01:00 level=INFO source=server.go:632 msg="llama runner started in 35.58 seconds"
time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:458 msg="finished setting up runner" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
[GIN] 2024/11/08 - 21:33:28 | 200 | 36.755545028s |       127.0.0.1 | POST     "/api/chat"
time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:462 msg="context for request finished"
time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:334 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 duration=5m0s
time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:352 msg="after processing request finished event" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 refCount=0
time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:336 msg="timer expired, expiring to unload" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:355 msg="runner expired event received" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:371 msg="got lock to unload" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:29.089+01:00 level=DEBUG source=server.go:1050 msg="stopping llama server"
time=2024-11-08T21:38:29.089+01:00 level=DEBUG source=server.go:1056 msg="waiting for llama server to exit"
time=2024-11-08T21:38:29.601+01:00 level=DEBUG source=server.go:1060 msg="llama server stopped"
time=2024-11-08T21:38:29.601+01:00 level=DEBUG source=sched.go:376 msg="runner released" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:33.993+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.008431342 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:33.994+01:00 level=DEBUG source=sched.go:380 msg="sending an unloaded event" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:33.994+01:00 level=DEBUG source=sched.go:303 msg="ignoring unload event with no pending requests"
time=2024-11-08T21:38:34.273+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.287736371 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
time=2024-11-08T21:38:34.548+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.562665772 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435

2024-11-08: ada0p2 - ollama - in the first terminal, I start ollama server

tingo@locaal:~ $ file /usr/local/bin/ollama
/usr/local/bin/ollama: ELF 64-bit LSB executable, x86-64, version 1 (FreeBSD), dynamically linked, interpreter /libexec/ld-elf.so.1, for FreeBSD 13.3, FreeBSD-style, Go BuildID=JLNZ20VZYvEn2LuhDl0-/VC-dnrH1y33jxyQLEOqg/Ghvn4ZvlqwJAVJFM5_jT/Avb_QBTK7vLqVySpN2Om, stripped

start it

tingo@locaal:~ $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start
Couldn't find '/home/tingo/.ollama/id_ed25519'. Generating new private key.
Your new public key is: 

ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINKXfpK4SGCPzaOsQvyLoCk9I+sBTqveh20aWCsBvCgv

2024/11/08 21:31:24 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/tingo/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-11-08T21:31:24.933+01:00 level=INFO source=images.go:782 msg="total blobs: 0"
time=2024-11-08T21:31:24.934+01:00 level=INFO source=images.go:790 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:   export GIN_MODE=release
 - using code:  gin.SetMode(gin.ReleaseMode)

[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullModelHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateModelHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushModelHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyModelHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteModelHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).ProcessHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (6 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
time=2024-11-08T21:31:24.934+01:00 level=INFO source=routes.go:1172 msg="Listening on 127.0.0.1:11434 (version 0.0.0)"
time=2024-11-08T21:31:24.934+01:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama2644925853/runners
time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu file=build/bsd/x86_64/cpu/bin/ollama_llama_server.gz
time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu_avx file=build/bsd/x86_64/cpu_avx/bin/ollama_llama_server.gz
time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu_avx2 file=build/bsd/x86_64/cpu_avx2/bin/ollama_llama_server.gz
time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=vulkan file=build/bsd/x86_64/vulkan/bin/ollama_llama_server.gz
time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=vulkan file=build/bsd/x86_64/vulkan/bin/vulkan-shaders-gen.gz
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server
time=2024-11-08T21:31:25.011+01:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 vulkan]"
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=sched.go:105 msg="starting llm scheduler"
time=2024-11-08T21:31:26.170+01:00 level=INFO source=types.go:105 msg="inference compute" id=0 library=vulkan compute="" driver=0.0 name="" total="12.2 GiB" available="12.2 GiB"

2024-11-08: ada0p2 - pkg - install ollama

Nov  8 21:26:41 locaal pkg[6019]: vulkan-loader-1.3.297 installed
Nov  8 21:26:42 locaal pkg[6019]: ollama-0.3.6_1 installed

messages

Message from ollama-0.3.6_1:
--
You installed ollama: the AI model runner.

To run ollama, plese open 2 terminals.
1. In the first terminal, please run:
   $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start
2. In the second terminal, please run:
   $ ollama run mistral

This will download and run the AI model "mistral".
You will be able to interact with it in plain English.

Please see https://ollama.com/library for the list
of all supported models.

The command "ollama list" lists all models downloaded
into your system.

When the model fails to load into your GPU, please use
the provided ollama-limit-gpu-layers script to create
model flavors with different num_gpu parameters.

ollama uses many gigbytes of disk space in your home directory,
because advanced AI models are often very large.
Pease symlink ~/.ollama to a large disk if needed.

2024-11-08: ada0p2 - nvidia - nvidia-smi report

root@locaal:~ # nvidia-smi
Fri Nov  8 21:21:49 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.120                Driver Version: 550.120        CUDA Version: N/A      |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3060        Off |   00000000:06:00.0 Off |                  N/A |
| 32%   28C    P0             33W /  170W |       1MiB /  12288MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

2024-11-08: ada0p2 - Xorg - I manually loaded the kld module nvidia-drm from the condsole, then (as my own user) I did startx. It worked, from /var/log/Xorg.0.log:

[170183.798] (II) xfree86: Adding drm device (/dev/dri/card0)
[170183.798] (II) Platform probe for /dev/dri/card0
[170183.798] (**) OutputClass "nvidia" ModulePath extended to "/usr/local/lib/nvidia/xorg,/usr/local/lib/xorg/modules,/usr/local/lib/xorg/modules"
[170183.798] (**) OutputClass "nvidia" setting /dev/dri/card0 as PrimaryGPU
[170183.798] (--) PCI:*(6@0:0:0) 10de:2504:1462:397d rev 161, Mem @ 0xfb000000/16777216, 0xd0000000/268435456, 0xe0000000/33554432, I/O @ 0x0000e000/128, BIOS @ 0x????????/65536

[170183.799] (II) Loading /usr/local/lib/xorg/modules/drivers/nvidia_drv.so
[170183.799] (II) Module nvidia: vendor="NVIDIA Corporation"
[170183.799]    compiled for 1.6.99.901, module version = 1.0.0
[170183.799]    Module class: X.Org Video Driver
[170183.799] (II) NVIDIA dlloader X Driver  550.120  Fri Sep 13 09:34:46 UTC 2024
[170183.799] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
[170183.799] (--) Using syscons driver with X support (version 2.0)
[170183.799] (--) using VT number 9

[170183.814] (WW) VGA arbiter: cannot open kernel arbiter, no multi-card support
[170183.814] (II) NVIDIA(0): Creating default Display subsection in Screen section
        "Default Screen Section" for depth/fbbpp 24/32
[170183.814] (==) NVIDIA(0): Depth 24, (==) framebuffer bpp 32
[170183.814] (==) NVIDIA(0): RGB weight 888
[170183.814] (==) NVIDIA(0): Default visual is TrueColor
[170183.814] (==) NVIDIA(0): Using gamma correction (1.0, 1.0, 1.0)
[170183.814] (II) Applying OutputClass "nvidia" options to /dev/dri/card0
[170183.814] (**) NVIDIA(0): Enabling 2D acceleration
[170183.814] (II) Loading sub module "glxserver_nvidia"
[170183.814] (II) LoadModule: "glxserver_nvidia"
[170183.814] (II) Loading /usr/local/lib/xorg/modules/extensions/libglxserver_nvidia.so
[170183.820] (II) Module glxserver_nvidia: vendor="NVIDIA Corporation"
[170183.820]    compiled for 1.6.99.901, module version = 1.0.0
[170183.820]    Module class: X.Org Server Extension
[170183.820] (II) NVIDIA GLX Module  550.120  Fri Sep 13 09:34:34 UTC 2024
[170183.820] (II) NVIDIA: The X server supports PRIME Render Offload.
[170186.288] (--) NVIDIA(0): Valid display device(s) on GPU-0 at PCI:6:0:0
[170186.288] (--) NVIDIA(0):     DFP-0 (boot)
[170186.288] (--) NVIDIA(0):     DFP-1
[170186.288] (--) NVIDIA(0):     DFP-2
[170186.288] (--) NVIDIA(0):     DFP-3
[170186.288] (--) NVIDIA(0):     DFP-4
[170186.288] (--) NVIDIA(0):     DFP-5
[170186.288] (--) NVIDIA(0):     DFP-6
[170186.289] (II) NVIDIA(0): NVIDIA GPU NVIDIA GeForce RTX 3060 (GA106-A) at PCI:6:0:0
[170186.289] (II) NVIDIA(0):     (GPU-0)
[170186.289] (--) NVIDIA(0): Memory: 12582912 kBytes
[170186.289] (--) NVIDIA(0): VideoBIOS: 94.06.2f.00.9a
[170186.289] (II) NVIDIA(0): Detected PCI Express Link width: 16X
[170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): connected
[170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): Internal TMDS
[170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): 600.0 MHz maximum pixel clock
[170186.334] (--) NVIDIA(GPU-0): 
[170186.334] (--) NVIDIA(GPU-0): DFP-1: disconnected
[170186.334] (--) NVIDIA(GPU-0): DFP-1: Internal DisplayPort
[170186.334] (--) NVIDIA(GPU-0): DFP-1: 2670.0 MHz maximum pixel clock
[170186.334] (--) NVIDIA(GPU-0): 
[170186.335] (--) NVIDIA(GPU-0): DFP-2: disconnected
[170186.335] (--) NVIDIA(GPU-0): DFP-2: Internal TMDS
[170186.335] (--) NVIDIA(GPU-0): DFP-2: 165.0 MHz maximum pixel clock
[170186.335] (--) NVIDIA(GPU-0): 
[170186.335] (--) NVIDIA(GPU-0): DFP-3: disconnected
[170186.335] (--) NVIDIA(GPU-0): DFP-3: Internal DisplayPort
[170186.335] (--) NVIDIA(GPU-0): DFP-3: 2670.0 MHz maximum pixel clock
[170186.335] (--) NVIDIA(GPU-0): 
[170186.336] (--) NVIDIA(GPU-0): DFP-4: disconnected
[170186.336] (--) NVIDIA(GPU-0): DFP-4: Internal TMDS
[170186.336] (--) NVIDIA(GPU-0): DFP-4: 165.0 MHz maximum pixel clock
[170186.336] (--) NVIDIA(GPU-0): 
[170186.336] (--) NVIDIA(GPU-0): DFP-5: disconnected
[170186.336] (--) NVIDIA(GPU-0): DFP-5: Internal DisplayPort
[170186.336] (--) NVIDIA(GPU-0): DFP-5: 2670.0 MHz maximum pixel clock
[170186.336] (--) NVIDIA(GPU-0): 
[170186.337] (--) NVIDIA(GPU-0): DFP-6: disconnected
[170186.337] (--) NVIDIA(GPU-0): DFP-6: Internal TMDS
[170186.337] (--) NVIDIA(GPU-0): DFP-6: 165.0 MHz maximum pixel clock
[170186.337] (--) NVIDIA(GPU-0): 

170186.381] (==) NVIDIA(0): No modes were requested; the default mode "nvidia-auto-select"
[170186.381] (==) NVIDIA(0):     will be used as the requested mode.
[170186.381] (==) NVIDIA(0): 
[170186.383] (II) NVIDIA(0): Validated MetaModes:
[170186.384] (II) NVIDIA(0):     "DFP-0:nvidia-auto-select"
[170186.384] (II) NVIDIA(0): Virtual screen size determined to be 1920 x 1080
[170186.424] (--) NVIDIA(0): DPI set to (92, 91); computed from "UseEdidDpi" X config
[170186.424] (--) NVIDIA(0):     option
[170186.425] (II) NVIDIA: Reserving 24576.00 MB of virtual memory for indirect memory
[170186.425] (II) NVIDIA:     access.
[170186.452] (II) NVIDIA(0): Setting mode "DFP-0:nvidia-auto-select"
[170186.513] (==) NVIDIA(0): Disabling shared memory pixmaps
[170186.513] (==) NVIDIA(0): Backing store enabled
[170186.513] (==) NVIDIA(0): Silken mouse enabled
[170186.513] (==) NVIDIA(0): DPMS enabled
[170186.513] (WW) NVIDIA(0): Option "PrimaryGPU" is not used

[170186.513] (II) NVIDIA(0): [DRI2] Setup complete
[170186.513] (II) NVIDIA(0): [DRI2]   VDPAU driver: nvidia
[170186.513] (II) Initializing extension Generic Event Extension
[170186.513] (II) Initializing extension SHAPE
[170186.514] (II) Initializing extension MIT-SHM
[170186.514] (II) Initializing extension XInputExtension
[170186.514] (II) Initializing extension XTEST
[170186.514] (II) Initializing extension BIG-REQUESTS
[170186.514] (II) Initializing extension SYNC
[170186.514] (II) Initializing extension XKEYBOARD
[170186.515] (II) Initializing extension XC-MISC
[170186.515] (II) Initializing extension SECURITY
[170186.515] (II) Initializing extension XFIXES
[170186.515] (II) Initializing extension RENDER
[170186.515] (II) Initializing extension RANDR
[170186.516] (II) Initializing extension COMPOSITE
[170186.516] (II) Initializing extension DAMAGE
[170186.516] (II) Initializing extension MIT-SCREEN-SAVER
[170186.516] (II) Initializing extension DOUBLE-BUFFER
[170186.516] (II) Initializing extension RECORD
[170186.516] (II) Initializing extension DPMS
[170186.517] (II) Initializing extension Present
[170186.517] (II) Initializing extension DRI3
[170186.517] (II) Initializing extension X-Resource
[170186.517] (II) Initializing extension XVideo
[170186.517] (II) Initializing extension XVideo-MotionCompensation
[170186.517] (II) Initializing extension GLX
[170186.517] (II) Initializing extension GLX
[170186.517] (II) Indirect GLX disabled.
[170186.517] (II) GLX: Another vendor is already registered for screen 0
[170186.517] (II) Initializing extension XFree86-VidModeExtension
[170186.518] (II) Initializing extension XFree86-DGA
[170186.518] (II) Initializing extension XFree86-DRI
[170186.518] (II) Initializing extension DRI2
[170186.518] (II) Initializing extension NV-GLX
[170186.518] (II) Initializing extension NV-CONTROL
[170186.518] (II) Initializing extension XINERAMA

2024-11-08: ada0p2 - pkg - install nvidia-drm-kmod

Nov  8 19:34:30 locaal pkg[5820]: drm-510-kmod-5.10.163_9 installed
Nov  8 19:34:30 locaal pkg[5820]: nvidia-drm-510-kmod-550.120_1 installed
Nov  8 19:34:30 locaal pkg[5820]: nvidia-drm-kmod-550.120 installed

messages

The drm-510-kmod port can be enabled for amdgpu (for AMD
GPUs starting with the HD7000 series / Tahiti) or i915kms (for Intel
APUs starting with HD3000 / Sandy Bridge) through kld_list in
/etc/rc.conf. radeonkms for older AMD GPUs can be loaded and there are
some positive reports if EFI boot is NOT enabled (similar to amdgpu).

For amdgpu: kld_list="amdgpu"
For Intel: kld_list="i915kms"
For radeonkms: kld_list="radeonkms"

Please ensure that all users requiring graphics are members of the
"video" group.

Modesetting must be enabled to use nvidia-drm.ko for graphics. This can be done
by setting the modeset sysctl, the equivalent of the modeset kernel parameter
on Linux.

hw.nvidiadrm.modeset=1

This must be set before loading nvdidia-drm.ko, most easily done by placing the
above in /boot/loader.conf.

Modesetting must be enabled to use nvidia-drm.ko for graphics. This can be done
by setting the modeset sysctl, the equivalent of the modeset kernel parameter
on Linux.

hw.nvidiadrm.modeset=1

This must be set before loading nvdidia-drm.ko, most easily done by placing the
above in /boot/loader.conf.

2024-11-06: ada0p2 - from dmidecode output

# dmidecode 3.6
Scanning /dev/mem for entry point.
SMBIOS 3.3.0 present.
Table at 0x000E6CC0.

Handle 0x0000, DMI type 0, 26 bytes
BIOS Information
        Vendor: American Megatrends Inc.
        Version: P5.70
        Release Date: 10/20/2022
        Address: 0xF0000
        Runtime Size: 64 kB
        ROM Size: 16 MB
        Characteristics:
                PCI is supported
                BIOS is upgradeable
                BIOS shadowing is allowed
                Boot from CD is supported
                Selectable boot is supported
                BIOS ROM is socketed
                EDD is supported
                5.25"/1.2 MB floppy services are supported (int 13h)
                3.5"/720 kB floppy services are supported (int 13h)
                3.5"/2.88 MB floppy services are supported (int 13h)
                Print screen service is supported (int 5h)
                8042 keyboard services are supported (int 9h)
                Serial services are supported (int 14h)
                Printer services are supported (int 17h)
                ACPI is supported
                USB legacy is supported
                BIOS boot specification is supported
                Targeted content distribution is supported
                UEFI is supported
        BIOS Revision: 5.17

2024-11-06: ada0p2 - pkg - install dmidecode

Nov  6 23:06:39 locaal pkg[1384]: dmidecode-3.6 installed

2024-11-06: ada0p2 - pkg - list of installed packages

root@locaal:~ # pkg info -a
avahi-app-0.8_2                Service discovery on a local network
brotli-1.1.0,1                 Generic-purpose lossless compression algorithm
curl-8.10.1                    Command line tool and library for transferring data with URLs
dbus-1.14.10_5,1               Message bus system for inter-application communication
dbus-glib-0.112_1              GLib bindings for the D-BUS messaging system
egl-wayland-1.1.13             EGLStream-based Wayland external platform
encodings-1.1.0,1              X.Org Encoding fonts
expat-2.6.3                    XML 1.0 parser written in C
fontconfig-2.15.0_3,1          XML-based font configuration API for X Windows
freetype2-2.13.3               Free and portable TrueType font rendering engine
fribidi-1.0.15                 Free Implementation of the Unicode Bidirectional Algorithm
gdbm-1.24                      GNU database manager
gettext-runtime-0.22.5         GNU gettext runtime libraries and programs
giflib-5.2.2                   Tools and library routines for working with GIF images
git-2.46.2                     Distributed source code management tool 
glib-2.80.5,2                  Some useful routines of C programming (current stable version)
gnome_subr-1.0                 Common startup and shutdown subroutines used by GNOME scripts
graphite2-1.3.14               Rendering capabilities for complex non-Roman writing systems
harfbuzz-10.0.1                OpenType text shaping engine
hidapi-0.14.0                  Library to access USB HID-class devices
indexinfo-0.3.1                Utility to regenerate the GNU info page index
jbigkit-2.1_3                  Lossless compression for bi-level images such as scanned pages, faxes
jpeg-turbo-3.0.4               SIMD-accelerated JPEG codec which replaces libjpeg
lcms2-2.16_2                   Accurate, fast, and small-footprint color management engine
lerc-4.0.0                     C++ library for Limited Error Raster Compression
libICE-1.1.1,1                 Inter Client Exchange library for X11
libSM-1.2.4,1                  Session Management library for X11
libX11-1.8.9,1                 X11 library
libXScrnSaver-1.2.4_1          The XScrnSaver library
libXau-1.0.11                  Authentication Protocol library for X11
libXaw-1.0.16,2                X Athena Widgets library
libXdamage-1.1.6               X Damage extension library
libXdmcp-1.1.5                 X Display Manager Control Protocol library
libXext-1.3.6,1                X11 Extension library
libXfixes-6.0.1                X Fixes extension library
libXfont2-2.0.6                X font library
libXft-2.3.8                   Client-sided font API for X applications
libXi-1.8.1,1                  X Input extension library
libXmu-1.1.4,1                 X Miscellaneous Utilities libraries
libXpm-3.5.17_1                X Pixmap library
libXrandr-1.5.4                X Resize and Rotate extension library
libXrender-0.9.11              X Render extension library
libXt-1.3.0,1                  X Toolkit library
libXv-1.0.12_1,1               X Video Extension library
libXxf86vm-1.1.5               X Vidmode Extension
libdaemon-0.14_1               Lightweight C library that eases the writing of UNIX daemons
libdeflate-1.22                Fast, whole-buffer DEFLATE-based compression library
libdrm-2.4.123,1               Direct Rendering Manager library and headers
libedit-3.1.20240808,1         Command line editor library
libepoll-shim-0.0.20240608     Small epoll implementation using kqueue
libepoxy-1.5.10                Library to handle OpenGL function pointer management
libevdev-1.13.2                Linux Event Device library
libevent-2.1.12                API for executing callback functions on events or timeouts
libffi-3.4.6                   Foreign Function Interface
libfontenc-1.1.8               The fontenc Library
libglvnd-1.7.0                 GL Vendor-Neutral Dispatch library
libgudev-237                   GObject bindings for libudev
libiconv-1.17_1                Character set conversion library
libidn2-2.3.7                  Implementation of IDNA2008 internationalized domain names
libimagequant-4.3.3_2          Image Quantization Library
libinput-1.26.2                Generic input library
liblz4-1.10.0,1                LZ4 compression library, lossless and very fast
libmtdev-1.1.7                 Multitouch Protocol Translation Library
libnghttp2-1.63.0              HTTP/2.0 C Library
libpciaccess-0.18.1            Generic PCI access library
libpsl-0.21.5_1                C library to handle the Public Suffix List
libraqm-0.10.1                 Library that encapsulates complex text layout logic
libssh2-1.11.0_1,3             Library implementing the SSH2 protocol
libudev-devd-0.6.0             libudev-compatible interface for devd
libunistring-1.2               Unicode string library
libunwind-20240221             Generic stack unwinding library
libwacom-1.5_1                 Adds tablet support to libinput
libxcb-1.17.0                  The X protocol C-language Binding (XCB) library
libxcvt-0.1.2_2                Calculate VESA CVT mode lines
libxkbfile-1.1.3               XKB file library
libxml2-2.11.9                 XML parser library for GNOME
libxshmfence-1.3.2             Shared memory 'SyncFence' synchronization primitive
llvm15-15.0.7_10               LLVM and Clang
lua53-5.3.6_1                  Powerful, efficient, lightweight, embeddable scripting language
luit-20240102_1                Locale and ISO 2022 support for Unicode terminals
mesa-dri-24.1.7                OpenGL hardware acceleration drivers for DRI2+
mesa-libs-24.1.7               OpenGL libraries that support GLX and EGL clients
mpdecimal-4.0.0                C/C++ arbitrary precision decimal floating point libraries
nss_mdns-0.14.1.20200624_1     NSS module implementing multicast DNS name resolution
nvidia-driver-550.120          NVidia graphics card binary drivers for hardware OpenGL rendering
openjpeg-2.5.2_1               Open-source JPEG 2000 codec
p5-Authen-SASL-2.17            Perl5 module for SASL authentication
p5-CGI-4.66                    Handle Common Gateway Interface requests and responses
p5-Clone-0.47                  Recursively copy Perl datatypes
p5-Digest-HMAC-1.04            Perl5 interface to HMAC Message-Digest Algorithms
p5-Encode-Locale-1.05          Determine the locale encoding
p5-Error-0.17029               Error/exception handling in object-oriented programming style
p5-GSSAPI-0.28_2               Perl extension providing access to the GSSAPIv2 library
p5-HTML-Parser-3.83            Perl5 module for parsing HTML documents
p5-HTML-Tagset-3.24            Some useful data table in parsing HTML
p5-HTTP-Date-6.06              Conversion routines for the HTTP protocol date formats
p5-HTTP-Message-6.46           Representation of HTTP style messages
p5-IO-HTML-1.004               Open an HTML file with automatic charset detection
p5-IO-Socket-IP-0.42           Drop-in replacement for IO::Socket::INET supporting IPv4 and IPv6
p5-IO-Socket-SSL-2.089         Perl5 interface to SSL sockets
p5-LWP-MediaTypes-6.04         Guess media type for a file or a URL
p5-Mozilla-CA-20240924         Perl extension for Mozilla CA cert bundle in PEM format
p5-Net-SSLeay-1.94             Perl5 interface to SSL
p5-TimeDate-2.33,1             Perl5 module containing a better/faster date parser for absolute dates
p5-URI-5.29                    Perl5 interface to Uniform Resource Identifier (URI) references
pcre2-10.43                    Perl Compatible Regular Expressions library, version 2
perl5-5.36.3_2                 Practical Extraction and Report Language
pixman-0.42.2                  Low-level pixel manipulation library
pkg-1.21.3                     Package manager
png-1.6.44                     Library for manipulating PNG images
py311-colorlog-6.8.2           Add colours to the output of Python logging module
py311-crcmod-1.7_2             Module for Cyclic Redundancy Check (CRC) calculations
py311-docopt-0.6.2_1           Pythonic argument parser, that will make you smile
py311-evdev-1.7.0              Bindings to the Linux input handling subsystem
py311-hidapi-0.14.0            Cython interface to comms/hidapi
py311-liquidctl-1.13.0         Cross-platform tool and drivers for liquid coolers and other devices
py311-olefile-0.46             Python module to read MS OLE2 files
py311-packaging-24.1           Core utilities for Python packages
py311-pillow-10.4.0            Fork of the Python Imaging Library (PIL)
py311-pyudev-0.24.1            Pure Python libudev binding
py311-pyusb-1.2.1              Python wrapper around libusb
py311-setuptools-63.1.0_1      Python packages installer
py311-six-1.16.0_1             Python 2 and 3 compatibility utilities
py311-tkinter-3.11.10_7        Python bindings to the Tk widget set (Python 3.11)
py311-wheel-0.44.0             Built-package format for Python
python311-3.11.10              Interpreted object-oriented programming language
readline-8.2.13_1              Library for editing command lines as they are typed
spirv-llvm-translator-llvm15-15.0.5 Bi-directional translation between SPIR-V and LLVM IR
spirv-tools-2024.4.r1          Tools for processing SPIR-V intermediate shader language modules
sudo-1.9.16                    Allow others to run commands as root
tcl86-8.6.15_2                 Tool Command Language
tiff-4.6.0                     Tools and library routines for working with TIFF images
tk86-8.6.15                    Graphical toolkit for Tcl
twm-1.0.12_1                   Tab Window Manager for the X Window System
wayland-1.23.1                 Core Wayland window system code and protocol
webp-1.4.0_1                   Google WebP image format conversion tool
xauth-1.1.3                    X authority file utility
xclock-1.0.9_1                 Analog and digital clock for X
xf86-input-libinput-1.3.0_1    X.Org libinput input driver
xf86-video-vesa-2.5.0_3        X.Org vesa display driver
xinit-1.4.2_1,1                X Window System initializer
xkbcomp-1.4.7                  Compile XKB keyboard description
xkeyboard-config-2.41_4        X Keyboard Configuration Database
xorg-minimal-7.5.2_3           X.Org minimal distribution metaport
xorg-server-21.1.13,1          X.Org X server and related programs
xorgproto-2024.1               X Window System unified protocol definitions
xrandr-1.5.2_1                 Primitive command line interface to the RandR extension
xterm-394                      Terminal emulator for the X Window System
zstd-1.5.6                     Fast real-time compression algorithm

2024-11-06: ada0p2 - usbconfig output

root@locaal:~ # usbconfig
ugen1.1: <AMD XHCI root HUB> at usbus1, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen0.1: <AMD XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen1.2: <PixArt HP USB Optical Mouse> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen1.3: <Chicony HP Elite USB Keyboard> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA)

2024-11-06: ada0p2 - pciconf -lv output

root@locaal:~ # pciconf -lv 
hostb0@pci0:0:0:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1450 subvendor=0x1022 subdevice=0x1450
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Root Complex'
    class      = bridge
    subclass   = HOST-PCI
hostb1@pci0:0:1:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
pcib1@pci0:0:1:3:   class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1453 subvendor=0x1022 subdevice=0x1453
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) PCIe GPP Bridge'
    class      = bridge
    subclass   = PCI-PCI
hostb2@pci0:0:2:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
hostb3@pci0:0:3:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
pcib6@pci0:0:3:1:   class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1453 subvendor=0x1022 subdevice=0x1453
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) PCIe GPP Bridge'
    class      = bridge
    subclass   = PCI-PCI
hostb4@pci0:0:4:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
hostb5@pci0:0:7:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
pcib7@pci0:0:7:1:   class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1454 subvendor=0x1022 subdevice=0x1454
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B'
    class      = bridge
    subclass   = PCI-PCI
hostb6@pci0:0:8:0:  class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge'
    class      = bridge
    subclass   = HOST-PCI
pcib8@pci0:0:8:1:   class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1454 subvendor=0x1022 subdevice=0x1454
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B'
    class      = bridge
    subclass   = PCI-PCI
intsmb0@pci0:0:20:0:    class=0x0c0500 rev=0x59 hdr=0x00 vendor=0x1022 device=0x790b subvendor=0x1849 subdevice=0xffff
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'FCH SMBus Controller'
    class      = serial bus
    subclass   = SMBus
isab0@pci0:0:20:3:  class=0x060100 rev=0x51 hdr=0x00 vendor=0x1022 device=0x790e subvendor=0x1849 subdevice=0xffff
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'FCH LPC Bridge'
    class      = bridge
    subclass   = PCI-ISA
hostb7@pci0:0:24:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1460 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0'
    class      = bridge
    subclass   = HOST-PCI
hostb8@pci0:0:24:1: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1461 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1'
    class      = bridge
    subclass   = HOST-PCI
hostb9@pci0:0:24:2: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1462 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2'
    class      = bridge
    subclass   = HOST-PCI
hostb10@pci0:0:24:3:    class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1463 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3'
    class      = bridge
    subclass   = HOST-PCI
hostb11@pci0:0:24:4:    class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1464 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4'
    class      = bridge
    subclass   = HOST-PCI
hostb12@pci0:0:24:5:    class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1465 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5'
    class      = bridge
    subclass   = HOST-PCI
hostb13@pci0:0:24:6:    class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1466 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6'
    class      = bridge
    subclass   = HOST-PCI
hostb14@pci0:0:24:7:    class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1467 subvendor=0x0000 subdevice=0x0000
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7'
    class      = bridge
    subclass   = HOST-PCI
xhci0@pci0:1:0:0:   class=0x0c0330 rev=0x01 hdr=0x00 vendor=0x1022 device=0x43d5 subvendor=0x1b21 subdevice=0x1142
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset USB 3.1 xHCI Compliant Host Controller'
    class      = serial bus
    subclass   = USB
ahci0@pci0:1:0:1:   class=0x010601 rev=0x01 hdr=0x00 vendor=0x1022 device=0x43c8 subvendor=0x1b21 subdevice=0x1062
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset SATA Controller'
    class      = mass storage
    subclass   = SATA
pcib2@pci0:1:0:2:   class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c6 subvendor=0x1b21 subdevice=0x0201
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset PCIe Bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib3@pci0:2:0:0:   class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset PCIe Port'
    class      = bridge
    subclass   = PCI-PCI
pcib4@pci0:2:1:0:   class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset PCIe Port'
    class      = bridge
    subclass   = PCI-PCI
pcib5@pci0:2:4:0:   class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = '400 Series Chipset PCIe Port'
    class      = bridge
    subclass   = PCI-PCI
re0@pci0:4:0:0: class=0x020000 rev=0x15 hdr=0x00 vendor=0x10ec device=0x8168 subvendor=0x1849 subdevice=0x8168
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet
vgapci0@pci0:6:0:0: class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x2504 subvendor=0x1462 subdevice=0x397d
    vendor     = 'NVIDIA Corporation'
    device     = 'GA106 [GeForce RTX 3060 Lite Hash Rate]'
    class      = display
    subclass   = VGA
hdac0@pci0:6:0:1:   class=0x040300 rev=0xa1 hdr=0x00 vendor=0x10de device=0x228e subvendor=0x1462 subdevice=0x397d
    vendor     = 'NVIDIA Corporation'
    device     = 'GA106 High Definition Audio Controller'
    class      = multimedia
    subclass   = HDA
none0@pci0:7:0:0:   class=0x130000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x145a subvendor=0x1022 subdevice=0x145a
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Zeppelin/Raven/Raven2 PCIe Dummy Function'
    class      = non-essential instrumentation
none1@pci0:7:0:2:   class=0x108000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1456 subvendor=0x1022 subdevice=0x1456
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device'
    class      = encrypt/decrypt
xhci1@pci0:7:0:3:   class=0x0c0330 rev=0x00 hdr=0x00 vendor=0x1022 device=0x145f subvendor=0x1849 subdevice=0xffff
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Zeppelin USB 3.0 xHCI Compliant Host Controller'
    class      = serial bus
    subclass   = USB
none2@pci0:8:0:0:   class=0x130000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1455 subvendor=0x1022 subdevice=0x1455
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Zeppelin/Renoir PCIe Dummy Function'
    class      = non-essential instrumentation
ahci1@pci0:8:0:2:   class=0x010601 rev=0x51 hdr=0x00 vendor=0x1022 device=0x7901 subvendor=0x1849 subdevice=0xffff
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'FCH SATA Controller [AHCI mode]'
    class      = mass storage
    subclass   = SATA
hdac1@pci0:8:0:3:   class=0x040300 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1457 subvendor=0x1849 subdevice=0x4897
    vendor     = 'Advanced Micro Devices, Inc. [AMD]'
    device     = 'Family 17h (Models 00h-0fh) HD Audio Controller'
    class      = multimedia
    subclass   = HDA

2024-11-06: ada0p2 - info from dmesg

CPU: AMD Ryzen 5 2600 Six-Core Processor             (3400.20-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x800f82  Family=0x17  Model=0x8  Stepping=2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
  Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
  TSC: P-state invariant, performance statistics
real memory  = 68719476736 (65536 MB)
avail memory = 33282408448 (31740 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 1 package(s) x 2 cache groups x 3 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 10 8 9 11 5 2 3 1 7 4 6

aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>

amdsmn0: <AMD Family 17h System Management Network> on hostb0
amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb0

ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0
nvidia0: <NVIDIA GeForce RTX 3060> on vgapci0
vgapci0: child nvidia0 requested pci_enable_io
vgapci0: child nvidia0 requested pci_enable_io
nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  550.120  Fri Sep 13 09:32:47 UTC 2024

uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0

2024-11-06: ada0p2 - connected up the SSD from the previous board, and the machine booted straight up.

root@locaal:~ # freebsd-version -ku
13.4-RELEASE
13.4-RELEASE

kernel

root@locaal:~ # uname -a
FreeBSD locaal 13.4-RELEASE FreeBSD 13.4-RELEASE releng/13.4-n258257-58066db597be GENERIC amd64

2024-11-06: I created this page.