ASRock B450M Pro4 R2.0 - FreeBSD
Hardware info on main page.
locaal - running FreeBSD amd64
Links
github skeeto/illume - scriptable command line program for LLM interfacing, null program - Everything I've learned so far about running local LLMs,
local links
Work log
2024-12-22: ada0p2 - pkg - upgrade
Dec 22 15:41:55 locaal pkg[42937]: sudo upgraded: 1.9.16 -> 1.9.16p1 Dec 22 15:41:56 locaal pkg[42937]: xorg-server upgraded: 21.1.13,1 -> 21.1.14,1 Dec 22 15:41:58 locaal pkg[42937]: postgresql16-client upgraded: 16.4 -> 16.6
2024-11-16: ada0p2 - rust - another hidapi example
tingo@locaal:~/work/rm750/hidapitest $ sudo target/debug/examples/dump_descriptors Printing all available hid devices: HP USB Optical Mouse (Interface 0): [5, 1, 9, 2, 161, 1, 9, 1, 161, 0, 5, 9, 25, 1, 41, 3, 21, 0, 37, 1, 149, 8, 117, 1, 129, 2, 5, 1, 9, 48, 9, 49, 9, 56, 21, 129, 37, 127, 117, 8, 149, 3, 129, 6, 192, 192] HP Elite USB Keyboard (Interface 0): [5, 1, 9, 6, 161, 1, 5, 7, 25, 224, 41, 231, 21, 0, 37, 1, 149, 8, 117, 1, 129, 2, 149, 1, 117, 8, 129, 1, 5, 8, 25, 1, 41, 3, 149, 3, 117, 1, 145, 2, 149, 5, 117, 1, 145, 1, 5, 7, 25, 0, 42, 255, 0, 21, 0, 38, 255, 0, 149, 6, 117, 8, 129, 0, 192] HP Elite USB Keyboard (Interface 1): [5, 1, 9, 128, 161, 1, 133, 1, 25, 129, 41, 131, 21, 0, 37, 1, 117, 1, 149, 3, 129, 2, 149, 5, 129, 1, 192, 5, 12, 9, 1, 161, 1, 133, 2, 21, 0, 38, 255, 2, 25, 0, 42, 255, 2, 117, 16, 149, 1, 129, 0, 192] RM-Series C-Link Adapter (Interface 0): [6, 0, 255, 9, 1, 161, 1, 117, 8, 21, 0, 38, 255, 0, 149, 8, 9, 1, 129, 2, 149, 8, 9, 2, 145, 2, 192]
2024-11-14: ada0p2 - rust - hidapi example
tingo@locaal:~/work/rm750/hidapitest $ sudo cargo run --example lshid Compiling hidapitest v0.1.0 (/usr/home/tingo/work/rm750/hidapitest) Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.13s Running `target/debug/examples/lshid` Printing all available hid devices: VID: 0461, PID: 4e8d, Serial: <COULD NOT FETCH>, Product name: HP USB Optical Mouse, Interface: 0 VID: 03f0, PID: 034a, Serial: <COULD NOT FETCH>, Product name: HP Elite USB Keyboard, Interface: 0 VID: 03f0, PID: 034a, Serial: <COULD NOT FETCH>, Product name: HP Elite USB Keyboard, Interface: 1 VID: 1b1c, PID: 0c06, Serial: <COULD NOT FETCH>, Product name: RM-Series C-Link Adapter, Interface: 0
so that part works.
2024-11-14: ada0p2 - devd - set up a config file for the Corsair C-Link interface
root@locaal:~ # cat /usr/local/etc/devd/corsairlink.conf # allow non-root users to have access to the Corsair C-Link interface # # notify 100 { match "system" "USB"; match "subsystem" "DEVICE"; match "type" "ATTACH"; match "vendor" "0x1b1c"; match "product" "0x0c06"; # Please uncomment the line below and change the group name to suit # your own needs. action "chgrp operator /dev/$cdev && chmod 660 /dev/$cdev"; };
and restart the devd service
root@locaal:~ # service devd restart Stopping devd. Waiting for PIDS: 664. Starting devd.
2024-11-14: ada0p2 - rust - create the new rmc package
tingo@locaal:~/work/rm750 $ cargo new rmc --bin Creating binary (application) `rmc` package note: see more `Cargo.toml` keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html
2024-11-14: ada0p2 - rust - install rust via rustup
tingo@locaal:~ $ curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh [..] Welcome to Rust! This will download and install the official compiler for the Rust programming language, and its package manager, Cargo. Rustup metadata and toolchains will be installed into the Rustup home directory, located at: /home/tingo/.rustup This can be modified with the RUSTUP_HOME environment variable. The Cargo home directory is located at: /home/tingo/.cargo This can be modified with the CARGO_HOME environment variable. The cargo, rustc, rustup and other commands will be added to Cargo's bin directory, located at: /home/tingo/.cargo/bin This path will then be added to your PATH environment variable by modifying the profile file located at: /home/tingo/.profile You can uninstall at any time with rustup self uninstall and these changes will be reverted. Current installation options: default host triple: x86_64-unknown-freebsd default toolchain: stable (default) profile: default modify PATH variable: yes 1) Proceed with standard installation (default - just press enter) 2) Customize installation 3) Cancel installation >1 [..] info: default toolchain set to 'stable-x86_64-unknown-freebsd' stable-x86_64-unknown-freebsd installed - rustc 1.82.0 (f6e511eec 2024-10-15) Rust is installed now. Great! To get started you may need to restart your current shell. This would reload your PATH environment variable to include Cargo's bin directory ($HOME/.cargo/bin). To configure your current shell, you need to source the corresponding env file under $HOME/.cargo. This is usually done by running one of the following (note the leading DOT): . "$HOME/.cargo/env" # For sh/bash/zsh/ash/dash/pdksh source "$HOME/.cargo/env.fish" # For fish
do that.
tingo@locaal:~ $ . ~/.cargo/env tingo@locaal:~ $ which cargo /home/tingo/.cargo/bin/cargo
good.
2024-11-14: ada0p2 - Corsair RM-750 and usbhidctl output
root@locaal:~ # dmesg | grep uhid uhid0 on uhub1 uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0 uhid1 on uhub0 uhid1: <Chicony HP Elite USB Keyboard, class 0/0, rev 1.10/1.21, addr 2> on usbus1 uhid1: detached uhid0: detached uhid0 on uhub1 uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0 uhid1 on uhub0 uhid1: <Chicony HP Elite USB Keyboard, class 0/0, rev 1.10/1.21, addr 2> on usbus1
usbconfig
root@locaal:~ # usbconfig ugen1.1: <AMD XHCI root HUB> at usbus1, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA) ugen0.1: <AMD XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA) ugen1.2: <PixArt HP USB Optical Mouse> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA) ugen1.3: <Chicony HP Elite USB Keyboard> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA) ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA)
usbhidctl output
root@locaal:~ # usbhidctl -f uhid0 -a Microsoft:0x0001.Microsoft:0x0001=6 Microsoft:0x0001.Microsoft:0x0001=173 Microsoft:0x0001.Microsoft:0x0001=0 Microsoft:0x0001.Microsoft:0x0001=0 Microsoft:0x0001.Microsoft:0x0001=166 Microsoft:0x0001.Microsoft:0x0001=132 Microsoft:0x0001.Microsoft:0x0001=0 Microsoft:0x0001.Microsoft:0x0001=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0 Microsoft:0x0001.Microsoft:0x0002=0
2024-11-09: ada0p2 - pkg - install py311-pytorch py311-pytorch-lightning py311-torchvision py311-torchaudio
Nov 9 02:11:20 locaal pkg[38579]: libgpg-error-1.50 installed Nov 9 02:11:20 locaal pkg[38579]: libtasn1-4.19.0_1 installed Nov 9 02:11:20 locaal pkg[38579]: libassuan-3.0.1 installed Nov 9 02:11:20 locaal pkg[38579]: nettle-3.10_1 installed Nov 9 02:11:20 locaal pkg[38579]: pinentry-curses-1.3.1 installed Nov 9 02:11:20 locaal pkg[38579]: p11-kit-0.25.5 installed Nov 9 02:11:20 locaal pkg[38579]: libksba-1.6.7 installed Nov 9 02:11:21 locaal pkg[38579]: gnutls-3.8.7.1 installed Nov 9 02:11:21 locaal pkg[38579]: pinentry-1.3.1 installed Nov 9 02:11:21 locaal pkg[38579]: npth-1.7 installed Nov 9 02:11:21 locaal pkg[38579]: libgcrypt-1.11.0 installed Nov 9 02:11:21 locaal pkg[38579]: sqlite3-3.46.1,1 installed Nov 9 02:11:21 locaal pkg[38579]: libfmt-10.2.1 installed Nov 9 02:11:21 locaal pkg[38579]: gnupg-2.4.5_1 installed Nov 9 02:11:22 locaal pkg[38579]: icu-74.2_1,1 installed Nov 9 02:11:22 locaal pkg[38579]: libcjson-1.7.18_2 installed Nov 9 02:11:22 locaal pkg[38579]: gpgme-1.23.2_1 installed Nov 9 02:11:22 locaal pkg[38579]: libdatrie-0.2.13_2 installed Nov 9 02:11:22 locaal pkg[38579]: minizip-1.3.1 installed Nov 9 02:11:22 locaal pkg[38579]: libpaper-1.1.28_1 installed Nov 9 02:11:22 locaal pkg[38579]: libaec-1.1.3 installed Nov 9 02:11:22 locaal pkg[38579]: nspr-4.36 installed Nov 9 02:11:23 locaal pkg[38579]: geos-3.13.0 installed Nov 9 02:11:23 locaal pkg[38579]: spdlog-1.14.1 installed Nov 9 02:11:23 locaal pkg[38579]: nss-3.106 installed Nov 9 02:11:23 locaal pkg[38579]: libthai-0.1.29_1 installed Nov 9 02:11:23 locaal pkg[38579]: psutils-1.17_6 installed Nov 9 02:11:24 locaal pkg[38579]: py311-pytz-2024.2,1 installed Nov 9 02:11:24 locaal pkg[38579]: cairo-1.17.4_2,3 installed Nov 9 02:11:24 locaal pkg[38579]: poppler-data-0.4.12 installed Nov 9 02:11:24 locaal pkg[38579]: gpgme-cpp-1.23.2_1 installed Nov 9 02:11:24 locaal pkg[38579]: librttopo-1.1.0 installed Nov 9 02:11:24 locaal pkg[38579]: libxslt-1.1.37_1 installed Nov 9 02:11:25 locaal pkg[38579]: hdf5-1.12.2_2,1 installed Nov 9 02:11:35 locaal pkg[38579]: boost-libs-1.85.0 installed Nov 9 02:11:35 locaal pkg[38579]: py311-appdirs-1.4.4_1 installed Nov 9 02:11:35 locaal pkg[38579]: libcbor-0.11.0 installed Nov 9 02:11:35 locaal pkg[38579]: freexl-2.0.0 installed Nov 9 02:11:35 locaal pkg[38579]: proj-9.4.1,1 installed Nov 9 02:11:35 locaal pkg[38579]: pkgconf-2.3.0,1 installed Nov 9 02:11:35 locaal pkg[38579]: uriparser-0.9.6 installed Nov 9 02:11:35 locaal pkg[38579]: uchardet-0.0.8_1 installed Nov 9 02:11:35 locaal pkg[38579]: level-zero-1.17.45 installed Nov 9 02:11:35 locaal pkg[38579]: cyrus-sasl-2.1.28_5 installed Nov 9 02:11:36 locaal pkg[38579]: qhull-8.0.2_3,1 installed Nov 9 02:11:36 locaal pkg[38579]: groff-1.23.0_3 installed Nov 9 02:11:36 locaal pkg[38579]: libgd-2.3.3_13,1 installed Nov 9 02:11:36 locaal pkg[38579]: libgeotiff-1.7.3_1 installed Nov 9 02:11:36 locaal pkg[38579]: py311-fs2-2.4.16 installed Nov 9 02:11:36 locaal pkg[38579]: py311-brotli-1.1.0 installed Nov 9 02:11:37 locaal pkg[38579]: hwloc2-2.11.2 installed Nov 9 02:11:37 locaal pkg[38579]: py311-lxml-4.9.3 installed Nov 9 02:11:37 locaal pkg[38579]: poppler-24.02.0_1 installed Nov 9 02:11:37 locaal pkg[38579]: py311-zopfli-0.2.3 installed Nov 9 02:11:37 locaal pkg[38579]: libltdl-2.4.7 installed Nov 9 02:11:38 locaal pkg[38579]: spatialite-5.1.0_2 installed Nov 9 02:11:38 locaal pkg[38579]: json-c-0.18 installed Nov 9 02:11:38 locaal pkg[38579]: netcdf-4.9.2_1 installed Nov 9 02:11:38 locaal pkg[38579]: py311-unicodedata2-15.1.0_1 installed Nov 9 02:11:38 locaal pkg[38579]: libfido2-1.15.0 installed Nov 9 02:11:39 locaal pkg[38579]: pango-1.52.2_1 installed Nov 9 02:11:39 locaal pkg[38579]: jansson-2.14 installed Nov 9 02:11:39 locaal pkg[38579]: xerces-c3-3.2.5 installed Nov 9 02:11:39 locaal pkg[38579]: libkml-1.3.0_27 installed Nov 9 02:11:40 locaal pkg[38579]: postgresql16-client-16.4 installed Nov 9 02:11:41 locaal pkg[38579]: openldap26-client-2.6.8 installed Nov 9 02:11:41 locaal pkg[38579]: sfcgal-1.5.2_1 installed Nov 9 02:11:41 locaal pkg[38579]: py311-python-dateutil-2.9.0 installed Nov 9 02:11:41 locaal pkg[38579]: lua54-5.4.7 installed Nov 9 02:11:41 locaal pkg[38579]: onetbb-2021.13.0 installed Nov 9 02:11:41 locaal pkg[38579]: librdkafka-2.3.0 installed Nov 9 02:11:41 locaal pkg[38579]: py311-tornado-6.4 installed Nov 9 02:11:42 locaal pkg[38579]: graphviz-12.0.0 installed Nov 9 02:11:42 locaal pkg[38579]: py311-kiwisolver-1.4.5,1 installed Nov 9 02:11:42 locaal pkg[38579]: py311-contourpy-1.3.0 installed Nov 9 02:11:42 locaal pkg[38579]: libsysinfo-0.0.3_3 installed Nov 9 02:11:42 locaal pkg[38579]: py311-pyparsing-3.1.4 installed Nov 9 02:11:42 locaal pkg[38579]: libjwt-1.17.2 installed Nov 9 02:11:42 locaal pkg[38579]: py311-sqlite3-3.11.10_7 installed Nov 9 02:11:42 locaal pkg[38579]: py311-bottleneck-1.3.8_1 installed Nov 9 02:11:42 locaal pkg[38579]: py311-pluggy-1.5.0 installed Nov 9 02:11:42 locaal pkg[38579]: libyaml-0.2.5 installed Nov 9 02:11:42 locaal pkg[38579]: munge-0.5.16 installed Nov 9 02:11:43 locaal pkg[38579]: py311-fonttools-4.51.0 installed Nov 9 02:11:43 locaal pkg[38579]: py311-cycler-0.12.1 installed Nov 9 02:11:43 locaal pkg[38579]: gdal-3.9.2_1 installed Nov 9 02:11:43 locaal pkg[38579]: check-0.15.2_1 installed Nov 9 02:11:44 locaal pkg[38579]: py311-tzdata-2024.2 installed Nov 9 02:11:44 locaal pkg[38579]: mysql80-client-8.0.39 installed Nov 9 02:11:44 locaal pkg[38579]: py311-numexpr-2.10.1 installed Nov 9 02:11:44 locaal pkg[38579]: py311-importlib-resources-6.4.5 installed Nov 9 02:11:44 locaal pkg[38579]: py311-gmpy2-2.2.1 installed Nov 9 02:11:45 locaal pkg[38579]: slurm-wlm-23.11.7_3 installed Nov 9 02:11:45 locaal pkg[38579]: py311-markupsafe-2.1.5_1 installed Nov 9 02:11:46 locaal pkg[38579]: py311-matplotlib-3.8.0_1 installed Nov 9 02:11:46 locaal pkg[38579]: py311-pydot-3.0.2 installed Nov 9 02:11:47 locaal pkg[38579]: py311-Babel-2.16.0 installed Nov 9 02:11:47 locaal pkg[38579]: py311-gdal-3.9.2 installed Nov 9 02:11:48 locaal pkg[38579]: protobuf-28.2,1 installed Nov 9 02:11:48 locaal pkg[38579]: py311-mpmath-1.3.0_1 installed Nov 9 02:11:51 locaal pkg[38579]: py311-pandas-2.0.3_2,1 installed Nov 9 02:11:51 locaal pkg[38579]: py311-scikit-sparse-0.4.8_9 installed Nov 9 02:11:51 locaal pkg[38579]: py311-pyyaml-6.0.1 installed Nov 9 02:11:51 locaal pkg[38579]: py311-pysocks-1.7.1_1 installed Nov 9 02:11:51 locaal pkg[38579]: py311-pygraphviz-1.6 installed Nov 9 02:11:52 locaal pkg[38579]: py311-dill-0.3.9 installed Nov 9 02:11:55 locaal pkg[38579]: py311-sympy-1.11.1_2 installed Nov 9 02:11:55 locaal pkg[38579]: pthreadpool-0.1.126 installed Nov 9 02:11:55 locaal pkg[38579]: blis-0.9.0_2 installed Nov 9 02:11:55 locaal pkg[38579]: py311-typing-extensions-4.12.2 installed Nov 9 02:11:55 locaal pkg[38579]: py311-Jinja2-3.1.4 installed Nov 9 02:11:56 locaal pkg[38579]: py311-networkx-3.3_1,2 installed Nov 9 02:11:57 locaal pkg[38579]: py311-filelock-3.16.1 installed Nov 9 02:11:57 locaal pkg[38579]: py311-charset-normalizer-3.3.2_1 installed Nov 9 02:11:57 locaal pkg[38579]: sleef-3.5.1.62 installed Nov 9 02:11:57 locaal pkg[38579]: openmpi4-4.1.6_1 installed Nov 9 02:11:57 locaal pkg[38579]: py311-urllib3-1.26.20,1 installed Nov 9 02:11:57 locaal pkg[38579]: onnx-1.16.2_5 installed Nov 9 02:11:58 locaal pkg[38579]: py311-joblib-1.3.2_1 installed Nov 9 02:12:18 locaal pkg[38579]: py311-pytorch-2.4.1_1 installed Nov 9 02:12:18 locaal pkg[38579]: py311-mypy_extensions-1.0.0 installed Nov 9 02:12:18 locaal pkg[38579]: py311-psutil-6.0.0 installed Nov 9 02:12:18 locaal pkg[38579]: py311-click-8.1.7 installed Nov 9 02:12:18 locaal pkg[38579]: py311-requests-2.32.3 installed Nov 9 02:12:19 locaal pkg[38579]: py311-regex-2024.7.24 installed Nov 9 02:12:19 locaal pkg[38579]: py311-tqdm-4.66.5 installed Nov 9 02:12:19 locaal pkg[38579]: py311-types-setuptools-75.1.0.20240917 installed Nov 9 02:12:21 locaal pkg[38579]: py311-nltk-3.8.1,2 installed Nov 9 02:12:24 locaal pkg[38579]: py311-mypy-1.11.2 installed Nov 9 02:12:25 locaal pkg[38579]: py311-torchvision-0.19.1 installed Nov 9 02:12:25 locaal pkg[38579]: py311-lightning-utilities-0.11.2 installed Nov 9 02:12:25 locaal pkg[38579]: py311-fsspec-2024.9.0 installed Nov 9 02:12:26 locaal pkg[38579]: py311-torchmetrics-0.11.4 installed Nov 9 02:12:27 locaal pkg[38579]: py311-torchaudio-2.2.1_5 installed Nov 9 02:12:28 locaal pkg[38579]: py311-pytorch-lightning-2.3.3 installed
2024-11-09: ada0p2 - setting up Fooocus
tingo@locaal:~/work/ai/Fooocus $ . fooocus_env/bin/activate (fooocus_env) tingo@locaal:~/work/ai/Fooocus $ which python /usr/home/tingo/work/ai/Fooocus/fooocus_env/bin/python
then
(fooocus_env) tingo@locaal:~/work/ai/Fooocus $ pip install -r requirements_versions.txt Collecting torchsde==0.2.6 (from -r requirements_versions.txt (line 1)) Using cached torchsde-0.2.6-py3-none-any.whl.metadata (5.3 kB) Collecting einops==0.8.0 (from -r requirements_versions.txt (line 2)) Using cached einops-0.8.0-py3-none-any.whl.metadata (12 kB) Collecting transformers==4.42.4 (from -r requirements_versions.txt (line 3)) Using cached transformers-4.42.4-py3-none-any.whl.metadata (43 kB) Collecting safetensors==0.4.3 (from -r requirements_versions.txt (line 4)) Using cached safetensors-0.4.3.tar.gz (69 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting accelerate==0.32.1 (from -r requirements_versions.txt (line 5)) Using cached accelerate-0.32.1-py3-none-any.whl.metadata (18 kB) Collecting pyyaml==6.0.1 (from -r requirements_versions.txt (line 6)) Using cached PyYAML-6.0.1.tar.gz (125 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pillow==10.4.0 (from -r requirements_versions.txt (line 7)) Using cached pillow-10.4.0.tar.gz (46.6 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting scipy==1.14.0 (from -r requirements_versions.txt (line 8)) Using cached scipy-1.14.0.tar.gz (58.6 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Installing backend dependencies ... done Preparing metadata (pyproject.toml) ... error error: subprocess-exited-with-error × Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [54 lines of output] + meson setup /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy/meson-python-native-file.ini The Meson build system Version: 1.6.0 Source dir: /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d Build dir: /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy Build type: native build Project name: scipy Project version: 1.14.0 C compiler for the host machine: cc (clang 18.1.6 "FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)") C linker for the host machine: cc ld.lld 18.1.6 C++ compiler for the host machine: c++ (clang 18.1.6 "FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)") C++ linker for the host machine: c++ ld.lld 18.1.6 Cython compiler for the host machine: cython (cython 3.0.11) Host machine cpu family: x86_64 Host machine cpu: x86_64 Program python found: YES (/usr/home/tingo/work/ai/Fooocus/fooocus_env/bin/python3.11) Did not find pkg-config by name 'pkg-config' Found pkg-config: NO Run-time dependency python found: YES 3.11 Program cython found: YES (/tmp/pip-build-env-naiwqvsl/overlay/bin/cython) Compiler for C supports arguments -Wno-unused-but-set-variable: YES Compiler for C supports arguments -Wno-unused-function: YES Compiler for C supports arguments -Wno-conversion: YES Compiler for C supports arguments -Wno-misleading-indentation: YES Library m found: YES ../meson.build:84:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']] The following exception(s) were encountered: Running `gfortran --help` gave "[Errno 2] No such file or directory: 'gfortran'" Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'" Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'" Running `flang-new --help` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang-new --version` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang-new -V` gave "[Errno 2] No such file or directory: 'flang-new'" Running `flang --help` gave "[Errno 2] No such file or directory: 'flang'" Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'" Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'" Running `nvfortran --help` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'" Running `pgfortran --help` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'" Running `ifort --help` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'" Running `ifx --help` gave "[Errno 2] No such file or directory: 'ifx'" Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'" Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'" Running `g95 --help` gave "[Errno 2] No such file or directory: 'g95'" Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'" Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'" A full log can be found at /tmp/pip-install-tmw7r43_/scipy_ad8791c869ec487d8ddf8ed16cfbad6d/.mesonpy-icxwjxsy/meson-logs/meson-log.txt [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. [notice] A new release of pip is available: 24.0 -> 24.3.1 [notice] To update, run: pip install --upgrade pip
fix up gfortran
root@locaal:~ # ln -s /usr/local/bin/gfortran13 /usr/local/bin/gfortran
retry
(fooocus_env) tingo@locaal:~/work/ai/Fooocus $ pip install -r requirements_versions.txt Collecting torchsde==0.2.6 (from -r requirements_versions.txt (line 1)) Using cached torchsde-0.2.6-py3-none-any.whl.metadata (5.3 kB) Collecting einops==0.8.0 (from -r requirements_versions.txt (line 2)) Using cached einops-0.8.0-py3-none-any.whl.metadata (12 kB) Collecting transformers==4.42.4 (from -r requirements_versions.txt (line 3)) Using cached transformers-4.42.4-py3-none-any.whl.metadata (43 kB) Collecting safetensors==0.4.3 (from -r requirements_versions.txt (line 4)) Using cached safetensors-0.4.3.tar.gz (69 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting accelerate==0.32.1 (from -r requirements_versions.txt (line 5)) Using cached accelerate-0.32.1-py3-none-any.whl.metadata (18 kB) Collecting pyyaml==6.0.1 (from -r requirements_versions.txt (line 6)) Using cached PyYAML-6.0.1.tar.gz (125 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pillow==10.4.0 (from -r requirements_versions.txt (line 7)) Using cached pillow-10.4.0.tar.gz (46.6 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting scipy==1.14.0 (from -r requirements_versions.txt (line 8)) Using cached scipy-1.14.0.tar.gz (58.6 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Installing backend dependencies ... done Preparing metadata (pyproject.toml) ... done Collecting tqdm==4.66.4 (from -r requirements_versions.txt (line 9)) Downloading tqdm-4.66.4-py3-none-any.whl.metadata (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 5.6 MB/s eta 0:00:00 Collecting psutil==6.0.0 (from -r requirements_versions.txt (line 10)) Downloading psutil-6.0.0.tar.gz (508 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 508.1/508.1 kB 14.3 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pytorch_lightning==2.3.3 (from -r requirements_versions.txt (line 11)) Downloading pytorch_lightning-2.3.3-py3-none-any.whl.metadata (21 kB) Collecting omegaconf==2.3.0 (from -r requirements_versions.txt (line 12)) Downloading omegaconf-2.3.0-py3-none-any.whl.metadata (3.9 kB) Collecting gradio==3.41.2 (from -r requirements_versions.txt (line 13)) Downloading gradio-3.41.2-py3-none-any.whl.metadata (17 kB) Collecting pygit2==1.15.1 (from -r requirements_versions.txt (line 14)) Downloading pygit2-1.15.1.tar.gz (768 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 768.8/768.8 kB 41.8 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Installing backend dependencies ... done Preparing metadata (pyproject.toml) ... done Collecting opencv-contrib-python-headless==4.10.0.84 (from -r requirements_versions.txt (line 15)) Downloading opencv-contrib-python-headless-4.10.0.84.tar.gz (150.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.5/150.5 MB 5.1 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting httpx==0.27.0 (from -r requirements_versions.txt (line 16)) Downloading httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB) ERROR: Ignored the following versions that require a different python version: 1.6.2 Requires-Python >=3.7,<3.10; 1.6.3 Requires-Python >=3.7,<3.10; 1.7.0 Requires-Python >=3.7,<3.10; 1.7.1 Requires-Python >=3.7,<3.10; 1.7.2 Requires-Python >=3.7,<3.11; 1.7.3 Requires-Python >=3.7,<3.11; 1.8.0 Requires-Python >=3.8,<3.11; 1.8.0rc1 Requires-Python >=3.8,<3.11; 1.8.0rc2 Requires-Python >=3.8,<3.11; 1.8.0rc3 Requires-Python >=3.8,<3.11; 1.8.0rc4 Requires-Python >=3.8,<3.11; 1.8.1 Requires-Python >=3.8,<3.11 ERROR: Could not find a version that satisfies the requirement onnxruntime==1.18.1 (from versions: none) ERROR: No matching distribution found for onnxruntime==1.18.1 [notice] A new release of pip is available: 24.0 -> 24.3.1 [notice] To update, run: pip install --upgrade pip
2024-11-09: ada0p2 - pkg - install some things
Nov 9 00:09:10 locaal pkg[1323]: py311-maturin-1.7.4 installed Nov 9 00:15:08 locaal pkg[1357]: rust-1.81.0 installed Nov 9 00:21:18 locaal pkg[1763]: libuv-1.49.0 installed Nov 9 00:21:18 locaal pkg[1763]: jsoncpp-1.9.6_1 installed Nov 9 00:21:18 locaal pkg[1763]: rhash-1.4.4_1 installed Nov 9 00:21:23 locaal pkg[1763]: cmake-core-3.30.5 installed Nov 9 00:28:34 locaal pkg[3922]: gmp-6.3.0 installed Nov 9 00:28:34 locaal pkg[3922]: mpfr-4.2.1,1 installed Nov 9 00:28:34 locaal pkg[3922]: mpc-1.3.1_1 installed Nov 9 00:28:38 locaal pkg[3922]: binutils-2.43.1,1 installed Nov 9 00:28:44 locaal pkg[3922]: gcc13-13.3.0 installed Nov 9 00:28:44 locaal pkg[3922]: openblas-0.3.27,2 installed Nov 9 00:28:44 locaal pkg[3922]: suitesparse-config-7.7.0_1 installed Nov 9 00:28:44 locaal pkg[3922]: suitesparse-ccolamd-3.3.3 installed Nov 9 00:28:44 locaal pkg[3922]: suitesparse-amd-3.3.2 installed Nov 9 00:28:45 locaal pkg[3922]: suitesparse-camd-3.3.2 installed Nov 9 00:28:45 locaal pkg[3922]: suitesparse-colamd-3.3.3 installed Nov 9 00:28:45 locaal pkg[3922]: suitesparse-cholmod-5.2.1_1 installed Nov 9 00:28:45 locaal pkg[3922]: suitesparse-umfpack-6.3.3_1 installed Nov 9 00:28:48 locaal pkg[3922]: py311-numpy-1.26.4_2,1 installed Nov 9 00:28:48 locaal pkg[3922]: blas-3.12.0_1 installed Nov 9 00:28:55 locaal pkg[3922]: py311-scipy-1.11.1_1,1 installed Nov 9 00:47:56 locaal pkg[13687]: py311-idna-3.10 installed Nov 9 00:47:57 locaal pkg[13687]: py311-hpack-4.0.0 installed Nov 9 00:47:57 locaal pkg[13687]: py311-sniffio-1.3.1 installed Nov 9 00:47:57 locaal pkg[13687]: py311-hyperframe-6.0.0 installed Nov 9 00:47:57 locaal pkg[13687]: py311-anyio-4.6.0 installed Nov 9 00:47:57 locaal pkg[13687]: py311-certifi-2024.8.30 installed Nov 9 00:47:57 locaal pkg[13687]: py311-h2-4.1.0 installed Nov 9 00:47:57 locaal pkg[13687]: py311-h11-0.14.0 installed Nov 9 00:47:57 locaal pkg[13687]: py311-httpcore-1.0.5 installed Nov 9 00:47:57 locaal pkg[13687]: py311-socksio-1.0.0_1 installed Nov 9 00:47:57 locaal pkg[13687]: py311-httpx-0.27.2 installed Nov 9 00:54:57 locaal pkg[16615]: abseil-20240722.0 installed Nov 9 00:54:58 locaal pkg[16615]: onnxruntime-1.18.2_1 installed Nov 9 01:20:04 locaal pkg[26201]: ninja-1.11.1,4 installed
2024-11-08: ada0p2 - reboot, FreeBSD 13.4-release-p2 is in
root@locaal:~ # freebsd-version -ku 13.4-RELEASE-p1 13.4-RELEASE-p2
kernel
root@locaal:~ # uname -a FreeBSD locaal 13.4-RELEASE-p1 FreeBSD 13.4-RELEASE-p1 GENERIC amd64
2024-11-08: ada0p2 - freebsd-update fetch
root@locaal:~ # freebsd-update fetch src component not installed, skipped [..] The following files will be updated as part of updating to 13.4-RELEASE-p2: /bin/freebsd-version /boot/kernel/ctl.ko /boot/kernel/kernel /lib/libnv.so.0 /rescue/[ /rescue/bectl /rescue/bsdlabel /rescue/bunzip2 /rescue/bzcat /rescue/bzip2 /rescue/camcontrol /rescue/cat /rescue/ccdconfig /rescue/chflags /rescue/chgrp /rescue/chio /rescue/chmod /rescue/chown /rescue/chroot /rescue/clri /rescue/cp /rescue/csh /rescue/date /rescue/dd /rescue/devfs /rescue/df /rescue/dhclient /rescue/disklabel /rescue/dmesg /rescue/dump /rescue/dumpfs /rescue/dumpon /rescue/echo /rescue/ed /rescue/ex /rescue/expr /rescue/fastboot /rescue/fasthalt /rescue/fdisk /rescue/fetch /rescue/fsck /rescue/fsck_4.2bsd /rescue/fsck_ffs /rescue/fsck_msdosfs /rescue/fsck_ufs /rescue/fsdb /rescue/fsirand /rescue/gbde /rescue/geom /rescue/getfacl /rescue/glabel /rescue/gpart /rescue/groups /rescue/gunzip /rescue/gzcat /rescue/gzip /rescue/halt /rescue/head /rescue/hostname /rescue/id /rescue/ifconfig /rescue/init /rescue/ipf /rescue/iscsictl /rescue/iscsid /rescue/kenv /rescue/kill /rescue/kldconfig /rescue/kldload /rescue/kldstat /rescue/kldunload /rescue/ldconfig /rescue/less /rescue/link /rescue/ln /rescue/ls /rescue/lzcat /rescue/lzma /rescue/md5 /rescue/mdconfig /rescue/mdmfs /rescue/mkdir /rescue/mknod /rescue/more /rescue/mount /rescue/mount_cd9660 /rescue/mount_msdosfs /rescue/mount_nfs /rescue/mount_nullfs /rescue/mount_udf /rescue/mount_unionfs /rescue/mt /rescue/mv /rescue/nc /rescue/newfs /rescue/newfs_msdos /rescue/nos-tun /rescue/pgrep /rescue/ping /rescue/ping6 /rescue/pkill /rescue/poweroff /rescue/ps /rescue/pwd /rescue/rcorder /rescue/rdump /rescue/realpath /rescue/reboot /rescue/red /rescue/rescue /rescue/restore /rescue/rm /rescue/rmdir /rescue/route /rescue/routed /rescue/rrestore /rescue/rtquery /rescue/rtsol /rescue/savecore /rescue/sed /rescue/setfacl /rescue/sh /rescue/shutdown /rescue/sleep /rescue/spppcontrol /rescue/stty /rescue/swapon /rescue/sync /rescue/sysctl /rescue/tail /rescue/tar /rescue/tcsh /rescue/tee /rescue/test /rescue/tunefs /rescue/umount /rescue/unlink /rescue/unlzma /rescue/unxz /rescue/unzstd /rescue/vi /rescue/whoami /rescue/xz /rescue/xzcat /rescue/zcat /rescue/zdb /rescue/zfs /rescue/zpool /rescue/zstd /rescue/zstdcat /rescue/zstdmt /usr/bin/fetch /usr/lib/libnv.a /usr/lib/libnv_p.a /usr/lib32/libnv.a /usr/lib32/libnv.so.0 /usr/lib32/libnv_p.a /usr/sbin/bhyve
install
root@locaal:~ # freebsd-update install src component not installed, skipped Installing updates... Restarting sshd after upgrade Performing sanity check on sshd configuration. Stopping sshd. Waiting for PIDS: 1054. Performing sanity check on sshd configuration. Starting sshd. Scanning //usr/share/certs/blacklisted for certificates... Scanning //usr/share/certs/trusted for certificates... done.
2024-11-08: ada0p2 - ollama - pull another model
tingo@locaal:~ $ ollama pull llama3.2:1b pulling manifest pulling 74701a8c35f6... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.3 GB pulling 966de95ca8a6... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.4 KB pulling fcc5a6bec9da... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 7.7 KB pulling a70ff7e570d9... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 6.0 KB pulling 4f659a1e86d7... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 485 B verifying sha256 digest writing manifest removing any unused layers success
show what we have
tingo@locaal:~ $ ollama list NAME ID SIZE MODIFIED llama3.2:1b baf6a787fdff 1.3 GB 30 seconds ago mistral:latest f974a74358d6 4.1 GB 17 minutes ago
try to run it
tingo@locaal:~ $ ollama run llama3.2:1b Error: Post "http://127.0.0.1:11434/api/chat": EOF
try again
tingo@locaal:~ $ ollama run llama3.2:1b >>> /set verbose Set 'verbose' mode.
that worked. Do a query
>>> why is the sky blue The sky appears blue to us because of a phenomenon called Rayleigh scattering, named after the British physicist Lord Rayleigh. He discovered that when sunlight enters Earth's atmosphere, it encounters tiny molecules of gases such as nitrogen and oxygen. These molecules scatter the light in all directions, but they scatter shorter (blue) wavelengths more than longer (red) wavelengths. This is because the smaller molecules are more effective at scattering the blue light. As a result, the blue light is distributed throughout the atmosphere, giving the sky its blue color. The amount of scattering that occurs depends on the altitude and density of the atmospheric gases. At sea level, where most people live, the sky appears blue due to Rayleigh scattering from the ground and higher altitudes. However, as you go higher into the atmosphere, the concentration of molecules decreases, and the shorter wavelengths (like blue and violet) are not scattered as much, which is why the sky appears more red or orange at higher altitudes. total duration: 3.16908962s load duration: 60.885314ms prompt eval count: 30 token(s) prompt eval duration: 316.333ms prompt eval rate: 94.84 tokens/s eval count: 198 token(s) eval duration: 2.74121s eval rate: 72.23 tokens/s
2024-11-08: ada0p2 - ollama - in the second terminal, I run the mistral model
tingo@locaal:~ $ ollama run mistral pulling manifest pulling ff82381e2bea... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 4.1 GB pulling 43070e2d4e53... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 11 KB pulling 491dfa501e59... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 801 B pulling ed11eda7790d... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 30 B pulling 42347cd80dc8... 100% ▕█████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 485 B verifying sha256 digest writing manifest removing any unused layers success Error: Post "http://127.0.0.1:11434/api/chat": EOF
ok, it didn't like that. In the first terminal, a lot happened
[GIN] 2024/11/08 - 21:31:57 | 200 | 34.56µs | 127.0.0.1 | HEAD "/" [GIN] 2024/11/08 - 21:31:57 | 404 | 171.688µs | 127.0.0.1 | POST "/api/show" time=2024-11-08T21:31:59.104+01:00 level=INFO source=download.go:175 msg="downloading ff82381e2bea in 42 100 MB part(s)" time=2024-11-08T21:32:42.117+01:00 level=INFO source=download.go:175 msg="downloading 43070e2d4e53 in 1 11 KB part(s)" time=2024-11-08T21:32:44.213+01:00 level=INFO source=download.go:175 msg="downloading 491dfa501e59 in 1 801 B part(s)" time=2024-11-08T21:32:46.419+01:00 level=INFO source=download.go:175 msg="downloading ed11eda7790d in 1 30 B part(s)" time=2024-11-08T21:32:48.441+01:00 level=INFO source=download.go:175 msg="downloading 42347cd80dc8 in 1 485 B part(s)" [GIN] 2024/11/08 - 21:32:52 | 200 | 54.830670798s | 127.0.0.1 | POST "/api/pull" [GIN] 2024/11/08 - 21:32:52 | 200 | 6.039215ms | 127.0.0.1 | POST "/api/show" time=2024-11-08T21:32:53.395+01:00 level=DEBUG source=sched.go:181 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=0x1482cc0 gpu_count=1 time=2024-11-08T21:32:53.400+01:00 level=DEBUG source=sched.go:219 msg="loading first model" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:32:53.400+01:00 level=DEBUG source=memory.go:101 msg=evaluating library=vulkan gpu_count=1 available="[12.2 GiB]" time=2024-11-08T21:32:53.401+01:00 level=INFO source=sched.go:710 msg="new model will fit in available VRAM in single GPU, loading" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 gpu=0 parallel=1 available=13142851584 required="4.8 GiB" time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=gpu_bsd.go:111 msg=gpu_bsd.go::GetCPUMem::GetCPUMem total_memory=34242666496 free_memory=26264035328 free_swap=4069965824 time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=server.go:101 msg="system memory" total="31.9 GiB" free="24.5 GiB" free_swap="3.8 GiB" time=2024-11-08T21:32:53.401+01:00 level=DEBUG source=memory.go:101 msg=evaluating library=vulkan gpu_count=1 available="[12.2 GiB]" time=2024-11-08T21:32:53.402+01:00 level=INFO source=memory.go:309 msg="offload to vulkan" layers.requested=-1 layers.model=33 layers.offload=33 layers.split="" memory.available="[12.2 GiB]" memory.required.full="4.8 GiB" memory.required.partial="4.8 GiB" memory.required.kv="256.0 MiB" memory.required.allocations="[4.8 GiB]" memory.weights.total="3.9 GiB" memory.weights.repeating="3.8 GiB" memory.weights.nonrepeating="105.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="185.0 MiB" time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server time=2024-11-08T21:32:53.402+01:00 level=INFO source=server.go:393 msg="starting llama server" cmd="/tmp/ollama2644925853/runners/vulkan/ollama_llama_server --model /home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 --ctx-size 2048 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --verbose --parallel 1 --port 36729" time=2024-11-08T21:32:53.402+01:00 level=DEBUG source=server.go:410 msg=subprocess environment="[PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/home/tingo/bin LD_LIBRARY_PATH=/tmp/ollama2644925853/runners/vulkan:/tmp/ollama2644925853/runners]" time=2024-11-08T21:32:53.405+01:00 level=INFO source=sched.go:445 msg="loaded runners" count=1 time=2024-11-08T21:32:53.405+01:00 level=INFO source=server.go:593 msg="waiting for llama runner to start responding" time=2024-11-08T21:32:53.405+01:00 level=INFO source=server.go:627 msg="waiting for server to become available" status="llm server error" INFO [main] build info | build=0 commit="unknown" tid="0x827f86000" timestamp=1731097973 INFO [main] system info | n_threads=6 n_threads_batch=-1 system_info="AVX = 0 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 0 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | " tid="0x827f86000" timestamp=1731097973 total_threads=12 INFO [main] HTTP server listening | hostname="127.0.0.1" n_threads_http="11" port="36729" tid="0x827f86000" timestamp=1731097973 llama_model_loader: loaded meta data with 25 key-value pairs and 291 tensors from /home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = llama llama_model_loader: - kv 1: general.name str = Mistral-7B-Instruct-v0.3 llama_model_loader: - kv 2: llama.block_count u32 = 32 llama_model_loader: - kv 3: llama.context_length u32 = 32768 llama_model_loader: - kv 4: llama.embedding_length u32 = 4096 llama_model_loader: - kv 5: llama.feed_forward_length u32 = 14336 llama_model_loader: - kv 6: llama.attention.head_count u32 = 32 llama_model_loader: - kv 7: llama.attention.head_count_kv u32 = 8 llama_model_loader: - kv 8: llama.rope.freq_base f32 = 1000000.000000 llama_model_loader: - kv 9: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 llama_model_loader: - kv 10: general.file_type u32 = 2 llama_model_loader: - kv 11: llama.vocab_size u32 = 32768 llama_model_loader: - kv 12: llama.rope.dimension_count u32 = 128 llama_model_loader: - kv 13: tokenizer.ggml.model str = llama llama_model_loader: - kv 14: tokenizer.ggml.pre str = default llama_model_loader: - kv 15: tokenizer.ggml.tokens arr[str,32768] = ["<unk>", "<s>", "</s>", "[INST]", "[... llama_model_loader: - kv 16: tokenizer.ggml.scores arr[f32,32768] = [0.000000, 0.000000, 0.000000, 0.0000... llama_model_loader: - kv 17: tokenizer.ggml.token_type arr[i32,32768] = [2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ... llama_model_loader: - kv 18: tokenizer.ggml.bos_token_id u32 = 1 llama_model_loader: - kv 19: tokenizer.ggml.eos_token_id u32 = 2 llama_model_loader: - kv 20: tokenizer.ggml.unknown_token_id u32 = 0 llama_model_loader: - kv 21: tokenizer.ggml.add_bos_token bool = true llama_model_loader: - kv 22: tokenizer.ggml.add_eos_token bool = false llama_model_loader: - kv 23: tokenizer.chat_template str = {{ bos_token }}{% for message in mess... llama_model_loader: - kv 24: general.quantization_version u32 = 2 llama_model_loader: - type f32: 65 tensors llama_model_loader: - type q4_0: 225 tensors llama_model_loader: - type q6_K: 1 tensors llm_load_vocab: special tokens cache size = 771 llm_load_vocab: token to piece cache size = 0.1731 MB llm_load_print_meta: format = GGUF V3 (latest) llm_load_print_meta: arch = llama llm_load_print_meta: vocab type = SPM llm_load_print_meta: n_vocab = 32768 llm_load_print_meta: n_merges = 0 llm_load_print_meta: vocab_only = 0 llm_load_print_meta: n_ctx_train = 32768 llm_load_print_meta: n_embd = 4096 llm_load_print_meta: n_layer = 32 llm_load_print_meta: n_head = 32 llm_load_print_meta: n_head_kv = 8 llm_load_print_meta: n_rot = 128 llm_load_print_meta: n_swa = 0 llm_load_print_meta: n_embd_head_k = 128 llm_load_print_meta: n_embd_head_v = 128 llm_load_print_meta: n_gqa = 4 llm_load_print_meta: n_embd_k_gqa = 1024 llm_load_print_meta: n_embd_v_gqa = 1024 llm_load_print_meta: f_norm_eps = 0.0e+00 llm_load_print_meta: f_norm_rms_eps = 1.0e-05 llm_load_print_meta: f_clamp_kqv = 0.0e+00 llm_load_print_meta: f_max_alibi_bias = 0.0e+00 llm_load_print_meta: f_logit_scale = 0.0e+00 llm_load_print_meta: n_ff = 14336 llm_load_print_meta: n_expert = 0 llm_load_print_meta: n_expert_used = 0 llm_load_print_meta: causal attn = 1 llm_load_print_meta: pooling type = 0 llm_load_print_meta: rope type = 0 llm_load_print_meta: rope scaling = linear llm_load_print_meta: freq_base_train = 1000000.0 llm_load_print_meta: freq_scale_train = 1 llm_load_print_meta: n_ctx_orig_yarn = 32768 llm_load_print_meta: rope_finetuned = unknown llm_load_print_meta: ssm_d_conv = 0 llm_load_print_meta: ssm_d_inner = 0 llm_load_print_meta: ssm_d_state = 0 llm_load_print_meta: ssm_dt_rank = 0 llm_load_print_meta: model type = 7B llm_load_print_meta: model ftype = Q4_0 llm_load_print_meta: model params = 7.25 B llm_load_print_meta: model size = 3.83 GiB (4.54 BPW) llm_load_print_meta: general.name = Mistral-7B-Instruct-v0.3 llm_load_print_meta: BOS token = 1 '<s>' llm_load_print_meta: EOS token = 2 '</s>' llm_load_print_meta: UNK token = 0 '<unk>' llm_load_print_meta: LF token = 781 '<0x0A>' llm_load_print_meta: max token length = 48 time=2024-11-08T21:32:53.698+01:00 level=INFO source=server.go:627 msg="waiting for server to become available" status="llm server loading model" ggml_vulkan: Found 1 Vulkan devices: Vulkan0: NVIDIA GeForce RTX 3060 (NVIDIA) | uma: 0 | fp16: 1 | warp size: 32 llm_load_tensors: ggml ctx size = 0.27 MiB llm_load_tensors: offloading 32 repeating layers to GPU llm_load_tensors: offloading non-repeating layers to GPU llm_load_tensors: offloaded 33/33 layers to GPU llm_load_tensors: CPU buffer size = 72.00 MiB llm_load_tensors: NVIDIA GeForce RTX 3060 buffer size = 3850.02 MiB time=2024-11-08T21:33:26.724+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.02" time=2024-11-08T21:33:27.017+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.11" time=2024-11-08T21:33:27.310+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.24" time=2024-11-08T21:33:27.562+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.44" time=2024-11-08T21:33:27.855+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.60" time=2024-11-08T21:33:28.148+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.80" time=2024-11-08T21:33:28.439+01:00 level=DEBUG source=server.go:638 msg="model load progress 0.99" llama_new_context_with_model: n_ctx = 2048 llama_new_context_with_model: n_batch = 512 llama_new_context_with_model: n_ubatch = 512 llama_new_context_with_model: flash_attn = 0 llama_new_context_with_model: freq_base = 1000000.0 llama_new_context_with_model: freq_scale = 1 llama_kv_cache_init: NVIDIA GeForce RTX 3060 KV buffer size = 256.00 MiB llama_new_context_with_model: KV self size = 256.00 MiB, K (f16): 128.00 MiB, V (f16): 128.00 MiB llama_new_context_with_model: Vulkan_Host output buffer size = 0.14 MiB llama_new_context_with_model: NVIDIA GeForce RTX 3060 compute buffer size = 164.00 MiB llama_new_context_with_model: Vulkan_Host compute buffer size = 12.01 MiB llama_new_context_with_model: graph nodes = 1030 llama_new_context_with_model: graph splits = 2 time=2024-11-08T21:33:28.732+01:00 level=DEBUG source=server.go:638 msg="model load progress 1.00" DEBUG [initialize] initializing slots | n_slots=1 tid="0x827f86000" timestamp=1731098008 DEBUG [initialize] new slot | n_ctx_slot=2048 slot_id=0 tid="0x827f86000" timestamp=1731098008 INFO [main] model loaded | tid="0x827f86000" timestamp=1731098008 DEBUG [update_slots] all slots are idle and system prompt is empty, clear the KV cache | tid="0x827f86000" timestamp=1731098008 DEBUG [process_single_task] slot data | n_idle_slots=1 n_processing_slots=0 task_id=0 tid="0x827f86000" timestamp=1731098008 time=2024-11-08T21:33:28.985+01:00 level=INFO source=server.go:632 msg="llama runner started in 35.58 seconds" time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:458 msg="finished setting up runner" model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 [GIN] 2024/11/08 - 21:33:28 | 200 | 36.755545028s | 127.0.0.1 | POST "/api/chat" time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:462 msg="context for request finished" time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:334 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 duration=5m0s time=2024-11-08T21:33:28.985+01:00 level=DEBUG source=sched.go:352 msg="after processing request finished event" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 refCount=0 time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:336 msg="timer expired, expiring to unload" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:355 msg="runner expired event received" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:28.985+01:00 level=DEBUG source=sched.go:371 msg="got lock to unload" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:29.089+01:00 level=DEBUG source=server.go:1050 msg="stopping llama server" time=2024-11-08T21:38:29.089+01:00 level=DEBUG source=server.go:1056 msg="waiting for llama server to exit" time=2024-11-08T21:38:29.601+01:00 level=DEBUG source=server.go:1060 msg="llama server stopped" time=2024-11-08T21:38:29.601+01:00 level=DEBUG source=sched.go:376 msg="runner released" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:33.993+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.008431342 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:33.994+01:00 level=DEBUG source=sched.go:380 msg="sending an unloaded event" modelPath=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:33.994+01:00 level=DEBUG source=sched.go:303 msg="ignoring unload event with no pending requests" time=2024-11-08T21:38:34.273+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.287736371 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435 time=2024-11-08T21:38:34.548+01:00 level=WARN source=sched.go:642 msg="gpu VRAM usage didn't recover within timeout" seconds=5.562665772 model=/home/tingo/.ollama/models/blobs/sha256-ff82381e2bea77d91c1b824c7afb83f6fb73e9f7de9dda631bcdbca564aa5435
2024-11-08: ada0p2 - ollama - in the first terminal, I start ollama server
tingo@locaal:~ $ file /usr/local/bin/ollama /usr/local/bin/ollama: ELF 64-bit LSB executable, x86-64, version 1 (FreeBSD), dynamically linked, interpreter /libexec/ld-elf.so.1, for FreeBSD 13.3, FreeBSD-style, Go BuildID=JLNZ20VZYvEn2LuhDl0-/VC-dnrH1y33jxyQLEOqg/Ghvn4ZvlqwJAVJFM5_jT/Avb_QBTK7vLqVySpN2Om, stripped
start it
tingo@locaal:~ $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start Couldn't find '/home/tingo/.ollama/id_ed25519'. Generating new private key. Your new public key is: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINKXfpK4SGCPzaOsQvyLoCk9I+sBTqveh20aWCsBvCgv 2024/11/08 21:31:24 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/tingo/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-11-08T21:31:24.933+01:00 level=INFO source=images.go:782 msg="total blobs: 0" time=2024-11-08T21:31:24.934+01:00 level=INFO source=images.go:790 msg="total unused blobs removed: 0" [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached. [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production. - using env: export GIN_MODE=release - using code: gin.SetMode(gin.ReleaseMode) [GIN-debug] POST /api/pull --> github.com/ollama/ollama/server.(*Server).PullModelHandler-fm (5 handlers) [GIN-debug] POST /api/generate --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers) [GIN-debug] POST /api/chat --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers) [GIN-debug] POST /api/embed --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers) [GIN-debug] POST /api/embeddings --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers) [GIN-debug] POST /api/create --> github.com/ollama/ollama/server.(*Server).CreateModelHandler-fm (5 handlers) [GIN-debug] POST /api/push --> github.com/ollama/ollama/server.(*Server).PushModelHandler-fm (5 handlers) [GIN-debug] POST /api/copy --> github.com/ollama/ollama/server.(*Server).CopyModelHandler-fm (5 handlers) [GIN-debug] DELETE /api/delete --> github.com/ollama/ollama/server.(*Server).DeleteModelHandler-fm (5 handlers) [GIN-debug] POST /api/show --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (5 handlers) [GIN-debug] POST /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers) [GIN-debug] HEAD /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers) [GIN-debug] GET /api/ps --> github.com/ollama/ollama/server.(*Server).ProcessHandler-fm (5 handlers) [GIN-debug] POST /v1/chat/completions --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers) [GIN-debug] POST /v1/completions --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers) [GIN-debug] POST /v1/embeddings --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers) [GIN-debug] GET /v1/models --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (6 handlers) [GIN-debug] GET /v1/models/:model --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (6 handlers) [GIN-debug] GET / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers) [GIN-debug] GET /api/tags --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers) [GIN-debug] GET /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers) [GIN-debug] HEAD / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers) [GIN-debug] HEAD /api/tags --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers) [GIN-debug] HEAD /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers) time=2024-11-08T21:31:24.934+01:00 level=INFO source=routes.go:1172 msg="Listening on 127.0.0.1:11434 (version 0.0.0)" time=2024-11-08T21:31:24.934+01:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama2644925853/runners time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu file=build/bsd/x86_64/cpu/bin/ollama_llama_server.gz time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu_avx file=build/bsd/x86_64/cpu_avx/bin/ollama_llama_server.gz time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=cpu_avx2 file=build/bsd/x86_64/cpu_avx2/bin/ollama_llama_server.gz time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=vulkan file=build/bsd/x86_64/vulkan/bin/ollama_llama_server.gz time=2024-11-08T21:31:24.934+01:00 level=DEBUG source=payload.go:182 msg=extracting variant=vulkan file=build/bsd/x86_64/vulkan/bin/vulkan-shaders-gen.gz time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu/ollama_llama_server time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx/ollama_llama_server time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/cpu_avx2/ollama_llama_server time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama2644925853/runners/vulkan/ollama_llama_server time=2024-11-08T21:31:25.011+01:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 vulkan]" time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY" time=2024-11-08T21:31:25.011+01:00 level=DEBUG source=sched.go:105 msg="starting llm scheduler" time=2024-11-08T21:31:26.170+01:00 level=INFO source=types.go:105 msg="inference compute" id=0 library=vulkan compute="" driver=0.0 name="" total="12.2 GiB" available="12.2 GiB"
2024-11-08: ada0p2 - pkg - install ollama
Nov 8 21:26:41 locaal pkg[6019]: vulkan-loader-1.3.297 installed Nov 8 21:26:42 locaal pkg[6019]: ollama-0.3.6_1 installed
messages
Message from ollama-0.3.6_1: -- You installed ollama: the AI model runner. To run ollama, plese open 2 terminals. 1. In the first terminal, please run: $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start 2. In the second terminal, please run: $ ollama run mistral This will download and run the AI model "mistral". You will be able to interact with it in plain English. Please see https://ollama.com/library for the list of all supported models. The command "ollama list" lists all models downloaded into your system. When the model fails to load into your GPU, please use the provided ollama-limit-gpu-layers script to create model flavors with different num_gpu parameters. ollama uses many gigbytes of disk space in your home directory, because advanced AI models are often very large. Pease symlink ~/.ollama to a large disk if needed.
2024-11-08: ada0p2 - nvidia - nvidia-smi report
root@locaal:~ # nvidia-smi Fri Nov 8 21:21:49 2024 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.120 Driver Version: 550.120 CUDA Version: N/A | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce RTX 3060 Off | 00000000:06:00.0 Off | N/A | | 32% 28C P0 33W / 170W | 1MiB / 12288MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+
2024-11-08: ada0p2 - Xorg - I manually loaded the kld module nvidia-drm from the condsole, then (as my own user) I did startx. It worked, from /var/log/Xorg.0.log:
[170183.798] (II) xfree86: Adding drm device (/dev/dri/card0) [170183.798] (II) Platform probe for /dev/dri/card0 [170183.798] (**) OutputClass "nvidia" ModulePath extended to "/usr/local/lib/nvidia/xorg,/usr/local/lib/xorg/modules,/usr/local/lib/xorg/modules" [170183.798] (**) OutputClass "nvidia" setting /dev/dri/card0 as PrimaryGPU [170183.798] (--) PCI:*(6@0:0:0) 10de:2504:1462:397d rev 161, Mem @ 0xfb000000/16777216, 0xd0000000/268435456, 0xe0000000/33554432, I/O @ 0x0000e000/128, BIOS @ 0x????????/65536 [170183.799] (II) Loading /usr/local/lib/xorg/modules/drivers/nvidia_drv.so [170183.799] (II) Module nvidia: vendor="NVIDIA Corporation" [170183.799] compiled for 1.6.99.901, module version = 1.0.0 [170183.799] Module class: X.Org Video Driver [170183.799] (II) NVIDIA dlloader X Driver 550.120 Fri Sep 13 09:34:46 UTC 2024 [170183.799] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs [170183.799] (--) Using syscons driver with X support (version 2.0) [170183.799] (--) using VT number 9 [170183.814] (WW) VGA arbiter: cannot open kernel arbiter, no multi-card support [170183.814] (II) NVIDIA(0): Creating default Display subsection in Screen section "Default Screen Section" for depth/fbbpp 24/32 [170183.814] (==) NVIDIA(0): Depth 24, (==) framebuffer bpp 32 [170183.814] (==) NVIDIA(0): RGB weight 888 [170183.814] (==) NVIDIA(0): Default visual is TrueColor [170183.814] (==) NVIDIA(0): Using gamma correction (1.0, 1.0, 1.0) [170183.814] (II) Applying OutputClass "nvidia" options to /dev/dri/card0 [170183.814] (**) NVIDIA(0): Enabling 2D acceleration [170183.814] (II) Loading sub module "glxserver_nvidia" [170183.814] (II) LoadModule: "glxserver_nvidia" [170183.814] (II) Loading /usr/local/lib/xorg/modules/extensions/libglxserver_nvidia.so [170183.820] (II) Module glxserver_nvidia: vendor="NVIDIA Corporation" [170183.820] compiled for 1.6.99.901, module version = 1.0.0 [170183.820] Module class: X.Org Server Extension [170183.820] (II) NVIDIA GLX Module 550.120 Fri Sep 13 09:34:34 UTC 2024 [170183.820] (II) NVIDIA: The X server supports PRIME Render Offload. [170186.288] (--) NVIDIA(0): Valid display device(s) on GPU-0 at PCI:6:0:0 [170186.288] (--) NVIDIA(0): DFP-0 (boot) [170186.288] (--) NVIDIA(0): DFP-1 [170186.288] (--) NVIDIA(0): DFP-2 [170186.288] (--) NVIDIA(0): DFP-3 [170186.288] (--) NVIDIA(0): DFP-4 [170186.288] (--) NVIDIA(0): DFP-5 [170186.288] (--) NVIDIA(0): DFP-6 [170186.289] (II) NVIDIA(0): NVIDIA GPU NVIDIA GeForce RTX 3060 (GA106-A) at PCI:6:0:0 [170186.289] (II) NVIDIA(0): (GPU-0) [170186.289] (--) NVIDIA(0): Memory: 12582912 kBytes [170186.289] (--) NVIDIA(0): VideoBIOS: 94.06.2f.00.9a [170186.289] (II) NVIDIA(0): Detected PCI Express Link width: 16X [170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): connected [170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): Internal TMDS [170186.334] (--) NVIDIA(GPU-0): BenQ GL2450H (DFP-0): 600.0 MHz maximum pixel clock [170186.334] (--) NVIDIA(GPU-0): [170186.334] (--) NVIDIA(GPU-0): DFP-1: disconnected [170186.334] (--) NVIDIA(GPU-0): DFP-1: Internal DisplayPort [170186.334] (--) NVIDIA(GPU-0): DFP-1: 2670.0 MHz maximum pixel clock [170186.334] (--) NVIDIA(GPU-0): [170186.335] (--) NVIDIA(GPU-0): DFP-2: disconnected [170186.335] (--) NVIDIA(GPU-0): DFP-2: Internal TMDS [170186.335] (--) NVIDIA(GPU-0): DFP-2: 165.0 MHz maximum pixel clock [170186.335] (--) NVIDIA(GPU-0): [170186.335] (--) NVIDIA(GPU-0): DFP-3: disconnected [170186.335] (--) NVIDIA(GPU-0): DFP-3: Internal DisplayPort [170186.335] (--) NVIDIA(GPU-0): DFP-3: 2670.0 MHz maximum pixel clock [170186.335] (--) NVIDIA(GPU-0): [170186.336] (--) NVIDIA(GPU-0): DFP-4: disconnected [170186.336] (--) NVIDIA(GPU-0): DFP-4: Internal TMDS [170186.336] (--) NVIDIA(GPU-0): DFP-4: 165.0 MHz maximum pixel clock [170186.336] (--) NVIDIA(GPU-0): [170186.336] (--) NVIDIA(GPU-0): DFP-5: disconnected [170186.336] (--) NVIDIA(GPU-0): DFP-5: Internal DisplayPort [170186.336] (--) NVIDIA(GPU-0): DFP-5: 2670.0 MHz maximum pixel clock [170186.336] (--) NVIDIA(GPU-0): [170186.337] (--) NVIDIA(GPU-0): DFP-6: disconnected [170186.337] (--) NVIDIA(GPU-0): DFP-6: Internal TMDS [170186.337] (--) NVIDIA(GPU-0): DFP-6: 165.0 MHz maximum pixel clock [170186.337] (--) NVIDIA(GPU-0): 170186.381] (==) NVIDIA(0): No modes were requested; the default mode "nvidia-auto-select" [170186.381] (==) NVIDIA(0): will be used as the requested mode. [170186.381] (==) NVIDIA(0): [170186.383] (II) NVIDIA(0): Validated MetaModes: [170186.384] (II) NVIDIA(0): "DFP-0:nvidia-auto-select" [170186.384] (II) NVIDIA(0): Virtual screen size determined to be 1920 x 1080 [170186.424] (--) NVIDIA(0): DPI set to (92, 91); computed from "UseEdidDpi" X config [170186.424] (--) NVIDIA(0): option [170186.425] (II) NVIDIA: Reserving 24576.00 MB of virtual memory for indirect memory [170186.425] (II) NVIDIA: access. [170186.452] (II) NVIDIA(0): Setting mode "DFP-0:nvidia-auto-select" [170186.513] (==) NVIDIA(0): Disabling shared memory pixmaps [170186.513] (==) NVIDIA(0): Backing store enabled [170186.513] (==) NVIDIA(0): Silken mouse enabled [170186.513] (==) NVIDIA(0): DPMS enabled [170186.513] (WW) NVIDIA(0): Option "PrimaryGPU" is not used [170186.513] (II) NVIDIA(0): [DRI2] Setup complete [170186.513] (II) NVIDIA(0): [DRI2] VDPAU driver: nvidia [170186.513] (II) Initializing extension Generic Event Extension [170186.513] (II) Initializing extension SHAPE [170186.514] (II) Initializing extension MIT-SHM [170186.514] (II) Initializing extension XInputExtension [170186.514] (II) Initializing extension XTEST [170186.514] (II) Initializing extension BIG-REQUESTS [170186.514] (II) Initializing extension SYNC [170186.514] (II) Initializing extension XKEYBOARD [170186.515] (II) Initializing extension XC-MISC [170186.515] (II) Initializing extension SECURITY [170186.515] (II) Initializing extension XFIXES [170186.515] (II) Initializing extension RENDER [170186.515] (II) Initializing extension RANDR [170186.516] (II) Initializing extension COMPOSITE [170186.516] (II) Initializing extension DAMAGE [170186.516] (II) Initializing extension MIT-SCREEN-SAVER [170186.516] (II) Initializing extension DOUBLE-BUFFER [170186.516] (II) Initializing extension RECORD [170186.516] (II) Initializing extension DPMS [170186.517] (II) Initializing extension Present [170186.517] (II) Initializing extension DRI3 [170186.517] (II) Initializing extension X-Resource [170186.517] (II) Initializing extension XVideo [170186.517] (II) Initializing extension XVideo-MotionCompensation [170186.517] (II) Initializing extension GLX [170186.517] (II) Initializing extension GLX [170186.517] (II) Indirect GLX disabled. [170186.517] (II) GLX: Another vendor is already registered for screen 0 [170186.517] (II) Initializing extension XFree86-VidModeExtension [170186.518] (II) Initializing extension XFree86-DGA [170186.518] (II) Initializing extension XFree86-DRI [170186.518] (II) Initializing extension DRI2 [170186.518] (II) Initializing extension NV-GLX [170186.518] (II) Initializing extension NV-CONTROL [170186.518] (II) Initializing extension XINERAMA
2024-11-08: ada0p2 - pkg - install nvidia-drm-kmod
Nov 8 19:34:30 locaal pkg[5820]: drm-510-kmod-5.10.163_9 installed Nov 8 19:34:30 locaal pkg[5820]: nvidia-drm-510-kmod-550.120_1 installed Nov 8 19:34:30 locaal pkg[5820]: nvidia-drm-kmod-550.120 installed
messages
The drm-510-kmod port can be enabled for amdgpu (for AMD GPUs starting with the HD7000 series / Tahiti) or i915kms (for Intel APUs starting with HD3000 / Sandy Bridge) through kld_list in /etc/rc.conf. radeonkms for older AMD GPUs can be loaded and there are some positive reports if EFI boot is NOT enabled (similar to amdgpu). For amdgpu: kld_list="amdgpu" For Intel: kld_list="i915kms" For radeonkms: kld_list="radeonkms" Please ensure that all users requiring graphics are members of the "video" group. Modesetting must be enabled to use nvidia-drm.ko for graphics. This can be done by setting the modeset sysctl, the equivalent of the modeset kernel parameter on Linux. hw.nvidiadrm.modeset=1 This must be set before loading nvdidia-drm.ko, most easily done by placing the above in /boot/loader.conf. Modesetting must be enabled to use nvidia-drm.ko for graphics. This can be done by setting the modeset sysctl, the equivalent of the modeset kernel parameter on Linux. hw.nvidiadrm.modeset=1 This must be set before loading nvdidia-drm.ko, most easily done by placing the above in /boot/loader.conf.
2024-11-06: ada0p2 - from dmidecode output
# dmidecode 3.6 Scanning /dev/mem for entry point. SMBIOS 3.3.0 present. Table at 0x000E6CC0. Handle 0x0000, DMI type 0, 26 bytes BIOS Information Vendor: American Megatrends Inc. Version: P5.70 Release Date: 10/20/2022 Address: 0xF0000 Runtime Size: 64 kB ROM Size: 16 MB Characteristics: PCI is supported BIOS is upgradeable BIOS shadowing is allowed Boot from CD is supported Selectable boot is supported BIOS ROM is socketed EDD is supported 5.25"/1.2 MB floppy services are supported (int 13h) 3.5"/720 kB floppy services are supported (int 13h) 3.5"/2.88 MB floppy services are supported (int 13h) Print screen service is supported (int 5h) 8042 keyboard services are supported (int 9h) Serial services are supported (int 14h) Printer services are supported (int 17h) ACPI is supported USB legacy is supported BIOS boot specification is supported Targeted content distribution is supported UEFI is supported BIOS Revision: 5.17
2024-11-06: ada0p2 - pkg - install dmidecode
Nov 6 23:06:39 locaal pkg[1384]: dmidecode-3.6 installed
2024-11-06: ada0p2 - pkg - list of installed packages
root@locaal:~ # pkg info -a avahi-app-0.8_2 Service discovery on a local network brotli-1.1.0,1 Generic-purpose lossless compression algorithm curl-8.10.1 Command line tool and library for transferring data with URLs dbus-1.14.10_5,1 Message bus system for inter-application communication dbus-glib-0.112_1 GLib bindings for the D-BUS messaging system egl-wayland-1.1.13 EGLStream-based Wayland external platform encodings-1.1.0,1 X.Org Encoding fonts expat-2.6.3 XML 1.0 parser written in C fontconfig-2.15.0_3,1 XML-based font configuration API for X Windows freetype2-2.13.3 Free and portable TrueType font rendering engine fribidi-1.0.15 Free Implementation of the Unicode Bidirectional Algorithm gdbm-1.24 GNU database manager gettext-runtime-0.22.5 GNU gettext runtime libraries and programs giflib-5.2.2 Tools and library routines for working with GIF images git-2.46.2 Distributed source code management tool glib-2.80.5,2 Some useful routines of C programming (current stable version) gnome_subr-1.0 Common startup and shutdown subroutines used by GNOME scripts graphite2-1.3.14 Rendering capabilities for complex non-Roman writing systems harfbuzz-10.0.1 OpenType text shaping engine hidapi-0.14.0 Library to access USB HID-class devices indexinfo-0.3.1 Utility to regenerate the GNU info page index jbigkit-2.1_3 Lossless compression for bi-level images such as scanned pages, faxes jpeg-turbo-3.0.4 SIMD-accelerated JPEG codec which replaces libjpeg lcms2-2.16_2 Accurate, fast, and small-footprint color management engine lerc-4.0.0 C++ library for Limited Error Raster Compression libICE-1.1.1,1 Inter Client Exchange library for X11 libSM-1.2.4,1 Session Management library for X11 libX11-1.8.9,1 X11 library libXScrnSaver-1.2.4_1 The XScrnSaver library libXau-1.0.11 Authentication Protocol library for X11 libXaw-1.0.16,2 X Athena Widgets library libXdamage-1.1.6 X Damage extension library libXdmcp-1.1.5 X Display Manager Control Protocol library libXext-1.3.6,1 X11 Extension library libXfixes-6.0.1 X Fixes extension library libXfont2-2.0.6 X font library libXft-2.3.8 Client-sided font API for X applications libXi-1.8.1,1 X Input extension library libXmu-1.1.4,1 X Miscellaneous Utilities libraries libXpm-3.5.17_1 X Pixmap library libXrandr-1.5.4 X Resize and Rotate extension library libXrender-0.9.11 X Render extension library libXt-1.3.0,1 X Toolkit library libXv-1.0.12_1,1 X Video Extension library libXxf86vm-1.1.5 X Vidmode Extension libdaemon-0.14_1 Lightweight C library that eases the writing of UNIX daemons libdeflate-1.22 Fast, whole-buffer DEFLATE-based compression library libdrm-2.4.123,1 Direct Rendering Manager library and headers libedit-3.1.20240808,1 Command line editor library libepoll-shim-0.0.20240608 Small epoll implementation using kqueue libepoxy-1.5.10 Library to handle OpenGL function pointer management libevdev-1.13.2 Linux Event Device library libevent-2.1.12 API for executing callback functions on events or timeouts libffi-3.4.6 Foreign Function Interface libfontenc-1.1.8 The fontenc Library libglvnd-1.7.0 GL Vendor-Neutral Dispatch library libgudev-237 GObject bindings for libudev libiconv-1.17_1 Character set conversion library libidn2-2.3.7 Implementation of IDNA2008 internationalized domain names libimagequant-4.3.3_2 Image Quantization Library libinput-1.26.2 Generic input library liblz4-1.10.0,1 LZ4 compression library, lossless and very fast libmtdev-1.1.7 Multitouch Protocol Translation Library libnghttp2-1.63.0 HTTP/2.0 C Library libpciaccess-0.18.1 Generic PCI access library libpsl-0.21.5_1 C library to handle the Public Suffix List libraqm-0.10.1 Library that encapsulates complex text layout logic libssh2-1.11.0_1,3 Library implementing the SSH2 protocol libudev-devd-0.6.0 libudev-compatible interface for devd libunistring-1.2 Unicode string library libunwind-20240221 Generic stack unwinding library libwacom-1.5_1 Adds tablet support to libinput libxcb-1.17.0 The X protocol C-language Binding (XCB) library libxcvt-0.1.2_2 Calculate VESA CVT mode lines libxkbfile-1.1.3 XKB file library libxml2-2.11.9 XML parser library for GNOME libxshmfence-1.3.2 Shared memory 'SyncFence' synchronization primitive llvm15-15.0.7_10 LLVM and Clang lua53-5.3.6_1 Powerful, efficient, lightweight, embeddable scripting language luit-20240102_1 Locale and ISO 2022 support for Unicode terminals mesa-dri-24.1.7 OpenGL hardware acceleration drivers for DRI2+ mesa-libs-24.1.7 OpenGL libraries that support GLX and EGL clients mpdecimal-4.0.0 C/C++ arbitrary precision decimal floating point libraries nss_mdns-0.14.1.20200624_1 NSS module implementing multicast DNS name resolution nvidia-driver-550.120 NVidia graphics card binary drivers for hardware OpenGL rendering openjpeg-2.5.2_1 Open-source JPEG 2000 codec p5-Authen-SASL-2.17 Perl5 module for SASL authentication p5-CGI-4.66 Handle Common Gateway Interface requests and responses p5-Clone-0.47 Recursively copy Perl datatypes p5-Digest-HMAC-1.04 Perl5 interface to HMAC Message-Digest Algorithms p5-Encode-Locale-1.05 Determine the locale encoding p5-Error-0.17029 Error/exception handling in object-oriented programming style p5-GSSAPI-0.28_2 Perl extension providing access to the GSSAPIv2 library p5-HTML-Parser-3.83 Perl5 module for parsing HTML documents p5-HTML-Tagset-3.24 Some useful data table in parsing HTML p5-HTTP-Date-6.06 Conversion routines for the HTTP protocol date formats p5-HTTP-Message-6.46 Representation of HTTP style messages p5-IO-HTML-1.004 Open an HTML file with automatic charset detection p5-IO-Socket-IP-0.42 Drop-in replacement for IO::Socket::INET supporting IPv4 and IPv6 p5-IO-Socket-SSL-2.089 Perl5 interface to SSL sockets p5-LWP-MediaTypes-6.04 Guess media type for a file or a URL p5-Mozilla-CA-20240924 Perl extension for Mozilla CA cert bundle in PEM format p5-Net-SSLeay-1.94 Perl5 interface to SSL p5-TimeDate-2.33,1 Perl5 module containing a better/faster date parser for absolute dates p5-URI-5.29 Perl5 interface to Uniform Resource Identifier (URI) references pcre2-10.43 Perl Compatible Regular Expressions library, version 2 perl5-5.36.3_2 Practical Extraction and Report Language pixman-0.42.2 Low-level pixel manipulation library pkg-1.21.3 Package manager png-1.6.44 Library for manipulating PNG images py311-colorlog-6.8.2 Add colours to the output of Python logging module py311-crcmod-1.7_2 Module for Cyclic Redundancy Check (CRC) calculations py311-docopt-0.6.2_1 Pythonic argument parser, that will make you smile py311-evdev-1.7.0 Bindings to the Linux input handling subsystem py311-hidapi-0.14.0 Cython interface to comms/hidapi py311-liquidctl-1.13.0 Cross-platform tool and drivers for liquid coolers and other devices py311-olefile-0.46 Python module to read MS OLE2 files py311-packaging-24.1 Core utilities for Python packages py311-pillow-10.4.0 Fork of the Python Imaging Library (PIL) py311-pyudev-0.24.1 Pure Python libudev binding py311-pyusb-1.2.1 Python wrapper around libusb py311-setuptools-63.1.0_1 Python packages installer py311-six-1.16.0_1 Python 2 and 3 compatibility utilities py311-tkinter-3.11.10_7 Python bindings to the Tk widget set (Python 3.11) py311-wheel-0.44.0 Built-package format for Python python311-3.11.10 Interpreted object-oriented programming language readline-8.2.13_1 Library for editing command lines as they are typed spirv-llvm-translator-llvm15-15.0.5 Bi-directional translation between SPIR-V and LLVM IR spirv-tools-2024.4.r1 Tools for processing SPIR-V intermediate shader language modules sudo-1.9.16 Allow others to run commands as root tcl86-8.6.15_2 Tool Command Language tiff-4.6.0 Tools and library routines for working with TIFF images tk86-8.6.15 Graphical toolkit for Tcl twm-1.0.12_1 Tab Window Manager for the X Window System wayland-1.23.1 Core Wayland window system code and protocol webp-1.4.0_1 Google WebP image format conversion tool xauth-1.1.3 X authority file utility xclock-1.0.9_1 Analog and digital clock for X xf86-input-libinput-1.3.0_1 X.Org libinput input driver xf86-video-vesa-2.5.0_3 X.Org vesa display driver xinit-1.4.2_1,1 X Window System initializer xkbcomp-1.4.7 Compile XKB keyboard description xkeyboard-config-2.41_4 X Keyboard Configuration Database xorg-minimal-7.5.2_3 X.Org minimal distribution metaport xorg-server-21.1.13,1 X.Org X server and related programs xorgproto-2024.1 X Window System unified protocol definitions xrandr-1.5.2_1 Primitive command line interface to the RandR extension xterm-394 Terminal emulator for the X Window System zstd-1.5.6 Fast real-time compression algorithm
2024-11-06: ada0p2 - usbconfig output
root@locaal:~ # usbconfig ugen1.1: <AMD XHCI root HUB> at usbus1, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA) ugen0.1: <AMD XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA) ugen1.2: <PixArt HP USB Optical Mouse> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA) ugen1.3: <Chicony HP Elite USB Keyboard> at usbus1, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA) ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON (100mA)
2024-11-06: ada0p2 - pciconf -lv output
root@locaal:~ # pciconf -lv hostb0@pci0:0:0:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1450 subvendor=0x1022 subdevice=0x1450 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Root Complex' class = bridge subclass = HOST-PCI hostb1@pci0:0:1:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib1@pci0:0:1:3: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1453 subvendor=0x1022 subdevice=0x1453 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) PCIe GPP Bridge' class = bridge subclass = PCI-PCI hostb2@pci0:0:2:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI hostb3@pci0:0:3:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib6@pci0:0:3:1: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1453 subvendor=0x1022 subdevice=0x1453 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) PCIe GPP Bridge' class = bridge subclass = PCI-PCI hostb4@pci0:0:4:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI hostb5@pci0:0:7:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib7@pci0:0:7:1: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1454 subvendor=0x1022 subdevice=0x1454 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B' class = bridge subclass = PCI-PCI hostb6@pci0:0:8:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1452 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib8@pci0:0:8:1: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1454 subvendor=0x1022 subdevice=0x1454 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B' class = bridge subclass = PCI-PCI intsmb0@pci0:0:20:0: class=0x0c0500 rev=0x59 hdr=0x00 vendor=0x1022 device=0x790b subvendor=0x1849 subdevice=0xffff vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'FCH SMBus Controller' class = serial bus subclass = SMBus isab0@pci0:0:20:3: class=0x060100 rev=0x51 hdr=0x00 vendor=0x1022 device=0x790e subvendor=0x1849 subdevice=0xffff vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'FCH LPC Bridge' class = bridge subclass = PCI-ISA hostb7@pci0:0:24:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1460 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0' class = bridge subclass = HOST-PCI hostb8@pci0:0:24:1: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1461 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1' class = bridge subclass = HOST-PCI hostb9@pci0:0:24:2: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1462 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2' class = bridge subclass = HOST-PCI hostb10@pci0:0:24:3: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1463 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3' class = bridge subclass = HOST-PCI hostb11@pci0:0:24:4: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1464 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4' class = bridge subclass = HOST-PCI hostb12@pci0:0:24:5: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1465 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5' class = bridge subclass = HOST-PCI hostb13@pci0:0:24:6: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1466 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6' class = bridge subclass = HOST-PCI hostb14@pci0:0:24:7: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1467 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7' class = bridge subclass = HOST-PCI xhci0@pci0:1:0:0: class=0x0c0330 rev=0x01 hdr=0x00 vendor=0x1022 device=0x43d5 subvendor=0x1b21 subdevice=0x1142 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset USB 3.1 xHCI Compliant Host Controller' class = serial bus subclass = USB ahci0@pci0:1:0:1: class=0x010601 rev=0x01 hdr=0x00 vendor=0x1022 device=0x43c8 subvendor=0x1b21 subdevice=0x1062 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset SATA Controller' class = mass storage subclass = SATA pcib2@pci0:1:0:2: class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c6 subvendor=0x1b21 subdevice=0x0201 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset PCIe Bridge' class = bridge subclass = PCI-PCI pcib3@pci0:2:0:0: class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset PCIe Port' class = bridge subclass = PCI-PCI pcib4@pci0:2:1:0: class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset PCIe Port' class = bridge subclass = PCI-PCI pcib5@pci0:2:4:0: class=0x060400 rev=0x01 hdr=0x01 vendor=0x1022 device=0x43c7 subvendor=0x1b21 subdevice=0x3306 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '400 Series Chipset PCIe Port' class = bridge subclass = PCI-PCI re0@pci0:4:0:0: class=0x020000 rev=0x15 hdr=0x00 vendor=0x10ec device=0x8168 subvendor=0x1849 subdevice=0x8168 vendor = 'Realtek Semiconductor Co., Ltd.' device = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller' class = network subclass = ethernet vgapci0@pci0:6:0:0: class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de device=0x2504 subvendor=0x1462 subdevice=0x397d vendor = 'NVIDIA Corporation' device = 'GA106 [GeForce RTX 3060 Lite Hash Rate]' class = display subclass = VGA hdac0@pci0:6:0:1: class=0x040300 rev=0xa1 hdr=0x00 vendor=0x10de device=0x228e subvendor=0x1462 subdevice=0x397d vendor = 'NVIDIA Corporation' device = 'GA106 High Definition Audio Controller' class = multimedia subclass = HDA none0@pci0:7:0:0: class=0x130000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x145a subvendor=0x1022 subdevice=0x145a vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Zeppelin/Raven/Raven2 PCIe Dummy Function' class = non-essential instrumentation none1@pci0:7:0:2: class=0x108000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1456 subvendor=0x1022 subdevice=0x1456 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device' class = encrypt/decrypt xhci1@pci0:7:0:3: class=0x0c0330 rev=0x00 hdr=0x00 vendor=0x1022 device=0x145f subvendor=0x1849 subdevice=0xffff vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Zeppelin USB 3.0 xHCI Compliant Host Controller' class = serial bus subclass = USB none2@pci0:8:0:0: class=0x130000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1455 subvendor=0x1022 subdevice=0x1455 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Zeppelin/Renoir PCIe Dummy Function' class = non-essential instrumentation ahci1@pci0:8:0:2: class=0x010601 rev=0x51 hdr=0x00 vendor=0x1022 device=0x7901 subvendor=0x1849 subdevice=0xffff vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'FCH SATA Controller [AHCI mode]' class = mass storage subclass = SATA hdac1@pci0:8:0:3: class=0x040300 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1457 subvendor=0x1849 subdevice=0x4897 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 00h-0fh) HD Audio Controller' class = multimedia subclass = HDA
2024-11-06: ada0p2 - info from dmesg
CPU: AMD Ryzen 5 2600 Six-Core Processor (3400.20-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x800f82 Family=0x17 Model=0x8 Stepping=2 Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM> AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX> Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA> XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES> AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB> SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 33282408448 (31740 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <ALASKA A M I > FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 2 cache groups x 3 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 <Version 2.1> irqs 0-23 ioapic1 <Version 2.1> irqs 24-55 Launching APs: 10 8 9 11 5 2 3 1 7 4 6 aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256> amdsmn0: <AMD Family 17h System Management Network> on hostb0 amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb0 ugen0.2: <Corsair Memory, Inc. RM-Series C-Link Adapter> at usbus0 nvidia0: <NVIDIA GeForce RTX 3060> on vgapci0 vgapci0: child nvidia0 requested pci_enable_io vgapci0: child nvidia0 requested pci_enable_io nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms 550.120 Fri Sep 13 09:32:47 UTC 2024 uhid0: <Corsair Memory, Inc. RM-Series C-Link Adapter, class 0/0, rev 2.00/0.03, addr 1> on usbus0
2024-11-06: ada0p2 - connected up the SSD from the previous board, and the machine booted straight up.
root@locaal:~ # freebsd-version -ku 13.4-RELEASE 13.4-RELEASE
kernel
root@locaal:~ # uname -a FreeBSD locaal 13.4-RELEASE FreeBSD 13.4-RELEASE releng/13.4-n258257-58066db597be GENERIC amd64
2024-11-06: I created this page.