release: Add some comments and tidy dist set targets

Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50458

release: Avoid pipe in tarball creation

Previously errors from invoking tar for src.txz or ports.txz were eaten
by the pipeline. If something fails in creating these tarballs we want
the build to f

release: Avoid pipe in tarball creation

Previously errors from invoking tar for src.txz or ports.txz were eaten
by the pipeline. If something fails in creating these tarballs we want
the build to fail rather than producing subtly broken artifacts. Use
${TAR_XZ_CMD} to add -J to tar's commandline rather than | xz.

Reviewed by: bz
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50459

show more ...

release: Add ${PKGBASE_REPO} dependency for dvd

A user may build only dvd1.iso, which would fail if the pkgbase-repo
did not already exist. Builds using `make release` build disc1 before
dvd1 so th

release: Add ${PKGBASE_REPO} dependency for dvd

A user may build only dvd1.iso, which would fail if the pkgbase-repo
did not already exist. Builds using `make release` build disc1 before
dvd1 so that case would work, but it must be possible to build only
one artifact.

Fixes: 62d18f8c4c10 ("release: Add -DPKGBASE option to include pkgbase packages")
Sponsored by: The FreeBSD Foundation

show more ...

release: Add -DPKGBASE option to include pkgbase packages

If this option is set, an offline repo of pkgbase packages corresponding
to base.txz and kernel.txz will be included in the disc1 release me

release: Add -DPKGBASE option to include pkgbase packages

If this option is set, an offline repo of pkgbase packages corresponding
to base.txz and kernel.txz will be included in the disc1 release media
rather than the base.txz and kernel.txz tarballs.

Reviewed by: bapt
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50346

show more ...

release: Use pkg install -f

Without -f, pkg will not write to the METALOG file if the packages
are already installed from a previous build, causing the packages to
not be included in the final insta

release: Use pkg install -f

Without -f, pkg will not write to the METALOG file if the packages
are already installed from a previous build, causing the packages to
not be included in the final install media.

Official builds start with a clean target directory and won't encounter
an issue, but this change supports iteration in development of the
release targets.

Reviewed by: emaste
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50344

show more ...

release: Pass -DNO_ROOT to dvd1 installworld/installkernel

Accidentally lost during a rebase.

Fixes: 89cf4b85db40 ("release: Use NO_ROOT mode for dvd1.iso")
Sponsored by: The FreeBSD Foundation

release: Use NO_ROOT mode for dvd1.iso

All ISO/memstick images are now built without requiring root.

Reviewed by: brooks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.

release: Use NO_ROOT mode for dvd1.iso

All ISO/memstick images are now built without requiring root.

Reviewed by: brooks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50269

show more ...

release: Exclude release/obj from the src tarball

A user may run `make objlink` in release/ in order to have easy access
to built release artifacts. We don't want this to appear in src.txz.

Review

release: Exclude release/obj from the src tarball

A user may run `make objlink` in release/ in order to have easy access
to built release artifacts. We don't want this to appear in src.txz.

Reviewed by: brooks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50262

show more ...

release: Pass -N to pkg-stage if NO_ROOT set

PR: 283387
Reviewed by: brooks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50268

release: Use unprivileged mode for disc1 and memstick

This same change was made for the bootonly and mini-memstick targets in
commit cbba69fb5793. That uncovered some makefs bugs, which are now
fix

release: Use unprivileged mode for disc1 and memstick

This same change was made for the bootonly and mini-memstick targets in
commit cbba69fb5793. That uncovered some makefs bugs, which are now
fixed. As there are no other known issues, extend this to disc1 and
memstick images now.

The change for the dvd image is waiting on PR 283387.

Reviewed by: brooks, cperciva
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50179

show more ...

release: Always create METALOG for pkg installation

We always use METALOG / non-root mode for bootonly.iso, even if not
specifically requested by the user (via setting NO_ROOT ). Thus, add
`-o META

release: Always create METALOG for pkg installation

We always use METALOG / non-root mode for bootonly.iso, even if not
specifically requested by the user (via setting NO_ROOT ). Thus, add
`-o METALOG=METALOG` to PKG_ARGS unconditionally so that the METALOG
will be available when building bootonly.iso.

This might result in a spurious METALOG temporarily appearing on some
other release artifacts. This will be addressed once all release
targets migrate to non-root mode (currently blocked on PR 283387).

PR: 286528
Reviewed by: bz, cperciva
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D50159

show more ...

release: install pkg to install media

This is the most straightforward way to make installation of base system
packages from install media possible. Bootstrapping pkg at install time
does not work s

release: install pkg to install media

This is the most straightforward way to make installation of base system
packages from install media possible. Bootstrapping pkg at install time
does not work since the root filesystem of install media is immutable.

Reviewed by: bz, cperciva, emaste
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D49968

show more ...

release: Emit warning if NO_ROOT used with pkg-stage

pkg-stage.sh (used by the disc1 build) does not currently support
METALOG output for NO_ROOT builds. Emit a warning for this case.

PR: 283387

release: Emit warning if NO_ROOT used with pkg-stage

pkg-stage.sh (used by the disc1 build) does not currently support
METALOG output for NO_ROOT builds. Emit a warning for this case.

PR: 283387
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D49785

show more ...

release: Use unprivileged mode for bootonly and mini-memstick

This in effect always builds these targets in NO_ROOT mode, removing
one more instance where release artifact builds require a privilege

release: Use unprivileged mode for bootonly and mini-memstick

This in effect always builds these targets in NO_ROOT mode, removing
one more instance where release artifact builds require a privileged
user (root). These artifacts are now always built the same way.

Reviewed by: brooks, Pat Maddox <pat@patmaddox.com>
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D48121

show more ...

vmimage.subr: Redirect etcupdate log to stdout

While we're here, send the etcupdate log from generating base.txz
to stdout instead of /dev/null (see e972e408d19a) as well.

Reviewed by: emaste, gord

vmimage.subr: Redirect etcupdate log to stdout

While we're here, send the etcupdate log from generating base.txz
to stdout instead of /dev/null (see e972e408d19a) as well.

Reviewed by: emaste, gordon, jrtc27
MFC after: 1 week
Sponsored by: Amazon
Differential Revision: https://reviews.freebsd.org/D48719

show more ...

release: Sort etcupdate entries for base metalog

Supports reproducible builds.

PR: 283214
Reviewed-by: emaste
Signed-off-by: Pat Maddox <pat@patmaddox.com>

release: Always use NO_ROOT for distribute* and package*

We used to have two different code paths for generating release media
dist sets, one which expected to run as root, and one which did not.
It

release: Always use NO_ROOT for distribute* and package*

We used to have two different code paths for generating release media
dist sets, one which expected to run as root, and one which did not.
It was possible that the two different paths could generate different
results.

We can use the path that does not *require* root also when running as
root, so use it always. We'll want to do eventually do the same for all
release targets, but these ones are an easy place to start.

Reviewed by: brooks
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D48041

show more ...

Clean pkg cache in release media

Recently wifi-firmware-kmod-release pkgs were added in the release
installation media, but unfortunately the pkgs were not cleaned up after
the installation. These k

Clean pkg cache in release media

Recently wifi-firmware-kmod-release pkgs were added in the release
installation media, but unfortunately the pkgs were not cleaned up after
the installation. These kept the stale pkgs in the /var/cache. The pkgs
should be removed with pkg clean.

PR: 283112
Reported by: yanhui.he@broadcom.com
Reviewed by: cperciva, emaste
Approved by: cperciva, emaste, re (implicit)
MFC after: 3 days
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D47942

show more ...

release: Don't break if firmware install fails

On some platforms (e.g. powerpc) we don't have packages, so we can't
install them onto the ISOs. Proceed with building the images anyway.

Reported by

release: Don't break if firmware install fails

On some platforms (e.g. powerpc) we don't have packages, so we can't
install them onto the ISOs. Proceed with building the images anyway.

Reported by: Weekly snapshot builds
Fixes: 7e2996c1f5b4 ("release: install wireless firmware onto disc1 and dvd")
MFC after: 1 minute

show more ...

release: install wireless firmware onto disc1 and dvd

Wireless driver firmware is no longer added to the src tree.
In order to have wireless support in the installer for the new drivers
we install t

release: install wireless firmware onto disc1 and dvd

Wireless driver firmware is no longer added to the src tree.
In order to have wireless support in the installer for the new drivers
we install the firmware packages onto disc1 (and memstick) and dvd
if built on FreeBSD and NOPKG is not defined (to not break cross-builds
from Linux or OSX and to allow people to opt-out).

Sponsored by: The FreeBSD Foundation
Submitted by: cperciva (the orig. commands and where to place them)
Reviewed by: jrtc27
MFC after: 6 hours
Differential Revision: https://reviews.freebsd.org/D47407

show more ...

release: Don't copy container images into /ftp/

These are installed into /ociimages/ and stage onto the download site
at /OCI-IMAGES/; they don't belong in the same directory as the
"distribution" .

release: Don't copy container images into /ftp/

These are installed into /ociimages/ and stage onto the download site
at /OCI-IMAGES/; they don't belong in the same directory as the
"distribution" .txz files.

Fixes: d03c82c28da8 ("release: add optional OCI images")
MFC after: 1 minute
Sponsored by: Amazon

show more ...

release: Exclude container images from globs

We use a *.txz glob to get all of the "distributions" which comprise
the FreeBSD release, but we now (optionally) also build container
images which are .

release: Exclude container images from globs

We use a *.txz glob to get all of the "distributions" which comprise
the FreeBSD release, but we now (optionally) also build container
images which are .txz files. Grep those out from the distribution
lists.

A better long-term fix would probably be to generate an explicit list
of the .txz files we want rather than using an overbroad glob and
filtering out the files we *don't* want.

Fixes: d03c82c28da8 ("release: add optional OCI images")
MFC after: 1 minute
Sponsored by: Amazon

show more ...

Retire MK_PROFILE infrastructure

It was disabled by default in fe52b7f60ef4. We planned to (but did not)
remove the option before FreeBSD 14. Remove it now, for FreeBSD 15.

Relnotes: Yes
Reviewed

Retire MK_PROFILE infrastructure

It was disabled by default in fe52b7f60ef4. We planned to (but did not)
remove the option before FreeBSD 14. Remove it now, for FreeBSD 15.

Relnotes: Yes
Reviewed by: imp
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D31558

show more ...

release: add optional OCI images

This adds three OCI archive format files to the release containing
FreeBSD base images suitable for static linked, dynamic linked and shell
workloads. The shell imag

release: add optional OCI images

This adds three OCI archive format files to the release containing
FreeBSD base images suitable for static linked, dynamic linked and shell
workloads. The shell image also contains pkg-bootstrap and can be easily
extended by installing packages (including pkgbase packages).

Reviewed by: dch, cpersiva, jlduran, zlei
Differential Revision: https://reviews.freebsd.org/D46759
MFC after: 2 days

show more ...

release: Remove useless ls

Replace "$((ls *.txz))" with "*.txz"

Reported by: jrtc27