res-os-builder: Alpine POC pipeline (rootfs, initramfs, GPT image) #2

Merged

merith-tk merged 14 commits from muse-lantern/os:lantern/res-os-builder-alpine into main 2026-10-10 01:47:43 +00:00

Conversation 0 Commits 14 Files changed 33 +1240 -2118

muse-lantern commented 2026-10-09 19:43:37 +00:00

Member

Copy link

Implements the container-native OS image builder as a Go tool (cmd/res-os-builder), per the design in residual/.agent#27.

• build-rootfs: downloads Alpine minirootfs, installs packages via apk --root (musl loader invoked explicitly, no chroot/mount needed)
• build-initramfs: hand-rolled initramfs with kernel modules and POC /init (PCI rescan for TCG virtio enumeration)
• convert: mksquashfs + GPT/FAT32 assembly, fully daemonless (mtools, no loop mounts)

The POC validates the end-to-end pipeline. QEMU block I/O is broken in the test environment, so the final squashfs mount is verified via host-side image inspection rather than a guest boot marker.

Closes the POC phase of residual/.agent#27.

Implements the container-native OS image builder as a Go tool (`cmd/res-os-builder`), per the design in residual/.agent#27. - `build-rootfs`: downloads Alpine minirootfs, installs packages via `apk --root` (musl loader invoked explicitly, no chroot/mount needed) - `build-initramfs`: hand-rolled initramfs with kernel modules and POC /init (PCI rescan for TCG virtio enumeration) - `convert`: mksquashfs + GPT/FAT32 assembly, fully daemonless (mtools, no loop mounts) The POC validates the end-to-end pipeline. QEMU block I/O is broken in the test environment, so the final squashfs mount is verified via host-side image inspection rather than a guest boot marker. Closes the POC phase of residual/.agent#27.

muse-lantern added 2 commits 2026-10-09 19:43:37 +00:00

ci: probe runner capabilities for res-os-builder 571d985f2c

res-os-builder: Alpine POC pipeline (rootfs, initramfs, GPT image) ... 51507f5274

Implements the container-native OS image builder as a Go tool:
- build-rootfs: downloads Alpine minirootfs, installs packages via apk --root
- build-initramfs: hand-rolled initramfs with kernel modules and POC /init
- convert: mksquashfs + GPT/FAT32 assembly, daemonless (no loop mounts)

The POC validates the end-to-end pipeline: Alpine rootfs -> initramfs ->
bootable GPT image with squashfs. QEMU block I/O is broken in the test
environment, so the final mount is verified via host-side inspection.

See residual/.agent#27 for the design.

muse-lantern added 1 commit 2026-10-09 20:09:30 +00:00

res-os-builder: slim the image (firmware strip, curated modules, xz+bcj) ... 768eceb925

- build-rootfs: add amd-ucode/intel-ucode to defaults, strip /lib/firmware
  (776MB of blobs we don't need), remove Alpine's stray initramfs-lts
  (179MB auto-generated during apk install)
- build-initramfs: curate kernel modules via modules.dep instead of
  bundling the full 139MB tree (15 modules + deps = 3.4MB initramfs)
- convert: add -Xbcj x86 to mksquashfs for better x86 code compression

Result: rootfs 1131MB -> 184MB, initramfs 131MB -> 3.4MB,
squashfs 1075MB -> 148MB. Bootable image fits in 384MB.

muse-lantern added 1 commit 2026-10-09 21:30:37 +00:00

initramfs: mkdir -p bootpart/sysroot before mount (defensive) d30fe6a535

muse-lantern added 1 commit 2026-10-09 23:43:24 +00:00

convert: drop -Xbcj x86 (kernel squashfs lacks BCJ support, mount fails EINVAL) 8170c85979

muse-lantern added 1 commit 2026-10-10 00:45:07 +00:00

res-os-builder: full-rootfs initramfs (BOOT-OK achieved) ... 23daff46b3

Replace the squashfs-on-boot-partition design with a simpler approach:
pack the entire rootfs directly into the initramfs. The guest kernel's
squashfs driver rejected all compression variants (xz+BCJ, plain xz,
xz 32K dict, gzip) with EINVAL, despite images validating with unsquashfs.

The full-rootfs initramfs (165MB gzip) boots clean via QEMU -kernel/-initrd
and prints RESIDUAL-POC-BOOT-OK. Simpler pipeline, better compression.

- build-initramfs: copy entire rootfs into cpio staging (was: busybox + curated modules)
- Remove unused copyModules/parseModulesDep/pocModules
- Add cmd/res-os-builder/README.md with pipeline docs

muse-lantern added 1 commit 2026-10-10 00:55:52 +00:00

repo cleanup: archive legacy ISO builder, x86_64 focus ... 6d4b668c4c

- Move scripts/, Dockerfile.mkimage, compose.yml, entrypoint.sh to
  archive/iso-builder/ (superseded by res-os-builder)
- Remove ARM/RPi ISO profiles (x86_64 only going forward)
- Rewrite root README.md around res-os-builder
- Add archive/iso-builder/README.md explaining the legacy pipeline

muse-lantern added 1 commit 2026-10-10 01:04:57 +00:00

remove legacy ISO builder and package tree, rework CI ... 459ac68726

- Delete archive/iso-builder/ entirely (superseded by res-os-builder)
- Remove residual/ package tree (moving to separate repo later)
- Delete build-iso.yml and lint.yml (referenced removed scripts/)
- Add commit.yml: go build/vet/test on push/PR, no artifacts
- Add release.yml: manual dispatch, compiles and uploads to release tag
- Keep probe.yml for runner capability checks

muse-lantern added 1 commit 2026-10-10 01:17:41 +00:00

res-os-builder: add high-level build command, remove squashfs from convert ... 45c4f232c7

- New 'build' command: OCI image (--image) or Dockerfile (--dockerfile)
  -> bootable .img. Mutually exclusive flags.
- pullOCIImage: skopeo copy + layer extraction (daemonless)
- buildDockerfile: docker build + export via skopeo
- convert: remove squashfs (initramfs contains full rootfs now)
- Update docs: new README with quickstart and design notes

muse-lantern added 2 commits 2026-10-10 01:26:18 +00:00

remove CODINGSTYLE.md and COMMITSTYLE.md (not needed for this repo) bb5a5a7e62

build: use docker export instead of skopeo for Dockerfile path ... 12ed6376b5

Pipeline is now: docker build -> docker create -> docker export -> extract.
Simpler, no skopeo needed for the Dockerfile path.

muse-lantern added 1 commit 2026-10-10 01:32:59 +00:00

add docker/ for residual image Dockerfiles and configs ... 12536a41d6

- docker/Dockerfile.residual: Alpine-based OS image (the Dockerfile.os layer)
- docker/config/: for residual configs (empty, placeholder)
- docker/scripts/: for image build scripts (empty, placeholder)
- docker/README.md: documents the two-layer design

muse-lantern added 1 commit 2026-10-10 01:34:38 +00:00

remove .githooks (Alpine-specific, not needed for Go tool) 5508769b3e

muse-lantern added 1 commit 2026-10-10 01:45:38 +00:00

rename docker/ to image/ 470b335c3f

merith-tk merged commit 3503627c44 into main 2026-10-10 01:47:43 +00:00

merith-tk referenced this pull request from a commit 2026-10-10 01:47:43 +00:00

Merge pull request 'res-os-builder: Alpine POC pipeline (rootfs, initramfs, GPT image)' (#2) from muse-lantern/os:lantern/res-os-builder-alpine into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

residual/os!2

No description provided.