Files
VeraCrypt/.github/workflows/build-linux-big-endian.yml
T
Ville TakioandGitHub df2e9dcd30 Tests: read known data from the test volumes without mounting (#1907)
The Linux workflow checks the content of the Tests/*.hc volumes by
mounting them, which needs root, FUSE and the installed package, and so
only runs on x86_64. Add a test that recovers the same data through the
volume layer instead, so it also runs on other architectures, e.g. on the
big-endian cross build under qemu-user.

Tests/volume_read_test.cpp opens a volume read-only and reads its data
area with Volume::ReadSectors: in one call, as multi-sector ranges at
nonzero offsets with odd sector counts, again with the encryption thread
pool running, and one sector at a time; every read must match the first.
CPU features are detected as in the application, and the character set
is taken from the environment (LC_CTYPE) so that paths with non-ASCII
characters work; if that locale is unavailable, the test continues in the
C locale and says so.

Tests/test_volume_read.py builds it against Volume.a and Platform.a of a
finished standard Linux build (CXX and NM can be set for a cross build)
and checks the plaintext of every Tests/test.*.hc volume: the FAT boot
sector, DUMMY.TXT with the content "Dummy" at the cluster given by the
root directory, and a known SHA-256 digest of the whole data area. A
volume without a digest, or a digest without a volume, is an error.

It runs in the Linux workflow after the .deb build and in the build job
of the big-endian workflow (test.sha512.hc only in the automatic check,
all volumes in the full run), and requires the thread pool there.

Signed-off-by: Ville Takio <ville+git@takio.fi>
2026-10-11 18:50:22 +09:00

231 lines
8.7 KiB
YAML

name: Build and test Linux big-endian
# Cross-builds the console version for s390x (big-endian) and runs it under
# qemu-user: the algorithm self-tests, a read of known data from one of the
# Tests/*.hc volumes without mounting, and a mount of one of them (all
# created on little-endian).
#
# The full suite (manual run with "full" selected) also builds amd64, then
# reads and tests all Tests/*.hc volumes on both builds and volume
# compatibility between them in both directions, in separate jobs that run
# concurrently.
on:
push:
branches: [ "master" ]
paths:
- 'src/Build/Include/Makefile.inc'
- 'src/Common/*.h'
- 'src/Common/*.cpp'
- 'src/Common/*.c'
- 'src/Core/**'
- 'src/Crypto/**'
- 'src/Driver/Fuse/**'
- 'src/Main/**'
- 'src/Platform/**'
- 'src/Volume/**'
- 'src/Makefile'
- 'Tests/test.*.hc'
- 'Tests/test_byte_order_interop.py'
- 'Tests/test_volume_read.py'
- 'Tests/volume_read_test.cpp'
- '.github/workflows/build-linux-big-endian.yml'
pull_request:
branches: [ "master" ]
paths:
- 'src/Build/Include/Makefile.inc'
- 'src/Common/*.h'
- 'src/Common/*.cpp'
- 'src/Common/*.c'
- 'src/Core/**'
- 'src/Crypto/**'
- 'src/Driver/Fuse/**'
- 'src/Main/**'
- 'src/Platform/**'
- 'src/Volume/**'
- 'src/Makefile'
- 'Tests/test.*.hc'
- 'Tests/test_byte_order_interop.py'
- 'Tests/test_volume_read.py'
- 'Tests/volume_read_test.cpp'
- '.github/workflows/build-linux-big-endian.yml'
# Manual runs, e.g. on a fork before opening a pull request.
workflow_dispatch:
inputs:
full:
description: 'Full suite: also build amd64 and test volume compatibility in both directions'
type: boolean
default: true
permissions:
contents: read
concurrency:
# Keep a manual full run from being cancelled by a push, and vice versa.
group: ${{ github.workflow }}-${{ github.event_name }}-${{ github.event.pull_request.number || github.ref }}
cancel-in-progress: true
env:
WXWIDGETS_VERSION: 3.2.5
# The same condition is repeated in the build matrix and the job "if"s,
# where the env context is not available.
FULL: ${{ github.event_name == 'workflow_dispatch' && inputs.full }}
jobs:
build:
runs-on: ubuntu-24.04
timeout-minutes: 60
strategy:
fail-fast: false
matrix:
arch: ${{ fromJSON(github.event_name == 'workflow_dispatch' && inputs.full && '["s390x","amd64"]' || '["s390x"]') }}
name: build-${{ matrix.arch }}
steps:
- name: Checkout repository
uses: actions/checkout@v4
- name: Install dependencies (s390x cross)
if: matrix.arch == 's390x'
run: |
sudo sed -i 's/^Types: deb$/Types: deb\nArchitectures: amd64/' /etc/apt/sources.list.d/ubuntu.sources
printf 'Types: deb\nURIs: http://ports.ubuntu.com/ubuntu-ports\nSuites: noble noble-updates\nComponents: main universe\nArchitectures: s390x\nSigned-By: /usr/share/keyrings/ubuntu-archive-keyring.gpg\n' | sudo tee /etc/apt/sources.list.d/ports.sources
sudo dpkg --add-architecture s390x
sudo apt-get update
sudo apt-get install -y g++-s390x-linux-gnu qemu-user-static \
libfuse3-dev:s390x libpcsclite-dev:s390x libstdc++6:s390x libgcc-s1:s390x
- name: Install dependencies (amd64)
if: matrix.arch == 'amd64'
run: sudo apt-get update && sudo apt-get install -y libfuse3-dev libpcsclite-dev yasm
- name: Cache wxBuildConsole
uses: actions/cache@v5
id: cache-wxbuildconsole
with:
path: /tmp/wxBuildConsole
key: wxBuildConsole-${{ matrix.arch }}-${{ env.WXWIDGETS_VERSION }}-${{ hashFiles('src/Makefile', '.github/workflows/build-linux-big-endian.yml') }}
- name: Download and extract wxWidgets
run: |
wget -q https://github.com/wxWidgets/wxWidgets/releases/download/v${{ env.WXWIDGETS_VERSION }}/wxWidgets-${{ env.WXWIDGETS_VERSION }}.tar.bz2 -O /tmp/wxWidgets.tar.bz2
mkdir -p /tmp/wxWidgets-${{ env.WXWIDGETS_VERSION }}
tar -xjf /tmp/wxWidgets.tar.bz2 -C /tmp/wxWidgets-${{ env.WXWIDGETS_VERSION }} --strip-components=1
- name: Build console VeraCrypt
run: |
set -- NOGUI=1 WITHFUSE3=1 WXSTATIC=1 NOTEST=1 \
WX_ROOT=/tmp/wxWidgets-${{ env.WXWIDGETS_VERSION }} WX_BUILD_DIR=/tmp/wxBuildConsole
if [ "${{ matrix.arch }}" = s390x ]; then
set -- "$@" ARCH=s390x NOSTRIP=1 \
CC=s390x-linux-gnu-gcc CXX=s390x-linux-gnu-g++ AR=s390x-linux-gnu-ar RANLIB=s390x-linux-gnu-ranlib \
WX_CONFIGURE_EXTRA_FLAGS="--host=s390x-linux-gnu --build=x86_64-linux-gnu"
# $(shell pkg-config ...) in the Makefile only sees the environment.
export PKG_CONFIG_LIBDIR=/usr/lib/s390x-linux-gnu/pkgconfig:/usr/share/pkgconfig
export PKG_CONFIG_PATH=$PKG_CONFIG_LIBDIR
fi
cd src
if [ "${{ steps.cache-wxbuildconsole.outputs.cache-hit }}" != true ]; then
make "$@" wxbuild
fi
make "$@" -j"$(nproc)"
file Main/veracrypt
- name: Algorithm self-tests
run: src/Main/veracrypt --text --test
# Needs Volume.a and Platform.a, so it runs here and not in the jobs that
# only receive the binary. One volume keeps the automatic check short.
- name: Read known data from the test volumes
run: |
set -- --build-dir src --require-thread-pool
if [ "${{ matrix.arch }}" = s390x ]; then
export CXX=s390x-linux-gnu-g++ NM=s390x-linux-gnu-nm
fi
if [ "${{ env.FULL }}" != true ]; then
set -- "$@" --fixture test.sha512.hc
fi
python3 Tests/test_volume_read.py "$@"
# One volume keeps this check short; the full suite opens all of them.
- name: Volume created on little-endian
if: env.FULL != 'true'
run: python3 Tests/test_byte_order_interop.py --binary-a src/Main/veracrypt --fixture test.sha512.hc
- name: Upload binary
if: env.FULL == 'true'
uses: actions/upload-artifact@v4
with:
name: veracrypt-${{ matrix.arch }}
path: src/Main/veracrypt
retention-days: 1
volumes:
if: github.event_name == 'workflow_dispatch' && inputs.full
needs: build
runs-on: ubuntu-24.04
timeout-minutes: 60
strategy:
fail-fast: false
matrix:
arch: [ s390x, amd64 ]
name: volumes-${{ matrix.arch }}
steps:
- name: Checkout repository
uses: actions/checkout@v4
- name: Install runtime dependencies (s390x)
if: matrix.arch == 's390x'
run: |
sudo sed -i 's/^Types: deb$/Types: deb\nArchitectures: amd64/' /etc/apt/sources.list.d/ubuntu.sources
printf 'Types: deb\nURIs: http://ports.ubuntu.com/ubuntu-ports\nSuites: noble noble-updates\nComponents: main universe\nArchitectures: s390x\nSigned-By: /usr/share/keyrings/ubuntu-archive-keyring.gpg\n' | sudo tee /etc/apt/sources.list.d/ports.sources
sudo dpkg --add-architecture s390x
sudo apt-get update
sudo apt-get install -y qemu-user-static \
libfuse3-3:s390x libpcsclite1:s390x libstdc++6:s390x libgcc-s1:s390x
- name: Install runtime dependencies (amd64)
if: matrix.arch == 'amd64'
run: sudo apt-get update && sudo apt-get install -y libfuse3-3 libpcsclite1
- uses: actions/download-artifact@v4
with:
name: veracrypt-${{ matrix.arch }}
path: bin
- name: Volumes created on little-endian
run: |
chmod +x bin/veracrypt
python3 Tests/test_byte_order_interop.py --binary-a bin/veracrypt
interop:
if: github.event_name == 'workflow_dispatch' && inputs.full
needs: build
runs-on: ubuntu-24.04
timeout-minutes: 60
steps:
- name: Checkout repository
uses: actions/checkout@v4
- name: Install runtime dependencies
run: |
sudo sed -i 's/^Types: deb$/Types: deb\nArchitectures: amd64/' /etc/apt/sources.list.d/ubuntu.sources
printf 'Types: deb\nURIs: http://ports.ubuntu.com/ubuntu-ports\nSuites: noble noble-updates\nComponents: main universe\nArchitectures: s390x\nSigned-By: /usr/share/keyrings/ubuntu-archive-keyring.gpg\n' | sudo tee /etc/apt/sources.list.d/ports.sources
sudo dpkg --add-architecture s390x
sudo apt-get update
sudo apt-get install -y qemu-user-static libfuse3-3 libpcsclite1 \
libfuse3-3:s390x libpcsclite1:s390x libstdc++6:s390x libgcc-s1:s390x
- uses: actions/download-artifact@v4
with:
path: bin
- name: Volumes created on one byte order open on the other
run: |
chmod +x bin/*/veracrypt
file bin/*/veracrypt
python3 Tests/test_byte_order_interop.py --skip-official \
--binary-a bin/veracrypt-s390x/veracrypt --binary-b bin/veracrypt-amd64/veracrypt