Ensure buildx/BuildKit support is enabled and run:

docker buildx build --platform=linux/arm64 --platform=linux/arm/v7 --platform=linux/amd64 --tag itzg/minecraft-server:multiarch --push .

To build for local testing, use:

docker buildx build --platform=linux/amd64 --tag mc-multiarch --load .