Infrastructure Engineering | Technical Case Study
Building a Linux Virtualisation Platform Without VMware or Proxmox
Designing, deploying and managing a flexible self-hosted virtualisation environment using Ubuntu Server, KVM, QEMU, libvirt, Cockpit and ZFS.
Project Overview
LAB01 is a self-hosted virtualisation platform built to demonstrate that powerful, flexible infrastructure can be delivered using native Linux technologies without depending on a proprietary or separately packaged hypervisor management platform.
The project provides a practical engineering laboratory for application development, operating system testing and infrastructure experimentation while keeping production services separate.
Instead of deploying VMware ESXi or Proxmox VE, the host uses the virtualisation capabilities of Linux, administered through standard command-line tools and Cockpit.
Infrastructure at a Glance
The Challenge
Virtualisation is essential to modern IT infrastructure, but building a practical laboratory or small-business environment can introduce licensing costs, platform dependencies and additional management complexity.
The goal was to support multiple operating systems and application workloads while retaining direct control over the Linux host, networking, storage and virtual machine configuration.
- Use established open-source virtualisation technologies.
- Support Windows and Linux virtual machines.
- Provide mirrored storage for VM disks.
- Use bonded physical interfaces and bridged networking.
- Offer web-based and command-line administration.
- Keep development separate from production services.
- Establish a foundation for monitoring, backups and recovery procedures.
Physical Hardware
| Component | LAB01 configuration |
|---|---|
| Motherboard | Gigabyte MD70-HB0-XX |
| Processors | 2 × Intel Xeon E5-2690 v4 |
| CPU resources | 28 physical cores / 56 logical threads |
| Memory | 64 GB Kingston DDR4-2400 ECC, evenly distributed between processors |
| Network | Intel X540 dual-port 10GbE adapter |
| Operating system disk | 240 GB Kingston SSD |
| ISO storage | Dedicated 1 TB HGST disk |
| VM storage | ZFS mirrored storage pool |
| Hardware management | Gigabyte IPMI/BMC monitoring |
Originally built with dual Xeon E5-2620 v4 processors, LAB01 was upgraded to dual E5-2690 v4 processors in October 2026.
Virtualisation Architecture
The platform uses Ubuntu Server 26.04.1, KVM for hardware-assisted virtualisation, QEMU for guest execution and libvirt for VM lifecycle management.
Cockpit provides convenient management, while libvirt and Linux command-line tools remain available for scripting, troubleshooting and recovery.
Network Architecture
Physical Network Bonding
The dual-port Intel X540 adapter uses Linux bonding with IEEE 802.3ad link aggregation (LACP).
The bonded interface, bond0, provides the physical uplink for the virtualisation host.
Bridged Virtual Networking
The Linux bridge br0 connects guest virtual interfaces to the physical network through bond0, allowing guests to communicate on the LAN without host-based NAT.
Storage Architecture
Storage is separated by purpose so the operating system, installation media and VM disks can be managed independently.
| Storage | Purpose | Location |
|---|---|---|
| System SSD | Ubuntu host operating system | Root filesystem |
| ISO repository | Operating system installation images | /srv/iso |
| ZFS mirror | Virtual machine disk storage | /vmstore/vms |
ZFS mirroring protects against a single mirror member failure when the remaining member is healthy. A mirror is not a backup: independent VM backups and tested restore procedures remain important future work.
Implementation Journey
Install and Prepare Ubuntu Server
Deploy the host operating system, configure administrative access, apply updates and validate hardware.
Configure Bonding and Bridging
Build the LACP bond and Linux bridge, then validate connectivity for the host and guests.
Prepare Storage
Configure the dedicated ISO repository and ZFS mirrored VM storage.
Deploy KVM and libvirt
Configure the virtualisation stack, libvirt storage pools and Cockpit Machines.
Resolve Security and Access Issues
Investigate QEMU disk access errors and implement AppArmor policy overrides for custom VM and ISO paths.
Deploy and Validate Guests
Test Windows 11 with VirtIO devices and deploy the Ubuntu development VM.
Upgrade and Validate Hardware
Install dual Xeon E5-2690 v4 processors, verify CPU detection and check hardware health through IPMI.
Real-World Application: Service Desk Development
LAB01 hosts a dedicated Ubuntu VM for developing and testing a custom multi-client IT service desk application.
Development VM
Name: servicedesk-dev
Allocation: 4 vCPUs / 8 GB RAM
Operating system: Ubuntu Server 26.04.1
Application Stack
Laravel, PHP, MySQL, Apache and Node.js provide the development environment for a bespoke service management platform.
Separating development from the production web server reduces the risk of application changes disrupting live services.
Troubleshooting and Lessons Learned
AppArmor and QEMU Permissions
VM deployment initially encountered permission errors when accessing disks in the custom ZFS path. Investigation identified access restrictions requiring appropriate AppArmor overrides for VM storage and ISO locations.
Windows VirtIO Drivers
The Windows 11 test deployment required suitable virtual storage and network drivers, validating Windows guest support under KVM/QEMU.
CPU Upgrade Validation
The new processors were recognised as 28 physical cores and 56 logical threads. Under a light workload, IPMI showed CPU temperatures of 32°C and 37°C, with healthy fan and voltage readings.
Memory Architecture
Eight 8 GB Kingston DIMMs provide 64 GB total, with four populated memory channels per CPU. Future expansion will consider memory type, slot population and NUMA balance.
Why Choose Native Linux Virtualisation?
KVM, QEMU and libvirt offer a mature virtualisation foundation administered through Linux tools, APIs and lightweight management interfaces.
Direct Infrastructure Control
Manage host networking, storage, security and virtual machines using familiar Linux technologies.
Flexible Automation
Use scripts, libvirt commands and standard automation tools rather than depending exclusively on a vendor-specific interface.
Reduced Platform Dependency
Avoid requiring a separate commercial virtualisation management product for a modest deployment.
Transferable Engineering Skills
Build practical knowledge of Linux, storage, networking and virtualisation across multiple environments.
Important distinction: Proxmox VE also uses KVM and open-source technologies. This project demonstrates an alternative management approach, not a claim that native KVM is universally superior.
Project Outcomes
- Operational dual-processor Linux virtualisation host.
- 28 physical CPU cores and 56 logical threads.
- 64 GB ECC memory balanced across CPU sockets.
- Dedicated ZFS mirrored virtual machine storage.
- LACP bonding and Linux bridged guest networking.
- Active Ubuntu development VM and validated Windows 11 test VM.
- Cockpit-based administration and libvirt command-line control.
- IPMI hardware health monitoring.
- Separation of development workloads from production hosting.
Future Development
Memory Expansion
Evaluate compatible ECC memory configurations to support more simultaneous VMs.
Out-of-Band Management
Configure the dedicated BMC network interface on a restricted management network.
Backup and Recovery
Implement and validate independent VM backups, configuration exports and bare-metal rebuild procedures.
Technical Build Guide
This project will also form the basis of a reproducible technical guide covering hardware planning, Ubuntu installation, KVM/QEMU, libvirt, networking, ZFS, VM deployment, security, troubleshooting and disaster recovery.
The goal is to help engineers build similar environments while explaining the decisions, trade-offs and verification checks at each stage.
The detailed guide is in preparation; recovery steps will be published once tested.
Need Help Designing Your Infrastructure?
From virtualisation and Linux administration to networking, cloud services and disaster recovery, I help organisations design practical infrastructure solutions around their requirements.
