Minecraft Is A Linux Wayland Compositor??

Summary of the video (Minecraft + Linux Wayland compositor mod)

• The video demonstrates a Minecraft mod that functions like a Wayland compositor/window manager inside Minecraft, allowing real desktop applications to run on the player’s system—without using a virtual machine.
• The host GUI is controlled using in-game input mappings:
  • Pressing V opens an application launcher. Searching/choosing apps spawns them as “window items” on a hotbar.
  • Players can place, move, and resize these windows in Minecraft’s 3D space using mouse interactions.
  • Window behavior model: there can be one window per window item, but multiple items can represent multiple instances (e.g., multiple Alacritty windows).
  • Keyboard capture: pressing G puts the active window/app into keyboard capture mode, so the app receives input normally (e.g., typing in a terminal).
  • Escape handling: Esc exits keyboard capture mode. To use Esc inside apps (e.g., nvim), a different binding is used:
    • Alt-Q enables a capture mode where Esc can be sent to the app
    • Alt-Q again exits that mode

Apps showcased and what worked

• Alacritty terminal: works like a real terminal, including:
  • text selection
  • resizing
• Chromium web browser: works in the compositor environment, including:
  • dragging tabs out to create new windows
  • opening content in separate windows
• Audio streams: mentioned as working (tested during the KDE community talk context).
• GIMP + file manager integration:
  • Multi-window apps open correctly, with each window appearing as a separate Minecraft window.
  • Drag-and-drop of files from a file manager onto GIMP is shown working.
• GIMP / Kdenlive-like behavior:
  • Not all apps behave perfectly due to missing/odd window decorations and some UI limitations.
• Controller support:
  • A controller is used to play a game (osu shown as an example).
  • The video notes it’s theoretically possible to run Minecraft inside Minecraft, but says it’s likely awkward in practice.

“Compositor mode” vs “world mode”

The video distinguishes two interaction modes:

• World mode (default): windows are placed into the 3D world and manipulated directly.
• Pressing B switches to compositor mode / window manager mode:
  • Provides a tabbing interface for easier switching/interaction.
  • Limitations are noted, including issues with resizing/rearranging tabs (possibly due to Minecraft mod UI constraints).
  • A resize button exists, but is awkward: holding and moving the mouse performs resizing.
• Additional UI controls in compositor mode:
  • Hide button: hides the window in the overworld; toggling it back is weird—bringing it back is done via replacing the window.
  • Give window item: used to recover window instances if the item is lost (e.g., if the player dies or loses the item).
  • Pin (picture-in-picture) button:
    • Keeps a window “always visible” on-screen (example shown: keeping gameplay visible continuously).
    • Pinned windows can replace the currently pinned slot.

Limitations / compatibility issues emphasized

• Wayland-native apps only: the mod does not support XWayland.
  • The video mentions alternatives in theory (e.g., XWayland via embedded compositor approaches), but testing wasn’t successful.
• Flatpak apps don’t work due to Flatpak sandboxing.
  • Possible workarounds are hinted (permissions), but the video suggests using unsandboxed installs instead.
• Apps lacking client-side decorations may be awkward to close:
  • Example: a Kdenlive-like case has no close button; closing may require app-specific quit UI or bindings.
  • Example: MPV can be closed via a key binding (like Q), but if not focused/bound correctly, closing becomes difficult—possibly requiring closing from a terminal.
• Requires a fairly up-to-date glibc (minimum not precisely stated; described as a recurring compatibility issue).
• Server use: described as client-side only.
  • Even if installed on a server, other users won’t see your windows; remote sharing/streaming isn’t solved by the mod.
• VR shaders: VR mods might work “probably,” but are not actively supported.
  • Shaders may break windows, so it’s advised to avoid or test cautiously.

Installation / requirements (as given)

• Must be on Linux + Wayland.
• Version requirement mentioned: Minecraft 26.1.2.
• Uses Fabric Mod Loader:
  • install via the universal jar
  • place the mod in the mod folder
• Requires xkb-common 1.11.0 or later plus xkb-common-tools (xkb-cli)—likely already installed on many systems.

Overall evaluation / takeaway

• The presenter is enthusiastic, describing it as “really, really cool”—a genuinely impressive technical experiment.
• It’s also clearly not aimed at productivity or daily driving:
  • the workflow is awkward/unproductive due to 3D placement and interaction constraints.
• Still, the video frames it as a fun and novel way to combine Wayland compositor concepts with Minecraft gameplay.

Main speakers / sources

• Primary speaker: the YouTube video narrator (the creator addressing viewers throughout).
• Referenced source/talk: a KDE Conference Akademy 2024 talk (context where audio testing worked).
• Referenced related work: mentions a previous dev video about a Minecraft-world “Git-like” mod concept (not detailed fully in the subtitles).