if xfce is what you want, try a custom install (using dvd1) and just pick xfce instead of the gnome default during tasksel. you will get a few desktop applications like libreoffice and firefox esr, but those are easily removed if you don’t want or want to replace them. using dvd1 as my install source, wired and wireless drivers were set up during install, were available during install, and were ready to go on first boot to xfce (on an am3 pavilion desktop test system).
donvict ain’t done yet, either. i think the damage and legacy he leaves behind, leaking out that giant diaper, will be the worst of the bunch.