Reported in #2530. Looks like we're either missing those icons, or GTK can't find them.
Already fixed as part of #2563, we ship a trimmed down 'Adwaita' theme.
this ticket has been moved to: https://github.com/Xpra-org/xpra/issues/2531