Xpra: Ticket #1883: packaging for mingw64 / MSYS2

We should be able to submit this as a package to MSYS2: https://github.com/msys2/msys2/wiki/Creating-Packages.

Thu, 21 Jun 2018 10:12:12 GMT - Antoine Martin: owner, summary changed

owner changed from Antoine Martin to Smo
summary changed from packaging for mingw to packaging for mingw64 / MSYS2

Python build changes mostly completed in r19684. We can now install xpra locally from an MSYS2 shell with:

rm -fr dist/*
python ./setup.py clean
python ./setup.py install --prefix=./dist --share=share/xpra --with-scripts
rsync -rplogt dist/* ${MINGW_PREFIX}/

Still TODO:

install both python2 and python3 builds?
figure out the dependencies we want to declare (ie: not opencv..)
create some packages for the most important python dependencies (those should be easy): rencode, lz4, PyOpenGL + PyOpenGL_accelerate, cryptography
fix audio subprocess command failures

@smo: can you help with any of this?

Tue, 10 Jul 2018 15:14:36 GMT - Antoine Martin:

Update from the transition to python 3.7 (#1878) done by msys2:

OpenGL_accelerate needs patching to build: pyopengl: Python 3.7 Build failure
websockify: we need our patch set - really wished I had merged this upstream now..

Fri, 03 Aug 2018 13:50:03 GMT - Antoine Martin:

for websockify with python 3.7 on win32, see attachment/ticket/1568/websockify-0.8-py37.tar.xz.
for paramiko / pynacl see 1646#comment:8
r20010 html5 client path fixup

Sat, 04 Aug 2018 18:54:51 GMT - totaamwin32:

r20022: use mingw packages for some python dependencies
for python-lzo see ticket:1044#comment:9
would be very useful to have libyuv (as per ticket:678#comment:40 - much easier now that libyuv builds the DLL by default and without errors) - every other installation step is now fully automated, see wiki/Building/MSWindows
pyopengl_accelerate can be built from source against python 3.7 (with a recent enough version of Cython), but only from a git copy (source here: https://github.com/mcfletch/pyopengl) and after removing the ".c" file to ensure they get re-generated - since the pyopengl version should match, build that from the same source tree (just remove the SGIX directories as those contain the "async" keyword which is now illegal - we don't need those anyway)
lz4 is crucial, we need the workaround from r20171 (ticket:1929#comment:1) so it gets packaged properly (I'm not blaming cx_Freeze for this particular breakage)

Sat, 25 Aug 2018 06:44:18 GMT - totaamwin32:

python-zeroconf (original feature ticket: #1644) dropped support for python2 in version 0.20 (see python2-zeroconf: updated to 0.20.0, but 0.20.0 dropped python2 support), but something is not right and using easy_install will pickup the latest (broken) version, so we have to be specific about it: r20193. No such problems with python3.

Sun, 26 Aug 2018 16:24:58 GMT - Antoine Martin:

Work in progress lives here: github thesmo MINGW-packages

Sat, 13 Oct 2018 07:28:18 GMT - Antoine Martin: milestone changed

milestone changed from 2.4 to 2.5

Tue, 16 Oct 2018 05:28:04 GMT - Antoine Martin:

Here's a slightly more tricky one: pygtkglext as per ticket:678#comment:27 (2 patches and a workaround for the install step), it was MIA from my 64-bit build VM, fortunately the new "native" backend was working OK so I didn't notice!

Sun, 21 Oct 2018 18:34:32 GMT - Antoine Martin:

Minor update: rencode 1.0.6, see r20754

Tue, 13 Nov 2018 09:03:08 GMT - Antoine Martin:

@smo: see ticket:2004#comment:3 for libyuv.

Wed, 28 Nov 2018 15:29:58 GMT - Smo:

Still waiting on this merge. https://github.com/Alexpux/MINGW-packages/pull/4595

Wed, 28 Nov 2018 15:34:38 GMT - Antoine Martin:

Can you update what has been merged and replace easy_install with pacman in the setup and update scripts?

Thu, 29 Nov 2018 12:30:45 GMT - Antoine Martin:

Found that paramiko, comtypes, netifaces and rencode are available in MSYS2 now, so r21147 switches to that.

Fri, 18 Jan 2019 03:58:54 GMT - Smo:

Here is a link to all the closed merge requests.

https://github.com/Alexpux/MINGW-packages/pulls?q=is%3Apr+author%3Athesmo+is%3Aclosed

nvidia-ml-py seems to be the only open one still

Fri, 25 Jan 2019 09:39:16 GMT - Antoine Martin:

Useful link: thesmo pull requests

r21483 switches to MSYS2 packages for: websocket-client, setproctitle, pyu2f, ldap, ldap3, bcrypt and pynacl. Also zeroconf, but only for python3 (see below, comment:5).

Important libraries left to package / fix:

lz4 - crucial, see comment:4
libyuv - see comment:10
websockify - see comment:3
nvidia-ml-py - pending: https://github.com/Alexpux/MINGW-packages/pull/4595
zeroconf should be using version 0.19 for python2 as per comment:5
pyopengl: should be packaging a version newer than 3.1.0, 3.1.1 needs patches for python3 support, as per comment:2
pygtkglext - see comment:8 (maybe we can just forget about this one since 2.5 will be using the "native" opengl backend by default)

Sun, 27 Jan 2019 16:12:35 GMT - totaamwin32:

With the two build files above, I can generate a working installation of xpra.

Still TODO:

apply fixes from comment:15
merge those two packages
provide a better way of generating the /etc and /share/xpra directories, without doing a fake build (even if it is a minimal one, doing the cx_Freeze step is expensive and unnecessary - also requires cx_Freeze which we don't really need for anything)
is there a way to make a truly generic noarch package? the contents of the mingw-w64-x86_64-xpra-common are not architecture dependent at all, we want a mingw-w64-xpra-common instead

Thu, 31 Jan 2019 16:04:58 GMT - Antoine Martin:

Sent pull request for https://github.com/Alexpux/MINGW-packages/pull/4937.

Fri, 01 Feb 2019 14:56:58 GMT - Antoine Martin: owner, status changed

owner changed from Smo to Antoine Martin
status changed from new to assigned

The pull request has been merged, I have made a new one for python-nvidia-ml - the one above was broken for python3.

Since 2.5 will drop websockify (#2121) and make "native" the default opengl backend (r21382), there aren't many important packages left to fix / add from comment:15:

libyuv as per comment:10
pyopengl as per comment:2
zeroconf as per comment:5 - no idea how to deal with this one..

Fri, 01 Feb 2019 16:15:37 GMT - Antoine Martin:

pull request for python-zeroconf: https://github.com/Alexpux/MINGW-packages/pull/4941 with one build file for each python version.

Mon, 04 Feb 2019 15:41:28 GMT - Antoine Martin:

As of r21532 + r21533 + r21534, minimal builds don't include anything at all, not even any python bits. Adding --with-data we get just the extra bits we need for packaging "xpra-common".