Xpra: Ticket #679: opengl improvements: double buffering, limited repaints, paint state

See also ticket:640#comment:3.

At the moment, only win32 uses double-buffering by default. Is it required? Useful? The PBO is a bit like our own double buffering already. Does double buffering limit the number of paints we can do per second because of the synchronization that happens when we swap_buffers? (if there is any!) This can also cause problems if we have many windows: they will all consume synchronization time. Or will they? See Using SwapBuffers() with multiple OpenGL canvases and vertical sync?

This needs testing with:

XPRA_OPENGL_DOUBLE_BUFFERED=0

And maybe a dedicated test app to trigger the paint refresh pattern needed for testing. (many windows? fast refresh? hard!)

Same for Linux, do we want to enable double buffering there? Does it work reliably? (works here)

Also, when not using double buffering, we can optimize repaints to only paste the fbo contents on the area of the window that needs updating instead of the whole window.

As per http://www.mesa3d.org/brianp/sig97/perfopt.htm: SwapBuffer? calls and graphics pipe blocking: On systems with 3-D graphics hardware the SwapBuffers? call is synchronized to the monitor's vertical retrace. Input to the OpenGL command queue may be blocked until the buffer swap has completed. Therefore, don't put more OpenGL calls immediately after SwapBuffers?. Instead, put application computation instructions which can overlap with the buffer swap delay. See also http://www.opengl.org/wiki/Swap_Interval We should try to ensure we don't make any GL calls after swap_buffers. For example, the whole set_rgb_paint_state / unset_rgb_paint_state logic should be changed to be done on-demand before each paint rather than assuming a specific state is the default. There is also a glClear there, not sure what to do with it: it doesn't really do anything, but I can only find conflicting information on the performance implications.

Also, we want zerocopy upload for video encodings, especially dec_avcodec2, see #717 - currently disabled because avcodec buffers are not thread safe?

We probably should re-probe the max texture size check when the screen is resized?



Sun, 14 Sep 2014 10:25:47 GMT - Antoine Martin: owner, status, description, summary changed


Sun, 14 Sep 2014 11:03:20 GMT - Antoine Martin: description changed

Improvements:

No matter how many small glxgears window I start, I seem to only get ~60fps, which is my monitor refresh rate... So we are capped.

Whilst we're here, it would be good to deal with #478 too.


Thu, 25 Sep 2014 04:21:49 GMT - Antoine Martin:

r7600 caused #693: bug with scaling, which is fixed in r7804.


Thu, 13 Nov 2014 05:23:20 GMT - Antoine Martin: description changed

#717: bug caused by old versions of pyopengl found in Fedora 20..


Wed, 10 Dec 2014 00:07:03 GMT - Antoine Martin:

See also: #760, #792


Tue, 14 Apr 2015 16:14:21 GMT - Antoine Martin: milestone changed

Re-scheduling.


Fri, 01 May 2015 06:23:15 GMT - Antoine Martin: description changed


Sat, 23 May 2015 10:51:31 GMT - Antoine Martin:

Double-buffering seems to work on Linux see ticket:760#comment:22, but on OSX this hides the box paint feature.


Mon, 06 Jul 2015 15:45:46 GMT - Antoine Martin:

A lot of work was completed in #792.

Which only leaves the cleanup of the paint state logic.


Tue, 07 Jul 2015 10:10:41 GMT - Antoine Martin:

I've just hit this error by starting a new command via the control channel very early and / or changing focus as it appeared:

Traceback (most recent call last):
  File "/usr/lib64/python2.7/site-packages/xpra/client/gl/gtk2/gl_window_backing.py", line 39, in gl_expose_event
    self.gl_init()
  File "/usr/lib64/python2.7/site-packages/xpra/client/gl/gl_window_backing_base.py", line 396, in gl_init
    glClear(GL_COLOR_BUFFER_BIT)
  File "/usr/lib/python2.7/site-packages/OpenGL/platform/baseplatform.py", line 402, in __call__
    return self( *args, **named )
  File "errorchecker.pyx", line 53, in OpenGL_accelerate.errorchecker._ErrorChecker.glCheckError (src/errorchecker.c:1218)
OpenGL.error.GLError: GLError(
	err = 1286,
	description = 'invalid framebuffer operation',
	baseOperation = glClear,
	cArguments = (GL_COLOR_BUFFER_BIT,)
)
Traceback (most recent call last):
  File "/usr/lib64/python2.7/site-packages/xpra/client/gl/gtk2/gl_window_backing.py", line 39, in gl_expose_event
    self.gl_init()
  File "/usr/lib64/python2.7/site-packages/xpra/client/gl/gl_window_backing_base.py", line 396, in gl_init
    glClear(GL_COLOR_BUFFER_BIT)
  File "errorchecker.pyx", line 53, in OpenGL_accelerate.errorchecker._ErrorChecker.glCheckError (src/errorchecker.c:1218)
OpenGL.error.GLError: GLError(
	err = 1286,
	description = 'invalid framebuffer operation',
	baseOperation = glClear,
	cArguments = (GL_COLOR_BUFFER_BIT,)
)

Maybe the expose event fired before we have a proper gl context to use for painting? r9871 should fix that.


Fri, 31 Jul 2015 06:43:28 GMT - Antoine Martin:

Minor enhancement / fix: see r10172.


Tue, 01 Sep 2015 08:55:27 GMT - Antoine Martin: status changed; resolution set

Closing:


Sat, 23 Jan 2021 05:02:46 GMT - migration script:

this ticket has been moved to: https://github.com/Xpra-org/xpra/issues/679