Shipped Boost.Python is incompatible with Python 3.11

[easybob95]

Hello,

in order to test Python 3.11 with pycuda, i have just installed latest pycuda version : 2022.1

I use CUDA 11.6.2 with a windows 11 laptop.

When i try my program (using pycuda), i get this error message :

Traceback (most recent call last):
  File "D:\Alain\Astro\Soft\PC\PC_Traitement_Video_V7_51g.py", line 19, in <module>
    import pycuda.driver as drv
  File "C:\Users\apail\AppData\Local\Programs\Python\Python311\Lib\site-packages\pycuda\driver.py", line 65, in <module>
    from pycuda._driver import *  # noqa
SystemError: type Boost.Python.enum has the Py_TPFLAGS_HAVE_GC flag but has no traverse function

Any help will be appreciate.

Alain

[inducer]

Thanks for the report! My read on this is that the (quite old, quite long in the tooth version of Boost.Python that ships with PyCUDA is incompatible with Python 3.11. You should be able to switch to Boost.Python from an up-to-date version of Boost for an immediate remedy.

In the medium-to-short term, we should either update the shipped Boost.Python or migrate to Pybind11 or nanobind. I'm leaning towards one of the latter.

[easybob95]

Hello,

i installed boost python 1.78 but i get the same issue.

Alain

[inducer]

I saw you filed boostorg/python#388.

If you're sure you disabled the shipped boost and the updated Boost.Python was used instead, then it may just be that Boost.Python itself still needs to be updated.

[easybob95]

Hello,
i made some tests and i think i still have the issue even with the updated Boost.Python.

Alain

[easybob95]

Hello,

any good or bad news about this problem ?

Alain

[inducer]

We could try simply applying this patch if that works: boostorg/python@a218bab.

[easybob95]

This means you will release a new pycuda version for Python 3.11 ?

If so, i will test it.

Alain

[inducer]

No, that means I'm hoping you can apply that patch to the source under bpl-subset and report back.

[easybob95]

I am really honoured you think i can do such thing. But to be honest, i don't understand a single word about the solution to this issue.
I am very sorry to say that i will never succed applying that patch and i do regret that. Really.

Alain

[inducer]

Fair enough. I've included the patch in 697139f. It would be helpful if you could try and build that.

[inducer]

(and report back)

[easybob95]

Hello Andreas,

Many thanks.

As i am one of the worst software writer, i must say you still use Chinese language (for example, my best level is to type "py -m pip install pycuda-XXX-XXX-XXX.whl").

So i will study the build of a modified boost (i guess ?).

For now, my holidays are coming and my software works fine on my laptop. As i plan to make many deep sky observations and videos using my software (it's ok with Python 3.10 and Pycuda 2022.1), i won't touch anything. If i make some experiments, as i don't really understand what i am supposed to do, i think i am able to destroy everything (and i would like to avoid this).

I am sorry Andreas to be such noob. This does not help me when i try to solve some issues with my system and i am my main and first victim !

Anyway, i really appreciate your help.

I'll be back.

Alain

[inducer]

Make sure that PyCUDA is not currently installed, then try

pip install git+https://github.com/inducer/pycuda.git