Skip to content

Python Seg Faults on upgrade #3827

@ITSJORDAN-TFA

Description

@ITSJORDAN-TFA

Self-Hosted Version

25.7.0 (was 25.6.2)

CPU Architecture

x86_64

Docker Version

25.0.8, build 0bab007

Docker Compose Version

2.36.2

Machine Specification

  • My system meets the minimum system requirements of Sentry
    4core/16gb (32gb swap)

Steps to Reproduce

I recently upgrades from 25.6.2 -> 25.7.0.
I can see from the nginx logs that the envelope ingestion is fine - but i seem to be having issues with the web container not serving requests.

curl http://172.18.0.9:9000/_health
curl: (7) Failed to connect to 172.18.0.9 port 9000 after 0 ms: Couldn't connect to server

I have noticed since the upgrade the minimum reccom specs are cutting it as the server is maxed at 100% most of the time (i only operate 1 service with around 100 users)

Does the web container have issues serving requests if the machine is under heavy load?

Image

From the web containers logs

)
spawned uWSGI worker 2 (pid: 742, cores: 4)
spawned uWSGI worker 3 (pid: 743, cores: 4)
spawned uWSGI http 1 (pid: 744)
WSGI app 0 (mountpoint='') ready in 68 seconds on interpreter 0x7f33a2818a70 pid: 741 (default app)
WSGI app 0 (mountpoint='') ready in 68 seconds on interpreter 0x7f33a2818a70 pid: 743 (default app)
WSGI app 0 (mountpoint='') ready in 68 seconds on interpreter 0x7f33a2818a70 pid: 742 (default app)
SIGINT/SIGTERM received...killing workers...
gateway "uWSGI http 1" has been buried (pid: 744)
Sentry is attempting to send 1 pending events
Waiting up to 2 seconds
Press Ctrl-C to quit
Sentry is attempting to send 1 pending events
Waiting up to 2 seconds
Press Ctrl-C to quit
!!! uWSGI process 741 got Segmentation Fault !!!
*** backtrace of 741 ***
/.venv/lib/python3.13/site-packages/pyuwsgi.cpython-313-x86_64-linux-gnu.so(uwsgi_backtrace+0x2f) [0x7f33a1cd331f]
/.venv/lib/python3.13/site-packages/pyuwsgi.cpython-313-x86_64-linux-gnu.so(uwsgi_segfault+0x2f) [0x7f33a1cd371f]
/lib/x86_64-linux-gnu/libc.so.6(+0x3c050) [0x7f33a2179050]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c69bb) [0x7f33a24e69bb]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x14d0f) [0x7f33a110dd0f]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x17a41) [0x7f33a1110a41]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x1c13c) [0x7f33a111513c]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x1c836) [0x7f33a1115836]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d4e4d) [0x7f33a24f4e4d]
/usr/local/bin/../lib/libpython3.13.so.1.0(PyObject_Vectorcall+0x58) [0x7f33a24aa318]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x95bb) [0x7f33a24c19fb]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d925a) [0x7f33a24f925a]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c6b23) [0x7f33a24e6b23]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d925a) [0x7f33a24f925a]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c6b23) [0x7f33a24e6b23]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d92d6) [0x7f33a24f92d6]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d92d6) [0x7f33a24f92d6]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x2a78a3) [0x7f33a25c78a3]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x21d298) [0x7f33a253d298]
/lib/x86_64-linux-gnu/libc.so.6(+0x891f5) [0x7f33a21c61f5]
/lib/x86_64-linux-gnu/libc.so.6(__clone+0x40) [0x7f33a2245b00]
*** end of backtrace ***
Traceback (most recent call last):
  File "/.venv/lib/python3.13/site-packages/sentry_sdk/transport.py", line 565, in send_envelope_wrapper
    self._send_envelope(envelope)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
  File "/.venv/lib/python3.13/site-packages/sentry_sdk/transport.py", line 499, in _send_envelope
    self._send_request(
    ~~~~~~~~~~~~~~~~~~^
        body.getvalue(),
        ^^^^^^^^^^^^^^^^
    ...<2 lines>...
        envelope=envelope,
        ^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/src/sentry/src/sentry/utils/sdk.py", line 279, in patched_send_request
    return _send_request(*args, **kwargs)
  File "/.venv/lib/python3.13/site-packages/sentry_sdk/transport.py", line 351, in _send_request
    response = self._request(
        "POST",
    ...<2 lines>...
        headers,
    )
  File "/.venv/lib/python3.13/site-packages/sentry_sdk/transport.py", line 768, in _request
    response = self._pool.request(
        method,
    ...<10 lines>...
        },
    )
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/interfaces.py", line 43, in request
    response = self.handle_request(request)
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/connection_pool.py", line 268, in handle_request
    raise exc
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/connection_pool.py", line 251, in handle_request
    response = connection.handle_request(request)
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/connection.py", line 99, in handle_request
    raise exc
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/connection.py", line 76, in handle_request
    stream = self._connect(request)
  File "/.venv/lib/python3.13/site-packages/httpcore/_sync/connection.py", line 156, in _connect
    stream = stream.start_tls(**kwargs)
  File "/.venv/lib/python3.13/site-packages/httpcore/_backends/sync.py", line 168, in start_tls
    raise exc
  File "/.venv/lib/python3.13/site-packages/httpcore/_backends/sync.py", line 163, in start_tls
    sock = ssl_context.wrap_socket(
        self._sock, server_hostname=server_hostname
    )
  File "/usr/local/lib/python3.13/ssl.py", line 455, in wrap_socket
    return self.sslsocket_class._create(
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        sock=sock,
        ^^^^^^^^^^
    ...<5 lines>...
        session=session
        ^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/local/lib/python3.13/ssl.py", line 1067, in _create
    self._sslobj = self._context._wrap_socket(
                   ~~~~~~~~~~~~~~~~~~~~~~~~~~^
        self, server_side, self.server_hostname,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        owner=self, session=self._session,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
TypeError: '' object is not callable
00:56:33 [ERROR] sentry_sdk.errors: Internal error in sentry_sdk
!!! uWSGI process 742 got Segmentation Fault !!!
*** backtrace of 742 ***
/.venv/lib/python3.13/site-packages/pyuwsgi.cpython-313-x86_64-linux-gnu.so(uwsgi_backtrace+0x2f) [0x7f33a1cd331f]
/.venv/lib/python3.13/site-packages/pyuwsgi.cpython-313-x86_64-linux-gnu.so(uwsgi_segfault+0x2f) [0x7f33a1cd371f]
/lib/x86_64-linux-gnu/libc.so.6(+0x3c050) [0x7f33a2179050]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c69cc) [0x7f33a24e69cc]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x14d0f) [0x7f33a110dd0f]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x17a41) [0x7f33a1110a41]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x1c13c) [0x7f33a111513c]
/usr/local/lib/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so(+0x1c836) [0x7f33a1115836]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d4e4d) [0x7f33a24f4e4d]
/usr/local/bin/../lib/libpython3.13.so.1.0(PyObject_Vectorcall+0x58) [0x7f33a24aa318]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x95bb) [0x7f33a24c19fb]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d925a) [0x7f33a24f925a]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c6b23) [0x7f33a24e6b23]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d925a) [0x7f33a24f925a]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1c6b23) [0x7f33a24e6b23]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d92d6) [0x7f33a24f92d6]
/usr/local/bin/../lib/libpython3.13.so.1.0(_PyEval_EvalFrameDefault+0x57f9) [0x7f33a24bdc39]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x1d92d6) [0x7f33a24f92d6]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x2a78a3) [0x7f33a25c78a3]
/usr/local/bin/../lib/libpython3.13.so.1.0(+0x21d298) [0x7f33a253d298]
/lib/x86_64-linux-gnu/libc.so.6(+0x891f5) [0x7f33a21c61f5]
/lib/x86_64-linux-gnu/libc.so.6(__clone+0x40) [0x7f33a2245b00]
*** end of backtrace ***
panicked at /rustc/6b00bc3880198600130e1cf62b8f8a93494488cc/library/std/src/thread/local.rs:281:25:

thread panicked while processing panic. aborting.
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.

Expected Result

I should be able to login to the front-end

Actual Result

Image

Event ID

No response

Metadata

Metadata

Assignees

No one assigned

    Projects

    Status

    No status

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions