Unable to redact value of type SIGSEGV

[hinchliff]

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

2.9.3

What happened?

Something in our airflow configuration (after configuring Writing logs to Google Stackdriver) is causing a SIGSEGV. Immediately after some of the logging messages from {local_task_job_runner.py:130} CRITICAL showing the SIGSEGV, there follows another log message {secrets_masker.py:282} WARNING - Unable to redact value of type with the SIGSEGV message as the item.

What you think should happen instead?

I'd love to not get a SIGSEGV when trying to configure Writing logs to Google Stackdriver. But I don't know what's causing that yet.

At the same time, those SIGSEGV probably should throw an exception in the redaction logic either. And those messages ask for a bug report to be filed.

How to reproduce

Cause Airflow to raise a SIGSEGV ?

Operating System

Debian GNU/Linux 12 (bookworm)

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==8.25.0
apache-airflow-providers-celery==3.7.2
apache-airflow-providers-cncf-kubernetes==8.3.3
apache-airflow-providers-common-io==1.3.2
apache-airflow-providers-common-sql==1.14.2
apache-airflow-providers-docker==3.12.2
apache-airflow-providers-elasticsearch==5.4.1
apache-airflow-providers-fab==1.2.2
apache-airflow-providers-ftp==3.10.0
apache-airflow-providers-google==10.21.0
apache-airflow-providers-grpc==3.5.2
apache-airflow-providers-hashicorp==3.7.1
apache-airflow-providers-http==4.12.0
apache-airflow-providers-imap==3.6.1
apache-airflow-providers-microsoft-azure==10.2.0
apache-airflow-providers-mysql==5.6.2
apache-airflow-providers-odbc==4.6.2
apache-airflow-providers-openlineage==1.9.1
apache-airflow-providers-postgres==5.11.2
apache-airflow-providers-redis==3.7.1
apache-airflow-providers-sendgrid==3.5.1
apache-airflow-providers-sftp==4.10.2
apache-airflow-providers-slack==8.7.1
apache-airflow-providers-smtp==1.7.1
apache-airflow-providers-snowflake==5.6.0
apache-airflow-providers-sqlite==3.8.1
apache-airflow-providers-ssh==3.11.2

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else?

Once the config changes to (attempt to) Write logs to Google Stackdriver, viewing every Task attempt in the UI resulted in the SIGSEGV.

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[hinchliff]

the full exception log from secrets_masker.py --

[2025-02-20T19:44:42.794+0000] {secrets_masker.py:282} WARNING - Unable to redact value of type 
******************************************* Received SIGSEGV *******************************************
SIGSEGV (Segmentation Violation) signal indicates Segmentation Fault error which refers to
an attempt by a program/library to write or read outside its allocated memory.

In Python environment usually this signal refers to libraries which use low level C API.
Make sure that you use right libraries/Docker Images
for your architecture (Intel/ARM) and/or Operational System (Linux/macOS).

Suggested way to debug
======================
  - Set environment variable 'PYTHONFAULTHANDLER' to 'true'.
  - Start airflow services.
  - Restart failed airflow task.
  - Check 'scheduler' and 'worker' services logs for additional traceback
    which might contain information about module/library where actual error happen.

Known Issues
============

Note: Only Linux-based distros supported as "Production" execution environment for Airflow.

macOS
-----
 1. Due to limitations in Apple's libraries not every process might 'fork' safe.
    One of the general error is unable to query the macOS system configuration for network proxies.
    If your are not using a proxy you could disable it by set environment variable 'no_proxy' to '*'.
    See: https://github.com/python/cpython/issues/58037 and https://bugs.python.org/issue30385#msg293958
********************************************************************************************************, please report this via <https://github.com/apache/airflow/issues>. Error was: RecursionError: maximum recursion depth exceeded

[potiuk]

Did you follow the recommendation for debugging that you copy & pasted?

[potiuk]

Converted to discussion - Linux is the only environment we test on (as explained) - so if things hapen on macOS because 3rd-party libraries do not handle forking well, that's a bit of discussion and it reqiires more debugging from someone who wants to make those libraries on macos