Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Building wheel for lz4 (pyproject.toml) did not run successfully #1790

Closed
2 tasks
DeepakDonde-GWL opened this issue Jan 29, 2025 · 1 comment
Closed
2 tasks

Comments

@DeepakDonde-GWL
Copy link

Describe the bug
I get error - Building wheel for lz4 (pyproject.toml) did not run successfully. when I try to run my project using astro dev start command
This bug occures when I switched project from Ubuntu to MacOS.(Facing issue on MacOS only)
Below is the error log:

#0 building with "desktop-linux" instance using docker driver

#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.15kB done
#1 DONE 0.0s

#2 [internal] load metadata for quay.io/astronomer/astro-runtime:12.0.0
#2 DONE 0.9s

#3 [internal] load .dockerignore
#3 transferring context: 112B done
#3 DONE 0.0s

#4 [1/2] FROM quay.io/astronomer/astro-runtime:12.0.0@sha256:7c6f1c068f11008b6ec97fcee5f8ad139e17f736c249c8f062f9c59876891a49
#4 resolve quay.io/astronomer/astro-runtime:12.0.0@sha256:7c6f1c068f11008b6ec97fcee5f8ad139e17f736c249c8f062f9c59876891a49 0.0s done
#4 DONE 0.0s

#5 [internal] load build context
#5 transferring context: 16.79kB done
#5 DONE 0.0s

#6 [3/2] RUN /usr/local/bin/install-system-packages
#6 CACHED

#7 [2/2] COPY packages.txt .
#7 CACHED

#8 [4/2] COPY requirements.txt .
#8 CACHED

#9 [5/2] RUN /usr/local/bin/install-python-dependencies
#9 0.087 + /usr/local/bin/install-python-dependencies
#9 0.282 Looking in indexes: https://pip.astronomer.io/v2/
#9 0.629 Collecting clickhouse-connect (from -r requirements.txt (line 2))
#9 0.699   Downloading clickhouse_connect-0.8.15-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (3.4 kB)
.
.
#9 9.260 Downloading websockets-13.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (165 kB)
#9 9.300 Downloading propcache-0.2.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (241 kB)
#9 9.366 Downloading yarl-1.18.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (332 kB)
#9 9.436 Building wheels for collected packages: lz4
#9 9.437   Building wheel for lz4 (pyproject.toml): started
#9 9.526   Building wheel for lz4 (pyproject.toml): finished with status 'error'
#9 9.528   error: subprocess-exited-with-error
#9 9.528   
#9 9.528   × Building wheel for lz4 (pyproject.toml) did not run successfully.
#9 9.528   │ exit code: 1
#9 9.528   ╰─> [20 lines of output]
#9 9.528       /tmp/pip-build-env-wlgo8hpa/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py:270: UserWarning: Unknown distribution option: 'tests_require'
#9 9.528         warnings.warn(msg)
#9 9.528       /tmp/pip-build-env-wlgo8hpa/overlay/lib/python3.12/site-packages/setuptools_scm/_integration/setuptools.py:92: UserWarning: version of lz4 already set
#9 9.528         warnings.warn(f"version of {dist_name} already set")
#9 9.528       running bdist_wheel
#9 9.528       running build
#9 9.528       running build_py
#9 9.528       creating build/lib.linux-aarch64-cpython-312/lz4
#9 9.528       copying lz4/__init__.py -> build/lib.linux-aarch64-cpython-312/lz4
#9 9.528       copying lz4/version.py -> build/lib.linux-aarch64-cpython-312/lz4
#9 9.528       creating build/lib.linux-aarch64-cpython-312/lz4/frame
#9 9.528       copying lz4/frame/__init__.py -> build/lib.linux-aarch64-cpython-312/lz4/frame
#9 9.528       creating build/lib.linux-aarch64-cpython-312/lz4/block
#9 9.528       copying lz4/block/__init__.py -> build/lib.linux-aarch64-cpython-312/lz4/block
#9 9.528       running build_ext
#9 9.528       building 'lz4._version' extension
#9 9.528       creating build/temp.linux-aarch64-cpython-312/lz4
#9 9.528       creating build/temp.linux-aarch64-cpython-312/lz4libs
#9 9.528       gcc -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -Ilz4libs -I/usr/local/include/python3.12 -c lz4/_version.c -o build/temp.linux-aarch64-cpython-312/lz4/_version.o -O3 -Wall -Wundef
#9 9.528       error: command 'gcc' failed: No such file or directory
#9 9.528       [end of output]
#9 9.528   
#9 9.528   note: This error originates from a subprocess, and is likely not a problem with pip.
#9 9.528   ERROR: Failed building wheel for lz4
#9 9.528 Failed to build lz4
#9 9.688 
#9 9.688 [notice] A new release of pip is available: 24.2 -> 25.0
#9 9.688 [notice] To update, run: pip install --upgrade pip
#9 9.688 ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (lz4)
#9 ERROR: process "/bin/bash -o pipefail -e -u -x -c /usr/local/bin/install-python-dependencies" did not complete successfully: exit code: 1
------
 > [5/2] RUN /usr/local/bin/install-python-dependencies:
9.528       error: command 'gcc' failed: No such file or directory
9.528       [end of output]
9.528   
9.528   note: This error originates from a subprocess, and is likely not a problem with pip.
9.528   ERROR: Failed building wheel for lz4
9.528 Failed to build lz4
9.688 
9.688 [notice] A new release of pip is available: 24.2 -> 25.0
9.688 [notice] To update, run: pip install --upgrade pip
9.688 ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (lz4)
------
Dockerfile:1
--------------------
   1 | >>> FROM quay.io/astronomer/astro-runtime:12.0.0
   2 |     
   3 |     USER root
--------------------
ERROR: failed to solve: process "/bin/bash -o pipefail -e -u -x -c /usr/local/bin/install-python-dependencies" did not complete successfully: exit code: 1

View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/j3vkz80y73hj1f835eaj0qckk

Error: an error was encountered while building the image, see the build logs for details

What CLI Version did you experience this bug?

Astro CLI Version: 1.33.0

This CLI bug is related to which Astronomer Platform?

  • Astro
  • Software
  • [ *] None/Unknown

What Operating System is the above CLI installed on?
MacOS Version 15.1 (24B2083)

🪜 Steps To Reproduce

  1. Create Airflow project with below requirement.txt and docker file
    requirement.txt
lickhouse-connect
attrs
blinker==1.7.0
Brotli
certifi
cffi
charset-normalizer
cryptography
et-xmlfile
exceptiongroup
flake8
h11
h2
hpack
hyperframe
idna
kaitaistruct
mccabe
numpy
openpyxl
outcome
pandas
pyasn1
pycodestyle
pycparser
pyflakes
pyOpenSSL
pyparsing
PySocks
python-dateutil
pytz
requests
selenium
selenium-wire
six
sniffio
sortedcontainers
trio
trio-websocket
typing-extensions
tzdata
urllib3
websocket-client
wsproto
zstandard
webdriver-manager
astro-run-dag
supabase
azure-storage-blob
xmltodict

docker file

FROM quay.io/astronomer/astro-runtime:12.0.0

USER root

RUN apt-get update && \
    apt-get install -y --no-install-recommends \
    ca-certificates \
    gnupg \
    unzip \
    wget \
    && rm -rf /var/lib/apt/lists/* \
    # Add Google Chrome repository securely
    && wget --max-redirect=0 -q -O - https://dl.google.com/linux/linux_signing_key.pub | apt-key add - \
    && echo "deb [arch=amd64] https://dl.google.com/linux/chrome/deb/ stable main" | tee /etc/apt/sources.list.d/google-chrome.list \
    && apt-get update \
    && apt-get install -y --no-install-recommends google-chrome-stable \
    # Clean up unnecessary files
    && rm -rf /var/lib/apt/lists/* \
    # Download and install ChromeDriver
    && CHROMEDRIVER_VERSION=$(wget -qO- https://chromedriver.storage.googleapis.com/LATEST_RELEASE) && \
    wget https://chromedriver.storage.googleapis.com/${CHROMEDRIVER_VERSION}/chromedriver_linux64.zip && \
    unzip chromedriver_linux64.zip && \
    mv chromedriver /usr/local/bin/chromedriver && \
    chmod +x /usr/local/bin/chromedriver && \
    rm chromedriver_linux64.zip

USER astro
  1. Run command : astro dev start
@DeepakDonde-GWL
Copy link
Author

This issue was resolved by adding lz4==4.3.3 at the top of requirement.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant