ContextQMD
Back to Arrow

Minimal Python source build on Linux

python/examples/minimal_build/README.md

latest2.7 KB
Original Source
<!--- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->

Minimal Python source build on Linux

This directory shows how to bootstrap a local build from source on Linux with an eye toward maximum portability across different Linux distributions. This may help for contributors debugging build issues caused by their local environments.

Fedora 35

First, build the Docker image using:

docker build -t arrow_fedora_minimal -f Dockerfile.fedora .

Then build PyArrow with conda or pip, respectively:

# With pip
docker run --rm -t -i -v $PWD:/io -v $PWD/../../..:/arrow arrow_fedora_minimal /io/build_venv.sh

# With conda
docker run --rm -t -i -v $PWD:/io -v $PWD/../../..:/arrow arrow_fedora_minimal /io/build_conda.sh

Alternatively you can use Docker Compose to build and run using:

docker compose build

# With conda
docker compose run --rm minimal-fedora-conda

# With pip
docker compose run --rm minimal-fedora-venv

Ubuntu 24.04

First, build the Docker image using:

docker build -t arrow_ubuntu_minimal -f Dockerfile.ubuntu .

Then build PyArrow with conda or pip, respectively:

# With pip
docker run --rm -t -i -v $PWD:/io -v $PWD/../../..:/arrow arrow_ubuntu_minimal /io/build_venv.sh

# With conda
docker run --rm -t -i -v $PWD:/io -v $PWD/../../..:/arrow arrow_ubuntu_minimal /io/build_conda.sh

Alternatively you can use Docker Compose to build and run using:

docker compose build

# With conda
docker compose run --rm minimal-ubuntu-conda

# With pip
docker compose run --rm minimal-ubuntu-venv

Building on Fedora - Podman and SELinux

In addition to using Podman instead of Docker, you need to specify :Z for SELinux relabelling when binding a volume.

First, build the image using:

podman build -t arrow_fedora_minimal -f Dockerfile.fedora

Then build PyArrow with pip:

# With pip
podman run --rm -i -v $PWD:/io:Z -v $PWD/../../..:/arrow:Z -t arrow_fedora_minimal /io/build_venv.sh