Bazel rules to install Python dependencies with Poetry

Last update: Dec 15, 2021

Overview

rules_python_poetry

Bazel rules to install Python dependencies from a Poetry project. Works with native Python rules for Bazel.

Getting started

Add the following to your WORKSPACE file:

load("@bazel_tools//tools/build_defs/repo:http.bzl", "http_archive")

http_archive(
    name = "rules_python",
    url = "https://github.com/bazelbuild/rules_python/releases/download/0.1.0/rules_python-0.1.0.tar.gz",
    sha256 = "b6d46438523a3ec0f3cead544190ee13223a52f6a6765a29eae7b7cc24cc83a0",
)

http_archive(
    name = "rules_python_poetry",
    url = "https://github.com/martinxsliu/rules_python_poetry/archive/v0.1.0.tar.gz",
    sha256 = "8f0abc58a8fcf75341b4615c6b7d9bb254119577629f45c2b1bb60f60f31b301",
    strip_prefix = "rules_python_poetry-0.1.0"
)

load("@rules_python_poetry//:defs.bzl", "poetry_install_toolchain", "poetry_install")

# Optional, if you want to use a specific version of Poetry (1.0.10 is the default).
poetry_install_toolchain(poetry_version = "1.1.4")

poetry_install(
    name = "my_deps",
    pyproject_toml = "//path/to:pyproject.toml",
    poetry_lock = "//path/to:poetry.lock",
    dev = True,  # Optional
)

Under the hood, poetry_install uses Poetry to export a requirements.txt file which is then passed to rule_python's pip_install repository rule. You can consume dependencies the same way as you would with pip_install, e.g.:

load("@my_deps//:requirements.bzl", "requirement")

py_library(
    name = "my_lib",
    srcs = ["my_lib.py"],
    deps = [
        ":my_other_lib",
        requirement("some_pip_dep"),
        requirement("another_pip_dep[some_extra]"),
    ],
)

Poetry dependencies

Poetry allows you to specify dependencies from different types of sources that are not automatically fetched and installed by the poetry_install rule. You will have to manually declare these dependencies.

See tests/multi/app for examples.

Local directory dependency

A dependency on a local directory, for example if you have multiple projects within a monorepo that depend on each other.

[tool.poetry.dependencies]
foo = {path = "../libs/foo"}

If the local dependency has a py_library target, you can include it in the deps attribute.

py_library(
    name = "my_lib",
    srcs = ["my_lib.py"],
    deps = [
        "//path/to/libs:foo",
    ],
)

Local file dependency

A dependency on a local tarball, for example if you have vendored packages.

[tool.poetry.dependencies]
foo = {path = "../vendor/foo-1.2.3.tar.gz"}

There are some options available. The first is to extract the archive and vendor the extracted files. Then add a py_library that can be included as a deps, like the local directory dependency.

The second is to use the py_archive repository rule to declare the archive as an external repository in your WORKSPACE file, e.g.:

load("@rules_python_poetry//:defs.bzl", "py_archive")

py_archive(
    name = "foo",
    archive = "//path/to/vendor:foo-1.2.3.tar.gz",
    strip_prefix = "foo-1.2.3",
)

The py_archive rule defines a target named :py_library that can be referenced like so:

py_library(
    name = "my_lib",
    srcs = ["my_lib.py"],
    deps = [
        "@foo//:py_library",
    ],
)

URL dependency

A dependency on a remote archive.

[tool.poetry.dependencies]
foo = {url = "https://example.com/packages/foo-1.2.3.tar.gz"}

You can use the py_archive repository rule to declare the remote archive as an external repository in your WORKSPACE file, e.g.:

load("@rules_python_poetry//:defs.bzl", "py_archive")

py_archive(
    name = "foo",
    url = "https://example.com/packages/foo-1.2.3.tar.gz",
    sha256 = "...",
    strip_prefix = "foo-1.2.3",
)

The py_archive rule defines a target named :py_library that can be referenced like so:

py_library(
    name = "my_lib",
    srcs = ["my_lib.py"],
    deps = [
        "@foo//:py_library",
    ],
)

Git dependency

Git dependencies are not currently supported. You can work around this by using a URL dependency instead of a git key.

You might also like...

Python 3.9.4 Graphics and Compute Shader Framework and Primitives with no external module dependencies

pyshader Python 3.9.4 Graphics and Compute Shader Framework and Primitives with no external module dependencies Fully programmable shader model (even

1 Jan 11, 2022

This library attempts to abstract the handling of Sigma rules in Python

This library attempts to abstract the handling of Sigma rules in Python. The rules are parsed using a schema defined with pydantic, and can be easily loaded from YAML files into a structured Python object.

44 Oct 29, 2022

Code and yara rules to detect and analyze Cobalt Strike

Cobalt Strike Resources This repository contains: analyze.py: a script to analyze a Cobalt Strike beacon (python analyze.py BEACON) extract.py; extrac

224 Jan 4, 2023

A Regex based linter tool that works for any language and works exclusively with custom linting rules.

renag Documentation Available Here Short for Regex (re) Nag (like "one who complains"). Now also PEGs (Parsing Expression Grammars) compatible with py

12 Oct 20, 2022

ChainJacking is a tool to find which of your Go lang direct GitHub dependencies is susceptible to ChainJacking attack.

36 Nov 2, 2022

A class to draw curves expressed as L-System production rules

6 Sep 9, 2022

An easy FASTA object handler, reader, writer and translator for small to medium size projects without dependencies.

miniFASTA An easy FASTA object handler, reader, writer and translator for small to medium size projects without dependencies. Installation Using pip /

3 Jun 30, 2022

Takes output from RedLime's SpeedRunIGT mod (igt_timer.log) to get the top run retime as per the rules in speedrun.com/mc as well as generating a new file which is a copy of igt_timer.log which specifies what type of pause each one was.

top-run-time Takes output from RedLime's SpeedRunIGT mod (igt_timer.log) to get the top run retime as per the rules in speedrun.com/mc as well as gene

2 May 12, 2022

An assistant to guess your pip dependencies from your code, without using a requirements file.

Pip Sala Bim is an assistant to guess your pip dependencies from your code, without using a requirements file. Pip Sala Bim will tell you which packag

15 Nov 19, 2022

Comments

Reference python3 instead of python in hashbang
This fixes a build error on Ubuntu 20.04:

ERROR: /workspace/WORKSPACE:41:15: fetching poetry_export rule //external:py_deps_export: Traceback (most recent call last): File "/workspace/out/external/rules_python_poetry/internal/export.bzl", line 19, column 17, in _poetry_export_impl fail("Poetry strip dependencies failed:\n%s\n%s" % (result.stdout, result.stderr))

Not all distros have python pointing to python3 by default yet. It's possible to resolve the issue by installing python-is-python3 but IMO explicitly specifying the version is better since it avoids this build error without needing to modify the host machine.

A future improvement could be to allow specifying a Bazel target which points to the Python target to use.
opened by bduffany 0
How can I have a py_test target use this poetry toolchain?
my BUILD file is:

load("@rules_python//python:defs.bzl", "py_test") py_test( name = "test_example", srcs = ["test_example.py"], )

but when running test, it is still using the system python instead of the poetry venv, is this possible and if so can you update the README?
opened by ruidc 0

Releases(v0.1.0)

v0.1.0(Nov 16, 2020)

First release of rules_python_poetry. Supports installing Python dependencies using Poetry's pyproject.toml and poetry.lock files.
Source code(tar.gz)
Source code(zip)

Bazel rules to install Python dependencies with Poetry

Related tags

Overview

rules_python_poetry

Getting started

Poetry dependencies

Local directory dependency

Local file dependency

URL dependency

Git dependency

You might also like...

Python 3.9.4 Graphics and Compute Shader Framework and Primitives with no external module dependencies

This library attempts to abstract the handling of Sigma rules in Python

Code and yara rules to detect and analyze Cobalt Strike

A Regex based linter tool that works for any language and works exclusively with custom linting rules.

ChainJacking is a tool to find which of your Go lang direct GitHub dependencies is susceptible to ChainJacking attack.

A class to draw curves expressed as L-System production rules

An easy FASTA object handler, reader, writer and translator for small to medium size projects without dependencies.

Takes output from RedLime's SpeedRunIGT mod (igt_timer.log) to get the top run retime as per the rules in speedrun.com/mc as well as generating a new file which is a copy of igt_timer.log which specifies what type of pause each one was.

An assistant to guess your pip dependencies from your code, without using a requirements file.

Comments

Reference python3 instead of python in hashbang

How can I have a py_test target use this poetry toolchain?

Releases(v0.1.0)

v0.1.0(Nov 16, 2020)

Owner

Martin Liu

Python library to decorate and beautify strings

FantasyBballHelper - Espn Fantasy Basketball Helper

A simple and efficient computing package for Genshin Impact gacha analysis

Get the stats of a (or more) Hypixel player(s)

Performance data for WASM SIMD instructions.

The purpose of this script is to bypass disablefund, provide some useful information, and dig the hook function of PHP extension.

No more support server flooding with questions about unsupported hosting.

Mechanized literally means automation.

A module to prevent invites and joins to Matrix rooms by checking the involved server(s)' domain.

Python communism - A module for initiating the communist revolution in each of our python modules

Amazon SageMaker Delta Sharing Examples

PyDy, short for Python Dynamics, is a tool kit written in the Python

Snek-test - An operating system kernel made in python and assembly

Safely pass trusted data to untrusted environments and back.

Bazel rules to install Python dependencies with Poetry

A good Tool to comment on xmw

A set of simple functions to upload and fetch pastes on paste.uploadgram.me

Python program to start your zoom meetings

World's best free and open source ERP.

NGEBUG is a tool that sends viruses to victims