Wiremind Kubernetes helper

Last update: Oct 09, 2021

Related tags

Overview

Wiremind Kubernetes helper

This Python library is a high-level set of Kubernetes Helpers allowing either to manage individual standard Kubernetes controllers (Deployment, StatefulSets, etc) or a logical set of standard Kubernetes controllers through the expecteddeploymentscales.wiremind.io CRD (for example allowing to scale down ALL Deployments of a Helm Release marked as such).

Installation

This library requires the expecteddeploymentscales.wiremind.io CRD: kubectl apply -f CustomResourceDefinition-expecteddeploymentscales.yaml.

Usage

See examples of usage in Wiremind Chartreuse tool.

stop-pods priorities

The expecteddeploymentscales.wiremind.io custom resource definition defines a priority field, Allowing to control the priority of the Deployment under control for scale down order.

wiremind-kubernetes will, for each different priority found for all considered ExpectedDeploymentScale, scale down all deployments with a given priority, then wait for their pods to be actually deleted, then continue with the next priority (in descending order).

Higher priority means that the Deployment will be scaled down before others with lower priority.

KubernetesDeploymentManager.stop_pods() will use that definition.

In case of some Pods being slow to be deleted and others serving web server, this allows for less downtime for users (since we can state to delete first those slow-to-be-deleted pods, then stop the web server pods).

The diagram has been drawn using the free online software https://draw.io, the source code is located at documentation/schema-stop-pods.png, feel free to correct it or make it more understandable.

Comments

feat(stop_pods): neutralize the HPA as HPAScaleToZero may be in use (…

…HPA may scale up the Deployment even if replicas=0), a more straightforward solution will be available in the future see here. Of course start_pods repairs it. (encourage users to run this command to re-scale up).

opened by machine424 1
chore(deps): bump oauthlib from 3.1.1 to 3.2.1
Bumps oauthlib from 3.1.1 to 3.2.1.

Release notes

Sourced from oauthlib's releases.

3.2.1

In short

OAuth2.0 Provider:

#803 : Metadata endpoint support of non-HTTPS

CVE-2022-36087

OAuth1.0:

#818 : Allow IPv6 being parsed by signature

General:

Improved and fixed documentation warnings.

Cosmetic changes based on isort

What's Changed

add missing slots to TokenBase by @ariebovenberg in oauthlib/oauthlib#804

Add CORS support for Refresh Token Grant. by @luhn in oauthlib/oauthlib#806

GitHub Action to lint Python code by @cclauss in oauthlib/oauthlib#797

Docs: fix Sphinx warnings for better ReadTheDocs generation by @JonathanHuot in oauthlib/oauthlib#807

Allow non-HTTPS issuer when OAUTHLIB_INSECURE_TRANSPORT. by @luhn in oauthlib/oauthlib#803

chore: fix typo in test by @tamanobi in oauthlib/oauthlib#816

Fix typo in server.rst by @NemanjaT in oauthlib/oauthlib#819

Fixed isort imports by @dasm in oauthlib/oauthlib#820

docs: Fix a few typos by @timgates42 in oauthlib/oauthlib#822

docs: fix typos by @kianmeng in oauthlib/oauthlib#823

New Contributors

@ariebovenberg made their first contribution in oauthlib/oauthlib#804

@tamanobi made their first contribution in oauthlib/oauthlib#816

@NemanjaT made their first contribution in oauthlib/oauthlib#819

@kianmeng made their first contribution in oauthlib/oauthlib#823

Full Changelog: https://github.com/oauthlib/oauthlib/compare/v3.2.0...v3.2.1

3.2.0

Changelog

OAuth2.0 Client:

#795: Add Device Authorization Flow for Web Application

#786: Add PKCE support for Client

#783: Fallback to none in case of wrong expires_at format.

OAuth2.0 Provider:

#790: Add support for CORS to metadata endpoint.

#791: Add support for CORS to token endpoint.

#787: Remove comma after Bearer in WWW-Authenticate

OAuth2.0 Provider - OIDC:

#755: Call save_token in Hybrid code flow

#751: OIDC add support of refreshing ID Tokens with refresh_id_token

#751: The RefreshTokenGrant modifiers now take the same arguments as the AuthorizationCodeGrant modifiers (token, token_handler, request).

... (truncated)

Changelog

Sourced from oauthlib's changelog.

3.2.1 (2022-09-09)

OAuth2.0 Provider:

#803: Metadata endpoint support of non-HTTPS

CVE-2022-36087

OAuth1.0:

#818: Allow IPv6 being parsed by signature

General:

Improved and fixed documentation warnings.

Cosmetic changes based on isort

3.2.0 (2022-01-29)

OAuth2.0 Client:

#795: Add Device Authorization Flow for Web Application

#786: Add PKCE support for Client

#783: Fallback to none in case of wrong expires_at format.

OAuth2.0 Provider:

#790: Add support for CORS to metadata endpoint.

#791: Add support for CORS to token endpoint.

#787: Remove comma after Bearer in WWW-Authenticate

OAuth2.0 Provider - OIDC:

#755: Call save_token in Hybrid code flow

#751: OIDC add support of refreshing ID Tokens with refresh_id_token

#751: The RefreshTokenGrant modifiers now take the same arguments as the AuthorizationCodeGrant modifiers (token, token_handler, request).

General:

Added Python 3.9, 3.10, 3.11

Improve Travis & Coverage

Commits

88bb156 Updated date and authors

1a45d97 Prepare 3.2.1 release

0adbbe1 docs: fix typos

6569ec3 docs: Fix a few typos

bdc486e Fixed isort imports

7db45bd Fix typo in server.rst

b14ad85 chore: s/bode_code_verifier/body_code_verifier/g

b123283 Allow non-HTTPS issuer when OAUTHLIB_INSECURE_TRANSPORT. (#803)

2f887b5 Docs: fix Sphinx warnings for better ReadTheDocs generation (#807)

d4bafd9 Merge pull request #797 from cclauss/patch-2

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
wiremind-kubernetes (Chartreuse, mayo) waits for evicted pods to terminate
Chartreuse waits for evicted pods to terminate before running the migrations. Of course they never terminates, they need to be cleaned by hand.

Here: https://gitlab.wiremind.io/wiremind/devops/wiremind-kubernetes/-/blob/master/src/wiremind_kubernetes/kubernetes_helper.py#L141

We should ignore the phases: Failed (reasons: Evicted ...), Succeeded (even thought not frequent for a deployment's Pod)

we can use a field selector or something, or filter after fetching ...

can Failed be a transient phase?
opened by desaintmartin 1
chore(deps): bump urllib3 from 1.26.4 to 1.26.5
Bumps urllib3 from 1.26.4 to 1.26.5.

Release notes

Sourced from urllib3's releases.

1.26.5

:warning: IMPORTANT: urllib3 v2.0 will drop support for Python 2: Read more in the v2.0 Roadmap

Fixed deprecation warnings emitted in Python 3.10.

Updated vendored six library to 1.16.0.

Improved performance of URL parser when splitting the authority component.

If you or your organization rely on urllib3 consider supporting us via GitHub Sponsors

Changelog

Sourced from urllib3's changelog.

1.26.5 (2021-05-26)

Fixed deprecation warnings emitted in Python 3.10.

Updated vendored six library to 1.16.0.

Improved performance of URL parser when splitting the authority component.

Commits

d161647 Release 1.26.5

2d4a3fe Improve performance of sub-authority splitting in URL

2698537 Update vendored six to 1.16.0

07bed79 Fix deprecation warnings for Python 3.10 ssl module

d725a9b Add Python 3.10 to GitHub Actions

339ad34 Use pytest==6.2.4 on Python 3.10+

f271c9c Apply latest Black formatting

1884878 [1.26] Properly proxy EOF on the SSLTransport test suite

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 1
chore(deps): bump certifi from 2022.9.24 to 2022.12.7
Bumps certifi from 2022.9.24 to 2022.12.7.

Commits

9e9e840 2022.12.07

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot use these labels will set the current labels as the default for future PRs for this repo and language

@dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language

@dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language

@dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the Security Alerts page.

dependencies
opened by dependabot[bot] 0
Add some helpers for env identification
define environment types: an Enum or sth else. (to unify and to avoid using strings "staging"; "prod" ...

Return en env type of a namespace (from labels probably)

Tell if a namespace is prod/staging (to avoid having sometimes if "prod" in namespace: sometimes if "-prod-" in namespace:) => If we make a change we make it in one place.

Given a resource name, return the env type it belongs to (maybe add the env as a label)

environmentkind in helmfile.yaml (used to construct the appropriate priorityclass, dev_mail ...)

environmentkind in cluster-manager (used by mayo, and other tools)

some teams (cayzn) define their own EnvironmentKind Enum, how/what should we do to keep being sync?)
opened by desaintmartin 0

Releases(v7.1.0)

v7.1.0(Dec 27, 2022)
What's Changed

fix: pretty parameter customizable for ClientWithArguments and KubernetesHelper

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v7.0.1...v7.1.0
Source code(tar.gz)
Source code(zip)
v7.0.1(Dec 27, 2022)
What's Changed

fix(mypy): errors and setup.cfg misconfiguration

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v7.0.0...v7.0.1
Source code(tar.gz)
Source code(zip)
v7.0.0(Sep 27, 2022)
What's Changed

stop_pods: neutralize the HPA as HPAScaleToZero may be in use (HPA may scale up the Deployment even if replicas=0), a more straightforward solution will be available in the future see here. Of course start_pods repairs it. (encourage users to run this command to re-scale up).

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v6.4.0...v7.0.0
Source code(tar.gz)
Source code(zip)
v6.4.0(Apr 13, 2022)
What's Changed

feat(kubernetes): add support for RbacAuthorizationV1 by @maxime1907 in https://github.com/wiremind/wiremind-kubernetes/pull/10

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v6.3.5...v6.4.0
Source code(tar.gz)
Source code(zip)
v6.3.5(Oct 9, 2021)
What's Changed

fix(stop_pods): harden logic by @desaintmartin in https://github.com/wiremind/wiremind-kubernetes/pull/9

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v6.3.4...v6.3.5
Source code(tar.gz)
Source code(zip)
v6.3.4(Oct 9, 2021)
What's Changed

ci: add 3.10 support by @desaintmartin in https://github.com/wiremind/wiremind-kubernetes/pull/8

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v6.3.3...v6.3.4
Source code(tar.gz)
Source code(zip)
v6.3.3(Oct 9, 2021)
v6.3.3 (2021-10-05)

Fixes

stop_pods: ignore failed (like Evicted) Pods, print what still needs to be stopped and simplify internal logic.

Full Changelog: https://github.com/wiremind/wiremind-kubernetes/compare/v6.3.2...v6.3.3
Source code(tar.gz)
Source code(zip)
v6.3.2(Oct 4, 2021)
v6.3.2 (2021-10-04)

Fixes

setup.py: require kubernetes>=18.

Source code(tar.gz)
Source code(zip)
v6.3.1(Oct 4, 2021)

Initial open-source version. Requires Python >= 3.7.
Source code(tar.gz)
Source code(zip)

Owner

Wiremind

GitHub Repository

Wiremind Kubernetes helper

Related tags

Overview

Wiremind Kubernetes helper

Installation

Usage

stop-pods priorities

Comments

feat(stop_pods): neutralize the HPA as HPAScaleToZero may be in use (…

chore(deps): bump oauthlib from 3.1.1 to 3.2.1

3.2.1

In short

What's Changed

New Contributors

3.2.0

Changelog

3.2.1 (2022-09-09)

3.2.0 (2022-01-29)

wiremind-kubernetes (Chartreuse, mayo) waits for evicted pods to terminate

chore(deps): bump urllib3 from 1.26.4 to 1.26.5

1.26.5

1.26.5 (2021-05-26)

chore(deps): bump certifi from 2022.9.24 to 2022.12.7

Add some helpers for env identification

Releases(v7.1.0)

v7.1.0(Dec 27, 2022)

What's Changed

v7.0.1(Dec 27, 2022)

What's Changed

v7.0.0(Sep 27, 2022)

What's Changed

v6.4.0(Apr 13, 2022)

What's Changed

v6.3.5(Oct 9, 2021)

What's Changed

v6.3.4(Oct 9, 2021)

What's Changed

v6.3.3(Oct 9, 2021)

v6.3.3 (2021-10-05)

Fixes

v6.3.2(Oct 4, 2021)

v6.3.2 (2021-10-04)

Fixes

v6.3.1(Oct 4, 2021)

Owner

Wiremind

Changelog CI is a GitHub Action that enables a project to automatically generate changelogs

Wubes is like Qubes but for Windows.

A tool to clone efficiently all the repos in an organization

Jenkins-AWS-CICD - Implement Jenkins CI/CD with AWS CodeBuild and AWS CodeDeploy, build a python flask web application.

CI repo for building Skia as a shared library

Project 4 Cloud DevOps Nanodegree

NixOps is a tool for deploying to NixOS machines in a network or cloud.

Rundeck / Grafana / Prometheus / Rundeck Exporter integration demo

Create pinned requirements.txt inside a Docker image using pip-tools

📦 Powerful Package manager which updates plugins & server software for minecraft servers

Deploy a simple Multi-Node Clickhouse Cluster with docker-compose in minutes.

Asynchronous parallel SSH client library.

Oracle Cloud Infrastructure Object Storage fsspec implementation

ZeroMQ bindings for Twisted

A tool to convert AWS EC2 instances back and forth between On-Demand and Spot billing models.

A Kubernetes operator that creates UptimeRobot monitors for your ingresses

Define and run multi-container applications with Docker

Push Container Image To Docker Registry In Python

Visual disk-usage analyser for docker images

Knock your images before these make you painful.