get-pip VS Poetry

then install whatever you want with pip. Sometimes I had issues with pip but just used this and then everything works. https://github.com/pypa/get-pip

[ { "Id": "sha256:4c7870c9f1f753961c4e61166ecf70f851da452f8b5c098fceafe5a59f866daf", "RepoTags": [ "python:3.11.3-slim-buster" ], "RepoDigests": [ "python@sha256:8c8998725afb2b71b06a8af7ecafaaaf83c394622e89d838064bb902d5632622" ], "Parent": "", "Comment": "buildkit.dockerfile.v0", "Created": "2023-04-12T00:20:26Z", "Container": "", "ContainerConfig": { "Hostname": "", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": null, "Cmd": null, "Image": "", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": null, "Labels": null }, "DockerVersion": "", "Author": "", "Config": { "Hostname": "", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "LANG=C.UTF-8", "GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D", "PYTHON_VERSION=3.11.3", "PYTHON_PIP_VERSION=22.3.1", "PYTHON_SETUPTOOLS_VERSION=65.5.1", "PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/d5cb0afaf23b8520f1bbcfed521017b4a95f5c01/public/get-pip.py", "PYTHON_GET_PIP_SHA256=394be00f13fa1b9aaa47e911bdb59a09c3b2986472130f30aa0bfaf7f3980637" ], "Cmd": [ "python3" ], "ArgsEscaped": true, "Image": "", "Volumes": null, "WorkingDir": "", "Entrypoint": null, "OnBuild": null, "Labels": null }, "Architecture": "amd64", "Os": "linux", "Size": 120263342, "VirtualSize": 120263342, "GraphDriver": { "Data": { "LowerDir": "/var/lib/docker/overlay2/ec5919b409872cc31f933e022f049631d3b6628b6938e5b15fdb9b179f6266c6/diff:/var/lib/docker/overlay2/a883e833f05d36f0aa46f10f7bed97ce245d65b9109d7eb97dffa0cc8441a7cc/diff:/var/lib/docker/overlay2/5cf759d19b4cfea4db9eb395cb6c84a6c89c2d2567baa46749e7449f2e8964f0/diff:/var/lib/docker/overlay2/68159c5e7f7c78e11f937851c29a6ba1a7384b4860063f95c346e67e85e0466e/diff", "MergedDir": "/var/lib/docker/overlay2/9d906031fca371a9d8d0afc0dd990d913adf9a782ea71ebe67a3ff4c30f40378/merged", "UpperDir": "/var/lib/docker/overlay2/9d906031fca371a9d8d0afc0dd990d913adf9a782ea71ebe67a3ff4c30f40378/diff", "WorkDir": "/var/lib/docker/overlay2/9d906031fca371a9d8d0afc0dd990d913adf9a782ea71ebe67a3ff4c30f40378/work" }, "Name": "overlay2" }, "RootFS": { "Type": "layers", "Layers": [ "sha256:61a5c84a1270a2da38fd32b5dd395bc404fb6c02940fa3b302a94d1c105ce499", "sha256:ccc60df26c61cea38c3708cf9fbaf0493862b219afd85a385c4291de60fda7f5", "sha256:c327d855c71f6e07fbcfb7964c23db29cfd7d0c46dc5c636be8bcd4386919e94", "sha256:12bb686bbe7fc8faaacc35b1cc806250df36b255941f4f1bced5150a3176f134", "sha256:1ea6e28a93aa6a6ce8f3bb44987a4eb307d878532a838fec0ce804da8ce2416b" ] }, "Metadata": { "LastTagTime": "0001-01-01T00:00:00Z" } } ]

okay i found my docker run: docker run --hostname=1347ff09f40e --env=CLI_ARGS=--allow-code --medvram --xformers --enable-insecure-extension-access --api --env=PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin --env=LANG=C.UTF-8 --env=GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D --env=PYTHON_VERSION=3.10.9 --env=PYTHON_PIP_VERSION=22.3.1 --env=PYTHON_SETUPTOOLS_VERSION=65.5.1 --env=PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/1a96dc5acd0303c4700e02655aefd3bc68c78958/public/get-pip.py --env=PYTHON_GET_PIP_SHA256=d1d09b0f9e745610657a528689ba3ea44a73bd19c60f4c954271b790c71c2653 --env=DEBIAN_FRONTEND=noninteractive --env=PIP_PREFER_BINARY=1 --env=ROOT=/stable-diffusion-webui --env=LD_PRELOAD=libtcmalloc.so --volume=C:\Users\rocko\Downloads\stable-diffusion-webui-docker-master\output:/output:rw --volume=C:\Users\rocko\Downloads\stable-diffusion-webui-docker-master\data:/data:rw --network=webui-docker_default --workdir=/stable-diffusion-webui -p 7860:7860 --label='com.docker.compose.config-hash=ae3651648afa7b3e607e063be20564f4c2f38f58bba0f58aca354bc896361a83' --label='com.docker.compose.container-number=1' --label='com.docker.compose.depends_on=' --label='com.docker.compose.image=sha256:343620282fc08be2facd9461f111f3b9d288bd3185bff327bf4d04a8a7216c9b' --label='com.docker.compose.oneoff=False' --label='com.docker.compose.project=webui-docker' --label='com.docker.compose.project.config_files=C:\Users\rocko\Downloads\stable-diffusion-webui-docker-master\docker-compose.yml' --label='com.docker.compose.project.working_dir=C:\Users\rocko\Downloads\stable-diffusion-webui-docker-master' --label='com.docker.compose.service=auto' --label='com.docker.compose.version=2.17.2' --runtime=runc -d sd-auto:51

So one thing that I didn't read here is how it works with environment variables.

Imagine you launch a container with FOOD=fries and DRINK=beer. The container doesn't set defaults for those variables, it does have one for DESSERT=ice-cream.

The container runs with FOOD=fries, DRINK=beer & DESSERT=ice-cream. An update comes along, and the container now has a default for DRINK=wine and switches to DESSERT=creme-brulee.

You update the container. What do you expect to happen with DRINK & DESSERT? DRINK remains beer, fine we chose that. But DESSERT also remains ice-cream, even though we didn't explicitly say that. The problem is that Docker (well, the surrounding tooling) cannot distinguish between your input and the container's default. They all get set in the `env` section of the container.

So you update the container and end up with FOOD=fries, DRINK=beer & DESSERT=ice-cream.

I get around this with using ansible with the Docker collection from the community [0]. This has a separate input and when it recreates the container it only takes into account the environment variables I set, and doesn't provide the other ones, so they become the container's default.

Many containers have things like PYTHON_VERSION=3.11.1 PYTHON_PIP_VERSION=22.3.1 PYTHON_SETUPTOOLS_VERSION=65.5.1 PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/66030fa03382b4914d4c4d08... PYTHON_GET_PIP_SHA256=1e501cf004eac1b7eb1f97266d28f995ae835d30250bec7f8850562703067dc6 in there.

PS: How do I get Podman 4 on Ubuntu?

[0] https://docs.ansible.com/ansible/latest/collections/communit...

What operating system is this on? It appears you are missing python3-distutils. Relevant conversation here: https://github.com/pypa/get-pip/issues/124

you could do what get-pip.py (do check the link) did to encode a binary package into itself, use layers of compression and encoding that only when reversed can you see the API key, but if they know enough coding they will know how to reverse it. you can cover yourself a little more to compile your python into bytecode *.pyc which can be executed by the python interpreter but if attempted to be open by a human its a bunch of binary.... but again depending on how much knowledge and effort they are willing to put in... it can be cracked. the second best option is to set up your own server to pass the one time key, but I imagine at that point its negating what your trying to do in the first place

See pip's installation instructions: https://pip.pypa.io/en/stable/installation/ , my suggestion would be to try get-pip first as it supports limiting the pip version to install, which you would probably need to do as version 21 doesnt' support Python 2 anymore. Also see its README at https://github.com/pypa/get-pip

After this, install pip. If this installation of Python was not from distro packages, then you can use https://github.com/pypa/get-pip (follow instructions on that page).

# In our server’s shell, set the `DATABASE_URL` variable. # `export` allows programs outside of this current shell session to use `DATABASE_URL`. root@28b24b724f54:/# export DATABASE_URL="postgresql://mydbuser:mysecretpass@thePGserver/db" # Let’s also set our environment type root@28b24b724f54:/# export ENV=development # Let’s see what Python would give us with `os.environ`. root@ee16c88faf39:/# python Python 3.6.14 (default, Jul 22 2021, 16:21:31) [GCC 8.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import os >>> os.environ environ({ 'DATABASE_URL': 'postgresql://mydbuser:mysecretpass@thePGserver/db', 'HOSTNAME': '28b24b724f54', 'PYTHON_VERSION': '3.6.14', 'ENV': 'development', 'PWD': '/', 'HOME': '/root', 'LANG': 'C.UTF-8', 'GPG_KEY': '0D96DF4D4110E5C43FBFB17F2D347EA6AA65421D', 'TERM': 'xterm', 'SHLVL': '1', 'PYTHON_PIP_VERSION': '21.2.4', 'PYTHON_GET_PIP_SHA256': 'fa6f3fb93cce234cd4e8dd2beb54a51ab9c247653b52855a48dd44e6b21ff28b', 'PYTHON_GET_PIP_URL': 'https://github.com/pypa/get-pip/raw/c20b0cfd643cd4a19246ccf204e2997af70f6b21/public/get-pip.py', 'PATH': '/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', '_': '/usr/local/bin/python' })

You can manage dependencies in Python with the package manager pip, which comes pre-installed with Python. Pip allows you to install and uninstall Python packages, and it uses a requirements.txt file to keep track of which packages your project depends on. However, pip does not have robust dependency resolution features or isolate dependencies for different projects; this is where tools like pipenv and poetry come in. These tools create a virtual environment for each project, separating the project's dependencies from the system-wide Python environment and other projects.

Poetry provides packaging and dependency management for Python. If you haven't already, install poetry via pip:

Poetry

The Semantify repository provides an example Astro.js project. Ensure you have poetry installed, then build the project from the root of the repository:

Has anyone else been paying attention to how hilariously hard it is to package PyTorch in poetry?

https://github.com/python-poetry/poetry/issues/6409

Based on this comment 5 days ago[0], it's working? I'm not sure didn't dig in too far but based on that comment it seems fair to say that it's not fully Poetry's fault because torch removed hashes (which poetry needs to be effective) for a while only recently adding it back in.

Not sure where I would stand if I fully investigated it tho.

[0] https://github.com/python-poetry/poetry/issues/6409#issuecom...

We will be running this project in Python 3.10 on Mac/Linux, and we will use Poetry to manage our dependencies. Later, we will bundle our app into a container using docker for deployment.

Here are the two main packaging issues I run into, specifically when using Poetry:

1) Lack of support for building extension modules (as mentioned by the article). There is a workaround using an undocumented feature [0], which I've tried, but ultimately decided it was not the right approach. I still use Poetry, but build the extension as a separate step in CI, rather than kludging it into Poetry.

2) Lack of support for offline installs [1], e.g. being able to download the dependencies, copy them to another machine, and perform the install from the downloaded dependencies (similar to using "pip --no-index --find-links=."). Again, you can work around this (by using "poetry export --with-credentials" and "pip download" for fetching the dependencies, then firing up pypiserver [2] to run a local PyPI server on the offline machine), but ideally this would all be a first class feature of Poetry, similar to how it is in pip.

I don't have the capacity to create Pull Requests for addressing these issues with Poetry, and I'm very grateful for the maintainers and those who do contribute. Instead, on the linked issues I share my notes on the matter, in the hope that it may at least help others and potentially get us closer to a solution.

Regardless, I'm sticking with Poetry for now. Though to be fair, the only other Python packaging tools I've used extensively are Pipenv and pip/setuptools. It's time consuming to thoroughly try out these other packaging tools, and is generally lower priority than developing features/fixing bugs, so it's helpful to read about the author's experience with these other tools, such as PDM and Hatch.

[0] https://github.com/python-poetry/poetry/issues/2740

[1] https://github.com/python-poetry/poetry/issues/2184

[2] https://pypi.org/project/pypiserver/

We believe that poetry is currently the best tool for this purpose, besides of being the most popular one at the moment. This is why we will use poetry to manage the dependencies of our project throughout this series of posts. Poetry allows you to declare the libraries your project depends on, and it will manage (install/update) them for you. Poetry also allows you to package your project into a distributable format and publish it to a repository, such as PyPI. We strongly recommend you to learn more about this tool by reading the official documentation.

I started using poetry. The problem is poetry will not install if there is dependency conflict and there is no way to ignore: github