data_engineering_project_template
isort
data_engineering_project_template | isort | |
---|---|---|
3 | 41 | |
176 | 6,321 | |
- | 0.5% | |
2.2 | 7.4 | |
10 months ago | 18 days ago | |
HCL | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data_engineering_project_template
-
Cloud services for small projects?
SCPs your code into EC2
-
Data engineering projects with template: Airflow, dbt, Docker, Terraform (IAC), Github actions (CI/CD) & more
Docker is used to containerize your application. For e.g. this Dockerfile is used to create a container and it specifies what OS it is, etc. You can run docker on any machine and you can think of it as running a separate os (not exactly, but close enough) on the machine. What Docker provides is the ability to replicate OS & its packages (e.g. python modules) across machines so that you don't run into "hey that worked on my computer" type issues.
isort
-
Enhance Your Project Quality with These Top Python Libraries
isort: This library sorts your imports alphabetically, and automatically separates them into sections and by type. It provides a cleaner and more organised way to manage project imports.
-
A Tale of Two Kitchens - Hypermodernizing Your Python Code Base
isort will sort the imports for you
-
Django Code Formatting and Linting Made Easy: A Step-by-Step Pre-commit Hook Tutorial
isort is a Python utility that helps in sorting and organizing import statements in Python code to create readable and consistent code. It automatically formats import statements in accordance with PEP 8.
-
How to Write Impeccably Clean Code That Will Save Your Sanity
repos: - repo: https://github.com/ambv/black rev: 23.3.0 hooks: - id: black args: [--config=./pyproject.toml] language_version: python3.11 - repo: https://github.com/pycqa/flake8 rev: 6.0.0 hooks: - id: flake8 args: [--config=./tox.ini] language_version: python3.11 - repo: https://github.com/pycqa/isort rev: 5.12.0 hooks: - id: isort args: ["--profile", "black", "--filter-files"] language_version: python3.11 - repo: https://github.com/pre-commit/pre-commit-hooks rev: v4.4.0 hooks: - id: requirements-txt-fixer language_version: python3.11 - id: debug-statements - id: detect-aws-credentials - id: detect-private-key
- Automate Python Linting and Code Style Enforcement with Ruff and GitHub Actions
-
Improve your Django Code with pre-commit
repos: ... pre-commmit stuff ... black stuff - repo: https://github.com/pycqa/isort rev: 5.12.0 hooks: - id: isort name: isort (python)
-
How I start every new Python backend API project
isort
-
nbdev formating and linting
isort , A Python utility / library to sort imports.
-
Curious what is too much on one line... how 'compressed' can our code be?
Install black and isort and just don't worry about it. :-)
-
I wrote a script to periodically change my Desktop background to live satellite images!
Sure. Also, and don't take this the wrong way, but there are some code smells in your project that could be partially mitigated with some basic linting/formatting. I suggest black as a code formatter, flake8 for basic linting, and isort for sorting imports (for example, you have local imports mixed in with standard library and third party imports). You can install these via pip and most editors (like VS Code) can autoformat on save and show you linting problems as you edit. And you can integrate these into your workflow by using pre-commit.
What are some alternatives?
public-api-lists - A collective list of free APIs for use in software and web development 🚀
black - The uncompromising Python code formatter
Flake8 - flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
yapf - A formatter for Python files
Docker Compose - Define and run multi-container applications with Docker
autoflake - Removes unused imports and unused variables as reported by pyflakes
Pylint - It's not just a linter that annoys you!
terraform - Terraform enables you to safely and predictably create, change, and improve infrastructure. It is a source-available tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.
autopep8 - A tool that automatically formats Python code to conform to the PEP 8 style guide.
pyright - Static Type Checker for Python
awesome-python-typing - Collection of awesome Python types, stubs, plugins, and tools to work with them.