Python Gcp

Open-source Python projects categorized as Gcp | Edit details

Top 21 Python Gcp Projects

  • ScoutSuite

    Multi-Cloud Security Auditing Tool

    Project mention: This Week in Python | dev.to | 2022-05-13

    ScoutSuite – Multi-Cloud Security Auditing Tool

  • checkov

    Prevent cloud misconfigurations during build-time for Terraform, CloudFormation, Kubernetes, Serverless framework and other infrastructure-as-code-languages with Checkov by Bridgecrew.

    Project mention: Allow ECS Task Role to assume any role or invoke any lambda function. Yay or nay? | reddit.com/r/aws | 2022-05-18
  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • cloud-custodian

    Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources

    Project mention: Tool that can find AWS resources created outside of terraform? | reddit.com/r/Terraform | 2022-05-10

    cloudcustodian.io can help with the scanning, although it needs some kind of criteria to filter against (like a terraform-generated tag).

  • ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: data engineering in web3 | reddit.com/r/dataengineering | 2022-05-20

    I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here

  • forseti-security

    Forseti Security

    Project mention: GCP Security Audit | reddit.com/r/AskNetsec | 2022-03-11

    https://simplecspm.com/ is a good start, you could also check out https://forsetisecurity.org/

  • seed_rl

    SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference. Implements IMPALA and R2D2 algorithms in TF2 with SEED's architecture.

    Project mention: Need some help understanding what steps to take to debug a RL agent | reddit.com/r/learnmachinelearning | 2021-07-17

    For some context, this is an algo trading bot that's trained on intraday time series stock data. I'm using Google Research's SEED RL codebase with vtrace. The model has a sequence length of 240, and 30 features. Each iteration represents training on a batch of 256 samples, and there are 256 environments being sampled from at a time. A reward is applied when the agent closes a position, and the size of the reward is based on how much profit (positive or negative) was made. The agent is forced to close its remaining position at the end of each day, resulting in a larger negative reward than normal if it had a large and unprofitable position.

  • resoto

    Resoto creates an inventory of your cloud, provides deep visibility, and reacts to changes in your infrastructure. ⚡️

    Project mention: someengineering / resoto - Find leaky resources, manage quota limits, detect drift, and clean up! | reddit.com/r/bag_o_news | 2022-03-03
  • SonarLint

    Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.

  • opal

    Policy and data administration, distribution, and real-time updates on top of Open Policy Agent (by permitio)

    Project mention: OPAL + OPA VS XACML | dev.to | 2022-05-19

    One such XACML alternative is OPA + OPAL. Open Policy Agent (OPA) is an open-source project created as a general-purpose policy engine to serve any policy enforcement requirements that unifies policy enforcement across the stack without being dependent on implementation details. It can be used with any language and network protocol, supports any data type, and evaluates and returns answers quickly. OPA’s policy rules are written in Rego - a high-level declarative (Datalog-like) language. You can find a more detailed introduction to OPA here. It’s important to note that OPA itself only provides an alternative to XACML’s PDP (More on that further). OPA is enhanced by OPAL (Open Policy Administration Layer) - another open-source solution that allows you to easily keep your authorization layer up-to-date in real-time. More information about the project is available here. The combination of OPA and OPAL provides a solid alternative for XACML.

  • spotty

    Training deep learning models on AWS and GCP instances

    Project mention: [D] Interactive Compute Platform Recommendations for ML Research | reddit.com/r/MachineLearning | 2021-11-25

    Use spotty https://github.com/spotty-cloud/spotty to launch AWS Spot instances that you can use ssh port forwarding with to run GPU experiments from a jupyer notebook.

  • PurplePanda

    Identify privilege escalation paths within and across different clouds

    Project mention: GitHub - carlospolop/PurplePanda: Identify privilege escalation paths within and across different clouds | reddit.com/r/bag_o_news | 2022-02-03
  • bitcoin-etl

    ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: How to import bitcoin blockchain to postgres? | reddit.com/r/BitcoinTechnology | 2021-12-28

    I am thinking about using https://github.com/blockchain-etl/bitcoin-etl project to get transactions data as JSON, maybe convert it to csv through jq and then use psql COPY to import.

  • tfquery

    tfquery: Run SQL queries on your Terraform infrastructure. Query resources and analyze its configuration using a SQL-powered framework.

  • goblet

    Goblet is an easy-to-use framework that enables developers to quickly spin up fully featured REST APIs with python on GCP

    Project mention: Cloud function deploying an ache in my head. Please help! | reddit.com/r/googlecloud | 2021-07-08
  • iris3

    An upgraded and improved version of the Iris automatic GCP-labeling project

    Project mention: is there a way to automatically push tags on gcp environment | reddit.com/r/googlecloud | 2022-03-12

    Try this for automatic labeling https://github.com/doitintl/iris3

  • xmigrate

    Cloud migration tool for migrating on premise data and infrastructure to cloud

    Project mention: xmigrate, an open-source cloud migration tool | reddit.com/r/developersIndia | 2022-05-08

    Web: https://xmigrate.cloud GitHub: https://github.com/xmigrate/xmigrate

  • sysbindings

    sysctl/sysfs settings on a fly for Kubernetes Cluster. No restarts are required for clusters and nodes.

    Project mention: wallarm/sysbindings: change sysctl/sysfs settings on a fly for Kubernetes Cluster. No restarts are required for clusters and nodes. | reddit.com/r/kubernetes | 2021-10-17
  • bb-bot

    🤖🔒 Fully-featured Discord bot with music, polls, memes and moderation.

    Project mention: Looking for Collaborators | reddit.com/r/Discord_Bots | 2022-03-21
  • mtx-hacks

    ☀️ Wrapper API for S3 and Google Cloud Storage

  • gcp-fastapi-poetry

    Template repo for a GCP-hosted REST API with automatic API versioning and custom domain mapping

    Project mention: I've created a template repo for quickly building a FastAPI REST server, and deploying it to Google Cloud, with automatic API versioning and custom domain mapping. E.g. a v1.2.3 release deploys v1.your-domain.com. Issues and discussion welcome! | reddit.com/r/Python | 2022-01-08
  • dimutex

    asyncio Python library for distributed mutex with GCS as a backend

    Project mention: dimutex: asyncio Python library for distributed mutex with GCS as a backend | reddit.com/r/opensource | 2022-05-23
  • cookiecutter-cloudfunctions

    Cookiecutter to create a Google Function. Powered by Poetry, GitHub actions, and Google Cloud Platform

    Project mention: I made an easy-to-use Google Cloud Function cookiecutter for creating a maintainable and scalable pipeline using GitHub Actions and Cloud Build! | reddit.com/r/Python | 2022-02-08

    I made a simple cookiecutter (under my work org) which allows you to easily create a serverless pipeline with continuous integration via GitHub actions and continuous deployment via Cloud Build. Would appreciate any feedback!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-23.

Python Gcp related posts

Index

What are some of the best open-source Gcp projects in Python? This list will help you:

Project Stars
1 ScoutSuite 4,275
2 checkov 4,215
3 cloud-custodian 4,147
4 ethereum-etl 1,785
5 forseti-security 1,241
6 seed_rl 722
7 resoto 624
8 opal 519
9 spotty 421
10 PurplePanda 390
11 bitcoin-etl 275
12 tfquery 268
13 goblet 48
14 iris3 32
15 xmigrate 27
16 sysbindings 19
17 bb-bot 16
18 mtx-hacks 3
19 gcp-fastapi-poetry 3
20 dimutex 3
21 cookiecutter-cloudfunctions 1
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com