Top 21 Python Gcp Projects
Multi-Cloud Security Auditing ToolProject mention: This Week in Python | dev.to | 2022-05-13
ScoutSuite – Multi-Cloud Security Auditing Tool
Prevent cloud misconfigurations during build-time for Terraform, CloudFormation, Kubernetes, Serverless framework and other infrastructure-as-code-languages with Checkov by Bridgecrew.Project mention: Allow ECS Task Role to assume any role or invoke any lambda function. Yay or nay? | reddit.com/r/aws | 2022-05-18
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resourcesProject mention: Tool that can find AWS resources created outside of terraform? | reddit.com/r/Terraform | 2022-05-10
cloudcustodian.io can help with the scanning, although it needs some kind of criteria to filter against (like a terraform-generated tag).
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQProject mention: data engineering in web3 | reddit.com/r/dataengineering | 2022-05-20
I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here
Forseti SecurityProject mention: GCP Security Audit | reddit.com/r/AskNetsec | 2022-03-11
https://simplecspm.com/ is a good start, you could also check out https://forsetisecurity.org/
SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference. Implements IMPALA and R2D2 algorithms in TF2 with SEED's architecture.Project mention: Need some help understanding what steps to take to debug a RL agent | reddit.com/r/learnmachinelearning | 2021-07-17
For some context, this is an algo trading bot that's trained on intraday time series stock data. I'm using Google Research's SEED RL codebase with vtrace. The model has a sequence length of 240, and 30 features. Each iteration represents training on a batch of 256 samples, and there are 256 environments being sampled from at a time. A reward is applied when the agent closes a position, and the size of the reward is based on how much profit (positive or negative) was made. The agent is forced to close its remaining position at the end of each day, resulting in a larger negative reward than normal if it had a large and unprofitable position.
Resoto creates an inventory of your cloud, provides deep visibility, and reacts to changes in your infrastructure. ⚡️Project mention: someengineering / resoto - Find leaky resources, manage quota limits, detect drift, and clean up! | reddit.com/r/bag_o_news | 2022-03-03
Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.
Policy and data administration, distribution, and real-time updates on top of Open Policy Agent (by permitio)Project mention: OPAL + OPA VS XACML | dev.to | 2022-05-19
One such XACML alternative is OPA + OPAL. Open Policy Agent (OPA) is an open-source project created as a general-purpose policy engine to serve any policy enforcement requirements that unifies policy enforcement across the stack without being dependent on implementation details. It can be used with any language and network protocol, supports any data type, and evaluates and returns answers quickly. OPA’s policy rules are written in Rego - a high-level declarative (Datalog-like) language. You can find a more detailed introduction to OPA here. It’s important to note that OPA itself only provides an alternative to XACML’s PDP (More on that further). OPA is enhanced by OPAL (Open Policy Administration Layer) - another open-source solution that allows you to easily keep your authorization layer up-to-date in real-time. More information about the project is available here. The combination of OPA and OPAL provides a solid alternative for XACML.
Training deep learning models on AWS and GCP instancesProject mention: [D] Interactive Compute Platform Recommendations for ML Research | reddit.com/r/MachineLearning | 2021-11-25
Use spotty https://github.com/spotty-cloud/spotty to launch AWS Spot instances that you can use ssh port forwarding with to run GPU experiments from a jupyer notebook.
Identify privilege escalation paths within and across different cloudsProject mention: GitHub - carlospolop/PurplePanda: Identify privilege escalation paths within and across different clouds | reddit.com/r/bag_o_news | 2022-02-03
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQProject mention: How to import bitcoin blockchain to postgres? | reddit.com/r/BitcoinTechnology | 2021-12-28
I am thinking about using https://github.com/blockchain-etl/bitcoin-etl project to get transactions data as JSON, maybe convert it to csv through jq and then use psql COPY to import.
tfquery: Run SQL queries on your Terraform infrastructure. Query resources and analyze its configuration using a SQL-powered framework.
Goblet is an easy-to-use framework that enables developers to quickly spin up fully featured REST APIs with python on GCPProject mention: Cloud function deploying an ache in my head. Please help! | reddit.com/r/googlecloud | 2021-07-08
An upgraded and improved version of the Iris automatic GCP-labeling projectProject mention: is there a way to automatically push tags on gcp environment | reddit.com/r/googlecloud | 2022-03-12
Try this for automatic labeling https://github.com/doitintl/iris3
Cloud migration tool for migrating on premise data and infrastructure to cloudProject mention: xmigrate, an open-source cloud migration tool | reddit.com/r/developersIndia | 2022-05-08
Web: https://xmigrate.cloud GitHub: https://github.com/xmigrate/xmigrate
sysctl/sysfs settings on a fly for Kubernetes Cluster. No restarts are required for clusters and nodes.Project mention: wallarm/sysbindings: change sysctl/sysfs settings on a fly for Kubernetes Cluster. No restarts are required for clusters and nodes. | reddit.com/r/kubernetes | 2021-10-17
🤖🔒 Fully-featured Discord bot with music, polls, memes and moderation.Project mention: Looking for Collaborators | reddit.com/r/Discord_Bots | 2022-03-21
☀️ Wrapper API for S3 and Google Cloud Storage
Template repo for a GCP-hosted REST API with automatic API versioning and custom domain mappingProject mention: I've created a template repo for quickly building a FastAPI REST server, and deploying it to Google Cloud, with automatic API versioning and custom domain mapping. E.g. a v1.2.3 release deploys v1.your-domain.com. Issues and discussion welcome! | reddit.com/r/Python | 2022-01-08
asyncio Python library for distributed mutex with GCS as a backendProject mention: dimutex: asyncio Python library for distributed mutex with GCS as a backend | reddit.com/r/opensource | 2022-05-23
Python Gcp related posts
dimutex: asyncio Python library for distributed mutex with GCS as a backend
1 project | reddit.com/r/opensource | 23 May 2022
Allow ECS Task Role to assume any role or invoke any lambda function. Yay or nay?
1 project | reddit.com/r/aws | 18 May 2022
Finding and Fixing Cloud Misconfigurations with open source
1 project | dev.to | 7 Apr 2022
Tool Release – ScoutSuite 5.11.0 - a new version of the open-source, multi-cloud auditing tool ScoutSuite - AWS, Azure and GCP improvements
1 project | reddit.com/r/devops | 16 Mar 2022
GCP Security Audit
2 projects | reddit.com/r/AskNetsec | 11 Mar 2022
GitHub - carlospolop/PurplePanda: Identify privilege escalation paths within and across different clouds
1 project | reddit.com/r/bag_o_news | 3 Feb 2022
How to import bitcoin blockchain to postgres?
2 projects | reddit.com/r/BitcoinTechnology | 28 Dec 2021
What are some of the best open-source Gcp projects in Python? This list will help you:
Are you hiring? Post a new remote job listing for free.