steampipe VS steampipe-plugin-sdk

Steampipe is a tool for querying cloud APIs and other data sources using SQL in a zero-ETL manner.

Readers may also enjoy Steampipe [1], an open source CLI to live query Google Sheets [2] and 140+ other services with SQL (e.g. AWS, GitHub, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc across the services. (Disclaimer - I'm a lead on the project.)

1 - https://github.com/turbot/steampipe

be mindful of its AGPLv3 https://github.com/turbot/steampipe/blob/v0.21.8/LICENSE (AFAIK v0.4.3 is the last MIT release https://github.com/turbot/steampipe/blob/v0.4.3/LICENSE ) and the actual providers are Apache 2 <https://github.com/turbot/steampipe-plugin-aws/blob/v0.131.0...> (but I don't know if provider drift makes them compatible with 0.4 or not)

iasql seems to be AWS only, but good for them for taking this on:

In a prior post I showed how to install Steampipe in AWS CloudShell to instantly query over 460+ resource types from your AWS APIs using SQL, and another post on how to use the Steampipe AWS Compliance mod to assess over 25+ security benchmarks across your AWS accounts.

Readers may find Steampipe's [1] AWS Thrifty Mod [2] useful. It will automatically scan multiple accounts and regions for 50 cost saving opportunities - many of which are looking for over-provisioned or unused resources. For example, it's crazy how much you can save by doing things like just converting your EBS volumes to the newer gp3 type. Combine with Flowpipe [3] to automate checks and actions. It's all open source and extensible.

1 - https://github.com/turbot/steampipe

Steampipe [1] is an open source project [2] that includes an embedded Postgres to instantly query cloud, code & more with SQL. This release expands our plugin ecosystem [3] to be a full Zero-ETL platform. Steampipe plugins can now run natively in your own Postgres as Foreign Data Wrappers [4], as SQLite extensions [5] or as simple data export tools [6]. Please give it a try, we'd love your feedback and contributions!

1 - https://steampipe.io

🔧 The CLI is written in Go, as well as the Steampipe Plugins connecting to various APIs like AWS, GitHub, Zoom, Reddit, and 130+ more. https://hub.steampipe.io/plugins

It's fully open source with a thriving community of users and contributors. As of today, there are 111 plugins (including AWS & Azure). We also have thousands of open source queries, security benchmarks, resource graphs and dashboards available out of the box as mods. See the Steampipe Hub for full docs and details.

Steampipe is free, open source. It's a CLI used to SQL query & report across all your cloud APIs & data sources (e.g. AWS, GitHub, Slack, Kubernetes, Terraform, etc) along with a dashboards-as-code capability to run automated security & compliance benchmarks. Allows you to simply query & report without the overhead for log ingestion, ETL or a DB.

For some background, the Steampipe CLI provides an open source, common SQL interface to query join and report from your cloud APIs (e.g. Azure, AWS, GitHub, AzureAD, M365, etc).

Not the author, but a big fan of steampipe. You can use this example as a starting point to write integrations with a number of other services that are supported by steampipe plugins.

Since Steampipe provides a common SQL interface across plugins, there could be interesting 'joins' that you can do for querying & reporting -- any interesting joins you would consider across SPO, M365 or other plugins?

The CLI is written primarily in Go, as well as its plugins (e.g. AWS, GitHub, Slack, Zoom, Reddit, etc): https://hub.steampipe.io/plugins. You can extend an existing plugin by adding new 'tables', or you can write your own plugin for your favorite cloud service.