Managing Plugins

Steampipe provides an integrated, standardized SQL interface for querying various services, but it relies on plugins to define and implement tables for those services. This approach decouples the core Steampipe code from the provider-specific implementations, providing flexibility and extensibility.

Installing Plugins

Steampipe plugins are packaged as Open Container Images (OCI) and stored in the Steampipe Hub registry. This registry contains a curated set of plugins developed by and/or vetted by Turbot. To install the latest version of a standard plugin, you can simply install it by name.

For example, to install the latest aws plugin:

$ steampipe plugin install aws

This will download the latest aws plugin from the hub registry, and will set up a default connection named aws.

Note: If you install multiple versions of a plugin only the first installation will create a connection automatically for you, you will need to create/edit a connection configuration file in order to use the additional versions of the plugin.

Installing a Specific Version

To install a specific version, simply specify the version tag after the plugin name, separated by @ or :

For example, to install the 0.118.0 version of the aws plugin:

$ steampipe plugin install aws@0.118.0

This will download the aws plugin version 0.118.0 (the one with the 0.118.0 tag) from the hub registry.

Installing from a SemVer Constraint

Plugins should follow semantic versioning guidelines, and they are tagged in the registry with a version tag that specifies their exact version in the major.minor.patch format (e.g. 1.0.1).

The intent of the version tag is that it is immutable - while it is technically possible to move the version tag to a different image version, this should not be done.

Installing with a semver constraint allows you to "lock" (or pin) to a specific set of releases which match the contraints.

If you install via steampipe plugin install aws@^1, for example, steampipe plugin update (and auto-updates) will only update to versions greater than 1.0.0 but less than 2.0.0.

Supported semver constraint types:

Wildcard Constraint: This matches any version for a particular segment (Major, Minor, or Patch).

  • 1.x.x would match any version with major segment of 1.
  • 1.2.x would match any version with the major segment of 1 and a minor segment of 2.

Caret Constraint (^): This matches versions that do not modify the left-most non-zero digit.

  • ^1.2.3 is the latest version equal or greater than 1.2.3, but less than 2.0.0.
  • ^0.1.2 is the latest version equal or greater than 0.1.2, but less than 0.2.0.

Tilde Constraint (~): This matches versions based on expression, if minor segment is expressed, locks to it, else locks to major.

  • ~1 is the latest version greater than or equal to 1.0.0, but less than 2.0.0 (same as 1.x.x).
  • ~1.2 is the latest version greater than or equal to 1.2.0, but less than 1.3.0 (same as 1.2.x).
  • ~1.2.3 is the latest version greater than or equal to 1.2.3, but less than 1.3.0.

Range Constraint: This specifies a range of versions using a hyphen.

  • 1.2.3-1.2.5 would limit to latest available version of 1.2.3,1.2.4 or 1.2.5.

Other Constraints:

  • >1.1.1 would match any version greater than 1.1.1.
  • >=1.2.0 would match any version greater than or equal to 1.2.0.

You can use the install command in the same way as a specific version with these constraints (imagename@constraint) syntax:

Note: For some constraints using special characters >, <, * you may need to escape the characters \> or quote the string steampipe plugin install "aws@>0.118.0" depending on your terminal.

  • To install the latest version locked to a specific major version:
$ steampipe plugin install aws@^2
# or
$ steampipe plugin install aws@2.x.x
  • To install the latest version locked to a specific minor version:
$ steampipe plugin install aws@~2.1
# or
$ steampipe plugin install aws@2.1.x

Installing from another registry

Steampipe plugins are packaged in OCI format and can be hosted and installed from any artifact repository or container registry that supports OCI V2 images. To install a plugin from a repository, specify the full path in the install command:

$ steampipe plugin install us-docker.pkg.dev/myproject/myrepo/myplugin@mytag

Installing from a File

A plugin binary can be installed manually, and this is often convenient when developing the plugin. Steampipe will attempt to load any plugin that is referred to in a connection configuration:

  • The plugin binary file must have a .plugin extension
  • The plugin binary must reside in a subdirectory of the ~/.steampipe/plugins/ directory and must be the ONLY .plugin file in that subdirectory
  • The connection must specify the path (relative to ~/.steampipe/plugins/) to the plugin in the plugin argument

For example, consider a myplugin plugin that you have developed. To install it:

  • Create a subdirectory .steampipe/plugins/local/myplugin
  • Name your plugin binary myplugin.plugin, and copy it to .steampipe/plugins/local/myplugin/myplugin.plugin
  • Create a ~/.steampipe/config/myplugin.spc config file containing a connection definition that points to your plugin:
    connection "myplugin" {
    plugin = "local/myplugin"
    }

Installing Missing Plugins

You can install all missing plugins that are referenced in your configuration files:

$ steampipe plugin install

Running steampipe plugin install with no arguments will cause Steampipe to read all connection and plugin blocks in all .spc files in the ~/.steampipe/config directory and install any that are referenced but are not installed. Note that when doing so, any default .spc file that does not exist in the configuration will also be copied. You may pass the --skip-config flag if you don't want to copy these files:

$ steampipe plugin install --skip-config

Viewing Installed Plugins

You can list the installed plugins with the steampipe plugin list command:

$ steampipe plugin list
┌─────────────────────────────────────────────────────┬─────────┬─────────────────────────────────────────────┐
│ NAME │ VERSION │ CONNECTIONS │
├─────────────────────────────────────────────────────┼─────────┼─────────────────────────────────────────────┤
│ hub.steampipe.io/plugins/turbot/aws@latest │ 0.4.0 │ aws,aws_account_aaa,aws_account_aab │
│ hub.steampipe.io/plugins/turbot/digitalocean@latest │ 0.1.0 │ digitalocean │
│ hub.steampipe.io/plugins/turbot/gcp@latest │ 0.0.6 │ gcp_project_a,gcp,gcp_project_b │
│ hub.steampipe.io/plugins/turbot/github@latest │ 0.0.5 │ github │
│ hub.steampipe.io/plugins/turbot/steampipe@latest │ 0.0.2 │ steampipe │
└─────────────────────────────────────────────────────┴─────────┴─────────────────────────────────────────────┘

Updating Plugins

To update a plugin to the latest version for a given stream, you can use the steampipe plugin update command:

steampipe plugin update plugin_name[@stream]

The syntax and semantics are identical to the install command - steampipe plugin update aws will get the latest aws plugin, steampipe plugin update aws@1 will get the latest in the 1.x major stream, etc.

To update all plugins to the latest in the installed stream:

steampipe plugin update --all

Removing Plugins

You can uninstall a plugin with the steampipe plugin remove command:

steampipe plugin uninstall [plugin]

Note that you cannot remove a plugin if there are active connections using it. You must remove any connections that use the plugin first:

$ steampipe plugin list
+--------------------------------------------------+---------+-------------+
| NAME | VERSION | CONNECTIONS |
+--------------------------------------------------+---------+-------------+
| hub.steampipe.io/plugins/turbot/aws@latest | 0.0.5 | aws |
| hub.steampipe.io/plugins/turbot/steampipe@latest | 0.0.1 | steampipe |
+--------------------------------------------------+---------+-------------+
$ steampipe plugin remove steampipe
Error: Failed to remove plugin 'steampipe' - there are active connections using it: 'steampipe'
$ rm ~/.steampipe/config/steampipe.spc
$ steampipe plugin remove steampipe
Removed plugin steampipe
$ steampipe plugin list
+--------------------------------------------+---------+-------------+
| NAME | VERSION | CONNECTIONS |
+--------------------------------------------+---------+-------------+
| hub.steampipe.io/plugins/turbot/aws@latest | 0.0.5 | aws |
+--------------------------------------------+---------+-------------+

Steampipe Plugin Registry Support Lifecycle

The Steampipe Plugin Registry is committed to ensuring accessibility and stability for its users by maintaining versions of plugins for at least one year and preserving at least one version of each plugin. This practice ensures that users can access older versions of plugins if needed, providing a safety net for compatibility issues or preferences.