Managing Plugins
Steampipe provides an integrated, standardized SQL interface for querying various services, but it relies on plugins to define and implement tables for those services. This approach decouples the core Steampipe code from the provider-specific implementations, providing flexibility and extensibility.
Installing Plugins
Steampipe plugins are packaged as Open Container Images (OCI) and stored in the Steampipe Hub registry. This registry contains a curated set of plugins developed by and/or vetted by Turbot. To install the latest version of a standard plugin, you can simply install it by name.
For example, to install the latest aws
plugin:
$ steampipe plugin install aws
This will download the latest aws plugin from the hub registry, and will set up a default connection named aws
.
Note: If you install multiple versions of a plugin only the first installation will create a connection automatically for you, you will need to create/edit a connection configuration file in order to use the additional versions of the plugin.
Installing a Specific Version
To install a specific version, simply specify the version tag after the plugin name, separated by @
or :
For example, to install the 0.118.0 version of the aws plugin:
$ steampipe plugin install aws@0.118.0
This will download the aws plugin version 0.118.0 (the one with the 0.118.0
tag) from the hub registry.
Installing from a SemVer Constraint
Plugins should follow semantic versioning guidelines, and they are tagged in the registry with a version tag that specifies their exact version in the major.minor.patch
format (e.g. 1.0.1
).
The intent of the version tag is that it is immutable - while it is technically possible to move the version tag to a different image version, this should not be done.
Installing with a semver constraint allows you to "lock" (or pin) to a specific set of releases which match the contraints.
If you install via steampipe plugin install aws@^1
, for example, steampipe plugin update
(and auto-updates) will only update to versions greater than 1.0.0
but less than 2.0.0
.
Supported semver constraint types:
Wildcard Constraint: This matches any version for a particular segment (Major, Minor, or Patch).
1.x.x
would match any version with major segment of1
.1.2.x
would match any version with the major segment of1
and a minor segment of2
.
Caret Constraint (^): This matches versions that do not modify the left-most non-zero digit.
^1.2.3
is the latest version equal or greater than1.2.3
, but less than2.0.0
.^0.1.2
is the latest version equal or greater than0.1.2
, but less than0.2.0
.
Tilde Constraint (~): This matches versions based on expression, if minor segment is expressed, locks to it, else locks to major.
~1
is the latest version greater than or equal to1.0.0
, but less than2.0.0
(same as1.x.x
).~1.2
is the latest version greater than or equal to1.2.0
, but less than1.3.0
(same as1.2.x
).~1.2.3
is the latest version greater than or equal to1.2.3
, but less than1.3.0
.
Range Constraint: This specifies a range of versions using a hyphen.
1.2.3-1.2.5
would limit to latest available version of1.2.3
,1.2.4
or1.2.5
.
Other Constraints:
>1.1.1
would match any version greater than1.1.1
.>=1.2.0
would match any version greater than or equal to1.2.0
.
You can use the install command in the same way as a specific version with these constraints (imagename@constraint
) syntax:
Note: For some constraints using special characters
>
,<
,*
you may need to escape the characters\>
or quote the stringsteampipe plugin install "aws@>0.118.0"
depending on your terminal.
- To install the latest version locked to a specific major version:
$ steampipe plugin install aws@^2# or$ steampipe plugin install aws@2.x.x
- To install the latest version locked to a specific minor version:
$ steampipe plugin install aws@~2.1# or$ steampipe plugin install aws@2.1.x
Installing from another registry
Steampipe plugins are packaged in OCI format and can be hosted and installed from any artifact repository or container registry that supports OCI V2 images. To install a plugin from a repository, specify the full path in the install command:
$ steampipe plugin install us-docker.pkg.dev/myproject/myrepo/myplugin@mytag
Installing from a File
A plugin binary can be installed manually, and this is often convenient when developing the plugin. Steampipe will attempt to load any plugin that is referred to in a connection
configuration:
- The plugin binary file must have a
.plugin
extension - The plugin binary must reside in a subdirectory of the
~/.steampipe/plugins/
directory and must be the ONLY.plugin
file in that subdirectory - The
connection
must specify the path (relative to~/.steampipe/plugins/
) to the plugin in theplugin
argument
For example, consider a myplugin
plugin that you have developed. To install it:
- Create a subdirectory
.steampipe/plugins/local/myplugin
- Name your plugin binary
myplugin.plugin
, and copy it to.steampipe/plugins/local/myplugin/myplugin.plugin
- Create a
~/.steampipe/config/myplugin.spc
config file containing a connection definition that points to your plugin:connection "myplugin" {plugin = "local/myplugin"}
Installing Missing Plugins
You can install all missing plugins that are referenced in your configuration files:
$ steampipe plugin install
Running steampipe plugin install
with no arguments will cause Steampipe to read all connection
and plugin
blocks in all .spc
files in the ~/.steampipe/config
directory and install any that are referenced but are not installed. Note that when doing so, any default .spc
file that does not exist in the configuration will also be copied. You may pass the --skip-config
flag if you don't want to copy these files:
$ steampipe plugin install --skip-config
Viewing Installed Plugins
You can list the installed plugins with the steampipe plugin list
command:
$ steampipe plugin list┌─────────────────────────────────────────────────────┬─────────┬─────────────────────────────────────────────┐│ NAME │ VERSION │ CONNECTIONS │├─────────────────────────────────────────────────────┼─────────┼─────────────────────────────────────────────┤│ hub.steampipe.io/plugins/turbot/aws@latest │ 0.4.0 │ aws,aws_account_aaa,aws_account_aab ││ hub.steampipe.io/plugins/turbot/digitalocean@latest │ 0.1.0 │ digitalocean ││ hub.steampipe.io/plugins/turbot/gcp@latest │ 0.0.6 │ gcp_project_a,gcp,gcp_project_b ││ hub.steampipe.io/plugins/turbot/github@latest │ 0.0.5 │ github ││ hub.steampipe.io/plugins/turbot/steampipe@latest │ 0.0.2 │ steampipe │└─────────────────────────────────────────────────────┴─────────┴─────────────────────────────────────────────┘
Updating Plugins
To update a plugin to the latest version for a given stream, you can use the steampipe plugin update
command:
steampipe plugin update plugin_name[@stream]
The syntax and semantics are identical to the install command - steampipe plugin update aws
will get the latest aws plugin, steampipe plugin update aws@1
will get the latest in the 1.x major stream, etc.
To update all plugins to the latest in the installed stream:
steampipe plugin update --all
Removing Plugins
You can uninstall a plugin with the steampipe plugin remove
command:
steampipe plugin uninstall [plugin]
Note that you cannot remove a plugin if there are active connections using it. You must remove any connections that use the plugin first:
$ steampipe plugin list+--------------------------------------------------+---------+-------------+| NAME | VERSION | CONNECTIONS |+--------------------------------------------------+---------+-------------+| hub.steampipe.io/plugins/turbot/aws@latest | 0.0.5 | aws || hub.steampipe.io/plugins/turbot/steampipe@latest | 0.0.1 | steampipe |+--------------------------------------------------+---------+-------------+$ steampipe plugin remove steampipeError: Failed to remove plugin 'steampipe' - there are active connections using it: 'steampipe'$ rm ~/.steampipe/config/steampipe.spc$ steampipe plugin remove steampipeRemoved plugin steampipe$ steampipe plugin list+--------------------------------------------+---------+-------------+| NAME | VERSION | CONNECTIONS |+--------------------------------------------+---------+-------------+| hub.steampipe.io/plugins/turbot/aws@latest | 0.0.5 | aws |+--------------------------------------------+---------+-------------+
Steampipe Plugin Registry Support Lifecycle
The Steampipe Plugin Registry is committed to ensuring accessibility and stability for its users by maintaining versions of plugins for at least one year and preserving at least one version of each plugin. This practice ensures that users can access older versions of plugins if needed, providing a safety net for compatibility issues or preferences.