AWS S3
Core pluginmarmotdata/s3
Discover S3 buckets from AWS accounts
The S3 plugin discovers and catalogs Amazon S3 buckets across your AWS accounts. It captures bucket metadata including security configurations, lifecycle policies, encryption settings, and tags.
Required Permissions
AWS Configuration
See AWS Configuration for the supported AWS configuration options.
In the UI
Point-and-click, no config file needed.
- 1 Open
Runs→Create Pipeline - 2 Pick AWS S3 from the plugin list.
- 3 Fill in the wizard, set a schedule, save.
With the CLI
Save a YAML config, then run marmot ingest.
name: my-s3-pipeline
runs:
- s3:
# No required fields — see the Configuration tab.marmot ingest -c ingest.yaml Not using plugins? Other ways to populate Marmot
Configuration
6 top-level fields.
tags multiselect Tags to apply to discovered assets
external_links object[] External links to show on all assets
name string Display name for the link
icon string Icon identifier for the link
url string URL to the external resource
filter object Filter discovered assets by name (regex)
include multiselect Include patterns for resource names (regex)
exclude multiselect Exclude patterns for resource names (regex)
credentials object AWS credentials configuration
use_default bool Use AWS credentials from environment or default profile (recommended)
true id string AWS access key ID
secret password AWS secret access key
token password AWS session token
profile string AWS profile to use from shared credentials file
role string AWS IAM role ARN to assume
role_external_id string External ID for cross-account role assumption
region string AWS region for services
endpoint string Custom endpoint URL for AWS services
tags_to_metadata bool Convert AWS tags to Marmot metadata
include_tags multiselect List of AWS tags to include as metadata. By default, all tags are included.
Assets Emitted
Metadata fields this plugin attaches to each discovered asset.
S3
S3FieldsS3Fields represents S3-specific metadata fields
bucket_arn stringThe ARN of the S3 bucket
region stringThe AWS region where the bucket is located
creation_date stringWhen the bucket was created
versioning stringBucket versioning status
encryption stringBucket encryption configuration
public_access_block stringPublic access block configuration
notification_config stringBucket notification configuration
lifecycle_config stringBucket lifecycle configuration
replication_config stringBucket replication configuration
website_config stringStatic website hosting configuration
logging_config stringBucket access logging configuration
accelerate_config stringTransfer acceleration configuration
request_payment_config stringRequest payment configuration
tags objectAWS resource tags