Azure Blob Storage

marmotdata/azureblob

Discover containers from Azure Blob Storage accounts

Storage Assets Experimental

You're viewing v0.1.1. The latest release is v0.1.2. View latest

The Azure Blob Storage plugin discovers containers from Azure Storage accounts. It captures container metadata including access levels, lease status, and custom metadata.

Connection Examples

Required Permissions

The following Azure RBAC role is recommended:

Storage Blob Data Reader - Read access to containers and blobs

Or use a custom role with these permissions:

Microsoft.Storage/storageAccounts/blobServices/containers/read
Microsoft.Storage/storageAccounts/blobServices/containers/blobs/read

In the UI

Point-and-click, no config file needed.

1 Open Runs Create pipeline
2 Pick Azure Blob Storage from the plugin list.
3 Fill in the wizard, set a schedule, save.

Read the UI guide

With the CLI

Save a YAML config, then run marmot ingest.

ingest.yaml yaml

name: my-azureblob-pipeline
runs:
  - azureblob:
      # No required fields — see the Configuration tab.

$ marmot ingest -c ingest.yaml

Read the CLI guide

Not using plugins? Other ways to populate Marmot

Terraform Declare assets as infrastructure-as-code. Pulumi Native TypeScript, Python, or Go resources. Kubernetes Operator Sync assets from Kubernetes custom resources.

Configuration

9 top-level fields. * marks required fields.

tags multiselect

Tags to apply to discovered assets

external_links object[]

External links to show on all assets

name string

Display name for the link

icon string

Icon identifier for the link

url string

URL to the external resource

filter object

Filter discovered assets by name (regex)

include multiselect

Include patterns for resource names (regex)

exclude multiselect

Exclude patterns for resource names (regex)

connection_string password

Azure Storage connection string

account_name string

Azure Storage account name

account_key password

Azure Storage account key

endpoint string

Custom endpoint URL (for Azurite or other emulators)

include_metadata bool

Include container metadata

default: true

include_blob_count bool

Count blobs in each container (can be slow for large containers)

default: false

Assets emitted

Metadata this plugin attaches to each discovered asset.

Azure Blob Container

AzureBlobContainerFields

9 fields

AzureBlobContainerFields defines metadata fields for Azure Blob containers

container_name string

Name of the container

last_modified string

Last modification timestamp

etag string

Entity tag for the container

lease_status string

Lease status (locked/unlocked)

lease_state string

Lease state (available/leased/expired/breaking/broken)

has_immutability_policy bool

Whether container has an immutability policy

has_legal_hold bool

Whether container has a legal hold

public_access string

Public access level (none/blob/container)

blob_count int

Number of blobs in the container