Redpanda
Official · maintained by Marmotmarmotdata/redpanda Discover topics from Redpanda clusters
The Redpanda plugin discovers topics from Redpanda clusters. It uses the same discovery engine as the Kafka plugin since Redpanda is Kafka API-compatible.
Connection
Redpanda Cloud
bootstrap_servers: "seed-xxxxx.cloud.redpanda.com:9092"
client_id: "marmot-discovery"
authentication:
type: "sasl_ssl"
username: "your-username"
password: "your-password"
mechanism: "SCRAM-SHA-256"
tls:
enabled: trueSelf-Hosted Redpanda
bootstrap_servers: "redpanda-0.example.com:9092,redpanda-1.example.com:9092"
client_id: "marmot-discovery"In the UI
Point-and-click, no config file needed.
- 1 Open Runs Create pipeline
- 2 Pick Redpanda from the plugin list.
- 3 Fill in the wizard, set a schedule, save.
With the CLI
Save a YAML config, then run marmot ingest.
name: my-redpanda-pipeline
runs:
- redpanda:
bootstrap_servers: "seed-xxxxx.cloud.redpanda.com:9092"$ marmot ingest -c ingest.yamlNot using plugins? Other ways to populate Marmot
Configuration
12 top-level fields. * marks required fields.
tags multiselect Tags to apply to discovered assets
external_links object[] External links to show on all assets
name string Display name for the link
icon string Icon identifier for the link
url string URL to the external resource
filter object Filter discovered assets by name (regex)
include multiselect Include patterns for resource names (regex)
exclude multiselect Exclude patterns for resource names (regex)
bootstrap_servers string Comma-separated list of bootstrap servers
- example
- seed-xxxxx.cloud.redpanda.com:9092
client_id string Client ID for the consumer
authentication object Authentication configuration
type select Authentication type: none, sasl_plaintext, sasl_ssl, ssl
username string SASL username
password password SASL password
mechanism select SASL mechanism: PLAIN, SCRAM-SHA-256, SCRAM-SHA-512
consumer_config string Additional consumer configuration
client_timeout_seconds int Request timeout in seconds
tls object TLS configuration
enabled bool Whether to enable TLS
cert_path string Path to TLS certificate file
key_path string Path to TLS key file
ca_cert_path string Path to TLS CA certificate file
skip_verify bool Skip TLS verification
schema_registry object Schema Registry configuration
url string Schema Registry URL
config string Additional Schema Registry configuration
enabled bool Whether to use Schema Registry
skip_verify bool Skip TLS certificate verification
include_partition_info bool Whether to include partition information in metadata
- default
- true
include_topic_config bool Whether to include topic configuration in metadata
- default
- true