Presto
Official · maintained by Marmotmarmotdata/presto Discover catalogs, schemas, tables and views from Presto clusters
The Presto plugin discovers catalogs, schemas, tables and views from Presto clusters.
Tables of connectors that another Marmot plugin covers (PostgreSQL, MySQL, Hive, Iceberg and the rest of the Trino connector map) are catalogued under that plugin's provider and name shape, so the same table reached through Presto and directly lands on one asset. Everything else, including memory and tpch tables, belongs to Presto under its full catalog.schema.table path.
Required Permissions
The connecting user needs SELECT access to system.metadata.catalogs, system.runtime.nodes and each catalog's information_schema. include_stats additionally runs SHOW STATS per table. A password is only sent over HTTPS, so secure: true is required with one.
In the UI
Point-and-click, no config file needed.
- 1 Open Runs Create pipeline
- 2 Pick Presto from the plugin list.
- 3 Fill in the wizard, set a schedule, save.
With the CLI
Save a YAML config, then run marmot ingest.
name: my-presto-pipeline
runs:
- presto:
host: "<host>"
user: "<user>"$ marmot ingest -c ingest.yamlNot using plugins? Other ways to populate Marmot
Configuration
16 top-level fields. * marks required fields.
tags multiselect Tags to apply to discovered assets
external_links object[] External links to show on all assets
name string Display name for the link
icon string Icon identifier for the link
url string URL to the external resource
filter object Filter discovered assets by name (regex)
include multiselect Include patterns for resource names (regex)
exclude multiselect Exclude patterns for resource names (regex)
host string Presto coordinator hostname
port int Presto coordinator port
- default
- 8080
user string Username for authentication
password password Password (requires HTTPS)
secure bool Use HTTPS
- default
- false
ssl_cert_path string Path to TLS certificate file
catalog string Specific catalog to discover (all if empty)
exclude_catalogs multiselect Catalogs to skip
- default
- ["system","jmx"]
exclude_schemas multiselect Schemas to skip in every catalog
- default
- []
include_catalogs bool Create catalog-level assets
- default
- true
include_views bool Discover views and their definitions
- default
- true
include_columns bool Include column info in table metadata
- default
- true
include_stats bool Collect row counts with SHOW STATS (can be slow)
- default
- false
Assets emitted
Metadata this plugin attaches to each discovered asset.
Catalog
PrestoCatalogFieldsThe metadata fields emitted for catalog assets.
catalog_name stringPresto catalog name
connector_name stringConnector backing the catalog
schema_count intNumber of discovered schemas
table_count intNumber of discovered tables
view_count intNumber of discovered views
host stringPresto coordinator hostname
port intPresto coordinator port
presto_version stringPresto coordinator version
Table
PrestoTableFieldsThe metadata fields emitted for table and view assets.
catalog stringParent catalog name
schema stringParent schema name
table_name stringTable or view name
table_type stringBASE TABLE or VIEW
connector_name stringConnector backing the catalog
comment stringTable comment
Column
PrestoColumnFieldsThe per-column fields embedded in an asset's schema.
column_name stringColumn name
data_type stringPresto data type, nested types verbatim
is_nullable boolWhether null values are allowed
ordinal_position intColumn position
description stringColumn comment
default_expression stringDefault value expression