Adding Additional Warehouses
You will typically connect your warehouse to Monte Carlo while you follow the on-screen onboarding wizard. If you have more than one data warehouse in your environment, you will be able to connect additional warehouses to Monte Carlo once initial onboarding is complete. Your dashboard will then provide unified access to all tables in all warehouses.
Have more than 3,000 tables in your new warehouse?
You might need to adjust the capacity of your data collector to support the increased load. Please consult with your Monte Carlo success team.
To connect Monte Carlo to a warehouse after initial onboarding had been completed, follow these steps:
- Ensure that Monte Carlo's data collector has network connectivity to the warehouse.
- Create a read-only service account with the appropriate permissions on your data warehouse. See detailed instructions in our dedicated guides for Snowflake, BigQuery and Redshift.
- Set your service account credentials on Monte Carlo using the CLI.
Please allow up to 24 hours for a newly added warehouse to take effect
It may take 12-24 hours for tables from a newly added warehouse to appear in Catalog and Pipelines
Setting credentials for a new warehouse using the CLI
You will provide connection details using Monte Carlo's CLI:
- Please follow this guide to install and configure the CLI.
- Please use one of the commands below to connect Monte Carlo with your warehouse.
Please give your warehouse a meaningful name
Please use the
name
parameter to give your new warehouse a friendly display name. This name will be used in Monte Carlo's UI.
$ montecarlo integrations add-snowflake --help
Usage: montecarlo integrations add-snowflake [OPTIONS]
Setup a Snowflake integration. For metadata, query logs and metrics.
Options:
--user TEXT User with access to snowflake. [required]
--account TEXT Snowflake account name. [required]
--warehouse TEXT Name of the warehouse for the user. [required]
--password TEXT User's password. If you prefer a prompt (with hidden
input) enter -1. [required]
--name TEXT Friendly name for the warehouse. [required]
--collector-id UUID ID for the data collector. To disambiguate accounts
with multiple collectors.
--skip-validation Skip all connection tests. This option cannot be used
with 'validate-only'.
--validate-only Run connection tests without adding. This option cannot
be used with 'skip-validation'.
--auto-yes Skip any interactive approval. [default: False]
--option-file FILE Read configuration from FILE.
--help Show this message and exit.
$ montecarlo integrations add-bigquery --help
Usage: montecarlo integrations add-bigquery [OPTIONS]
Setup a BigQuery integration. For metadata, query logs and metrics.
Options:
--key-file PATH JSON Key file. [required]
--name TEXT Friendly name for the warehouse. [required]
--collector-id UUID ID for the data collector. To disambiguate accounts
with multiple collectors.
--skip-validation Skip all connection tests. This option cannot be used
with 'validate-only'.
--validate-only Run connection tests without adding. This option cannot
be used with 'skip-validation'.
--auto-yes Skip any interactive approval. [default: False]
--option-file FILE Read configuration from FILE.
--help Show this message and exit.
$ montecarlo integrations add-redshift --help
Usage: montecarlo integrations add-redshift [OPTIONS]
Setup a Redshift integration. For metadata, query logs and metrics.
Options:
--port INTEGER HTTP port. [default: 5439]
--name TEXT Friendly name for the warehouse. [required]
--host TEXT Hostname. [required]
--user TEXT Username with access to the database. [required]
--database TEXT Name of database. [required]
--password TEXT User's password. If you prefer a prompt (with hidden
input) enter -1. [required]
--collector-id UUID ID for the data collector. To disambiguate accounts
with multiple collectors.
--skip-validation Skip all connection tests. This option cannot be used
with 'validate-only'.
--validate-only Run connection tests without adding. This option cannot
be used with 'skip-validation'.
--auto-yes Skip any interactive approval. [default: False]
--test-network-only Skip any permission tests. Only validates network
connection between the collector and resource can be
established. This option cannot be used with 'skip-
validation'. [default: False]
--option-file FILE Read configuration from FILE.
--help Show this message and exit.
Updated 10 months ago