Looker

Integrating Monte Carlo with Looker lets you track metadata and lineage for your dashboards, looks, dashboard-tiles, explores, and views.

This guide explains how to create service accounts for Monte Carlo on Looker and on your LookML code repository. To review all steps necessary to integrate a BI tool with Monte Carlo, please see here.

📘

Admin credentials required

To make the read only role and key for Monte Carlo, you will need Looker admin credentials as well as admin privileges for the code repository that hosts your LookML code.

🚧

Looker in Lineage

For full end-to-end lineage in Looker, you must connect both the Looker API and the Looker Git integrations. The Looker API integration provides Looker-to-Looker lineage, while the Git Repository for LookML is required to establish warehouse-to-Looker lineage.

There are two connections required to fully access Looker: the Looker API and the service hosting your LookML files. In this guide, you will:

1. Create an API key on Looker, allowing Monte Carlo to access metadata about your Dashboards, Looks and other Looker objects.
2. Connect Monte Carlo with your LookML code repository, allowing Monte Carlo to map dependencies between Looker objects and data warehouse tables. You have two options to connect: private/public keys which provides more granular control and connectivity, or HTTPS which is recommended if you have many repos to connect to MC.

The "Looker" Integration - Creating a Looker API Key

The following steps are to connect to your Looker API, allowing Monte Carlo to access metadata about your Dashboards, Looks and other Looker objects.

To create a read-only Looker API key for Monte Carlo, please follow the steps below in Looker.

First, create a permission set:

1. In the top navigation bar, go to Admin > Roles and click New Permission Set.
2. Name your permission set "montecarlops".
3. Check the necessary permissions (see list below), and click New Permission Set to save.

see_datagroups
access_data
access_data.see_lookml_dashboards
access_data.see_looks
access_data.see_looks.see_user_dashboards
access_data.see_looks.explore
access_data.see_looks.see_lookml

Then, create a role:

1. In the top navigation bar, go to Admin > Roles and click New Role.
2. Name your role "montecarlorole".
3. Select the permission set you created ("montecarlops").
4. Select the appropriate Model Set (typically, All).
5. Click New Role to save.

Then, create a user:

1. In the top navigation bar, go to Admin > Users and click Add Users.
2. Choose an email address, for example [email protected]. You are not required to use a valid email address.
3. Uncheck the Send setup emails option.
4. Select the role you created ("montecarlorole").
5. Click Add Users to save.

Then, set what content Folders the Monte Carlo User has access to see.

1. In the top navigation bar, go to Admin > Content Access.
2. Note: At this point, you can decide which folders to give access to Monte Carlo. Monte Carlo simply uses this content for Lineage and does not actually read the content in the Dashboards/Looks. We recommend starting with all Content (Shared + Users), as you can always revoke permissions to remove them from Lineage later on.
3. With the Shared folder selected, click Manage Access. If All Users does not already have View or Manage/Edit Access, add the Monte Carlo user you just created with View access.
4. Click Save.
5. Repeat with the Users folder.

Then, create an API key

1. In the top navigation bar, go to Admin > Users and click Edit on the new user you created for Monte Carlo.
2. Click Edit Keys and then New API3 Key.
3. Copy Client ID, and paste into Monte Carlo's integration wizard.
4. Unhide and copy Client Secret, and paste into Monte Carlo's integration wizard.

Finally, get your Looker host URL:

1. In the top navigation bar, go to Admin > Settings.
2. Copy Host URL, and paste into Monte Carlo's integration wizard.
3. Add the suffix :19999 to the URL, e.g. if your host is https://mydomain.looker.com, then you should provide the value https://mydomain.looker.com:19999 on Monte Carlo's integration wizard.

🚧

Port :19999

This is looker.com's port, so if you are cloud hosted or not located at looker.com, you should use your own port. That means the information you give Monte Carlo can look like: https://looker.<your_domain>.com:443.

Please note that if you use a self-signed certificate for Looker's SSL connection, you will need to uncheck the Verify SSL on Monte Carlo's integration wizard:

Click the blue "CONNECT" button, and you should be all set! You will see a module pop up testing the connection. On successful connection, the module will show a green check mark saying the connection was successful; if there was an error connecting using the details provided, the error will surface for further debugging.

📘

Need Debugging Help?

Please click on the Intercom chat bot in the lower right hand corner or contact us at [email protected].

📘

Looker API usage frequency

In order to keep Looker API usage minimal, Monte Carlo will collect Looker metadata every 4 days. This means you may have to wait 4 days for your latest user permission changes to be reflected in Monte Carlo. For more details, please contact your Monte Carlo representative.

The "Looker Git SSH" Integration - Connecting to your LookML Code Repository

The following steps are to connect to your repository hosting your LookML files, allowing Monte Carlo to map dependencies between Looker objects and data warehouse tables.

🚧

Connect to Looker API First

You will need to complete setting up Looker's API key on Monte Carlo prior to performing this section.

To enable LookML access to Monte Carlo, you will create an SSH key to access your LookML code repository.

Creating an SSH key

To enable Monte Carlo access to hosted Git repositories, you can provide a read-only SSH key.

First, create an SSH key on your local machine:

1. In your terminal, please use the following command, using your own email address.

ssh-keygen -t rsa -b 4096 -C "[email protected]"

📘

Email Doesn't Matter

You do not have to be an admin or use an admin's email to generate this key. The email provided in the command is only for record keeping purposes on your own computer so it is recommended you use your own.

2. Please follow the prompts and do not provide a passphrase (leave empty).

This process saved two keys: one private and one public. During the process, you were asked to provide a file in which to save the keys; you can now find these keys under that file name in your main directory's .ssh/id_rsa folder. For example:

work@Katies-MacBook-Pro % ssh-keygen -t rsa -b 4096 -C [email protected]
Generating public/private rsa key pair.
Enter file in which to save the key (/Users/work/.ssh/id_rsa): testing
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in testing.
Your public key has been saved in testing.pub.
The key fingerprint is:
<revoked>
The key's randomart image is:
<revoked>
work@Katies-MacBook-Pro % ls -a
...			.ssh			...
work@Katies-MacBook-Pro % cd .ssh
work@Katies-MacBook-Pro .ssh % ls
config	 testing	 testing.pub	 known_hosts

As you can see, there are two files: testing which contains the private key you will provide Monte Carlo with, and testing.pub which contains the public key you will give to Github. Once in the .ssh folder, you can run open <file_name> to access the key information. When copying this, use pbcopy to ensure no extra characters are included which will cause authentication to fail:

work@Katies-MacBook-Pro % cd .ssh
work@Katies-MacBook-Pro .ssh % open testing

Next, use the public key (found within the .pub file you generated earlier, called testing.pub in the above example) to configure read-only SSH access on your repo using the following instructions:

• Gitlab
  • You can bypass error "your git repo is not accessible" or "please provide an SSH key with read-only access" by setting up your Gitlab connection via CLI.
• Bitbucket
• Github
• Others: please consult with your Monte Carlo representative for assistance.

Finally, provide the following details on Monte Carlo's integration wizard to validate and complete the integration:

• Your private key (found within the file that has no extension you generated earlier, called testing in the above example).
• Your repository URL. Most hosting services will provide the SSH cloning URL on the repository's main page. It typically looks like so: [email protected]:USERNAME/REPOSITORY.git_.

Click the blue "CONNECT" button, and you should be all set! You will see a module pop up testing the connection. On successful connection, the module will show a green check mark saying the connection was successful; if there was an error connecting using the details provided, the error will surface for further debugging.

🚧

Placeholder Values

The placeholder values are an exact formatting match to what the integration expects. If you have an error connecting, please verify what you put in the wizard looks similar to what the placeholder value shows. For example, your Private SSH Key should begin with -----BEGIN OPENSSH PRIVATE KEY -----.

Repeat this process for every repo you want Monte Carlo to read from. Too many repos? See instructions below to connect to Github using HTTPS.

📘

Need Debugging Help?

Please click on the Intercom chat bot in the lower right hand corner or contact us at [email protected]

The "Looker Git HTTPS" Integration - Connecting to your LookML Code Repository

You can also connect to your repository hosting your LookML files using personal access tokens and Https, allowing Monte Carlo to map dependencies between Looker objects and data warehouse tables. Looker Git Https support is currently only available through our CLI.

First, you will need to make a personal access token for your github account. See instructions here for information on how to do so: creating a personal access token (classic).

For Github repos, Monte Carlo needs repo access (available scopes). This access is the only access that provides read privileges to your repos.

Then, follow this guide to install and configure the CLI. For reference, see --help for this command:

Usage: montecarlo integrations add-looker-git [OPTIONS]

  Setup a Looker ML (git) integration. For reports.

Options:
  --ssh-key FILE       The ssh key for git ssh integrations. This option
                       cannot be used with 'username', and 'token'.

  --repo-url TEXT      Repository URL as ssh://[user@]server/project.git or
                       the shorter form [user@]server:project.git for ssh. For
                       https, use https://server/project.git.  [required]

  --token TEXT         Git Access Token to be used for Https instead of ssh
                       key. This option cannot be used with 'ssh-key'.

  --username TEXT      Git username to be used in conjunction with the access
                       token. This is only required for BitBucket
                       integrations. This option cannot be used with 'ssh-
                       key'.

  --collector-id UUID  ID for the data collector. To disambiguate accounts
                       with multiple collectors.

  --skip-validation    Skip all connection tests. This option cannot be used
                       with 'validate-only'.

  --validate-only      Run connection tests without adding. This option cannot
                       be used with 'skip-validation'.

  --auto-yes           Skip any interactive approval.  [default: False]
  --help               Show this message and exit.