Data Observatory

Data Observatory

Accessing your subscriptions from BigQuery, AWS or Azure

You can access your Data Observatory subscriptions directly from BigQuery, AWS S3 and Azure Blob Storage. For BigQuery, you will be given access to the table(s) of your subscription. For AWS and Azure, your subscription will be uploaded to either of their storages as AVRO files.

Access in BigQuery

If you haven’t already, please create a BigQuery connection from Your connections section, otherwise this functionality won’t be available.

Go to Your Subscriptions page, click on the three dots to expand the menu and then on Access in BigQuery.

Access in BigQuery from Your Subscriptions.

Alternatively, you can access this option directly from the dataset page.

Access in BigQuery from the Dataset page.

The following information will be displayed:

  • Location of the data table in BigQuery, in the format project.dataset.table.
  • Location of the geography table in BigQuery, in the format project.dataset.table.
  • Example query to join the data and geography tables.
Access details for BigQuery.

If your subscription is a geography

If your dataset subscription is a geography, such as Australia’s States by CARTO, then only one table location will be shown:

Access details for BigQuery when your subscription is a geography.

A note on BigQuery permissions

If the BigQuery connection you have set up in your CARTO Dashboard is of type OAuth, you will be granted permissions to query the BigQuery tables provided with your Google user (i.e. logged in on your BigQuery console). If your connection uses a Service Account instead, these tables can only be accessed using those credentials.

Access in AWS or Azure

Since the process of accessing your subscription in AWS or Azure is similar, we will only detail that of AWS in the following description.

Go to Your Subscriptions page, click on the three dots to expand the menu and then on Access in AWS.

Access in BigQuery from Your Subscriptions.

Alternatively, you can access this option directly from the dataset page.

Access in BigQuery from the Dataset page.

The following screen will be shown, where you can confirm your request by clickin on the Request access button. You will receive a confirmation email.

Access in BigQuery from the Dataset page.

Once your data has been uploaded to an AWS S3 bucket, you will be able to access its location by coming back to your subscription and clickin on the Access in AWS button.

Access details for BigQuery when your subscription is a geography.

Requesting an Extended license

Although most of the datasets in our Spatial Data Catalog are eligible to be accessed directly in the different cloud data storages and warehouses detailed here, for some of them it is necessary to update your existing license to an Extended type.

You will be able to identify when this additional step is necessary when trying to access your subscription from BigQuery, AWS or Azure, as the following screen will be shown:

Access details for BigQuery when your subscription is a geography.

After you confirm your request by clicking on the Request extended license button you will receive a confirmation email and a member of our team will get in touch with you to make the necessary adjustments to your license. Once this process is finished, you will be able to access this functionality as with any other of your subscriptions.