Data Sources
Last updated
Last updated
In the Sources explorer you can find all the data sources available via the data warehouse connection that you have selected when creating the workflow. Here you can learn more about how to create your data warehouse connections in CARTO.
There are three different types of data source: Connection data, Data Observatory and Files
Note
In case you are using a service account to connect to Google BigQuery, note that it must have at least BigQuery Data Editor (roles/bigquery.dataEditor
) permissions in order to edit schemas, create and edit tables, and get information regarding jobs.
It is important to note that currently each workflow can only be associated with one single data warehouse connection and that it is defined at the time of creating the workflow (without being able to modify it afterwards).
Through "Connection data" you will have access to tables in schemas/datasets in your data warehouse. These sources can be used in workflows by just adding them to the canvas.
If your CARTO organization has been provisioned in a cloud region outside of the US (Europe-West, Asia-Northeast or Australia-Southeast), you will be able to select between two different options in your Sources panel in Workflows:
Your organization's region. You will only have access to your own 'shared' and 'private' datasets within 'organization data'.
CARTO's region (US). This one will grant to access to a different 'organization data' provisioned in the US region and also to CARTO's 'demo data'.
Are you interested in getting access to the best geospatial data, already curated and ready to be used within the CARTO platform? Learn more about Data Observatory in its documentation page.
If you have subscriptions to Data Observatory datasets, they can be used as data sources in Workflows.
If there are subscriptions available through your current connection, they will be listed by provider and organized as Samples and Subscriptions.
You can add a data source to your workflow's canvas by drag and drop. Once added to the canvas, it will work as any other data source that you can connect to one or more components:
Learn more about creating, managing and accessing your subscriptions in different Data Warehouses here.
If you want to use data that is not available via the data warehouse connection used in the workflow, you always have the possibility to drag and drop files to your workflow at any time which will get imported to your data warehouse via the established connection. Please find the list of supported file formats and size limits here.
The files added by drag and drop, or selected from your browser will be stored and remain accessible from the same Workflow.