Creating a dataset using dedicated connectors

Edited

You can create datasets based on data from remote services for which we have created dedicated connectors.

For a list of available connectors, see the table of connectors to remote services below. Some connectors are only available on-demand and may be subject to pricing.

  1. In Catalog > Assets, click on the Create an asset button and click on Dataset.

  2. In the wizard that opens, select the desired service under the Configure a remote service section.

  3. Configure the connection to your source.

For some remote services, you can select a saved connection or configure a new connection.

If you configure a new connection, select the Save connection information check box to save your connection.

  1. From the preview of the first 20 records that appears, configure the source.

  2. Configure the dataset information or use the prefilled values:

    • In the Dataset name field, enter the title for this dataset.

    • In the Dataset technical identifier field, enter a meaningful identifier for this dataset.

    • If you want anyone with access to your domain to be able to explore the dataset, toggle off Access restricted to allowed users and groups.

After creating a dataset, an editing interface opens. Only users granted with the right permissions, either "Create dataset" or "Edit dataset," can use this interface.

Using this interface you can process the data, configure the datasets and their visualizations, and manage the publishing of the dataset. For more information, see Processing data, Configuring metadata, Configuring visualizations, and Publishing a dataset.

Connectors to remote services

Huwise can connect to a variety of remote services.

Contact your local support team to get on-demand connectors activated on your domain. Some of them are subject to pricing.

Connector

Type

Description

Incremental updates possible

Connection is reusable

Airtable

API

Retrieves data from an Airtable base

Amazon S3

Files

Retrieves data from a file stored in an Amazon S3 bucket

ArcGIS

API

Retrieves data from an ArcGIS server

Azure Blob storage

Files

Retrieves data from a file stored in Azure Blob Storage

Azure SQL

Database (SQL)

Retrieves data from an Azure SQL database

Census

API

Retrieves data using the US Census Bureau API

Databricks

Database (SQL)

Retrieves data from Databricks using SQL queries

Dataset of datasets

Internal

Creates a dataset from the catalog of a Huwise domain

Denodo

Database (SQL)

Retrieves data from a Denodo database

Eco Counter

API

Retrieves data from Eco Counter counters and counting sites

Feed (RSS/Atom)

API

Retrieves data from Atom and RSS feeds

Google BigQuery

Database (SQL)

Retrieves data from a Google BigQuery table

Google Drive

Files

Retrieves data from files located in Google Drive

JCDecaux

API

Retrieves the state of JCDecaux bike station services

Netatmo

API

Retrieves data using the Netatmo API

OpenAgenda

API

Retrieves events from OpenAgenda agendas

Realtime

API

Pushes real-time data to the platform

Salesforce

API

Retrieves data using the Salesforce API

SharePoint

Files

Retrieves files stored in SharePoint

Snowflake

Database (SQL)

Retrieves data from a Snowflake table

Waze

API

Retrieves data from a Waze flow

WFS

API

Retrieves geographic data from a WFS (Web Feature Service)