DLHDLH.io Documentation

Azure Blob Storage

DLH.io documentation for Azure Blob Storage

Azure Blob Storage is Microsoft’s object storage solution for the cloud. Users can create data lakes with Azure Blob Storage to support their analytics needs, and it also offers storage so you can design robust mobile and cloud-native applications.

Pre-Requisites:

  • Access to your Azure portal services
  • Ability to create a Blob Storage
  • Ability to update your Azure network firewall
  • Ability to test with private or public secured containers

Setup Instructions

DLH.io securely connects to your Azure Blob Storage. Using the form in the DLH.io portal please complete the following basic steps:

  1. Enter a Name or Alias for this connection, in the 'Name/Alias' field, that is unique from other connectors

  2. Enter a Target Schema Prefix, a name which will be the prefix for the schema at the target destination to where your data will sync

  3. Enter in the Connection String (SAS) URL field the Shared Access Signature (SAS) URL connection string you retrieved from the Azure Pre-Requisite Steps based in the Azure storage account where your files are stored:

    • The URL typically starts with the storage account and other information related to the container, for example: https://<your_storage_account>.blob.core.windows.net/<container_name>?sp=....
  4. Enter any other optional details in the available fields (See the setup video if you need help or contact support)

    • Folder Path, is a path on the root bucket from where desired files will be retrieved
    • File Pattern, is a regular expression (RegEx) used to isolated only certain files to be retrieved
    • File Type, allows for a pre-determined type of file extension to be retreived
  5. Click the **Save & Test **button. Once your credentials are accepted you should be able to see a successful connection.

Public vs. Private Containers

DLH.io works with both private and public security on the containers. If for some reason during testing you have an issue connecting to a private configured container, please test with a public access configured container. This will ensure that you have confirmed that security is not a problem or if there is some other issue with how you have configured your access credential or container when provided it for your DLH.io blob storage connector setup. If there any questions please contact Customer Support .

Container Access Level Container Access Level

SAS Token Security Permission Levels

Your Azure Blob Storage access policy and your permissions shouls be set for the least permissive access. However, DLH.io requires the following permissions on the container when creating the SAS Token(s), in order to validate (test) a connection each time:

  • Read, List

And, when used as a target destination connection it requires the permissions:

  • Read, Add, Create, Write, Delete, List, and Move

If you are unclear on how to create a Shared Access Token, or what it is, please review the Microsoft Blob Storage Container documentation on SAS Token Creation.

Shared Access Token Permissions Example Shared Access Token Permissions Example