Oracle Cloud Storage

Oracle Cloud Storage or Oracle Storage is a service offered by Oracle, a long running technology company that with its cloud and Fusion offerings has their own object storage for managing various types of data and blobs. Oracle Cloud Storage based on their Oracle Cloud Infrastructure (OCI) uses the same scalable storage infrastructure that it already provides to tens of thousands of customers. Oracle Cloud Storage can store any type of object, which allows uses like storage for Internet applications, backups, disaster recovery, data archives, data lakes for analytics, and hybrid cloud storage.

Our Oracle Cloud Storage DLH.io integration provides:

replicatation of stored data to any Cloud Data Warehouse target
synchronization of your target destination at a scheduled frequency
a single platform to analyze your data and integrate with other data so that you can combine all into a single source of truth repository for true analytics that will empower your business, for example many Oracle customers often have Snowflake, Databricks, or another system they need to integrate with and DLH.io provides the ability to do so.

All you need is to specify the connection to your Oracle Storage, point to your target system, and does the rest. Our Customer Support team can help you set it up for you during a short technical on-boarding session, as needed.

Setup Instructions

DLH.io securely connects to your Oracle storage. Using the form in the DLH.io portal please complete the following basic steps.

Enter a Name or Alias for this connection, in the 'Name/Alias' field, that is unique from other connectors
Enter a 'Target Schema Prefix', which will be the prefix for the schema at the target you will sync to
Enter a 'Bucket' name, where your files are stored
- Typically starts with https://, so enter just the name without the prefix.
Select your 'Region'
Enter your 'Access Key', credentials to access the bucket
Enter your 'Secret Key', credentials to access the bucket
Enter any other optional details in the available fields (See the setup video if you need help or contact support)
- Folder Path, is a path on the root bucket from where desired files will be retrieved
- File Pattern, is a regular expression (RegEx) used to isolated only certain files to be retrieved
- File Type, allows for a pre-determined type of file extension to be retreived
Click the **Save & Test **button. Once your credentials are accepted you should be able to see a successful connection.

Creating Credentials: Access & Secret Key in OCI

Using the Console

Using the console you can create your keys to access Oracle Storage and Oracle Fusion BICC data files used for synchronizing data to your target destination, etc. The steps are as follows:

Access the IAM for users in the domain
Create a new service account user specifically for the purpose of using a service account credential for DLH and accessing data for BICC and controling the keys as a service account. This requires an email address to be created as this is in effect creating a new user in your OCI account. The benefit here is that a service account will not be tied to a named administrator or named user and a service account credential can be shared by administrators of your account internally. We recommend a new service account with a name such as this be created (you can change this suggestion to fit your companies policy and standards, of course):
1. First Name = DLH Storage
2. Last Name = Service Account
3. Email = dlh_oracle_storage_svc@<your_company_domain>
Create a new group by navigating to:
1. Domains > User Management > Groups (Scroll down on user management page)
2. Name the group something like Object Storage Access Group
3. Assign the newly created user to this group
Create a new policy by navigating to:
1. For example, create a policy named, dlh_bucket_access_policy
2. In the policy storage builder (if using the UI) give this policy the permissions of, storage management > Let users write objects to Object Storage buckets
3. Assign the newly created group to this policy and save
Return to the Domains > User Management area
Click on the newly created Service Account User
Navigate to the tab, Customer secret keys
Click on the Generate Secret Key button
1. Copy the Secret Key
2. Then, copy the Access Key
3. Be sure to copy these immediately and paste them somewhere safe for re-use as the secret key cannot be recreated, so you would have to delete the key and repeat the process to retrieve it (is essence recycling the key, destroying the previous key rendering it useless)
Save the secret key and access key and use this for inputs into the DLH.io Oracle Cloud Storage connection form setup.

...

Testing or Troubleshooting the Access and Secret Keys

The best way to test the keys are working is to create a DLH.io Oracle Cloud Storage connection and then use the Test Connection button.

Another way is to use a quick python script or Jupyter Notebook (or equivelant) and run the following code on your local machine, etc. for testing. You will be able to see any error messages returned by OCI quickly and troublshoot with Customer Support much easier if there are issues.

import boto3

s3 = boto3.resource(
    's3',
    aws_access_key_id="bexxxxxxxxxxxxxxxxxxxxxxxxxxxxxxdb2",
    aws_secret_access_key="8xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=",
    region_name="us-ashburn-1", # Region name here that matches the endpoint
    endpoint_url="https://xxxxxxxxxxx.compat.objectstorage.us-ashburn-1.oraclecloud.com" # Include your namespace in the URL
)
  
# Print out the bucket names
for bucket in s3.buckets.all():
    print (bucket.name)

How to Video

[Coming Soon]

If any issues occur with the authorization simply return to the sources page in DLH.io, edit the source details and click the 'Save & Test' button to confirm connectivity. If any issues persist please contact our support team via the DLH.io Support Portal.

Issue Handling

If any issues occur with the authorization simply return to the sources page in DLH.io, edit the source details and click the Save & Test or Authorize Your Account or Re-Authorize Account button to confirm connectivity. If any issues persist please contact our support team via the DLH.io Support Portal.