Oracle Cloud Storage

Oracle Cloud Storage or Oracle Storage is a service offered by Oracle, a long running technology company that with its cloud and Fusion offerings has their own object storage for managing various types of data and blobs. Oracle Cloud Storage based on their Oracle Cloud Infrastructure (OCI) uses the same scalable storage infrastructure that it already provides to tens of thousands of customers. Oracle Cloud Storage can store any type of object, which allows uses like storage for Internet applications, backups, disaster recovery, data archives, data lakes for analytics, and hybrid cloud storage. 

Our Oracle Cloud Storage DLH.io integration provides:

• replicatation of stored data to any Cloud Data Warehouse target
• synchronization of your target destination at a scheduled frequency
• a single platform to analyze your data and integrate with other data so that you can combine all into a single source of truth repository for true analytics that will empower your business, for example many Oracle customers often have Snowflake, Databricks, or another system they need to integrate with and DLH.io provides the ability to do so.

All you need is to specify the connection to your Oracle Storage, point to your target system, and does the rest. Our Customer Support team can help you set it up for you during a short technical on-boarding session, as needed.

Setup Instructions

Follow the setup steps guide for configuring your Oracle Cloud Storage connection to enable data to flow into your destination via DLH.

Supported Features

Here are key features supported for this connector.

If you have any questions about these supported features please reach out to our Customer Support team.

Details on Sync Processing

For this connector, we believe the sync processing is straightforward. We've provided a number of details, steps, and other guidance here and in the setup steps guide. Be sure to also check the change log and notes page from time to time for any changes.

Creating Credentials: Access & Secret Key in OCI

Using the Console

Using the console you can create your keys to access Oracle Storage and Oracle Fusion BICC data files used for synchronizing data to your target destination, etc. The steps are as follows:

1. Access the IAM for users in the domain
2. Create a new service account user specifically for the purpose of using a service account credential for DLH and accessing data for BICC and controling the keys as a service account. This requires an email address to be created as this is in effect creating a new user in your OCI account. The benefit here is that a service account will not be tied to a named administrator or named user and a service account credential can be shared by administrators of your account internally. We recommend a new service account with a name such as this be created (you can change this suggestion to fit your companies policy and standards, of course):
   1. First Name = DLH Storage
   2. Last Name = Service Account
   3. Email = dlh_oracle_storage_svc@<your_company_domain>
3. Create a new group by navigating to:
   1. Domains > User Management > Groups (Scroll down on user management page)
   2. Name the group something like Object Storage Access Group
   3. Assign the newly created user to this group
4. Create a new policy by navigating to:
   1. For example, create a policy named, dlh_bucket_access_policy
   2. In the policy storage builder (if using the UI) give this policy the permissions of, storage management > Let users write objects to Object Storage buckets
   3. Assign the newly created group to this policy and save
5. Return to the Domains > User Management area
6. Click on the newly created Service Account User
7. Navigate to the tab, Customer secret keys
8. Click on the Generate Secret Key button
   1. Copy the Secret Key
   2. Then, copy the Access Key
   3. Be sure to copy these immediately and paste them somewhere safe for re-use as the secret key cannot be recreated, so you would have to delete the key and repeat the process to retrieve it (is essence recycling the key, destroying the previous key rendering it useless)
9. Save the secret key and access key and use this for inputs into the DLH.io Oracle Cloud Storage connection form setup.

...

Testing or Troubleshooting the Access and Secret Keys

The best way to test the keys are working is to create a DLH.io Oracle Cloud Storage connection and then use the Test Connection button.

Another way is to use a quick python script or Jupyter Notebook (or equivelant) and run the following code on your local machine, etc. for testing. You will be able to see any error messages returned by OCI quickly and troublshoot with Customer Support much easier if there are issues.

import boto3

s3 = boto3.resource(
    's3',
    aws_access_key_id="bexxxxxxxxxxxxxxxxxxxxxxxxxxxxxxdb2",
    aws_secret_access_key="8xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=",
    region_name="us-ashburn-1", # Region name here that matches the endpoint
    endpoint_url="https://xxxxxxxxxxx.compat.objectstorage.us-ashburn-1.oraclecloud.com" # Include your namespace in the URL
)
  
# Print out the bucket names
for bucket in s3.buckets.all():
    print (bucket.name)

How to Video

[Coming Soon]

If any issues occur with the authorization simply return to the sources page in DLH.io, edit the source details and click the 'Save & Test' button to confirm connectivity. If any issues persist please contact our support team via the DLH.io Support Portal.

Issue Handling

If any issues occur with the authorization simply return to the sources page in DLH.io, edit the source details and click the Save & Test or Authorize Your Account or Re-Authorize Account button to confirm connectivity. If any issues persist please contact our support team via the DLH.io Support Portal.