Amazon S3
How to Use DBSync's Amazon Simple Storage Service (S3) Connector
Overview
The DBSync Amazon Simple Storage Service (S3) connector allows for seamless data transfer between local file systems and Amazon S3 cloud storage. It supports operations such as uploading and downloading files and directories, enhancing your data management capabilities.
Prerequisites
To connect with Amazon S3 via DBSync:
A valid DBSync Amazon S3 connector license, along with a DBSync iPaaS platform username and password.
AWS S3 Access Key ID and Secret Access Key from the AWS Management Console.
Connector Configurations
The Amazon S3 connector requires the following parameters:
Property | Description | Required | Default Value |
Class Name | Logical unit of storage in AWS to store objects | Yes | awsS3Adapter |
User Name | Amazon user Access Key ID | Yes |
|
Password | Amazon user Secret Access Key | Yes |
|
Step-by-Step Process
Login to DBSync Cloud Workflow
Navigate to the DBSync website and click 'Login'.
Choose 'Cloud Workflow'.
Enter Login Credentials
Provide your User Name and Password, then click 'Login'.
Create a New Project
Click on 'Create' to start a new project.
Name your project (e.g., 'S3 Integration Project').
Add a Task
Click on Add Task and name it (e.g., 'Upload to S3').
Assign the task to a Bot and click Configure.
Drag and Drop the S3 Connector
In the task configuration screen, drag and drop the 'Amazon S3' connector from the available connectors list.
Configure the S3 Connector
Click on the S3 connector to configure it. Fill in the required fields:
AWS Access Key ID: Your Amazon S3 access key.
AWS Secret Access Key: Your Amazon S3 secret key.
Bucket Name: Specify the S3 bucket where you want to store or retrieve data.
Region: Select the AWS region where your S3 bucket is located.
Define Operations
Choose the operation you want to perform with the S3 connector:
Upload File: Specify the local file path and the destination path in S3.
Upload Directory: Specify the local directory path to upload.
Download File: Specify the S3 file path and the local destination path.
Download Directory: Specify the S3 directory path to download.
Add Additional Actions (Optional)
If needed, add additional actions such as Transform or Query to process data before uploading or after downloading.
Add Debugging (Optional)
Add a Debug action to print out the status or results of the S3 operations to ensure everything is working correctly.
Save and Run the Workflow
Click Save to store your configuration.
Click the Run icon to execute the workflow. Monitor the console output for any errors or confirmation messages regarding the S3 operations.
Review Logs
After running the integration, check the logs to verify that the data was successfully uploaded or retrieved from S3. This will help you identify any issues that may have occurred during the process.
Uses of Amazon S3 Connector
Scheduled Auto Backups: Automate backups and archives from file systems or databases to Amazon S3, reducing manual intervention.
Improved File Sharing: Enhance file sharing capabilities between databases and Amazon S3.
PRO TIP
Use IAM roles with appropriate permissions for enhanced security when accessing your S3 buckets. This minimizes the risk of exposing your Access Key and Secret Key.
Related Content
Error Handling in Integrations: Learn how to troubleshoot and resolve common integration errors.
Monitoring and Alerts Setup: Set up alerts to monitor your workflows proactively.
Scheduler: By establishing a schedule, you can automate your workflows to run without manual intervention, allowing you to manage recurring tasks more efficiently.
Last updated