CSV

Learn how to use the CSV storage action to build your workflow

Introduction

In this article, you will learn how to use the CSV Storage Action in DBSync Cloud Workflow to create and parse CSV (Comma-Separated Values) files during workflow execution.

This action allows you to:

  • Generate CSV files from source data as part of an integration

  • Parse and process incoming CSV files from external systems

The CSV format is widely used for exporting and importing structured data. This feature is particularly useful for backing up records, generating reports, integrating with external systems, or preparing data for manual review or downstream processing.

By including this action in your workflow, you can easily manage CSV-based data exchanges within your automated integration pipelines.

Key Use Cases

  • Archiving processed records in a structured, portable format.

  • Exporting data for use in third-party systems.

  • Creating audit trails or logs of data operations.

  • Supporting offline or manual data review processes.

Configuration Steps

  1. Add CSV Storage Action to Workflow

  • Drag and drop the CSV storage action into your workflow.

  • Click Configure provided on the CSV action.

  • Click on the Operation dropdown and select the operation that you want to perform.

  • Select the desired operations provided (COMPOSE and PARSE).

Composing in CSV
  1. Defining COMPOSE Operation

  • Operation: Select the Compose operation from the Operation drop down.

  • Compose To: Specify the desired output file name. You may use dynamic variables (e.g., output_${date}.csv) for uniqueness.

  • Select Seperator: Select the seperator that you want to compose your CSV file with. (example: Comma, Space, Tab, Semicolon, Pipe and Custom).

  • Custom Seperator: If you select Custom Separator from the Separator dropdown, you can manually specify the Seperator you want to use.

  • Include Header Row: Enable the checkbox to include the headers in the CSV file that is generated.

  • Header Layout: Provide the column names in order to map.

  • Map: Define how data fields from the source system are transformed and transferred to corresponding fields in the target system during integration.

  • Properties

    • Encoding type: Select any of the encoding type from the following:

      • UTF-8

      • ASCII

    • Batch size: User can select the batch size of 1, 50, 100, 200, 500 from the dropdown.

Parsing for CSV
  1. PARSE Operation

  • Operation: Select the Parse operation from the Operation drop down.

  • Parse From: Specify the desired location from where you want to fetch the file. For example: VALUE("$file_download_6")

  • Select Seperator: Select the seperator that your CSV file has. (example: Comma, Space, Tab, Semicolon, Pipe and Custom).

  • Custom Seperator: If you select the custom seperator in the Seperator dropdown, you can specify the custom seperator that you want.

  • Include Header Row: Enable the checkbox to include the headers in the CSV file that is generated.

  • Header Layout: Provide the column names in order to map.

  • Properties

    • Encoding type: Select any of the encoding type from the following:

      • UTF-8

      • ASCII

    • Batch size: User can select the batch size of 1, 50, 100, 200, 500 from the dropdown.

Best Practices

  • Use timestamp variables in file names to prevent overwriting critical data.

  • Regularly monitor storage usage and archive older files if needed.

  • Ensure sensitive data is securely stored and encrypted if necessary.

Limitations

  • File size is subject to plan-specific limits.

  • Only plain-text CSV format is supported (no Excel-specific features).

  • No automatic upload to external storage (use additional steps/actions if required).

Troubleshooting Tips

  • Ensure the specified file path exists.

  • Validate that all required fields are present in the incoming data.

  • Check file permissions if writing fails.

Last updated