Transformation

On the Transformation page, convert the extracted data into a suitable format for analysis. This stage includes data cleaning, filtering, aggregation, and normalization. Enrich the data by integrating it with additional information.

Once the project data has been successfully transferred to the designated destination database, select a specific project and access the Transform tab located in the right panel.

Click on Add New to create a table in the destination using SQL scripts.

The table name must be specified in the “Transform table name” text box. Optionally, primary key values can be specified in a comma-separated format.

The data will initially be transferred to the DuckDB database within the designated {project_name} schema before undergoing transformation for integration into the target databases. For example, in the case of a project named “test”, the data will be moved to the test table schema.

Sample Transformation scripts:

select date_part('year',payment_date) as "year", date_part('month',payment_date) as "month", sum(amount) as "TotalAmount" from test.payment
group by date_part('year',payment_date),date_part('month',payment_date)

Preview

Click on Preview to view the data with a limit value of 10.

Note: The preview option only works after the source table data has been moved to destination database.

In the Transform section, users have the capability to incorporate multiple tables into their projects. They are also able to rearrange the sequence in which the transform tables are executed, as well as reuse these tables for future analyses.

When users desire to incorporate Primary keys into the transform tables, they should input the primary key values during the process of adding or editing the tables.

Important: After finishing the transformation, users should click the Save button. To execute the project, navigate to the Load tab, save the project again, and then select the Run Now option on the schedule page. The tables will be transferred to the destination database during this process.