Skip to main content
All CollectionsTx
Working with Tx Projects
Working with Tx Projects

Overview and first steps to working with Tx projects

S
Written by Serge Gershkovich
Updated over a year ago

Tx Projects are currently available for the following:

  • Plan: Tx is a standalone product license that includes all the features of existing SqlDBM plans and data automation and transformation features

  • Databases:

    • Snowflake

    • other CDPs will be included in the future

How to get started with Tx

Tx is a new type of project that allows data transformation and automation. To begin, create a new Tx Project.

Starting a new Tx project and creating your first transformation

In this article, we will cover the basic steps required to set up a Tx project and create your first transformation. These include:

  1. Saving the project

  2. Setting up a User Connection

  3. Defining and mapping locations

  4. Adding sources

  5. Reviewing Tx Templates

  6. Creating a transformation by applying a Tx Template to a Source

Setting Up a User Connection

Currently, Tx is only available for Snowflake, so please ensure you have a User Connection with Snowflake connectivity and a git repository (all git flavors are supported).

After the project is saved, a prompt to set up a connection will appear. Select an existing User Connection from the list of available connections or create a new one.

  • The first time the project user connection is configured, the user is asked to choose an existing branch to load the project.

  • User connections are individually configured, but the Git repository is saved at the project level.

  • All users working on a project will use the same repository.

Start transforming data

The following is a summary of the steps required to create a sample data transformation.

  1. Add Sources: Data is obtained from sources for transformations. To learn how to add sources, see the related article.

  2. Review Tx Templates: in the following step, we will create a Tx Object from a Source using a Tx Template. Please review the existing Tx Templates available by default in all new projects or create your own by copying and modifying an existing one. See the related article on Tx Templates.

  3. Create a Tx Object from a Source: select a Source and from the context menu or by right-click, create a Tx Object by selecting a Tx Template.

  4. Create Tx Objects: The Tx object is created based on the data structure from the source and the columns defined in the template. This consists of:

    • A Column grid.

    • The logic block defines how data for this node is created or loaded. See the related article on Tx Objects.

Working with Tx Objects

Understanding Dependencies

In Tx, dependencies between objects are shown in the "Main Flow" as a Direct Acyclic Graph (DAG. A dependency between Tx objects and related sources is shown as a line linking the elements. This differs from a constraint in that it only indicates that the Tx Object depends on the related source through the logic expressed in its SELECT statement.

Data Preview

  • Tx Sources: Data Preview provides a brief sample of records sourced directly from the database, offering valuable context about the entities.

  • Tx Objects: The "Select data" button allows for a data preview of the SELECT statement in the logic definition. See the related article on Data Preview and Tx Objects.

Integration with Relational Diagram (ERD)

Both Tx Sources and Tx Objects can be added to the Relational Diagram (ERD), allowing relational modeling to be in sync with the transformational, visualizing all elements in the diagram.

Editing and Viewing Elements in ERD Diagram

  • Sources: These are existing elements in the database that do not have transformations. Therefore, they can be edited in the same way as relational elements.

  • Tx Objects: These objects have transformations, so they can only be viewed as a grid structure. Manipulation of Tx Objects must be done from within Tx.

  • Virtual Relationships: Only virtual relationships can be included with these elements.
    โ€‹

On relational diagrams, transformational dependency lines (purple color and directional arrow) can be seen alongside FK and virtual relationship lines (IDEF1X or Crow's Foot standard).


See also:

Did this answer your question?