Robust Import Set Transformers

1. Overview on Robust Transform Map

Robust transform map we can use if we want to extract, transform, and load data to one or more target tables.

The Robust Transform Engine (RTE) and the robust import set transformer separate the transform and processing functions, providing a more flexible alternative to transform maps. The robust import set transformer allows you to extract data from a source table into an intermediary data structure. You can transform the data as desired and then load that data to one or more target tables. Records are processed as batches to enhance performance.

Why we should use Robust import set transformers over transform maps

 Robust Transform Engine vs Transform Maps

3. Understand Robust import set transformers

Using robust import set transformers we define how information is sent from the source table to target tables via a Robust Transform Engine (RTE).

Navigate to System Import Sets > Administration > Robust Import Set Transformers.

4. Understand Robust transform definitions

Specify your own Robust Transform Engine (RTE) to transfer data from a source table to a target table.

1. Navigate to System Import Sets > Administration > Robust Import Set Transformers
2. Select an existing robust import set transformer, or click New to create a new robust import set transformer.
3. At the Transformer Definition field, click the search icon.
4. On the Robust Transform Definitions window, click New.
5. On the Robust Transformer Definition pop-up, select ETL Definition.
6. Complete the form.

 

5. Extract Transform Load (ETL)

ETL definitions is used to extract data from a source table, transform the data as desired, and load the data into a target table. ETL definitions also support nested data structures.

Navigate to System Import Sets > Administration > ETL Definitions.

5.a) ETL entities

1. Navigate to System Import Sets > Administration > ETL Definitions.
2. Select an ETL definition.
3. On the ETL Entities tab, click New.
4. Complete the form.

5.b) ETL entity mappings

Map the source entity to a target entity.

1. Navigate to System Import Sets > Administration > ETL Definitions.
2. Select an ETL definition.
3. On the RTE Entity Mappings tab, click New.
4. Complete the form.

5.c) ETL entity field definitions

Here we will define the entity fields mapped for Extract Transform Load (ETL) operations.

1. Navigate to System Import Sets > Administration > ETL Definitions.
2. Select an ETL definition.
3. On the ETL Entities tab, select an ETL entity.
4. On the ETL Entity fields tab, click New.
5. Complete the form.

5.d) Robust Transform Engine operations

Here we will define the operations the Robust Transform Engine (RTE) should perform.

We should always perform operations on only one entry. Select all source and target fields from the same entity.

 

1. Navigate to System Import Sets > Administration > ETL Definitions.
2. Select an ETL definition.
3. On the ETL Entities tab, select an ETL entity.
4. On the RTE Entity Operations tab, click New.
5. Select the kind of operation you want to create.
6. Complete the form.

 

 

6. Live Implementation

Scenarios: Bring sccm data into linux and windows server table.

 

Step 1: Create one data source (SNHD-SCCM-Get-Server) and populate all required fields.

Step 2: Create Robust Transformer (SNHD-SCCM-Server)

Step 3: Define ETL Definition (SNHD-SCCM-Server)

Step 4: Create 4 ETL entities

1. ImportSet (This is for loading data into source table)
2. stagingTable (This is for transferring data from import set table to temporary staging table.) Here we can perform ETL Operation if needed.
3. Linux table (Target table 1).
4. Window table (Target table 2)

 

Step 5: Create RTE entity mapping

1. ImportSetToStaging: select source as ImportSet and target as stagingTable. Give the lowest order to execute it first.

Also do RTE field mapping.

2. stagingToWindows: select source as stagingTable and target as Window. Give the high order compare to ImportSetToStaging

Also do RTE field mapping.

3. stagingToLinux: select source as stagingTable and target as Linux. Give the high order compare to ImportSetToStaging

Also do RTE field mapping.

 

Step 6: You are all set to go. Open data source and click related link load all record and run the robust transform map.

Validate the record inserted/update into target table.