Informatica Cloud - Copy data from SQL to Azure ADLS

Today we will learn on how to load data from SQL database to Azure ADLS as file

1. Purchase and enable Microsoft Azure data lake (ADLS) Gen 2 connector for Informatica 
2.  Register your informatica app with Azure AD
1. This app will act as a service principal 
2. Note down the client secret and client ID
3. Give appropriate permissions to Informatica app (in Azure)
• Storage blob data contributor
• Internet access to Informatica to talk to Azure ADLS
3. Create an Informatica connection to Azure ADLS Gen 2
1. Enter the following information:
• Client ID
• Client Secret
• Tenant ID
• Account Name (Azure Storage account name)
• File System Name (Container name within a storage account)
• Directory Path: /   (leave as default)

Informatica Cloud - Incremental Load (Data Ingestion)

Today we will learn how to create incremental data load (ingestion) in Informatica cloud data integration

1. Create two SQL server connections in Informatica cloud administration
1. Connection for source database
2. Connection for target database
2. Create a mapping from Informatica data integration
1. Add source
1. Select source connection (point to the newly created source connection in the Informatica administration)
2. Select source type as query
3. In the query window, enter the query to get the maximum timestamp from your target table
4. The timestamp should come from the target database table here. This max timestamp will act as a filter to fetch latest records from the source