Informatica EDC profiling 10.4.1 Error - Could not create id creator for schema dbo and table due to missing row count result summary

Scenario: We want to integrate Azure SQL with Informatica EDC 10.4.1 and run profiling. 

Error: Integration and connection test was successful from the Informatica Catalog Admin. but, when we run the resource, it fails.

Steps to Resolve:

Informatica Cloud - Copy Files from source to target

Today we will learn on how to copy files using Informatica cloud from source to target server using File processor connector

Steps:

1. Create an Informatica File processor connection to define source and target destination

       1. Source file directory: enter source file path (e.g.: \\Source_Server_name\directory1)

       2. Target file directory: enter target file path (e.g.: \\target_Server_name\target_dir\current)

       3. Select file: All (for selecting all the files)

Informatica Cloud - Ingest Data from Rest Api into Azure SQL

Today we will learn on how to fetch data from Rest Api and ingest into Azure SQL using Informatica Cloud data integration

Steps to Ingest data from REST API to Azure SQL DB via Informatica:

1.    Create a test SQL Server Database in Azure

·        Setup a new server for the database

·        For testing, use “Public endpoint” while setting up Azure server for database (this has to be properly setup when using for production)

·        Add your current computer’s IP address in the Azure server firewall

·        Add Informatica server’s IP address in the Azure server firewall

o   If you don’t add informatica server’s IP, Informatica will throw error “client with IP *** is not allowed to access the server”

·        Click Create the server.

·        Once the server is created, click OK to create the database

Informatica Cloud - Copy data from SQL to Azure ADLS

Today we will learn on how to load data from SQL database to Azure ADLS as file

1. Purchase and enable Microsoft Azure data lake (ADLS) Gen 2 connector for Informatica 
2.  Register your informatica app with Azure AD
1. This app will act as a service principal 
2. Note down the client secret and client ID
3. Give appropriate permissions to Informatica app (in Azure)
• Storage blob data contributor
• Internet access to Informatica to talk to Azure ADLS
3. Create an Informatica connection to Azure ADLS Gen 2
1. Enter the following information:
• Client ID
• Client Secret
• Tenant ID
• Account Name (Azure Storage account name)
• File System Name (Container name within a storage account)
• Directory Path: /   (leave as default)

Informatica Cloud - Incremental Load (Data Ingestion)

Today we will learn how to create incremental data load (ingestion) in Informatica cloud data integration

1. Create two SQL server connections in Informatica cloud administration
1. Connection for source database
2. Connection for target database
2. Create a mapping from Informatica data integration
1. Add source
1. Select source connection (point to the newly created source connection in the Informatica administration)
2. Select source type as query
3. In the query window, enter the query to get the maximum timestamp from your target table
4. The timestamp should come from the target database table here. This max timestamp will act as a filter to fetch latest records from the source