Synchronizing a Synapse table from an on-premise Oracle table
Hi, I've a Synapse table on a dedicated SQL pool and I need to update it reading from an Oracle table. I've already implemented a Self-hosted IR and I've already read from the Oracle table rightly with the Oracle connector. The requirement from my…
I am encountering an error when trying to debug a data flow in Azure Data Factory that connects to an Azure SQL Database. My linked service and dataset connections to the Azure SQL Database are working fine, and I can preview data without any issues.
I am encountering an error when trying to debug a data flow in Azure Data Factory that connects to an Azure SQL Database. My linked service and dataset connections to the Azure SQL Database are working fine, and I can preview data without any issues.…
How to run a purge command in ADX using ADF?
I tried running the purge command but it keeps returning syntax error. Even a simple command like: .purge table MyTable in database DBName allrecords Gives this error: BadRequest_SyntaxError: Request is invalid and cannot be executed The command is…
File movement from sharepoint Nested Subfolders using Microsoft Graph API to blob using ADF
I am trying to copy files from sharepoint to Azure Blob Storage using Microsoft Graph API in ADF. I am able to do it when the sharepoint folder structure is flat. I am facing issue when the sharepoint has nested subfolders. Is there a way to get…
Copy activities from two difference self hosted integration runtime
Good afternoon. I have a task to prepare a pipeline for a copy activity from an Oracle database as the source to MS SQL as the sink. The Oracle database uses a different self-hosted integration runtime. After creating the copy activity, I received this…
Dynamic Content Option for Password Field in SFTP Connector in Azure Synapse Analytics
I am working on a feature in Azure Synapse Analytics that connects to different SFTP servers dynamically based on a meta-data table. As I proceeded through it, I found out that in SFTP Linked Service, the PASSWORD field does not allow dynamic content.…
Unable to create ADF Linked Service to Azure SQL database using Self-Hosted Integrated Runtime
Hi all, I am having trouble creating a Linked Service that connects to one of our Azure SQL databases. After entering all required Linked Service fields and testing the connection using our self-hosted integration runtime, I received the following error…
Mapping individual array values to new values based on a lookup table
In Azure Data Factory, how can I perform a lookup on each item in a string array or line of delimited text to map each item to a new value? I have a set of codes in one column. I would like to map these codes to their descriptions and have the…
Error de Conexión REST: TrustFailure y Certificado Inválido en Azure Data Factory
Description: Hello everyone, I'm facing an issue while trying to connect a REST service in Azure Data Factory. The configuration is as follows: Base URL: https://yam.3psi.com.pe/wsextdatsee/api/operacioncliente?datpet=20383929050_1_Lgo2023$1 …
Mongo DB and Mongo DB Atlas connectors in ADF compatibility
Hello, Is it true that both connectors - the Mongo DB and the Mongo DB Atlas connector are incompatible with higher than 4.2 versions of Mongo DB? Or is it only the first one and the second is may be compatible with higher versions? If they both are…
Issue with Salesforcev2Connector
Hi team, I have a question regarding this article. First I have created a Linked Service, DataSet and copy activity in the pipeline which copy from SalesForce to Azure SQL database through…
What enhancements and fixes being done on V2 snowflake connector for ADF?
Hi Microsoft Support team, I would like to know when the following features will be available for the new snowflake connector as our code will have a huge impact if these are not enabled. Multi statement execution in the script activity. Script…
ADF dynamic expression builder to keep trailing zeros on
I working with an API which accepts datetime in a particular format like yyyy-MM-ddThh:mm:ss.fffZ for example 2021-02-30T15:30:30.070Z when I write this back to cosmosDB to store this date for incremental load for next run, the training zero is not…
Get jsonlines response from Rest API and load into SQL DB using ADF pipeline
Hi Guys, Requirement is to call Rest APIs which will response data in jsonlines format (not Json array) and load data into table. Tried with Web activity and Set Variable to capture the response but not getting the response in expected format. Can you…
Datafactory insertion leads PluginNotRegisteredException,Message=Invalid type 'SalesforceV2' is provided in 'linkedServices
Getting Plug in error while inserting data (Dataset from Cloud Salesforce ) to SQL database (Onprimissive). Unfortunately it leads the…
ErrorCode=ODataFailedClientCreation
we would like transfer data about odata to sql. Our linked service is working. Only the ADF pipeline doesn't work with folling error... …
ADF copy activity - How to preserve hierarchy?
Hi, I tried to config a copy activity on ADF so I can get the right folder hierarchy in the sink. Source is on an FTP server with following path: folder1/folder2/variable(path)/ folder1/folder2: names are fixed and not required in the sink. …
Creating ADF linked service to connect to a storage account on private endpoint using service principal
HI, Currently my storage account is open and allows public access. I disabled public network access to storage and followed this article for creating a secured SFTP connection through a firewall -…
ADF web activity payload is to big
We are using ADF now, there is a step need send Post to Remote Sever, but this payload is too big, far more than 896KB, it's already 15MB, so we try to store the request payload to blob and then use the Copy Activity, but we facing another issue is Copy…
Dynamic mapping adf copy activity
Hi I am trying to do a dynamic mapping between file to SQL Table in ADF Copy activity. In the mapping section, I am adding the following dynamic content , for just one column for testing purpose. But it gives error "Expression of type: 'String'…