Azure Data Factory can't access HDInsight cluster in IP restricted VNet

Question

I have a HDInsight Hadoop cluster (Linux, deployed separately) on Azure VNet (restricting client IPs using NSG). Azure SQL firewall has an option called "Allow access to Azure services", which allows Data Factory to access Azure SQL. In VNet there is no such option, you have to either specify IP addresses range or set a tag (Internet, Virtual Network, AzureLoadBalancer). I thought AzureLoadBalancer will solve the issue, but no - HDInsight is still hidden from Azure Data Factory. I tried to find Data Factory port ranges, unsuccessfully. Is there a way to access secured HDInsight Linux cluster from Azure Data Factory? Select the correct answer from above options

Answer 1

Azure Data Factory can access resources that can be accessed publicly. If your HDInsight cluster is in a VNet then it cannot be accessed publicly. So Azure Data Factory cannot access and orchestrate it. Azure Data Factory is not supported in a VNet environment but that would take some time to land.