Job Description
A Bachelor’s or Higher Degree is the minimum entry required for the position

  • Skill Set: WINDOWS AZURE PAAS
  • Total Experience: 5.00 to 8.00 Years
  • No of Openings: 1
  • Job Post Date: 26/04/2021
  • Job Expiry Date: 04/06/2021
  • Domain: IT
  • Location: CHENNAI [India]
  • Job Reference No:

Job Summary

Job Description 

Azure Data Engineer




Apr 2021
























Prepared by,
Anencia Nancy






1. JOB DESCRIPTION: AZURE DATA ENGINEER EXPERT

Required skills:


¿ Strong Experience in design and development in Azure Datalake solutions
¿ Strong experience in SQL analytic queries
¿ Strong experience in designing data distributions strategy
¿ Design a partition strategy for efficient analytical workloads
¿ Designing incremental data load
¿ Designing metastores in Azure SQL/Synapse and Azure Databricks
¿ Strong experience in Data transformations using Apache Spark, T SQL, Data factory, Encode and decode data, Data Exploratory analysis
¿ Strong experience in batch loads using Data Factory, Data lake, Spark, Function Apps
¿ Strong experience in Python, Java
¿ Strong experience in Data streaming components like Azure Event hubs, Kafka etc.
¿ Strong experience in developing application in Azure Databricks


Tools:

Azure Data Factory
Azure Databricks
Azure Storage Accounts
Azure Function Apps
Azure SQL and Azure Synapse
Azure Event Hubs, Stream Analytics and Kafka
Java or Python
Apache Spark and Spark Streaming


Roles & Responsibilities:

¿ Design and develop data pipelines using Azure Data Factory to various components like Azure SQL/Synapse or storage accounts.
¿ Design and develop full load and incremental loads using ADF to Azure SQL/Synapse
¿ Develop real time data processing applications using Azure Event Hubs, Kafka and Azure Stream analytics
¿ Connect to different source systems and collect the data in scheduled time and process them using different components like Azure Data bricks, Function Apps etc., and distribute it to the downstream applications or downstream locations like Azure SQL/Synapse, Amazon S3/RedShift etc.
¿ Data cleansing and pruning with python libraries like Pandas, Numpy etc.
¿ Develop cost effective, serverless applications using Azure Function apps (Java, Python or any supported language) to process and transform data



Level of experience: Overall experience 5 to 8 years with minimum of 3 years in required skills.


Project language: Business communication skills in English language

Location: India

Other info:

¿ Starting Date: May 2021
¿ Team player attitude would be required.

Recommend to Friend