Job Description

5.00 to 10.00 Years
Year of Exp. & Pre-Requisites Primary & Secondary Skills ¿ Minimum of 6 to 8 year of overall IT experience ¿ Working knowledge of Data Warehousing concepts and design (incl. ETL, data modelling ) ¿ Good communication and interpersonal skills You will be expected to know below Azure Components (DataBricks, ADF V2, ADLS, SQL DB & SQL DWH) to a proficient level o Databricks (Spark SQL, Python/SCALA, Spark - Setting up Databricks Cluster and automation of on demand clusters, Scaling Databricks workflows, Integration of ADF data pipelines with ADB o Azure Data Factory V2 - datasets & linked services, pipeline development, execution & triggers and integration runtimes. o Azure Storage Services (Blob & ADLS Gen1/Gen2) - creation use of azure storage, access policies and associated keys, encryption techniques for sharing etc. o SQLDW and SQL DB - Write, modify, tune and debug queries, stored procedures, views, indexes, user-defined functions, and other database entities. Creation of external tables using polybase. o Azure Key Vault, Service Principle, Power Shell etc. You will be expected to perform below activities o Design, implement, and maintain data solutions from data collection and curation. o Model and develop databases and data structures to satisfy business processes and technical requirements. o Identify complex data patterns and inconsistencies through data analysis o Design and Implementation of security principles and access management through AD group roles In addition to the above, knowledge and skills are preferable in ADLA (U-SQL, C#). o Design, develop and implement U-SQL based activities/jobs using Azure Data Lake Analytics o Knowledge of Performance tuning to define azure code artefacts for optimal performance o Experience with Azure DevOps and GitHub.