Scam Alert : To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers Learn More..

Job Description

  • Skill Set : azure databricks
  • Total Experience : 4.00 to 8.00 Years
  • No of Openings : 1
  • Job Post Date : 11/05/2026
  • Job Expiry Date : 30/06/2026
  • Domain : IT
  • Location : HYDERABAD [India]
  • Job Reference No : 4069908
Recommend to friend

Job Summary

Job Title: Software Development Engineer

Location: TechM Hyd HIC SEZ U1T2(4 5F)

Years of Experience: 5 7 Years

Job Summary:

We are seeking a skilled Software Development Engineer with a strong background in data engineering and analytics to join our dynamic team. The ideal candidate will have extensive experience with Azure Databricks and a solid understanding of data migration, data processing frameworks, and cloud technologies. You will be responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring data integrity across various platforms.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark on the Databricks platform.
  • Implement Delta Lake solutions to enhance data reliability and performance.
  • Utilize Python, focusing on Pandas and Polars frameworks, for data manipulation and analysis.
  • Write and optimize SQL queries for data extraction and transformation in Databricks.
  • Lead the migration of data from Redshift to Databricks, ensuring minimal downtime and data loss.
  • Develop and integrate REST APIs for data access and manipulation.
  • Manage Azure Data Factory and Storage Accounts for efficient data orchestration and storage.
  • Utilize DBT framework for data transformation and modeling.
  • Implement MLFlow and Feature Store for machine learning model management.
  • Use Terraform for infrastructure as code to manage cloud resources.
  • Collaborate with cross functional teams to gather requirements and deliver data solutions.
  • Maintain documentation of data processes, workflows, and architecture.

Mandatory Skills:

  • Proven experience with Azure Databricks (version >3.0).
  • Strong proficiency in PySpark and Delta Lake.
  • Solid understanding of Python, particularly with Pandas and Polars frameworks.
  • Experience with SQL in Databricks environment.
  • Hands on experience in migrating data from Redshift to Databricks.
  • Familiarity with REST API development and integration.
  • Experience managing Azure Data Factory and Storage Accounts.

Preferred Skills:

  • Experience with DBT framework for data transformation.
  • Knowledge of MLFlow and Feature Store for machine learning.
  • Familiarity with Terraform for infrastructure management.
  • Basic understanding of Azure DevOps for CI/CD processes.
  • Experience with Azure SQL Server, Event Hub, and Data Migration Services (DMS).

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 5 7 years of relevant experience in software development and data engineering.
  • Strong analytical and problem solving skills.
  • Excellent communication and teamwork abilities.

If you are passionate about data engineering and have the required skills, we encourage you to apply and join our innovative team!

Recommend to Friend