Senior Azure Data Engineer

Job Purpose:

To ensure smooth promotion, operation, and reliability of data and technology pipelines across environments. This role is responsible for maintaining strong alerting and monitoring systems and ensuring all workflows run consistently with no disruptions or surprises.

Key Accountabilities:

• Monitor and manage Databricks workspaces across Dev, QA, and Prod environments.

• Troubleshoot job failures, cluster performance issues, and workspace-level errors.

• Understand design concepts and architectural fundamentals.

• Follow and support CI/CD processes for deployments and automation.

• Translate functional and non-functional requirements into actionable system specifications.

• Develop and maintain complex scripts/applications as needed for platform operations.

• Create test cases, scenarios, and validation steps based on specifications.

• Apply solid knowledge of SDLC and Agile methodologies.

• Stay current with the latest technologies, tools, and industry trends.

• Apply strong logical thinking, analytical reasoning, and problem‑solving skills.

• Collaborate effectively with cross-functional and distributed teams.

• Maintain general working knowledge of Azure DevOps and related operational processes.

• Execute quality processes, estimation methods, and documentation activities.

• Maintain fundamental understanding of the project domain and data lifecycle.
  

Skills:

• Knowledge of CI/CD process

• Primary skills: Cloud Platform, Azure, Databricks, ADF, ADO

• Sought: SQL, Python, PowerBI

• Logical thinking and problem-solving abilities, as well as the capacity to collaborate.
  

Knowledge and Experience:

• Strong understanding of system design principles and architectural basics.

• Experience working with CI/CD processes and DevOps workflows.

• Ability to convert functional and non-functional requirements into technical solutions.

• Experience developing or modifying moderately complex applications or automation scripts.

• Ability to design test cases and scenarios from specifications.

• In‑depth understanding of SDLC and Agile practices.

• Awareness of the latest cloud and data engineering technologies.

• General working knowledge of Azure DevOps.

• 3+ years of hands‑on software development or platform engineering experience, ideally with exposure to cloud computing and data engineering tools.
  

Education:

• Bachelor's Degree in technical discipline (Math’s, Science, Engineering, Computing, etc.).