Senior Data Engineer

We are currently recruiting a Senior Data Engineer to join our team! This individual will be charged with building and managing pipelines on the Azure Databricks Platform.

Role and Responsibilities

• Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting

• If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders

• Excellent grasp of and expertise with test-driven development and continuous integration processes

• Analysis and Design – Converts high-level design to low-level design and implements it

• Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans

• Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle

• Benchmark application code proactively to prevent performance and scalability concerns

• Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management

• Support and Troubleshooting – Assist the Operations Team with any environmental issues that arise during application deployment in the Development, QA, Staging, and Production environments

• Assist other teams in resolving issues that may develop as a result of applications or the integration of multiple components

Azure Developer Requirements & Skills

• Understanding of design concepts and architectural basics

• Knowledge of performance engineering

• Understanding of quality processes and estimate methods

• Fundamental grasp of the project domain

• The ability to transform functional and nonfunctional needs into system requirements.

• The ability to develop and code complicated applications is required.

• The ability to create test cases and scenarios based on specifications.

• Solid knowledge of SDLC and agile techniques

• Knowledge of current technology and trends

• Logical thinking and problem-solving abilities, as well as the capacity to collaborate

• Primary skills: Cloud Platform->Azure Developer->Microsoft Azure/PAAS

• Sought: SQL, Python

• General Knowledge: PowerApps, Java

• Bachelor of Science in Computer Science, Engineering, or related technical field

• 6-9 years of experience in software development with minimum 2 years of cloud computing