Data Engineer

We are looking for a Senior Data Analytics Engineer who can take ownership of tasks, deliver stable, incremental changes frequently, and ensure thorough testing to maintain high-quality standards.

This role tackles a range of complex software and data challenges, including data management, advanced analytics, and business intelligence. It is pivotal in implementing, maintaining, and supporting data pipelines using shared data platforms that exploit modern data technologies and software development practices

Tasks & Responsibilities:

• Participate and contribute to overall data architecture and design.

• Ensure effective design and development of system architectures through frequent product deliveries, employing effective governance methods for transparency and communication.

• Translate functional and technical requirements into detailed design.

• Develop required code for end-to-end data pipelines with optimal extraction, transformation, and loading of data from a wide variety of data sources. Incorporate business rules and functional capabilities, security, data retention requirements, etc.

• Work with stakeholders including business area sponsors, product owners, data architects, data engineers, project managers, and business analysts to assist them with their data-related technical issues and support their data needs.

• Remain up to date with industry standards and technological advancements that will improve the quality of your output.

• Interact with the business to identify, capture, and analyse business requirements.

• Assist and support proof of concepts as data technology evolves.

Must-Haves:

• Minimum of 7 years of work experience in modern data technologies as a Data Analytics Engineer or similar role.

• Experience in building data ingestion pipelines for data lake and data warehouse architecture. As well as strong experience in data modelling, design patterns, and building highly scalable applications.

• Hands-on development using open-source data technologies such as Hadoop, Hive, Spark, HBase, Kafka, Impala, ELK, etc., preferably with Cloudera.

• Experience working with relational databases such as Oracle, SQL Server, etc.

• Strong experience with Python