DATA ENGINEER at Reverside – IT-Online

0

DATA ENGINEER Role in JHB

We are looking forDATA ENGINEERprofessionals with 5+ yesrs strong development experience in DATA ENGINEERING and has a solid SDLC knowledge base.

About the employer:

Role tasks:Applies advanced domain knowledge:

Project / process management
Ability to evolve in a specific programming language sought
Strong working knowledge of software development tools, techniques and approaches used to create application solutions
Working knowledge of software development tools, techniques and approaches used to create application solutions
Cloud Computing Technologies, Business Drivers and Emerging IT TrendsGeneric technical/functional skillsUnderstanding of integration between different technologies Assistance with business case Coordination between development and support environments Planning and tracking Requirements elicitation Requirements organization Requirements translation and simplification Requirements management and communication Requirements analysis Document requirements in an appropriate format according to the methodology followed Assist in the identification and management of risksSpecific Technical / Functional Skills Expertise in ETL optimization, design, coding and tuning of Big Data processes using Apache Spark. Experience building data pipelines and applications to stream and process low latency datasets. Demonstrate efficiency in data processing – following data lineage, ensuring data quality and improving data discovery. Good knowledge of distributed systems and data architecture (lambda) – design and implement batch and streaming data processing pipelines, know how to optimize distribution, partitioning of high-level data structures. Experience designing and supporting large-scale distributed systems in a production environmentBeneficial: Certification: AWS Certified Developer Associate/Solutions Architect Bitbucket/Git Jira/Confluence Familiar with data streaming services such as Apache Kafka, Amazon Kinesis, or similar CI/CD Tool (Nexus/Jenkins).General skills : Ability and willingness to mentor and train colleagues and users as needed

Find out more/Apply to this position

Share.

Comments are closed.