Senior Data Engineer with AWS Negotiable

The services of a Senior Data Engineer are needed for one of our prestigious clients. Suitable candidates are invited to apply. Applies advanced knowledge of area • Managing projects / processes • Ability to develop within a specific sought-after programming language • Strong working knowledge with software development tools, techniques and approaches used to build application solutions • Working knowledge with software development tools, techniques and approaches used to build application solutions • Cloud computing technologies, Business drivers and emerging computing trends At least 10-12 years Cloud architecture and reporting technology experience • Extensive experience in implementing and monitoring solutions • Experience in testing (manual or automated testing) • Web and digital project experience advantageous • Agile working experience advantageous Relevant IT / Business Degree *Functional Skills:* Understanding of integration between different technologies • Coordination between development and support environments • Assisting with the business case • Planning and monitoring • Eliciting requirements • Requirements organisation • Translating and simplifying requirements • Requirements management and communication • Requirements analysis • Document requirements in appropriate format depending on methodology followed • Assist with identification and management of risks Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark. • Experience with building data pipelines and applications to stream and process datasets at low latencies. • Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data. • Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning of high-level data structures. • Experience designing and supporting large-scale distributed systems in a production environment AWS Solid understanding of Components - VPC | IAM. Above average experience/understanding of AWS Components: • Lambda • DynamoDB • Param Store • Secrets Manager • Athena • Glue • CloudWatch • Step Function • SNS • Code Build/Pipeline • CloudFormation • S3 Strong experience/understanding of: • Python 3x • SQL • Py Spark • Boto3 • Terraform • ETL • Docker • Linux / Unix • Big Data • Oracle/PostgreSQL • Powershell / Bash • Experience working in Agile SDLC methodology. At least 10-12 years Cloud architecture and reporting technology experience • Extensive experience in implementing and monitoring solutions • Experience in testing (manual or automated testing) • Web and digital project experience advantageous • Agile working experience advantageous Relevant IT / Business Degree *Functional Skills:* Understanding of integration be