Data Engineer

Role Title / Position: Data Engineer III
Type : Contract
Duration:12 months
Location: Bromley or Chester

Job Description:

Required qualifications :

• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
• Experience working on and delivering end to end projects independently
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience with data modeling, warehousing and building ETL pipelines
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
• Experience with SQL

Preferred qualifications

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
• Experience with Apache Spark / Elastic Map Reduce