Share this Job

Big Data Engineer

Date: Apr 6, 2021

Location: London, United Kingdom

Company: KPMG UK

The Team





The Data Engineer will be responsible for consulting with our internal stakeholders and customers to provide deep technical expertise with regards our FS analytics and data engineering capabilities and products. The individual is expected to go through a training and accreditation process on one of our key Data Engineering platforms. Additional job responsibilities include the ability to architect solutions, install, connect, and use our solutions and platforms. The individual will interface directly with clients and collaborate with other Data Engineers.






The Role




Implement scalable and reliable data engineering solutions for moving data efficiently across systems at near real-time and batch




Build a data store that will be central source of truth




Implement tools that helps our data consumers to extract, analyse, and visualize data faster




Build data expertise and own data quality for the pipelines you build




Use your expert coding skills across languages – Scala, Spark-SQL, Elastic Search query




Evaluate new technologies and build prototypes for continuous improvements in Data Engineering




Partner with DevOps teams to ensure instrumentation, logging, and monitoring is in place




Occasionally support pre-sales proof of concepts involving data science and data engineering solutions.




Provide consultative support to the our extended analytics organization




Evangelize the value of Data Engineering platform.





The Person




Java programming experience- JDK 1.8 and above.




Functional programming experience using Scala and/or experience using front end frameworks, ideally Angular JS.




Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc.




Big Data experience - Spark, Hadoop, Spark SQL, preferably Elastic Search.




Dev Ops - Gradle experience.




Object oriented programming experience and ability to convert low level designs to implementation.




Preferably worked on a microservice API based implementation.




Jira and GitHub.




Experience working within an Agile environment using Scrum, as part of a large development programme.




Experience managing development teams.




Have the ability to work in a matrix environment with cross functional teams of Business Analysts and demonstrating an excellent understanding of business requirements.




Have excellent knowledge and understanding of Big Data technologies – Scala, Spark, Hadoop, Elastic Search




Ability to work in a fast paced challenging environment and solve complex big data problems.





Job Segment: Database, Oracle, Consulting, Developer, SQL, Technology