Big Data Engineer

Location: Surrey Salary: Market related
Type: Permanent Start Date: 28/04/2018
Posted: 20 days ago Contact: Matthew Fulbrook
Big Data Engineer
My client, who specialise in collecting and assessing driving data for behavior analysis, crash detection, recovery and fleet management are expanding their organisation and are looking for a Big Data Engineer to join their skilled development team based in Surrey.

They are looking for an engineer to help us with our big data development using Spark and Hadoop. This position comprises development, consulting and architectural tasks on both the networking/infrastructure and with their data analytics.

Successful candidates will be passionate about Devops and able to work in an agile environment, contribute to new projects, improve processes and practices from conception to implementation and deployment.
  • 5+ years’ experience with full development life-cycle experience from inception through implementation.
  • 5+ years’ experience with Scala or Java, preferably both. 
  • Experience with Hadoop ecosystem technology stacks as HDFS, HBase, Hive, Pig, Spark, MapReduce, Cloudera.
  • Experience with development, deployment, and support of large-scale distributed applications in a mission-critical production environment  

  • Strong and demonstrable experience with Apache Spark
  • Installation, configuration, documentation and administration of Hadoop
  • Understanding of Scala, including experience with development and debugging
  • Experience with the development of Big Data systems
  • Experience working in an agile environment
  • Experience of Continuous Integration and Continuous Deployment
  • Experience with cloud-native architecture development and deployments
  • Experience working with big data ETL tools
  • Experience in working with large data sets with real time streaming applications
  • The ability to continuously improve the performance of the application and data structures

To apply, send an updated CV to