Big Data Engineer

They are looking for an engineer to help us with our big data development using Spark and Hadoop. This position comprises development, consulting and architectural tasks on both the networking/infrastructure and with their data analytics.

• 5+ years’ experience with full development life-cycle experience from inception through implementation.
• 5+ years’ experience with Scala or Java, preferably both. 
• Experience with Hadoop ecosystem technology stacks as HDFS, HBase, Hive, Pig, Spark, MapReduce, Cloudera.
• Experience with development, deployment, and support of large-scale distributed applications in a mission-critical production environment  

• Strong and demonstrable experience with Apache Spark
• Installation, configuration, documentation and administration of Hadoop
• Understanding of Scala, including experience with development and debugging
• Experience with the development of Big Data systems
• Experience working in an agile environment
• Experience of Continuous Integration and Continuous Deployment
• Experience with cloud-native architecture development and deployments
• Experience working with big data ETL tools
• Experience in working with large data sets with real time streaming applications
• The ability to continuously improve the performance of the application and data structures