Mid-Level Data Engineering Consultant

OpenCredo (OC) is a UK based software development consultancy helping clients achieve more by leveraging modern technology and delivery approaches. We are a community of passionate technologists who thrive on delivering pragmatic solutions for our clients' most complex challenges. Curious, tenacious but always sensitive to our clients' context, we are not afraid to speak our minds to help steer our clients towards understanding and achieving their key goals. We are looking for a hands-on mid level data engineer with experience in dealing with various data centric problems and challenges. You will have worked with modern data technologies including RDBMS as well as solid exposure to at least one other NoSQL solution. You understand the benefits of event streaming, the cases for ETL and batch processing, and enjoy building reliable data pipelines which really help advance businesses forward.

We’ll give you…

• A highly competitive basic salary
• 5% matched contributory pension
• Private Health Insurance
• Life Insurance
• 25 days’ holiday plus public holidays (plus and extra day for each year of service)
• Childcare vouchers
• Cycle to work scheme
• A high spec laptop (of course!)

Need more reasons? Heres a few more...

• Work with some of the most exciting new technologies
• Spark off co-workers who’ll challenge your thinking and help you to achieve your potential
• Deal openly and honestly with customers
• Benefit from a transparent environment including regular company meetings where we discuss anything and everything
• Have exceptional opportunities as a speaker, blogger and contributor to open source projects. We have some great connections in the wider technology community that we encourage our team to make the most of!
• Work alongside senior leaders who understand and value passionate technologists;
• Enjoy coming to work! We’re a friendly, sociable bunch who genuinely support each other and have a lot of fun

What we’re looking for:

• Data Specialist: You will be comfortable articulating and explaining broad key data concepts as well as diving into the details and the nitty-gritty of your chosen specialist area. You are confident in, and actively seek to grow in your ability as a technical Data Expert.
• Data Pipelines & LifeCycle: You are comfortable building and delivering data pipelines and have a solid appreciation for how all phases of the data lifecycle fit together - from ingestion, to cleansing, transforming and analysing.
• A Problem Solver with a Can Do Attitude: You can be relied on as the person who gets stuck in and makes things happen.
• Distributed Systems Experience: You have developed and worked with Big data architectures. You have run into, and enjoy working through complex data platforms and storage solutions challenges.
• A Skilled Technologist: You have a background in programming and creating data-centric solutions using code. You are an accomplished programmer in one or maybe more programming languages.
• Innovation & Continuous Learning: You enjoy and actively seek to learn about new technologies and techniques in the Data and AI/ML space.

Experience with as many of these as possible:

• Real-time Streaming: Developing real-time data streaming solutions leveraging modern technologies and industry practises using technologies such as: Apache Kafka, Flink, Pulsar, Spark, Beam
• Cloud Vendor Solutions: Development of data pipelines or solutions within one or more cloud providers (AWS, GCP, Azure) utilising a mixture of open source as well as vendor-specific data offerings.
• Event Driven Solutions: Development and implementation of event driven systems - including utilisation of techniques such as event sourcing, CQRS, domain driven design
• Data Modelling & Data Engineering: A solid understanding of key data modelling techniques and approaches, experience with data engineering tools and platforms such as Kafka, Spark, various RDBMS databases and Hadoop
• ML & AI: Integration of, and productionisation of (MLOps) ML Models
• Graph Technologies: Understanding of connected data problems and challenges and the technologies used to manage this (eg graph databases like Neo4j)

Although aptitude and attitude are what makes a great OCer, and interviewing with OC is not a box-ticking exercise of technologies, as a rough guideline, we think you are likely to have the following on your CV:

• 2-4 yrs of data centric development experience
• Strong communication skills; ability to articulate your ideas and thoughts with others
• Demonstrable experience with modern data platforms, practises & approaches such as Streaming, Event Sourcing, Data Pipelines
• Expertise in at least one modern data technology or solution stack