Junior Data Engineer
Concirrus
This job is no longer accepting applications
See open jobs at Concirrus.See open jobs similar to "Junior Data Engineer" SpaceTalent.Concirrus
We are the leading data and analytics platform for specialty and commercial insurance globally.
Our mission is to revolutionise the insurance industry by simplifying and streamlining insurance operations with cutting-edge technology. We have been focused on the risk management and pricing parts of the market but we’re now expanding our focus.
D&I Statement
We aspire to build a diverse team and cultivate an inclusive environment where everyone is empowered to perform their best work. As we continue to learn and evolve, we are committed to:
- Providing a safe environment where all individuals feel accepted and valued.
- Continuing to educate ourselves and celebrate our differences.
- Ensuring that our behaviors align with our values and our dedication to DE&I.
- Regularly reviewing our performance and perpetually striving for improvement.
The Role
We are currently seeking a Junior Data Engineer to join our rapidly expanding London based team.
Developing products that solve real problems for our customers is at the heart of everything we do. And we’re on the hunt for an exceptional Data Engineer to help shape Quest, our dynamic data platform that’s changing the game in commercial insurance. Reporting to our Manager Data Engineer, you will enjoy working in a structured team environment. You will be inquisitive, and detail oriented, with strong experience building end-to-end ETL pipelines. You will enjoy working with large, messy datasets and transforming them into useable, structured, maintainable resources. On top of this, you will enjoy interrogating data to understand the best way to clean, merge, and derive maximum insight from the available data feeds.
You’re in your element getting hands on with messy data from multiple sources and transforming it into a useable resource. You’re motivated, inquisitive, and understand the potential of this data to the business. You enjoy a challenge and see the bigger picture of what is to be achieved.
This is an exciting and rewarding role requiring a smart, disciplined and experienced Data Engineer who is data savvy with a very good technical background in programming, the analysis of data and the design and creation of data pipelines.
Major Responsibilities
- Design and implement ETL processes and data pipelines for receiving, transforming and aggregating large amounts of data.
- Perform analysis across new and existing data sources to determine how best to process and combine, as well as what the functional results should be.
- Write code to transform and manipulate data to build data features.
- Maintain and schedule data pipelines and ETL processes.
- Implement unit and end-to-end testing to ensure that data is accurate and outputs reliable.
- Validate and monitor various aspects of Data Quality.
Key Attributes
Essential:
- Degree in Computer Science or similar engineering field.
- Strong Python & SQL Engineering skills.
- Experience processing big data using tools such as Apache Spark.
- Experience building ETL Data Pipelines.
- Experience with preferably GCP ecosystem for Data Engineering development.
- Experience working with scalable Data Pipelines and creating production grade code using a range of approaches and tools.
- Experience performing analysis and writing Python code to achieve an optimal result, while bearing in mind functional requirements, algorithm optimisation and maintainability.
- Good understanding of best practice software techniques, along with experience querying and processing real world data to derive insight and discuss results with the business.
- Strong problem-solving skills.
- Proven ability to effectively communicate results.
- Very good interpersonal skills and ability to work closely with other members of the Data Science and Data Engineering team.
Tools:
- Python and SQL, and preferably exposure to other languages.
- Apache Spark (preferably with PySpark), Polars, Airflow and understanding of productionizing Python pandas, numpy, scikit-learn.
- Goof grasp of Airflow implementation on Cloud environments.
- GCP Data Engineering tools such as BigQuery, DataProc, CloudRun, Pub/Sub
- Git version control.
- Command line, Linux and bash scripting.
Nice to have:
- Experience of software engineering practices such as OOP, SOLID, and TDD.
- Track record of working with cluster computing and distributed systems.
- Experience with command-line scripting, data structures and algorithms.
- Ability to work in a Linux environment, processing large amounts of data in a cloud environment.
- Relational database experience.
- Knowledge of system architecture best practices.
- Experience with Data mesh DB.
Benefits
As well as the opportunity to work in a fast-paced, dynamic environment, we like to look after our team members at Concirrus. Here are some of our perks…
- We pay competitively with regular pay reviews.
- Tax efficient Pension Scheme with 5% matched contribution.
- Private medical insurance from Vitality Healthcare.
- Life insurance AIG Life.
- Learning & Development fund for all employees.
- 25 days annual leave (plus public holidays).
- Modern offices close to Liverpool Street Station.
- Coffee and snacks are all on hand in the office to keep you fueled.
- Monthly team drinks, birthday cakes and social events.
- Season Ticket Loan and Cycle2Work schemes, plus seasonal flu vaccinations.
- Plus, we’re always on the lookout for creative ways to look after our employees and encourage them to come to us when they have an idea or need.
Join us at Concirrus and be part of a diverse and inclusive team where your talents and ideas are valued. Apply now and let's transform the insurance industry together!
This job is no longer accepting applications
See open jobs at Concirrus.See open jobs similar to "Junior Data Engineer" SpaceTalent.