Data Engineer

Data Engineer

We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's data capabilities and supporting the launch of our new platform and mobile app.

Key Responsibilities:

  • Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs.
  • Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform.
  • Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards.
  • Define and embed data quality measures within data pipelines.
  • Ensure data integrity, monitoring, and alerting are integrated into all solutions.
  • Create and manage Build and Deployment pipelines.
  • Enhance and support our archive Data Lake.
  • Collaborate with analysts and data scientists to translate requirements into solutions and ensure successful business outcomes.
  • Contribute to the overall design of the Data Platform.
  • Develop visualisations in Power BI.
  • Work in an Agile Kanban workflow to safely code, review, test, and deploy solutions using source control.

Personal Qualities and Cultural Fit:

  • Intellectual curiosity and a growth mindset.
  • Ability to understand and work within operational constraints.
  • Focus on building technology solutions that are scalable and cost-effective.
  • Strong collaboration skills to work across departments.

Required Skills and Experience:

  • Implement data solutions in an AWS environment using native technologies and RDS (SQL Server) toolsets.
  • Experience with transactional reporting solutions for critical business reporting.
  • Experience with dimensionally modelled databases for analytics use cases.
  • Knowledge of ETL tools and approaches.
  • Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS.
  • Experience with Python for scripting and automating data tasks.
  • Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines.
  • Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables.
  • Exposure to visualisation development using Power BI.
  • Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects.
  • Experience in a relevant sector is a plus.
  • Degree or equivalent qualification/experience in computer science, data science, or a related field.

Benefits:

  • Competitive salary and benefits.
  • A collaborative and innovative work environment.
  • Opportunities for professional growth and development.
  • Hybrid working -one to two days office-based 

How to Apply:

Interested? Please Click Apply Now!

Join our client and be part of a team shaping the future through data-driven solutions!

Data Engineer 

 

 

Permanent
18 June 2024
Data
Data Engineer
Manchester
£60K

SEND US YOUR CV

Don't see a job that you like? That's no problem, send us your CV and we will be in touch once we find a position that is suitable for you!

SEND CV