Data Engineer

div]:bg-bg-000/50 [&_pre>div]:border-0.5 [&_pre>div]:border-border-400 [&_.ignore-pre-bg>div]:bg-transparent [&_.standard-markdown_:is(p,blockquote,h1,h2,h3,h4,h5,h6)]:pl-2 [&_.standard-markdown_:is(p,blockquote,ul,ol,h1,h2,h3,h4,h5,h6)]:pr-8 [&_.progressive-markdown_:is(p,blockquote,h1,h2,h3,h4,h5,h6)]:pl-2 [&_.progressive-markdown_:is(p,blockquote,ul,ol,h1,h2,h3,h4,h5,h6)]:pr-8"> _*]:min-w-0 gap-3 [&_>_*:last-child]:mb-0 print:block print:[&_>_*_+_*]:mt-3 standard-markdown"> Brainlabs is the independent, founder-led agency building the future of media. We have over 1000 Brainlabbers based across the global, all united through the 12 principles laid out in our Culture Code. We're full-service, with people and AI agents working side by side, all aligned to one thing: maximizing our clients' revenue through a genuinely scientific approach to media. If you want to help play your part in achieving this for the world's biggest brands in an environment that will support and challenge you in equal measure, this is where you do it. We are looking for a motivated and detail-oriented Data Engineer with 2+ years of experience in designing, building, and managing scalable data solutions on Google Cloud Platform (GCP). The ideal candidate will have a strong background in data engineering, cloud-based architectures, and proficiency in implementing data pipelines to transform raw data into actionable insights. Experience building or supporting AI and GenAI data workflows, including pipelines for LLM applications and AI/ML model training, is a strong plus. What you do Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines using GCP tools like CloudFunctions, CloudRun, Dataflow, Dataproc, or Cloud Data Fusion. Ensure data pipelines are scalable, efficient, and optimised for performance. AI & GenAI Process Development: Build and manage data pipelines that support LLM and GenAI applications, including Retrieval-Augmented Generation (RAG) architectures, vector data stores, and prompt context assembly workflows. Curate and prepare datasets for AI/ML model training, covering feature engineering, labeling pipeline oversight, and data versioning using tools like Vertex AI Feature Store or DVC. Data Integration and Storage: Integrate data from various sources into GCP services such as BigQuery, Cloud Storage, and Cloud SQL. Design and implement data warehouse/mart solutions using BigQuery for analytics and reporting. Data Transformation & Optimization: Build transformation logic using SQL, Python, or Spark for preparing clean and structured data. Optimise query performance and storage cost in BigQuery or other GCP storage systems. Data Quality & Monitoring: Develop processes to ensure data quality, integrity, and consistency across the pipeline. Implement monitoring and logging systems using tools like Stackdriver or Looker. Requirement Understanding : Understand and interpret business and technical requirements to support data development tasks. Assist in building, testing, and maintaining data pipelines while ensuring alignment with project objectives and stakeholder needs Collaboration & Communication: Work closely with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand requirements. Provide technical guidance on GCP best practices and tools. Documentation & Maintenance: Maintain clear documentation of processes, workflows, and data architecture. Ensure regular maintenance and version control of pipelines and scripts. Who you are Mandatory Skills: Hands-on experience with GCP services like CloudFunctions, CloudRun, Schedular, BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Strong programming skills in Python, SQL. Knowledge of data modelling, schema design, and query optimization techniques. Experience in building batch and streaming data pipelines. Excellent communication and collaboration skills. Ability to work in a fast-paced and dynamic environment. Preferred Skills:…