Principal Data Engineer (m/f/d)

Principal data engineers at Thoughtworks are strategic leaders who spearhead data engineering initiatives, tackle complex business challenges and uncover transformative insights. They possess a deep understanding of a client's business ecosystem and partner with executives to align technology strategies with business objectives. By contextualizing emerging trends and Thoughtworks' exploration, they expand the impact of data engineering within the client organization. They draw upon their profound expertise in developing modern data architectures and infrastructure for the management of data applications. Effective collaboration is paramount, as they adeptly convey their discoveries to both technical and non-technical stakeholders. They stay abreast of industry advancements, ensure data quality and security, and provide mentorship to team members. At Thoughtworks, data engineers leverage deep technical knowledge to solve complex business problems, making a significant impact on client success. This is a client-facing, builder's leadership role. You will start with a small, senior team and grow it through technical depth, delivery excellence and thought leadership, rather than inheriting a large organisation to manage. The role is based in Germany and requires regular travel to client sites, up to approximately 50% of your time. Job responsibilities You will collaborate with sales and pre-sales to clarify requirements, design viable solutions and independently drive complex pursuits with technical and executive stakeholders. You will establish a clear vision and direction for the data paradigm and practices, aligning it with the overall business strategy. You will collaborate with executive-level stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality. You will consult on complex data platform programs, synchronizing cross-cutting architectural concerns and providing client-facing technical leadership as a data subject-matter expert. You will create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data scientists to design scalable implementation and production of their models. You will write clean and iterative code based on TDD and leverage continuous-delivery practices to deploy, support and operate data pipelines. You will design and implement the strategy around data governance, data security and data privacy to support business and compliance requirements. You will grow the capability around you, mentoring engineers and building out the next generation of the team. You lead through influence rather than headcount: growing capability and raising delivery standards inside the organisation, while building our presence in the market through thought leadership, ecosystem initiatives and client-facing points of view. Job qualifications Technical Skills You must have extensive pre-sales experience and a proven ability to independently drive complex pursuits and create winning commercial proposals. You are equally happy coding and leading a team to implement a solution, and you stay hands-on in at least one or two core technologies. You have experience in system design using Domain-Driven Design for enterprise organisations with various domains. Working with data excites you; you have created big-data architecture, can build and operate data pipelines, and maintain data storage within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering tools and platforms, along with cloud warehousing tools. You have built and deployed large-scale data pipelines and data-centric applications using distributed storage and processing platforms in a production setting. You have experience designing and developing real-time and low-latency data streaming solutions (cloud and locally hosted). You have experience with data visualization techniques and can…