Senior Data Engineer

Category IT & Software Development Job Location Willingboro, NJ, US Additional Locations Downers Grove, IL, US Position Type Full-Time/Regular JOB SUMMARY As a Senior Data Engineer at Radwell, you will be a key member of the data engineering team, responsible for designing, building, and maintaining our data environment. You will collaborate closely with fellow data engineers, ML teams, reporting analysts, and software engineers to ensure our data pipelines are efficient, scalable, and reliable. The Radwell Data Engineer is a forward-thinking innovator who understands how to implement data solutions for next-generation challenges by working directly with the business to understand their data needs. Your work will help optimize activities across multiple functions such as pricing, warehousing, and procurement, driving data-driven decisions and operational efficiency throughout the organization. ESSENTIAL DUTIES AND RESPONSIBILITIES · Architect and scale data platforms — design and maintain distributed data systems (batch + streaming), ensuring reliability, performance, and cost efficiency · Lead end‑to‑end data pipeline development — build, optimize, and monitor ETL/ELT pipelines that support analytics, ML training, and real‑time inference workloads · Enable machine learning workflows — collaborate with data scientists to deliver feature pipelines, model training environments, and production inference systems · Own data quality and governance — define standards for data validation, lineage, cataloging, and compliance across the organization · Partner with cross‑functional teams — work with product, analytics, and ML teams to translate business needs into scalable data solutions · Operational excellence — manage CI/CD for data and ML pipelines, implement observability, and ensure SLAs for mission‑critical data services · Evaluate and integrate new technologies — assess tools for data processing, orchestration, storage, and MLOps; lead POCs and production rollouts · Build and maintain advanced data systems that bring together data from disparate sources in order to enable decision makers · Design, develop, and maintain scalable data pipelines and ETL processes using Databrick, azure data factory, SQL and Python · Build pipelines and prepare data for use by data scientists, data analysts, and other data systems · Take a solution-oriented problem-solving approach to develop creative solutions for business needs by partnering with business leaders and subject matter experts · Leverage cloud infrastructure and metadata driven frameworks to deliver value and scalability · May be modified from time to time. Other duties, tasks and work may be assigned METRICS · Consistently meet monthly deadlines and objectives as agreed and typically described in monthly reviews or through other project planning efforts · Handle ongoing projects and day-to-day demands that are not identified in formal monthly objectives in a timely and accurate manner · Adherence to any related budget expenses · Adherence to/achievement of business objectives described in project benefit analyses AI-Native Development & Coding Deployment · Incorporate AI-powered developer tools (e.g., GitHub Copilot, Cursor, Claude Code) to accelerate code scaffolding, boilerplates, and refactoring · Govern the deployment pipeline by maintaining ultimate accountability for the security, extensibility, and clarity of AI-generated code · Automate test suites using Generative AI to programmatically generate edge-case validation checks, regression testing, and data quality rules. · Manage continuous integration and zero-touch deployment (CI/CD) via GitHub Actions, Terraform, or Jenkins, using AI to debug execution failures and draft deployment manifests · Implement rollback strategies and reversible migration practices for schema modifications developed through automated workflows · Build automated anomaly detection and schema drift monitoring alerts into critical business pipelines · En…