Data Engineer (On-Site) | Engenheiro de Dados (Remoto)

**Company Overview** **Dadosfera** is transforming the data landscape with a platform that delivers advanced Data, AI, and Analytics capabilities—previously available only to tech giants like Meta, Amazon, Alphabet, and Microsoft—into the hands of small and medium-sized businesses. By democratizing access to these technologies, we empower our clients to accelerate business opportunities through AI-powered Data Apps. Our platform minimizes the time spent on cloud management and streamlines the entire data lifecycle—from collection and exploration to processing and interaction—allowing clients to focus on their business goals. Built on a high-growth SaaS model, Dadosfera offers tailored solutions that meet real business needs. What sets Dadosfera apart is our innovative focus on speed, scalability, and flexibility, combining big data storage with advanced analytics to drive strategic decision-making. Leveraging years of experience with data platform implementations on foreign public clouds, we now deliver a cost-effective, locally adapted solution tailored for both Brazilian and global markets. By blending deep expertise with localized infrastructure, Dadosfera provides a powerful, efficient tool that optimizes corporate data management and drives data-driven transformation. **About the Job** We are looking for a **Data Engineer** to join our engineering team and help design, develop, and evolve scalable data platforms and pipelines on AWS. In this role, you will be responsible for building robust solutions for data ingestion, processing, integration, and delivery, ensuring reliable data for analytics, data products, and business decision-making. You will also develop solutions that leverage Artificial Intelligence to improve data quality and enrichment, including automated attribute extraction, information classification, entity recognition, record deduplication, and match-and-merge processes. You will collaborate with cross-functional teams, participate in architecture discussions, and contribute to building modern, cloud-native, and scalable data ecosystems while following engineering, governance, and security best practices. **Responsibilities** - Design, develop, and maintain scalable ETL/ELT pipelines using Python, SQL, and AWS services. - Design and evolve layered Data Lake architectures following the Medallion Architecture pattern. - Develop incremental data pipelines with checkpointing, idempotency, failure recovery, and reprocessing strategies. - Build solutions for ingesting, processing, and integrating structured, semi-structured, and unstructured data. - Develop automated mechanisms to extract attributes and relevant information from documents, text, and multiple data sources. - Apply Artificial Intelligence, Machine Learning, or Large Language Models (LLMs) to classify, standardize, validate, and enrich data. - Implement entity resolution, record linkage, deduplication, and match-and-merge processes to identify related records and build trusted, unified datasets. - Define similarity criteria, business rules, confidence thresholds, and review workflows for record-matching processes. - Optimize SQL queries and storage structures for analytical workloads and large-scale datasets. - Work with AWS services including Amazon S3, AWS Lambda, AWS Glue, AWS Step Functions, Amazon Athena, and Amazon DynamoDB. - Ensure the quality, reliability, performance, security, and observability of data pipelines and data products. - Implement validation rules, monitoring, metrics, and alerting mechanisms to detect failures and data inconsistencies. - Collaborate with software engineers, data analysts, business stakeholders, and clients to translate business requirements into scalable technical solutions. - Participate in code reviews, architecture discussions, and continuous improvement initiatives. - Document data flows, processing rules, technical solutions, and architectural decisions. **Minimum Qualifications** - Solid experience w…