Engenheiro de Dados SR
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engenheiro de Dados SR based in Brazil.
You will join a dynamic Data & AI environment focused on designing, building, and scaling modern data platforms that power critical business decisions. The role involves working with large-scale distributed systems and cloud-native architectures, ensuring data is reliable, accessible, and optimized for performance. You will contribute directly to the evolution of robust data pipelines supporting analytics and machine learning initiatives. Operating in a collaborative and fast-paced setting, you will engage with engineering, analytics, and business teams to deliver high-impact solutions. The position offers exposure to modern data stack tools and practices in a highly innovative and growth-oriented ecosystem. You will also play a key role in improving data governance, observability, and architectural best practices.
Accountabilities:
- Develop, maintain, and optimize scalable end-to-end data pipelines supporting business and analytics needs.
- Build distributed data processing solutions using Apache Spark for high-volume workloads.
- Orchestrate workflows, scheduling, and automation using Apache Airflow.
- Design and implement data engineering solutions in Python following best engineering practices.
- Work within cloud environments, primarily on Microsoft Azure, ensuring scalable and secure data solutions.
- Implement CI/CD pipelines to support reliable and automated deployment processes.
- Use YAML/YML configurations to enable automation, infrastructure definitions, and pipeline standardization.
- Containerize applications and services using Docker to improve portability and scalability.
- Build and maintain transformation models using dbt.
- Collaborate with cross-functional teams to ensure data quality, reliability, performance, and alignment with business goals.
- Support architectural decisions related to scalability, observability, governance, and data platform evolution.
- Advanced English is mandatory, with strong communication skills for meetings, documentation, and stakeholder interaction.
- Solid experience working with cloud data environments, especially Microsoft Azure and related services.
- Strong programming skills in Python.
- Proven experience with distributed data processing using Apache Spark.
- Experience building and managing workflows using Apache Airflow.
- Hands-on experience with CI/CD pipelines and modern DevOps practices.
- Knowledge of YAML/YML for configuration and automation workflows.
- Experience using Docker for containerized environments.
- Experience with dbt for data modeling and transformations.
- Familiarity with version control, testing, documentation, and software engineering best practices.
- Experience in consulting environments.
- Knowledge of lakehouse, data lake, or data warehouse architectures.
- Experience with Databricks, Azure Data Factory, Synapse, or Fabric.
- Exposure to data observability, monitoring, and data quality practices.
- Experience with high-scale, production-grade data pipelines.
- Competitive compensation aligned with market standards.
- Flexible work arrangements (remote or hybrid, depending on project).
- Health and wellness benefits package.
- Career development and continuous learning opportunities.
- Exposure to international projects and cutting-edge data technologies.
- Collaborative and innovation-driven work environment.
- Access to training programs, mentorship, and technical communities.
Requirements:
Differentials:
Benefits:
How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1