Senior Data Engineer
Tasks
- Apply data modeling and performance optimization
- Build infrastructure as code with Terraform
- Collaborate with cross-functional teams to deliver technical solutions
- Design scalable lakehouse data solutions
- Develop scalable data pipelines
- Document architecture pipelines and operational processes
- Enable pipeline observability with logging monitoring and alerting
- Ensure production readiness and reliability
- Execute data migration using Databricks and DBT
- Implement data quality frameworks
- Improve stability and operational processes
- Integrate legacy systems with Azure data platform
- Migrate data to Azure
- Monitor and maintain production data pipelines
- Own end to end data pipeline delivery
- Provide code reviews and mentor engineers
- Support data governance with lineage and compliance
- Troubleshoot incidents and perform root-cause analysis
Perks/Benefits
Skills/Tech-stack
Alerting | CI/CD | Cause analysis | Compliance | Cost Optimization | DBT | Data Governance | Data Lineage | Data Modeling | Data Quality | Databricks | Delta Live Tables | Delta Live) | ELT | ETL | Event Hubs | Git | Git based version control | Incident Response | Infrastructure as Code | Kafka | Lakehouse | Logging | Monitoring | Performance Tuning | Python | Root Cause Analysis | Root cause | SQL | Snowflake | Terraform | Version control | “as-code”
Education
N/A
Roles
Related jobs
-
Angular | CI/CD | Databases | Databricks | Distributed SystemsMentoring system | Professional developmentSenior-level Full TimeBlumenau, SC, Brazil11h ago
-
Senior-level Full TimeBrazil18h ago
-
Tech Lead – Engenharia de Dados BRL 117K-142KAWS | Amazon Kinesis | Apache Spark | CI/CD | Data GovernanceSenior-level Full TimeSão Paulo, Brazil21h ago
-
Agile methodology | Amazon Web Services | Data Governance | Data Pipelines | Data QualityBike parking | Childcare assistance | Company shuttle | Dental insurance | Food VoucherMid-level Full TimeSão Paulo, Brazil22h ago
-
Asynchronous programming | CI/CD | Elasticsearch | Embeddings | Evaluation FrameworksHybrid work option | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBrazil22h ago
-
Analytics Platform Engineer BRL 305K-390KAWS | Apache Airflow | CI/CD | DBT Core | Data ClassificationRemote workSenior-level Full TimeBrazil23h ago
-
Especialista I - Technical Lead BRL 210K-252KAWS | Acceptance Testing | CI/CD | Checkmarx | Distributed SystemsSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
Machine Learning Engineer USD 132K-165KApache Spark | MLOps | Machine Learning | Pandas | PyTorchDistributed team | Flexible work schedule | Remote workMid-level Full TimeBogota R1d ago
-
[Job-30403] AI Engineer, Brazil BRL 319K-390KA2A | ACP | Agent Coordination Protocol | Agent Orchestration | Agent coordinationChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
Data Analytics Engineer BRL 150K-220KApache Airflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerMid-level Full TimeSão Paulo1d ago
-
Ablation Studies | Active Learning | Adversarial Testing | Attention Mechanisms | BPEFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growthMid-level Full TimeBrazil R1d ago
-
API Management | AWS | Apigee | Bash | CI/CDFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growth opportunitiesSenior-level Full TimeBrazil R1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth opportunity | Competitive salary | Friendly work environment | Impact on learning accessibilityMid-level Full TimeRio de Janeiro, Brazil1d ago
-
Bash | Data pipeline | Docker | GCP | LinuxAsynchronous culture | Inclusive workplace | Remote work opportunityMid-level Full TimePorto Alegre, Brazil1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeSalvador, Brazil1d ago
-
PL Data Engineer - Indaiatuba/SP BRL 107K-107KAWS | Agile | CI/CD | Data Pipelines | Data WarehousingCorporate university | Dental insurance | Eye Care Benefit | Gym membership | Health insuranceMid-level Full TimeIndaiatuba,Sao Paulo,Brazil1d ago
-
AWS | Azure | CI/CD | Databricks | GitHubChildcare assistance | Corporate university | Dental insurance | Education partnerships | Health insuranceSenior-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
API Integration | Automation | Blaze Advisor | CI/CD | Data AnalysisChildcare support | Dental insurance | Extended parental leave | Gym membership | Health insuranceSenior-level Full TimeBrazil2d ago
-
AWS | Amazon ECS | Apache Airflow | Apache Hadoop | Apache HiveChildcare subsidy | Day off on birthday | Dental plan | Discounts On Everyday Services | Discounts at educational institutionsSenior-level Full TimeBrasil2d ago
-
[Job-30060] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure | Azure DevOps | Azure Machine Learning | CI/CD | Data GovernanceChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil2d ago
-
Alerting | Anti-Bot | Anti-bot evasion | Asynchronous programming | Bot EvasionFlexible working arrangements | International engineering team | Learning and coaching | Optional office near Berlin | Remote-first cultureSenior-level Full TimeBrazil2d ago
-
Anomaly Detection | Azure Databricks | CI/CD | Classification | ClusteringChildcare assistance | Dental insurance | Extended parental leave | Food allowance | Gym membership discountMid-level Full TimeBrazil2d ago
-
[Job - 30376] AI Developer PL/SR (.NET + AWS) BRL 132K-144K.NET | AWS Lambda | Agent planning | Amazon DynamoDB | Amazon EC2Senior-level Full TimeBrazil2d ago
-
Analista de Ciência de Dados em IA Pleno BRL 78K-160KAdversarial Testing | Bias detection | Chunking | Embeddings | FairnessCLT employment | Flexible schedule | Remote workSenior-level Full TimeSão Paulo2d ago
-
Analista de Desenvolvimento de Software Sênior BRL 118K-119KAWS | Automated testing | CI/CD | DDD | Design PatternsSenior-level Full TimeSão Paulo, Brazil2d ago