Sr Data Engineering Specialist
BR, São Paulo, Sumare, Brazil
BRL 171K-183K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming pipelines
- Conduct root cause analysis and continuous improvement
- Deploy pipelines using CI CD and infrastructure as code
- Design scalable data pipelines
- Develop lakehouse integrated pipelines
- Implement data quality checks and monitoring
- Integrate pipelines with DataHub and AWS
- Maintain data models for analytics and AI
- Monitor pipelines and perform troubleshooting
- Optimize pipeline performance and cost
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Kinesis | Airflow | Amazon S3 | Apache Spark | CI/CD | Data Cataloging | Data Governance | Data Lineage | Data Modeling | Data Transformation | Data Warehousing | Databricks | Datahub | Delta Lake | Feature Engineering | Infrastructure as Code | Kafka | LLM | PySpark | Python | SQL | Step Functions | Temporal | Testing | Unity Catalog | Vector Search | Version control | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Image SegmentationEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRecife, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Image SegmentationEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeCuritiba, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeSão Paulo, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Science | Fine TuningEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSão Bernardo do Campo, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Science | Edge ComputingEducation budget | Fitness budget | Flextime | Mentorship | Office workSenior-level Full TimeRio de Janeiro, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Science | Deep learningEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimePorto Alegre, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Science | Deep learningEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeCampinas, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Image Segmentation | Image classificationFlexible schedule | Mentorship | Office options | Professional growth | Remote work optionsSenior-level Full TimeBelo Horizonte, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Image SegmentationFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSorocaba, Brazil8h ago
-
Senior Computer Vision Engineer ID72408 BRL 300K-360KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Deep learningEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeFlorianópolis, Brazil8h ago
-
API Integration | Apache Airflow | Batch Processing | CI/CD | Cloud ComputingHealth insurance subsidies | Learning-focused culture | Paid Holidays | Paid training and professional development | Remote-firstSenior-level Full TimeBrazil16h ago
-
Analista Data Engineer Sênior BRL 72K-90KBusiness Intelligence | Data Engineering | Data Governance | Data Observability | Data PipelinesBirthday off | Career mentoring | Childcare assistance | Company results participation | Dental insuranceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil21h ago
-
Estágio em Análise de Dados BRL 21K-24KAWS | Big Data | Data Visualization | ETL | Power BIChildcare assistance | Dental insurance | Gympass | Health insurance | Life insuranceNone Full TimeSão Paulo22h ago
-
Analista de Dados Sênior (São Carlos) BRL 25K-25KAWS | Amazon EMR | Amazon S3 | Anomaly Detection | Apache AirflowMid-level Full TimeSão Carlos, Brazil22h ago
-
[30060] Senior Engenheiro de Dados, Brasil BRL 20K-31KAgile | Apache Kafka | CI/CD | Databricks | GitHubChildcare assistance | Dental insurance | Extended parental leave | Gympass | Health insuranceSenior-level Full TimeBrazil1d ago
-
Senior Data Engineer BRL 319K-443KAgile | Automation | Cloud Architecture | DBT | Data ModelingMedical healthcare | Ongoing learning reimbursement | Recognition program | Remote flexibility | Team eventsSenior-level Full TimeBrazil1d ago
-
AKS | Apache Airflow | Apache Spark | Azure Data | Azure Data LakeChildcare support | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
Entry-level Full TimeSP, Brazil1d ago
-
Engenheiro(a) de Dados SR BRL 20K-31KAgile methodologies | Data Governance | Data Lineage | Data Modeling | Data TransformationDiversity and inclusionSenior-level Full TimeSão Paulo, Brazil1d ago
-
Azure | CI/CD | Docker | FastAPI | Generative AIChildcare assistance | Continuous learning platform | Dental insurance | Extended parental leave | Food allowanceSenior-level Full TimeBrazil1d ago
-
AWS | Advanced Analytics | Apache Spark | Data Quality | Data integrationCorporate university | Dental plan | Food allowance | Health insurance | Life insuranceEntry-level Full TimeMontenegro,Rio Grande do Sul,Brazil1d ago
-
AI guardrails | API Development | Accuracy Optimization | Anthropic | Application SecurityEquity participation | Equity participation in client projects | Flexible work arrangements | High ownership and autonomy | Opportunity to work on cutting-edge AI productsSenior-level Full TimeBrazil1d ago
-
Access Control | Amazon Web Services | Anonymization | Cloud Data | Cloud Data ServicesChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveMid-level Full TimeBrazil1d ago
-
Azure | Data Governance | Data Modeling | Data Quality | Data meshChildcare assistance | Continuous learning support | Discounts and corporate benefits marketplace | Extended parental leave | Health and dental insuranceSenior-level Full TimeBrazil1d ago
-
ABAP | ABAP development | API Design | Alerting | Apache SparkSenior-level Full TimeSão Leopoldo, BR, 93022-718 R1d ago