Lead Data Engineer
Tasks
- Advise on distributed storage and computing technologies
- Collaborate with data scientists on model implementations
- Create data processing strategies
- Define project scope and goals
- Deploy and support data pipelines
- Design data architecture
- Develop and operate data processing pipelines
- Ensure on time delivery with cross team collaboration
- Implement data models using modeling techniques
- Integrate data quality into day to day work
- Lead data engineering projects end-to-end
- Maintain data storage and distributed systems
- Manage data governance data security and data privacy
Perks/Benefits
- N/A
Skills/Tech-stack
Big Data | CI/CD | Data Architecture | Data Engineering | Data Governance | Data Lake | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Data Visualization | Databricks | Distributed Systems | Generative AI | LLMs | NoSQL | SQL | Test-Driven | Test-Driven Development
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Artificial Intelligence | Causal Inference | Customer fulfillment | Data Modeling | Data ScienceChildcare assistance | Extended holiday breaks | Flexible hybrid work model | Flexible vacation planning | Health and wellness initiativesSenior-level Full TimeSão Paulo, São Paulo, BR7h ago
-
Data Analyst USD 96K-138KAutomation | CTE | Data Migration | Database Integrity | Debugging10 paid holidays per year | Annual performance reviews | Career growth opportunities | Learning culture | Quarterly performance bonusEntry-level ContractColombia; Argentina; Brazil; Mexico; Ecuador; Uruguay; …9h ago
-
Analista de Dados Pleno - 127203 INT BRL 107K-118KAPIs | Apache Airflow | Apache NiFi | Automated testing | AvroMid-level Full TimeAlphaville - Barueri, BR, 06.454-00013h ago
-
Senior-level Full TimeBrasil19h ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Concurrency debuggingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeCampinas, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimePorto Alegre, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimeRecife, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | C# | Concurrency | SQLEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeSalvador, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Cloud NativeEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C Sharp | Cloud NativeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil1d ago
-
Senior Big Data Engineer - SAP Concur Complete BRL 304K-396KACID | AWS CDK | AWS EMR | AWS Glue | AWS KinesisHealth and well-being benefits | Hybrid work | Inclusive culture | Learning opportunities | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7181d ago
-
Senior Data Scientist - SAP Concur Travel BRL 325K-443KA/B | A/B Testing | AWS EC2 | AWS SageMaker | Amazon EMRContinuous learning opportunities | Flexible working models | Health and wellbeing support | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7181d ago
-
Engenharia de Dados Sênior (Híbrido/SP) - 132080 BRL 96K-119KApache Airflow | Apache Kafka | Apache Spark | Azure | ConfluenceHybrid work | In person 3x per weekMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
API Development | AWS | Agent systems | Continuous Delivery | DatabricksCorporate university | Dental plan | Gym membership reimbursement | Health insurance | Hybrid workSenior-level Full TimeIndaiatuba, São Paulo, BR, 13337-3001d ago
-
Senior-level Full TimeBrazil - Remote R1d ago
-
Agile | Anomaly Detection | Azure Data | Azure Data Factory | Azure DatabricksSenior-level Full TimeBrazil - Remote R1d ago
-
Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeSão Paulo, Brazil1d ago
-
AI Engineer (Brazil) BRL 232K-267KAWS | Agents | Azure | CI/CD | Cloud platformFlexible ways of working | International projects | Learning and development opportunities | Mentoring system | Supportive corporate cultureMid-level Contract Full TimeBlumenau, SC, Brazil1d ago
-
Airflow | CI/CD | Clean Code | Cloud platform | DataflowBicycle storage | Childcare allowance | Dental insurance | Food allowance | Health insuranceSenior-level Full TimeSão Paulo, Brazil1d ago