Data Platform Engineering Lead
Tasks
- Build data pipelines
- Collaborate with stakeholders on new data analytics workloads
- Develop data analytics accessibility solutions
- Evaluate build versus buy decisions
- Mentor analytics engineers and data engineers
- Own data platform technical roadmap
- Partner with engineering leadership on planning and prioritization
- Research and integrate big data technologies
- Review code and designs
- Set data quality validation governance observability standards
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Hadoop | Apache Hive | Apache Spark | Argo Workflows | Azure | Bazel | CMake | CUE | Cloud platform | DBT | Docker | Git | Google Cloud | Google Cloud Platform | Kubernetes | Python | SQL | Shell | YAML
Education
Related jobs
-
Machine Learning Engineer EUR 45K-60KAWS | Argo | BigQuery | Cloud Computing | DockerEmployee Assistance Program (EAP) | Flexible working environment | Hybrid work | LinkedIn Learning | Ongoing trainingsMid-level Full TimeKuala Lumpur, 14, Malaysia R2h ago
-
Senior Data Engineer (Databricks) (m/w/d) EUR 62K-72KApache Spark | Azure Data | Azure Data Factory | CI/CD | ComplianceBicycle leasing | Corporate benefits platform | Deutschlandticket | Employee Assistance Program (EAP) | Employee wellbeing supportSenior-level Full TimeHamburg, Germany R3h ago
-
Senior Data Engineer (Databricks) (m/w/d) EUR 62K-72KAgile | Apache Spark | Azure Data | Azure Data Factory | CI/CD30 days paid vacation | Allowance for mobile workspace | Bahncard | Bike leasing | Corporate benefits platformSenior-level Full TimeStuttgart, Germany R3h ago
-
Senior Data Engineer (Databricks) (m/w/d) EUR 75K-95KApache Spark | Azure Data | Azure Data Factory | CI/CD | DBTCorporate benefits platform | Employee Assistance Program (EAP) | Flexible working hours | Inhouse trainings | MentoringSenior-level Full TimeBerlin, Germany R3h ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R4h ago
-
Mid-Level Python Developer (GenAI) BGN 72K-82KAnthropic API | Asynchronous programming | CI/CD | Content Moderation | DockerAnnual paid leave | Food vouchers | Health insurance | Life insurance | Multisport cardMid-level Full TimeSofia, Bulgaria R4h ago
-
Manager/Senior Manager, Quantitative Market Risk Models CAD 126K-234KAt risk | Binomial trees | C# | C++ | CVADeloitte Days | Development and Innovation Days | Flexible benefits spending account | Flexible work arrangements | Hybrid work structureSenior-level Full TimeToronto, ON, CA, M5H 0A9 R4h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R5h ago
-
Data Engineer USD 149K-175KAgile | Airflow | Amazon QuickSight | Amazon Redshift | Amazon Web ServicesCareer coaching | Coaching | Employee assistance programme | Flexible working hours | Hybrid workSenior-level Full TimeKuala Lumpur, Kuala Lumpur, Malaysia R5h ago
-
AWS | Asynchronous programming | Azure | CI/CD | Data PipelinesAsynchronous Working Environment | Autonomy and flexibility | Career development and growth | Hardware provided | Hybrid Arrangements Based on RoleSenior-level Full TimeSwitzerland R6h ago
-
AWS | Algorithm Design | Async Programming | Azure | CI/CDAsynchronous Working Environment | Autonomy and flexibility | Career development opportunities | Hardware provided | International Diverse Collaborative EnvironmentSenior-level Full TimeFrance R6h ago
-
AWS | Async/Await | Asynchronous programming | Azure | CI/CDAsynchronous Working Environment | Career development | Hardware provided | Hybrid arrangements | Opportunity to work abroadSenior-level Full TimeSpain R6h ago
-
(Canada) Principal ML System Engineer CAD 153K-200KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote or Mississauga R6h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R6h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R7h ago
-
AWS | Azure | BI | Cause analysis | ComplianceAutonomy | International collaboration | Opportunity to travel | Professional growth and development | Remote workSenior-level Full TimeBrazil R7h ago
-
Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsCertification incentives | Childcare assistance | Dental insurance | Educational discounts | Fitness benefitsSenior-level Full TimeBrazil R7h ago
-
AWS | AWS Glue | Airbyte | Apache NiFi | AutomationBirthday day off | Childcare assistance | Dental insurance | Employee referral bonuses | Extended parental leaveMid-level Full TimeBrazil R7h ago
-
API | Access Control | Apache Spark | CI/CD | Data GovernanceBirthday day off | Childcare or nanny reimbursement | Christmas allowance | Company life insurance | Day off during childrens birthday monthSenior-level Full TimeBrazil R7h ago
-
AI Agents | APIs | Cloud platform | CrewAI | Data EngineeringCertification support | Childcare assistance | Dental insurance | Education Discounts | Fitness program discountsMid-level Full TimeBrazil R7h ago
-
AWS | Asynchronous programming | Azure | CI/CD | Data WranglingAsynchronous Working Environment | Career development growth | Hardware provided | Remote-first work model | Work abroad short periodsSenior-level Full TimeGermany R7h ago
-
Agent systems | Deep learning | Embeddings | Fine Tuning | Function CallingContinuous learning | Networking opportunities | Professional development opportunities | Work from homeEntry-level Full TimeAsia R7h ago
-
Data Architect & Delivery Lead INR 3600K-5400KAgile | Airflow | Batch Processing | BigQuery | Canonical DataSenior-level Full TimeHyderabad, India R8h ago
-
Sr. Data Engineer BRL 253K-310KAWS | AWS DMS | Amazon AppFlow | Amazon Kinesis | Amazon SNSIn-person team events | International collaboration | Remote-first cultureSenior-level Full TimeRemote - Brazil R9h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R9h ago