Data Platform Engineering Lead
Tasks
- Build data pipelines
- Collaborate with stakeholders on new data analytics workloads
- Develop data analytics accessibility solutions
- Evaluate build versus buy decisions
- Mentor analytics engineers and data engineers
- Own data platform technical roadmap
- Partner with engineering leadership on planning and prioritization
- Research and integrate big data technologies
- Review code and designs
- Set data quality validation governance observability standards
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Hadoop | Apache Hive | Apache Spark | Argo Workflows | Azure | Bazel | CMake | CUE | Cloud platform | DBT | Docker | Git | Google Cloud | Google Cloud Platform | Kubernetes | Python | SQL | Shell | YAML
Education
Related jobs
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R3h ago
-
Mid-Level Python Developer (GenAI) BGN 72K-82KAnthropic API | Asynchronous programming | CI/CD | Content Moderation | DockerAnnual paid leave | Food vouchers | Health insurance | Life insurance | Multisport cardMid-level Full TimeSofia, Bulgaria R3h ago
-
Manager/Senior Manager, Quantitative Market Risk Models CAD 126K-234KAt risk | Binomial trees | C# | C++ | CVADeloitte Days | Development and Innovation Days | Flexible benefits spending account | Flexible work arrangements | Hybrid work structureSenior-level Full TimeToronto, ON, CA, M5H 0A9 R3h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R4h ago
-
AWS | Asynchronous programming | Azure | CI/CD | Data PipelinesAsynchronous Working Environment | Autonomy and flexibility | Career development and growth | Hardware provided | Hybrid Arrangements Based on RoleSenior-level Full TimeSwitzerland R5h ago
-
AWS | Algorithm Design | Async Programming | Azure | CI/CDAsynchronous Working Environment | Autonomy and flexibility | Career development opportunities | Hardware provided | International Diverse Collaborative EnvironmentSenior-level Full TimeFrance R5h ago
-
AWS | Async/Await | Asynchronous programming | Azure | CI/CDAsynchronous Working Environment | Career development | Hardware provided | Hybrid arrangements | Opportunity to work abroadSenior-level Full TimeSpain R5h ago
-
(Canada) Principal ML System Engineer CAD 153K-200KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote or Mississauga R5h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R5h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R6h ago
-
AWS | Azure | BI | Cause analysis | ComplianceAutonomy | International collaboration | Opportunity to travel | Professional growth and development | Remote workSenior-level Full TimeBrazil R6h ago
-
Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsCertification incentives | Childcare assistance | Dental insurance | Educational discounts | Fitness benefitsSenior-level Full TimeBrazil R6h ago
-
AWS | AWS Glue | Airbyte | Apache NiFi | AutomationBirthday day off | Childcare assistance | Dental insurance | Employee referral bonuses | Extended parental leaveMid-level Full TimeBrazil R6h ago
-
API | Access Control | Apache Spark | CI/CD | Data GovernanceBirthday day off | Childcare or nanny reimbursement | Christmas allowance | Company life insurance | Day off during childrens birthday monthSenior-level Full TimeBrazil R6h ago
-
AI Agents | APIs | Cloud platform | CrewAI | Data EngineeringCertification support | Childcare assistance | Dental insurance | Education Discounts | Fitness program discountsMid-level Full TimeBrazil R6h ago
-
AWS | Asynchronous programming | Azure | CI/CD | Data WranglingAsynchronous Working Environment | Career development growth | Hardware provided | Remote-first work model | Work abroad short periodsSenior-level Full TimeGermany R7h ago
-
Agent systems | Deep learning | Embeddings | Fine Tuning | Function CallingContinuous learning | Networking opportunities | Professional development opportunities | Work from homeEntry-level Full TimeAsia R7h ago
-
Data Architect & Delivery Lead INR 3600K-5400KAgile | Airflow | Batch Processing | BigQuery | Canonical DataSenior-level Full TimeHyderabad, India R7h ago
-
Sr. Data Engineer BRL 253K-310KAWS | AWS DMS | Amazon AppFlow | Amazon Kinesis | Amazon SNSIn-person team events | International collaboration | Remote-first cultureSenior-level Full TimeRemote - Brazil R8h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R8h ago
-
Manager, Quantitative Risk Management USD 210K-240KAWS | Amazon EC2 | Amazon RDS | Amazon Redshift | Amazon S3401(k) plan match | Company in person events | Employer-paid health insurance | Flexible paid time off | Home office stipendMid-level Full TimeUnited States R9h ago
-
ML Engineer CAD 160K-180KA/B | A/B Testing | Anomaly Detection | B testing | BigQueryDental insurance | Health insurance | Hybrid work environment | Vision insuranceMid-level Full TimeVancouver R9h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R10h ago
-
A/B | A/B Testing | B testing | Data parallelism | Deep learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefit programsSenior-level Full TimeRemote - United States R10h ago
-
A/B | A/B Testing | B testing | C++ | Cloud Computing401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefitsSenior-level Full TimeRemote - United States R10h ago