Senior Data Engineer (Team Lead)
Tasks
- Architect batch data solutions
- Architect streaming data solutions
- Collaborate cross-functional teams
- Define data strategy
- Deploy data infrastructure
- Design scalable data pipelines
- Ensure data compliance
- Ensure data governance
- Ensure data security
- Implement data engineering standards and tooling
- Lead data engineering team
- Mentor junior engineers
- Monitor data infrastructure
- Optimize data pipelines
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data Platforms | Data Compliance | Data Governance | Data Processing | Data Security | Data pipeline | Data pipeline optimization | Data platforms | Distributed data | Distributed data processing | Hadoop | Performance Tuning | Pipeline Optimization
Education
Related jobs
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Azure HDInsightCareer development opportunities | Cooptation bonus | Employee representative council | Health insurance | Meal vouchersSenior-level Full TimeNantes, Pays de la Loire, France R8h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R9h ago
-
Senior Data Engineer - Paris - H/F EUR 45K-55KAirflow | Batch data | CI/CD | ClickHouse | Data CatalogMeal allowance | Profit sharing | Remote work | Restaurant voucherSenior-level Full TimeParis, IDF, France R9h ago
-
Applied AI Software Engineer GBP 75K-90KAgile | Azure | Continuous Delivery | Data Observability | Data PrivacyAnnual leave | Critical illness protection | Cycle to work | Dental coverage | Electric vehicle schemeSenior-level Full TimeGlasgow, Lanarkshire, United Kingdom R10h ago
-
ADLS Gen2 | Apache Spark | Auto Loader | Azure | Azure DataSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R15h ago
-
Data Engineer PHP 1200K-1440KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Hive | Apache SparkAnnual leave | Bereavement leave | Birthday leave | Flexible work arrangement | Hybrid work arrangementSenior-level Full TimeTaguig, Metro Manila, Philippines R17h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible schedule | Remote workMid-level Full TimePakistan - Remote R17h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R20h ago
-
VP of Data & Analytics USD 180K-225KAttribution | Data Engineering | Data Governance | Data Modeling | Data PipelinesHybrid work | Remote workExecutive-level Full TimeRemote R21h ago
-
AI/ML Engineer - Revenue Cycle Automation-Remote USD 125K-171KAzure | Bias detection | Cloud infrastructure | Cloud platform | Data Engineering100 percent remote | Dental insurance | FSA | HSA | Health insuranceMid-level Full TimeRochester, MN, United States R21h ago
-
AWS | CI/CD | Data Governance | Data Lakehouse | Data ModelingHybrid work model | International team | Remote work option | Training programSenior-level ContractVilnius, Lithuania (Remote) R1d ago
-
Data Engineer EUR 35K-39KAWS CloudFormation | Apache Airflow | BigQuery | Cloud platform | DBTFlexible work hours | Half day Friday | Inclusive international environment | Learning and training access | Paid volunteering daysMid-level Full TimeLisbon, Lisbon, Portugal R1d ago
-
Senior Data Engineer CAD 95K-143KAWS CloudFormation | Apache Spark | CI/CD | Cloud Storage | Cloud platformCareer growth opportunities | Community involvement opportunities | Health and wellbeing programs | Hybrid work environment | Paid personal daysSenior-level Full TimeToronto, ON, CA R1d ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R1d ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Remote work | Team building eventsSenior-level Full TimeIllinois R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work environment | Flexible work atmosphere | Team building eventsSenior-level Full TimeColumbia R1d ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Open office environment | Team building eventsMid-level Full TimeColorado R1d ago
-
Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Team building eventsSenior-level Full TimeFlorida R1d ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data ConsistencyCollaborative work environment | Remote work flexibility | Team building eventsMid-level Full TimeCalifornia R1d ago
-
Airflow | BigQuery | Cloud platform | Data Modeling | Database ManagementFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeArizona R1d ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceCollaborative open office | Flexible work environment | Team building eventsSenior-level Full TimeConnecticut R1d ago
-
Data Engineer / BI Developer (Power BI, Domo) PHP 420K-480KData Modeling | Data Quality | Data Warehousing | Data pipeline | DomoFully remote | Remote work from PhilippinesMid-level ContractAnywhere in the Philippines, Philippines R1d ago