Senior Data Engineer
Tasks
- Build pipelines with version control and CI CD
- Collaborate with stakeholders and mentor teams
- Create technical design documentation
- Design Lakehouse architecture
- Develop ELT pipelines
- Enable AI/ML use cases
- Ensure data security and compliance
- Implement data quality testing and observability
- Optimize workflow performance and cost
- Orchestrate schedule and monitor pipelines
- Work in Agile Scrum
Perks/Benefits
Skills/Tech-stack
AWS Kinesis | Access Control | Agile | Apache Airflow | Azure | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | DAX | DBT | Dagster | Data Engineering | Data Modeling | Data Observability | Data Quality | Data Quality Testing | Data Warehouse | Data masking | Databricks Unity | Databricks Unity Catalog | Databricks Vector Search | Debezium | Delta Live Tables | Delta Live) | ELT | Encryption | Event Hubs | Feature Engineering | Fivetran | Git | Governance | Kafka | Lakehouse | LookML | Looker | Medallion Architecture | Model Serving | Performance Tuning | Power BI | Prefect | Python | Quality testing | Role-Based Access | Role-Based Access Control | SQL | Scrum | Spark SQL | Storage Optimization | Streaming Ingestion | T-SQL | Tableau | Terraform | Unity Catalog | Vector Search | Workflow Orchestration
Education
Roles
Related jobs
-
.NET | Angular | Azure | Azure DevOps | C#Great Place to Work 10 years | Great place to work | Hybrid work | Job Mobility | Maternity return policySenior-level Full TimeToulouse, Occitanie, France R11h ago
-
Testing Senior Associate - Power BI/Power Automate Tester INR 1000K-2000KAgile | Case design | Dashboard Verification | Data Reconciliation | Data ValidationFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R11h ago
-
GCP Data Engineer/Consultant Specialist INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud SDK | Cloud SQLFlexible working | Inclusive and diverse environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R13h ago
-
Lead Database Engineer INR 1800K-3000KASH | AWR | AWS CloudWatch | AWS RDS | Access GovernanceHealth and life insurance | Hybrid schedule | Paid time off | Pension and retirement benefits | Professional development supportSenior-level Full TimeHyderabad, India R13h ago
-
Gcp Data Engineer/Consultant Specialist INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQuerySenior-level Full TimePune, Maharashtra, India R16h ago
-
Senior Data Engineer PHP 80K-160KApache Airflow | Apache Spark | BigQuery | Cloud platform | Data ModelingAnnual leave | Birthday leave | Flexible work arrangement | Hybrid work arrangement | Learning leaveSenior-level Full TimeTaguig, Metro Manila, Philippines R23h ago
-
Data Analyst/PowerBI Engineer INR 1628K-2500KData Modeling | ETL | Microsoft Excel | Microsoft Fabric | Power BISenior-level Full TimeHyderabad, Telangana, India - Remote R23h ago
-
Data Engineer (Crypto) 12mth FTC-1 GBP 53K-73KAWS EventBridge | AWS Glue | AWS Lambda | AWS Redshift | AWS Step FunctionsEmployee assistance program | Flexible benefits | Hybrid work | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R23h ago
-
Data Engineering Lead Analyst - HOH - Evernorth INR 1500K-2500KAWS Glue | AWS RDS | Amazon Athena | Amazon Redshift | Amazon S3Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R23h ago
-
Machine Learning Lead Analyst - HIH - Evernorth INR 2500K-4500KAPI Integration | AWS | Algorithms | C# | Cloud platformFull-time employment | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R23h ago
-
Machine Learning/ AI Engineer EUR 60K-76KA/B | A/B Testing | APIs | AWS Lambda | Amazon S3Flexible working hours | Free Lunches | Free breakfast | Free fruit | Free snacksMid-level Full TimeMadrid - Busuu, Spain R23h ago
-
Data Engineer, Fraud EUR 98K-98KApache Airflow | Apache Superset | CI/CD | ClickHouse | DBTFlexible work hours | Global co-working access | Retention bonus scheme | Team events and gatherings | Workstation providedSenior-level Full TimeLisbon, Lisbon, Portugal - Remote R23h ago
-
Senior Engineer, Customer Data Operations INR 3000K-4000KAWS | Airflow | Anomaly Detection | Apache Spark | CI/CDESG initiatives | Employee incentive programs | Flexible vacation | Headspace app access | Hybrid work modelSenior-level Full TimeIndia, Bengaluru, Karnataka R23h ago
-
Senior Systems Engineer, Storage - DGX Cloud USD 208K-414KAlerting | Algorithms | Ansible | Argo CD | CI/CDSenior-level Full TimeUS, CA, Remote, United States R23h ago
-
Senior Data Engineer EMEA EUR 71K-107KAzure | CI/CD | CSV | Data Contracts | Data ModelingAutonomy | Career development | Comprehensive employee benefits program | Dedicated learning time | Flexible, agile work environmentSenior-level Full TimeAmsterdam, Netherlands R23h ago
-
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory401k match | Disability insurance | Education benefit | Employee stock purchase plan | Life insuranceSenior-level Full TimePrudential Tower, 655 Broad Street, Newark, … R23h ago
-
Machine Learning/ AI Engineer EUR 60K-76KA/B | A/B Testing | API | AWS | AWS LambdaEnhanced maternity leave | Enhanced paternity leave | Flexible working hours | Free Lunches | Free breakfastMid-level Full TimeMadrid - Busuu, Spain R23h ago
-
Mid-level Full TimeBangalore, India R23h ago
-
Machine Learning Engineer USD 125K-234KA/B | A/B Testing | Apache Spark | B testing | Causal InferenceMid-level Full TimeSan Jose, United States R23h ago
-
Prompt Engineering Architect USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation | Fine Tuning100 percent remote | Career growth | MentorshipSenior-level Full TimeUnited States - Remote R23h ago
-
Prompt Engineering Architect USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | EvaluationSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Developer USD 100K-150KAWS | AWS EMR | Airflow | Apache Atlas | Apache SparkBenefits package | Career growth | Long-term project | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerators | Computer Vision | Data Quality | Data labeling | Data quality monitoringRemote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningRemote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAccelerator hardware | Computer Vision | Data labeling | Deep learning | Distributed TrainingMid-level Full TimeUnited States - Remote R23h ago