Lead Data Engineer
Tasks
- Build APIs and data services for dashboards and analytics
- Build data models for forecasting budgeting allocation optimization
- Build data pipelines
- Develop ETL/ELT pipelines
- Enable standardized reporting and unit economics
- Implement CI CD pipelines for data platform services
- Implement anomaly detection and alerting
- Implement data validation and quality controls
- Integrate cloud billing usage telemetry and business data
- Maintain chargeback showback pipelines
- Optimize pipeline performance scalability and reliability
- Partner with FinOps practitioners and analysts to define data requirements
- Support cloud cost allocation and tagging
- Support forecasting and planning with accurate data
- Support self-service analytics
- Use infrastructure as code
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | AWS | Alerting | Anomaly Detection | CI/CD | Cloud Cost Management | Cloud billing | Cost Management | Data Modeling | Data Quality | Data Validation | Data Warehousing | Data orchestration | DevOps | Dimensional Modeling | Docker | ELT | ETL | GCP | Infrastructure as Code | Kubernetes | Python | SQL | “as-code”
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R1d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Apache Airflow | Apache Beam | Auditability | Batch ProcessingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R1d ago
-
AWS | Apache Spark | Big Data | Hadoop | JavaRemote workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
BI Engineer (Contract) INR 2000K-3500KAmazon Athena | Amazon QuickSight | Amazon Redshift | Amazon S3 | Amazon SPICEContract employment | Remote workSenior-level ContractIndia, Remote R1d ago
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 2800K-3900KAWS | Agile | Ansible | Apache Spark | CDCFlexible working | Inclusive work environment | Opportunities for growth | Professional developmentSenior-level Full TimePune, Maharashtra, India R2d ago
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R2d ago
-
Sr. AI Engineer - 2.00 pm to 11.00 pm IST (Remote, IND) INR 3242K-4580KAWS Bedrock | Alerting | Autogen | CI/CD | Configuration ManagementCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeIND MH Remote, India R2d ago
-
Machine Learning Engineer - 5 INR 3600K-5500KAWS | Airflow | Amazon SageMaker | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R2d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowWork from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R2d ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R2d ago
-
Data Science Lead INR 2817K-5000KAWS | Apache Airflow | Experiment design | Lookalike modeling | MLOpsCommunity volunteering | Financial advisory services | Group health coverage | Holidays | Hybrid work modelSenior-level Full TimeBengaluru R2d ago
-
AWS CloudTrail | AWS CloudWatch | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceContinuous learning culture | Flexible working hours | Fully remote work | Professional growth | Supportive innovation focused environmentMid-level Full TimeIndia R3d ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R3d ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQueryFlexible workingSenior-level Full TimeHyderabad, Telangana, India R3d ago
-
GCP Data Engineer/Associate Director, Data and Analytics INR 800K-2000KAgentic AI | Agile | Airflow | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India R3d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R3d ago
-
ML Platform Engineer USD 100K-160KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++Senior-level Full TimeJersey City (India Square), NJ R3d ago
-
AVP, Data Engineer (L10) INR 4000K-5000KAPI | AWS | AWS Glue | Agile | Amazon EMRCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India R3d ago
-
Tech Lead INR 3500K-5000KAPI Design | Analytics Platforms | Artificial Intelligence | Backend Development | Best practicesSenior-level Full TimeIndia - Remote R3d ago
-
Full Stack AI Developer INR 2500K-4500KAPI | Artificial Intelligence | C# | Cloud Computing | ContainersCareer growth opportunities | Collaborative culture | Purpose-driven work | Remote workSenior-level Full TimeIndia - Remote R3d ago
-
Principal Specialist- Data Science Customer Programs INR 2000K-2700KApache Spark | Data Governance | Data Ingestion | Data Lineage | Data ModelingFlexible work hours | Hybrid work environmentSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R3d ago