Tech Lead Data Engineer
Tasks
- Assemble complex datasets meeting business requirements
- Build analytical tools for business metrics
- Build scalable secure data processing infrastructure
- Design build implement automate ingestion pipelines
- Enrich and process analytics data pipelines
- Extract, transform, and load data from multiple sources
- Identify design implement process improvements
- Implement big data solutions as hands on technical lead
- Lead and develop big data platform
- Mentor and coach data engineers
- Process ingest high volume data and transactions
- Support stakeholders with data-related technical issues
Perks/Benefits
- Equal opportunity for learning
- Extended hours as needed
- Flexible learning culture
- Mentorship and coaching
- Personal growth
- Stable work environment
Skills/Tech-stack
AWS | Athena | Batch Ingestion | Cause analysis | CloudFormation | CloudWatch | Cost Optimization | Data Governance | Data Ingestion | Data Lake | Data Modeling | Data Pipelines | Data Transformation | ELT | ETL | Event Driven | Event-driven architecture | FinOps | Glue | IAM | IaC | Lake Formation | Logging | Metadata Management | Observability | Operational excellence | Real Time | Real-time Data | Real-time data ingestion | Redshift | Reliability Engineering | Root Cause Analysis | Root cause | S3 | S3 Replication | SQL | Structured data | Terraform | Tracing | Unstructured Data
Related jobs
-
Senior GIS Enginer INR 900K-2500KAPI Integration | ArcGIS | Coordinate systems | Data Transformation | Data cleaningSenior-level Full TimeHyderabad, TS, IN / Hyderabad, Telangana, …8h ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia10h ago
-
Staff Engineer (Snowflake, Apache Kafka, Oracle, AWS Lambda) INR 1500K-2500KAWS EC2 | AWS IAM | AWS Lambda | AWS VPC | Access ManagementSenior-level Full TimeGurugram, India11h ago
-
Staff Engineer (Datadog Engineer) INR 2000K-4000KAmazon Web Services | Application Performance Monitoring | Application performance | Automation | Azure DevOpsSenior-level Full TimeHyderabad, India12h ago
-
Staff Engineer (AI Security and DevSecOps ) INR 2500K-5000KAI RMF | AWS | AWS Secrets | AWS Secrets Manager | Abuse detectionSenior-level Full TimeHyderabad, India12h ago
-
Senior Software Engineer (Data Platform) INR 2475K-3500KAWS | Airflow | Apache Flink | Apache Hadoop | Apache HiveCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Healthcare benefitsSenior-level Full TimeBengaluru, India18h ago
-
Senior Cloud Storage Engineer – NetApp CVO on GCP, AVP INR 2755K-3500KAutomation | CI/CD | Cloud Security | Cloud platform | Cloud volumes ONTAPAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimePune - Business Bay, India1d ago
-
Mid-level Full TimePune, India1d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Cloud services | Code review | Data Modeling | Data WarehousingSenior-level Full TimePune, India1d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Application development | Cloud services | Code review | Data ModelingSenior-level Full TimePune, India1d ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Batch Processing | DAX | Data Ingestion | Data ModelingFinancial consultations | Language courses | Legal consultations | Medical insurance | Mental health supportSenior-level Full TimeIndia1d ago
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior AI Engineer INR 3242K-4680KAWS EC2 | AWS ECS | AWS Lambda | AWS RDS | Amazon S3Financial consultation | Legal consultation | Medical insurance | Mental health support | Paid certificationsSenior-level Full TimeIndia1d ago
-
Lead Data Engineer INR 2771K-4064KAWS | Cloud Computing | Data Governance | Data Processing | Data StreamingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Bitbucket | CI/CD | CSS | CeleryCollaborative work environment | Onsite work 5 days a week | Training and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Data Scientist – AI & Cybersecurity INR 2500K-4500KAPIs | AWS | Adversarial Testing | Amazon SageMaker | Anomaly DetectionGrowth opportunities | Mentorship programs | Training opportunitiesSenior-level Full TimeBangalore - Karnataka - India1d ago
-
Senior Python GenAI Engineer INR 2000K-4580KAWS | Angular | Anthropic | Azure | Azure OpenAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India1d ago
-
Senior Machine Learning (ML) Ops Engineer INR 3715K-5449KAWS | Airflow | Amazon SageMaker | Azure | CI/CDEquity compensation | Fully remote | Global & diverse team | Innovation culture | Part-timeSenior-level Full TimeMumbai, Maharashtra, India R1d ago
-
Senior Java Kafka Architect INR 2000K-2700KAmazon Web Services | Apache Kafka | CI/CD | Code Refactoring | Code reviewSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Data Engineer INR 2000K-3000KAPI Design | Asynchronous programming | Caching | Celery | Clean architectureSenior-level Full TimeIN-KA-Bangalore1d ago
-
Azure Data Engineer INR 1500K-2500KApache Spark | Azure Data | Azure Data Lake | Azure Databricks | Data GovernanceMid-level Full TimeIN-KA-Bangalore1d ago
-
Mid-level Full TimeIN-KA-Bangalore1d ago
-
Campus FTE INR 1200K-2500KAgentic AI | Amazon Web Services | Classification | Cloud platform | Data AnalysisMid-level Full TimeBangalore, Karnataka, India1d ago
-
AI Engineer INR 2000K-5000KAWS SageMaker | Azure Machine Learning | C++ | Computer Vision | Deep learningSenior-level Full TimeIndia - Pune1d ago