Data Engineering Lead-AWS, Python, Spark, Pyspark
Primary location: Gurgaon, Haryana
INR 3000K-3500K (estimate) Senior-level Full Time
Tasks
- Assist in technical interviewing
- Automate repetitive tasks
- Build infrastructure as code
- Collaborate on application design with architects
- Collaborate with engineering teams
- Contribute to technology stack
- Create pipelines and monitoring
- Deliver customer value in agile framework
- Design and develop scalable reliable self healing solutions
- Implement telemetry coverage
- Mentor junior engineers
- Optimize SQL statements
- Provide technical communication and presentations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | App Insights | Azure App | Azure App Insights | Containerization | Continuous Delivery | Continuous integration | Docker | GitHub Actions | Infrastructure as Code | Integration Testing | Kafka | Kubernetes | Observability | PySpark | Python | REST API | SQL | Serverless architecture | System design | Terraform | Unit Testing | “as-code”
Education
N/A
Related jobs
-
Senior Staff AI Engineer INR 2500K-5000KAWS | Agents | Azure | Code Quality | Code Quality AutomationRelocation assistanceSenior-level Full TimeBengaluru, India6h ago
-
Senior GenAI Data Integration Engineer INR 3000K-5000KApp Engine | BigQuery | Cloud Functions | Cloud Run | Function CallingSenior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeIN-MH-Pune14h ago
-
Senior-level Full TimeIN-HR-Gurgaon14h ago
-
Mid-level Full TimeBengaluru, Karnataka14h ago
-
Mid-level Full TimeBengaluru, Karnataka14h ago
-
Associate Engineer - Data Engineer pyTorch INR 980K-1500KData Pipelines | Data Transformation | Data cleaning | ETL | Feature EngineeringMid-level Full TimeBangalore - Karnataka, India - Kalyani …14h ago
-
Senior Manager INR 3000K-5000KFeature Engineering | Hugging Face | Hugging Face Transformers | Intent detection | Language ProcessingSenior-level Full TimeGurugram, Haryana, India15h ago
-
Agile | Agile delivery | CI/CD | Cloud platform | DashboardsMid-level Full TimePune, Maharashtra, India R16h ago
-
Senior-level Full TimeBangalore, Karnataka, India16h ago
-
Data Devops lead/Associate Director, Data and Analytics INR 650K-1100KAI/ML | Agentic AI | Agile | Apache Airflow | Apache HadoopMid-level Full TimeHyderabad, Telangana, India R16h ago
-
Executive-level Full TimeBangalore, Karnataka, India16h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2500KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India18h ago
-
Mid-level Full TimeBengaluru, Karnataka, India18h ago
-
Scientist 4, Data Science INR 3700K-5000KAWS | Azure | Causal Inference | Deep learning | Distributed ComputingSenior-level Full TimeBengaluru, KA, India18h ago
-
Data Engineer INR 3000K-4000KAI machine learning | Cortex AI | Data Modeling | Machine Learning | Performance TuningSenior-level Full TimePune, Maharashtra, India18h ago
-
Engineer - Data Science INR 2500K-4000KAgile | Anomaly Detection | Azure IoT | Azure IoT Hub | Azure Machine LearningSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101318h ago
-
Sr. AI / ML Engineer – OpenAI Expert INR 2500K-5000KAI Search | Agent systems | Agentic AI | Agents SDK | Assistants APISenior-level Full TimePune, Maharashtra, India18h ago
-
Principal Platform Engineer-Databricks INR 3000K-4000KAWS | Automation | Azure | CI/CD | ComplianceCareer growth | Engineering culture focused on innovation | Global collaboration | Mission-driven workSenior-level Full TimeBangalore, Karnataka, IN19h ago
-
AI Analyst INR 180K-180KAI Foundry | Agent architecture | Autogen | Azure AI | Azure AI FoundryEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Paid parental leaveEntry-level Full TimeCHANDIGARH, CHANDIGARH, India20h ago
-
Knowledge Graph, Graph DB, Python/Senior Consultant Specialist INR 3000K-4200KAgile methodology | Amazon Neptune | Data Governance | Data Lineage | Data ModelingContinuous professional development | Flexible working | Inclusive workplace | Opportunities for growthSenior-level Full TimeHyderabad, Telangana, India R20h ago
-
Senior Associate — Data Scientist, Applied AI/ML INR 1400K-2800KAWS | Agentic Workflows | Alerting | Azure | CI/CDMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Lead Data Platform Engineer INR 3000K-4000KAWS Glue | AWS Lake Formation | AWS Lambda | AWS SageMaker | AWS SageMaker Unified StudioFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India21h ago
-
Data Scientist- Air Quality INR 1400K-1800KAirflow | Ansible | Apache Spark | CI/CD | Code reviewHealth and safety support | Hybrid work model | Mentoring | Professional developmentMid-level Full TimeNoida, Uttar Pradesh, India21h ago