Senior Data Engineer - Data & AI Platform
Tasks
- Build customer data onboarding services with governance
- Build platform automation tooling and templates
- Collaborate on end to end solutions with software and AI teams
- Contribute to technical design reviews and architecture decisions
- Design and build scalable data pipelines
- Design batch and streaming data workflows
- Develop reusable ingestion transformation and serving patterns
- Enable standardized deployment and operational workflows
- Ensure reliability observability data quality and performance
- Implement CI CD practices testing strategies and runbooks
- Implement data modeling schema management and performance optimization
- Monitor and troubleshoot production pipelines with root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | CI/CD | Cloud Storage | Data Modeling | Data Quality | Databricks | Distributed Systems | ELT | ETL | Incident Response | Monitoring | Observability | Python | SQL | Schema evolution | Testing | Version control
Education
Roles
Related jobs
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data ProcessingMid-level Full TimePune, Maharashtra, India R6h ago
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India7h ago
-
Senior-level Full TimeBangalore, IN8h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
Senior Consultant INR 2000K-2700KAzure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data LakeSenior-level Full TimeIN-KA-Bangalore8h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000KAPIs | Automation | Cause analysis | Incident Management | JavaSenior-level Full TimeIndia11h ago
-
Assistant Manager-KDNI INR 1500K-2000KAgile | Apache Spark | Azure | Azure Data | Azure Data FactoryMid-level Full TimeHyderabad, Telangana, India11h ago
-
Senior Data Systems Software Engineer INR 3264K-5572KAPI Integration | APIs | Agentic AI | C# | C++Senior-level Full TimeBENGALURU, KARNATAKA, India12h ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN13h ago
-
Senior AI Solutions Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Autonomous Agents | Data Pipelines | Database ConnectionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN13h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN13h ago
-
Consultant - AI Engineer INR 2500K-5000KAutogen | CI/CD | Cloud infrastructure | Containerization | CrewAISenior-level Full TimeBangalore, Karnataka, India14h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2500K-4400KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS | Agentic AI | Automation | Bitbucket | ConfluenceSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Analytics Modeler INR 1500K-2800KARIMA | Data Visualization | Generative AI | GitHub Copilot | Hypothesis TestingMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS Lambda | Agentic AI | Amazon EC2 | Amazon ECS | Amazon Web ServicesSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Software Development Engineer INR 1430K-2200KAPIs | Agile | Anonymization | Batch Job Scheduling | Batch jobMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
Senior-level Full TimeIndia15h ago
-
Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud RunCareer growth opportunities | Collaborative cross-functional environment | Continuous learning | Flexible or hybrid work arrangements | Health and wellness supportSenior-level Full TimeIndia15h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2500K-4800KAPI Development | Cloud platform | Containerization | Gemini Enterprise | Google ADKSenior-level Full TimeBangalore, Karnataka, India15h ago