Group Manager - Data Engineering
Tasks
- Build cloud-based data platforms
- Collaborate with stakeholders to deliver data solutions
- Design ETL/ELT pipelines
- Develop batch data processing pipelines
- Develop real-time data processing pipelines
- Ensure data quality governance scalability reliability security
- Integrate generative AI into data platforms
- Lead architecture reviews and mentor engineers
- Optimize BigQuery performance
- Orchestrate workflows with Apache Airflow
- Process structured and unstructured datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Dataflow | Dataproc | ELT | ETL | Generative AI | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Langchain | Language Models | Large Language Models | MLOps | PubSub | PySpark | Python | RAG | Retrieval-Augmented Generation | SQL | Spark | Terraform | Vector Databases | Vertex AI | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Full Stack AI Engineer - 3162 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | Learning and development programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R2h ago
-
AI Practice Lead INR 2000K-4600KAPI Integration | Agent systems | Agentic Systems | Artificial Intelligence | AutogenSenior-level Full TimeShaikpet, India3h ago
-
Mid-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-HR-Gurgaon4h ago
-
AI Developer with Move Framework INR 1800K-2800KAgentic AI | Artificial Intelligence | Chatbot | MCP | MoveworksMid-level Full TimeIN-KA-Bangalore4h ago
-
Senior QA Engineer - GenAI, VoiceAI, Telephony, and IVR testing INR 1800K-3000KAPI Testing | ASR | Automation frameworks | CCaaS | Call Flow TestingSenior-level Full TimeNoida, Uttar Pradesh, India4h ago
-
Mid-level Full TimeBengaluru, Karnataka, India4h ago
-
Elite Software Engineering Pipeline (All Levels) INR 2475K-3500KAWS | Amazon Neptune | Angular | Autogen | Database MigrationHybrid work | Inclusive culture | Structured mentorshipSenior-level Full TimePune, MH, India4h ago
-
3-5 Years Experience in DevOps(MLOps), ML-Python INR 2500K-4225KAngular | DevOps | MLOps | Machine Learning | PythonSenior-level Full Timecoimbatore, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Mid-level Full TimeMumbai, Maharashtra, India5h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2400KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India6h ago
-
Senior AI/ML Engineer I INR 3000K-4000KAzure | Data Pipelines | Distributed Systems | Docker | Fine TuningCertification programs | Education reimbursement program | Employee assistance program | Flexible work options | Health coverageSenior-level Full TimeBangalore, Karnataka, India6h ago
-
DAX | Data Documentation | Data Governance | Data Quality | Data WarehousingAsync first collaboration | Flexible overlap schedule | Remote workSenior-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Entry-level Full TimeIndia7h ago
-
API Gateway | AWS | AWS IAM | AWS Lambda | AgileSenior-level Full TimeMaharashtra, Pune, India R7h ago
-
Mid-level Full TimePune, ASIA, India7h ago
-
Deputy General Manager INR 1500K-2500KAgile | Azure | Cloud Computing | Data Engineering | Data GovernanceSenior-level Full TimeIndia7h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-3500KAI Agents | API Development | Cloud platform | Containerization | Gemini EnterpriseWork from client office 5 days per weekSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeCoimbatore, India8h ago
-
Senior Engineer, AI, Quality Assurance INR 1800K-3000KAgile | Artificial Intelligence | CI/CD | Data Quality | Drift DetectionSenior-level Full TimeChennai, IN8h ago
-
Senior-level Full TimeChennai, IN8h ago
-
Analytics Solution- Associate INR 1640K-2461KAgile | Change Data Capture | Continuous Deployment | Continuous integration | Data CaptureSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Mid-level Full TimeHyderabad, TS, India8h ago