Cloud Data Engineer
Tasks
- Build AI ML data pipelines for feature engineering
- Build integrations with APIs and databases
- Create CI CD pipelines for data engineering
- Deploy AI powered analytics and recommendation systems
- Design data pipelines
- Develop ETL/ELT workflows
- Ensure data quality with validation and monitoring
- Implement data governance and metadata management
- Integrate LLM generative AI with enterprise data sources
- Optimize data storage and query performance
- Perform performance tuning for SQL and Spark jobs
- Provide training and documentation for end-users
- Track data lineage and compliance standards
Perks/Benefits
Skills/Tech-stack
APIs | ARM Templates | Access Control | Alerting | Apache Spark | Azure Data | Azure Data Factory | Azure Resource | Azure Resource Manager | Azure SQL | CI/CD | Capacity Planning | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Security | Data Warehousing | Data integration | Database Design | Databricks | ELT | ETL | Encryption | Feature Engineering | Generative AI | Git | LLM | Lakehouse | Logging | Machine Learning | Metadata Management | Microsoft Azure | Monitoring | Pipeline Orchestration | Python | Resource manager | SQL | Terraform | Version control
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Staff Analytics Engineer - Finance INR 2800K-3465KCI/CD | DBT | Data Governance | Data Modeling | Data QualityHybrid work | On-site onboardingSenior-level Full TimeBengaluru, India2h ago
-
Software Engineer (Data Engineering & Building APIs) INR 1200K-1680KAWS | AWS Lambda | Agile | Algorithms | CI/CDHybrid work environmentMid-level Full TimeGurgaon - Cyber Park, India7h ago
-
Associate Machine Learning Engineer INR 1900K-3000KData Analysis | Machine Learning | Model Deployment | Model DevelopmentMid-level Full TimeMumbai (ex Bombay), IN7h ago
-
Senior Software Engineer I (Databases) INR 2520K-3200KCI/CD | Concurrency | Distributed Systems | Docker | GRPCConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeHyderabad12h ago
-
Data Scientist (R-19247) INR 1500K-2500KAgentic Systems | Anomaly Detection | Confluence | Data Lineage | Data ObservabilityMid-level Full TimeHyderabad - India14h ago
-
Automation Engineer, Data Quality (R-19246) INR 2520K-3880KAirflow | Alerting | Apache Airflow | Automated testing | CI/CDSenior-level Full TimeHyderabad - India14h ago
-
Senior AI Dev Platform Engineer INR 2475K-4725KAWS | AWS EKS | Argo CD | CI/CD | Cloud Cost AttributionHealthcare | Hybrid work model | Internet reimbursement | Learning and development stipend | Phone reimbursementSenior-level Full TimeBengaluru, India16h ago
-
Software Engineer 3 INR 2040K-4000KAWS Glue | Amazon S3 | Apache Airflow | Apache Hive | Apache SparkSenior-level Full TimeGurugram17h ago
-
Solution Architect (AWS, AI, Python) INR 3000K-4000KAWS CDK | AWS CLI | AWS Glue | AWS Lambda | Amazon EMRHybrid work | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India17h ago
-
API Development | CI/CD | ETL | Git | OpenpyxlDistributed team | Work from homeMid-level Full TimeMaharashtra, Pune, India17h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KAI Search | Apache Airflow | Apache Spark | CI/CD | Change Data CaptureEducation budget | Local connection | Remote work | Wellness budgetSenior-level Full TimePune City, India17h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureBudget for education | Budget for wellness | Legal compliance in India | Local connection meetups | Remote workSenior-level Full TimeBangalore North, India17h ago
-
Data Engineer (GCP) ID56375 INR 2400K-3380KApache Airflow | Apache Spark | BigQuery | Bitemporal Modeling | CI/CDCompetitive compensation | Education budget | Local connection | Remote work | Wellness budgetSenior-level Full TimeMumbai, India17h ago
-
Data Engineer (MS) (Indian Citizen only) INR 3000K-4000KCI/CD | Data Quality | Data Validation | Databricks | Date normalizationCollaborative culture | Long-term project stability | Mentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India17h ago
-
Mid-level Full TimeBengaluru; Gurugram18h ago
-
Copilot Studio / Agentic AI Engineer INR 2000K-4000KAI Services | API Integration | Agent Orchestration | Autonomous workflows | AzureSenior-level Full TimeMaharashtra, Pune, India18h ago
-
Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseFlat, non-hierarchical structure | Inclusive culture | Ongoing learning opportunitiesEntry-level Full TimeIndia - Pune18h ago
-
Software Engineer INR 1068K-1910KAzure | Bitbucket | Data Architecture | Data Modeling | Data PipelinesEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India18h ago
-
Gen Ai INR 2500K-5000KAlgorithms | Computer Vision | Data Analysis | Data Preprocessing | Data StructuresSenior-level Full TimeIN-TN-Chennai18h ago
-
AWS GenAI Platform Engineer (Cloud Engineer with AWS + AI) INR 1800K-2700KA/B | A/B Testing | API Gateway | AWS AppSync | AWS CloudMid-level Full TimeIN-TN-Chennai18h ago
-
Mid-level Full TimeIN-AP-Hyderabad18h ago
-
AWS GenAI Platform Engineer (Cloud Engineer with AWS + AI) INR 1800K-2700KA/B | A/B Testing | API Gateway | AWS Agents | AWS Agents for BedrockMid-level Full TimeIN-TN-Chennai18h ago
-
GEN AI Consultant INR 2000K-3000KAI Studio | Azure AI | Azure AI Studio | Azure Cognitive | Azure Cognitive SearchMid-level Full TimeIN-AP-Hyderabad18h ago
-
Gen AI INR 2500K-4500KAWS | Agent systems | Airflow | Asynchronous programming | Attention MechanismsSenior-level Full TimeIN-KA-Bangalore18h ago
-
Mid-level Full TimeIN-KA-Bangalore18h ago