Data Engineer (AWS, Azure & Microsoft Copilot Studio)
Tasks
- Automate build, test, deployment, and release processes
- Build data ingestion frameworks
- Build knowledge grounded enterprise search and retrieval solutions
- Create workflow automation with Power Automate and Power Platform
- Design ETL ELT data pipelines
- Design batch and real time processing solutions
- Develop Copilot Studio AI agents and enterprise integrations
- Develop and optimize data models
- Implement AWS data solutions with security and monitoring
- Implement Azure data solutions with security and monitoring
- Implement CI CD pipelines for data engineering and AI solutions
- Implement data quality checks reconciliation and governance controls
- Implement retrieval augmented generation for AI responses
- Integrate large language models with enterprise data and APIs
- Manage data lineage metadata and governance
- Support data lake lakehouse and cloud data warehouse initiatives
- Troubleshoot pipeline failures performance issues and data quality defects
- Use infrastructure as code with Terraform or Bicep
Perks/Benefits
Skills/Tech-stack
AI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access Management | Agile | Amazon Athena | Amazon EventBridge | Amazon Redshift | Amazon S3 | Azure AI | Azure AI Foundry | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Functions | Azure OpenAI | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Copilot Studio | Cosmos DB | Data Factory | Data Governance | Data Lake | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Monitoring | Data Quality | Data Warehousing | ELT | ETL | FinOps | Git | GitHub Actions | Identity and Access Management | Infrastructure as Code | Lakehouse | Language Models | Large Language Models | Microsoft Copilot | Microsoft Copilot Studio | Microsoft Dataverse | Microsoft Fabric | Microsoft Power | Microsoft Power Platform | Power Automate | Power Platform | Prompt engineering | PySpark | Python | REST API | Retrieval-Augmented Generation | SQL | Scrum | Snowflake | Spark SQL | Synapse Analytics | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, IN2h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN2h ago
-
Entry-level Full TimeHyderabad5h ago
-
Oracle AI Developer INR 2475K-3465KAzure DevOps | LLM integration | Langchain | Langgraph | Language ModelsSenior-level Full TimeGurugram, HR, IN8h ago
-
Senior Data Engineer, BizTech INR 2940K-4170KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India8h ago
-
Mid-level Full TimeGurgaon, HR, India8h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad9h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India9h ago
-
Lead Data Scientist-(VLM-Multimodal AI ,CV, Deep Learning) INR 4000K-5500KComputer Vision | Distributed Training | Embeddings | Faiss | Fine TuningCollaborative inclusive work environment | Employee wellness programs | Flexible-hybrid work | Learning and growth opportunities | Performance-based bonusSenior-level Full TimeMumbai, India9h ago
-
Sr Software Engineer (C++, Edge AI) INR 3242K-4460KBenchmarking | C++ | CPU Utilization | CUDA | Computer VisionCareer development | Continuous learning | Flexible work arrangements | Work-life balanceSenior-level Full TimeMumbai, India9h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN13h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN13h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …13h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India13h ago
-
Trainee - AI/ML Job INR 900K-900KData Structures | Machine Learning | NumPy | Pandas | PythonAgile collaboration | Continuous learning culture | Flexible work arrangements | Inclusive team environment | Supportive workplaceEntry-level Full TimeHyderabad, IN13h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore13h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN13h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4580KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access ManagementSenior-level Full TimeBangalore, KA, IN13h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
Azure Databricks Lead INR 2000K-2800KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
Azure Databricks Developer INR 1500K-2200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Batch ProcessingMid-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN13h ago
-
Azure Databricks Lead INR 2000K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactorySenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
IN_Senior Associate_AL/ML Developer _D&A_Advisory _Noida INR 2500K-4500KAI Pipelines | API Gateway | AWS | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago
-
Product Engineer II - Geospatial Data Science INR 1500K-2400KAgile | ArcGIS | Arcpy | Deep learning | GDALMid-level Full TimeNew Delhi, Delhi, India16h ago