Data Engineer (AWS, Azure & Microsoft Copilot Studio)
Tasks
- Apply data governance controls
- Automate build test deploy using Azure DevOps and GitHub Actions
- Build AWS data solutions with serverless and event driven patterns
- Build Azure data solutions with data factory and synapse
- Build batch and real time processing solutions
- Build reusable data ingestion frameworks
- Design scalable ETL and ELT pipelines
- Develop AI agents with Microsoft Copilot Studio
- Develop and optimize enterprise data models
- Develop workflow automation with Power Automate
- Implement CI CD pipelines for data and AI solutions
- Implement Retrieval-Augmented Generation architectures
- Implement data ingestion and integration across cloud services
- Implement data quality checks and reconciliation
- Integrate Copilot Studio with enterprise data sources
- Manage infrastructure as code with Terraform or Bicep
- Manage metadata and data lineage
- Set up monitoring logging and alerting for pipelines and infrastructure
- Troubleshoot pipeline performance and defects
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access Management | Amazon Athena | Amazon EventBridge | Amazon Redshift | Amazon S3 | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Functions | Azure OpenAI | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Batch Processing | Bicep | CI/CD | Copilot Studio | Data Factory | Data Governance | Data Lake | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Event Driven | Event-driven architecture | Git | GitHub Actions | Identity and Access Management | Lakehouse | Language Model | Large Language Model | Microsoft Copilot | Microsoft Copilot Studio | Microsoft Dataverse | Microsoft Fabric | Microsoft Power | Microsoft Power Platform | Monitoring and Logging | Power Automate | Power Platform | Prompt engineering | PySpark | Python | REST API | Retrieval-Augmented Generation | SQL | SQL Database | Serverless | Spark SQL | Streaming Data | Synapse Analytics | Terraform
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, IN3h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN3h ago
-
Entry-level Full TimeHyderabad5h ago
-
Oracle AI Developer INR 2475K-3465KAzure DevOps | LLM integration | Langchain | Langgraph | Language ModelsSenior-level Full TimeGurugram, HR, IN8h ago
-
Senior Data Engineer, BizTech INR 2940K-4170KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India9h ago
-
Mid-level Full TimeGurgaon, HR, India9h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad9h ago
-
Senior Machine Learning Engineer - Recommendations INR 3000K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Senior-level Full TimeBengaluru, India9h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India9h ago
-
Lead Data Scientist-(VLM-Multimodal AI ,CV, Deep Learning) INR 4000K-5500KComputer Vision | Distributed Training | Embeddings | Faiss | Fine TuningCollaborative inclusive work environment | Employee wellness programs | Flexible-hybrid work | Learning and growth opportunities | Performance-based bonusSenior-level Full TimeMumbai, India9h ago
-
Sr Software Engineer (C++, Edge AI) INR 3242K-4460KBenchmarking | C++ | CPU Utilization | CUDA | Computer VisionCareer development | Continuous learning | Flexible work arrangements | Work-life balanceSenior-level Full TimeMumbai, India9h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN13h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN13h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …13h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India13h ago
-
Trainee - AI/ML Job INR 900K-900KData Structures | Machine Learning | NumPy | Pandas | PythonAgile collaboration | Continuous learning culture | Flexible work arrangements | Inclusive team environment | Supportive workplaceEntry-level Full TimeHyderabad, IN13h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore13h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4720KAI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access ManagementHealthcare life sciences industry focus | Remote workSenior-level Full TimeBangalore, KA, IN13h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN13h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
Azure Databricks Lead INR 2000K-2800KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
Azure Databricks Developer INR 1500K-2200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Batch ProcessingMid-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN13h ago
-
Azure Databricks Lead INR 2000K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactorySenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
IN_Senior Associate_AL/ML Developer _D&A_Advisory _Noida INR 2500K-4500KAI Pipelines | API Gateway | AWS | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago