Azure Data Engineer - Analyst
Tasks
- Apply Lakehouse layer concepts Bronze Silver and Gold
- Build Python and PySpark transformations
- Contribute to Microsoft Fabric pipelines lakehouse and notebooks
- Develop and maintain ADF pipelines for ingestion and transformation
- Implement incremental and delta loads and error handling
- Ingest data from databases APIs SFTP and SharePoint into ADLS Blob
- Monitor and troubleshoot data pipelines
- Process data across Raw Staging and EDW layers
- Write and optimize SQL queries and stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Blob Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehouse | Delta Loading | Incremental loading | Lakehouse | PySpark | Python | SQL | Stored Procedures
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeChennai, IN, 6000322h ago
-
Mid-level Full TimeChennai, IN, 6000322h ago
-
Applied AI Engineer, Beneficial Deployments INR 2000K-4600KAgent architecture | Benchmarks | Context engineering | Cost Optimization | Evaluation FrameworksFlexible working hours | Generous vacation | Parental leave | Visa sponsorshipSenior-level Full TimeBangalore, India17h ago
-
Scientist 4, Data Science INR 2520K-4600KAWS Glue | AWS Lambda | AWS S3 | Amazon Bedrock | Amazon EKSSenior-level Full TimeBengaluru, KA, India19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai19h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Technical Delivery Manager INR 1317K-2280KAgile | Data Management | Data Warehousing | Data masking | Data subsettingMid-level Full TimeIN-KA-Bangalore19h ago
-
Lead ML Engineer INR 2000K-3800KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, TN, India20h ago
-
Forward Deployed Engineer, GenAI, Google Cloud INR 2500K-5000KAlgorithms | Apache Beam | Apache Hadoop | Apache Spark | C++Embedded customer development | Technical feedback to product roadmap | White glove deploymentSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India20h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4725KAudio generation | Data Processing | Generative AI | Image Generation | Language ModelsSenior-level Full TimeHyderabad, Telangana, India20h ago
-
Forward Deployed Engineer, GenAI, Google Cloud INR 1800K-2500KAPI Integration | Agent systems | CrewAI | Data Pipelines | Deep learningMid-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India20h ago
-
Senior Software Engineer, Applied AI, Vertex AI Search INR 2500K-4500KC++ | Data Structures | Data Structures and Algorithms | Debugging | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Software Engineer II (Data Platform) INR 1200K-1600KAlerting | Apache Spark | CI/CD | Data Governance | Data QualityDental insurance | Flexible time off | Medical insurance | Paid parental leave | Remote-first teamsMid-level Full TimeIndia (Remote-First) R21h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN21h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R21h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Amazon OpenSearch | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R21h ago
-
Junior GenAI Developer INR 600K-900KAWS | Agentic Workflows | Chroma | Embeddings | FaissCompany events | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R21h ago
-
Senior-level Full TimeHyderabad - India21h ago
-
AI Engineer - Acon - BLR INR 2500K-4500KAI Search | AI Studio | Agentic Workflows | Application Security | Arize PhoenixSenior-level Full TimeIndia22h ago
-
AI Engineer INR 1500K-2400KAgentic AI | Agile | Apache Spark | Artificial Intelligence | AutomationAccidental insurance | Life insurance | Meal arrangements | Medical insurance | Professional development opportunitiesMid-level Full TimeGurugram, HR, IN22h ago
-
Data Engineer with AI developer INR 2000K-2800KAPIs | AWS SageMaker | Azure Data | Azure Data Factory | Azure Machine LearningSenior-level Full Timebangalore, India23h ago
-
Member of Technical Staff INR 2500K-4500KAutomated testing | Batching | CI/CD | Caching | Cloud infrastructureSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior - Data and App Modernization INR 2500K-3500KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationSenior-level Full TimeGurgaon, Haryana, India1d ago