Azure Data Engineer - Analyst
Tasks
- Apply Lakehouse layer concepts Bronze Silver and Gold
- Build Python and PySpark transformations
- Contribute to Microsoft Fabric pipelines lakehouse and notebooks
- Develop and maintain ADF pipelines for ingestion and transformation
- Implement incremental and delta loads and error handling
- Ingest data from databases APIs SFTP and SharePoint into ADLS Blob
- Monitor and troubleshoot data pipelines
- Process data across Raw Staging and EDW layers
- Write and optimize SQL queries and stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Blob Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehouse | Delta Loading | Incremental loading | Lakehouse | PySpark | Python | SQL | Stored Procedures
Education
N/A
Roles
Related jobs
-
Senior Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India10h ago
-
Junior Professional AE Engineer INR 180K-180KAzure Cloud | Copilot Studio | Docker | Git | KubernetesEntry-level Full TimeMorinda, India10h ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R13h ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R13h ago
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India17h ago
-
Staff Machine Learning Engineer INR 2600K-5000KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Bias detectionSenior-level Full TimeBangalore17h ago
-
Staff Data Engineer INR 3200K-4600KAgentic Workflows | Airflow | Argo | Data Modeling | Data QualitySenior-level Full TimeBangalore17h ago
-
Senior Machine Learning Engineer INR 3100K-4500KA/B | A/B Testing | B testing | Cloud Computing | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Senior Analytics Engineer INR 2940K-4170KAmazon Redshift | BigQuery | Data Modeling | Data Transformation | Data WarehousingCommunity benefits | Family benefits | Finance benefits | Health benefits | Relocation supportSenior-level Full TimeHyderabad - Main Office18h ago
-
Consultant Machine Learning Engineer INR 3380K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsMid-level Full TimeBangalore, India R20h ago
-
Business Intelligence Data Engineer INR 1524K-3000KAWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon RedshiftMid-level Full TimeHyderabad India20h ago
-
Senior-level Full TimePune, MH, India21h ago
-
Entry-level Full TimeBangalore North, India21h ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India21h ago
-
AI Solutions Specialist INR 1200K-1800KData Monitoring | Data Pipelines | Data Preparation | Experimentation | Language ModelsCellphone reimbursement | Corporate wellness programs | Daycare/Creche facility | Great Place to Work certification | Headspace reimbursementMid-level Full TimePune, Maharashtra, India22h ago
-
Azure Data Engineer - Analyst INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeGurugram, India22h ago
-
Entry-level Full TimeHyderabad, Telangana, India22h ago
-
Senior AI Engineer (Agents) INR 2500K-4500KA/B | A/B Testing | API Integration | Agent Assist | B testingEmployee benefits | Flexible work environment | Remote work option | Self-care supportSenior-level Full TimeChennai, India23h ago
-
Business Intelligence Engineer INR 805K-1024KAgile | Dashboard Design | Data Governance | Data Quality | Data VisualizationFlexible hybrid schedule | Health and life insurance | Hybrid work model | Paid time off | Pension and retirement benefitsMid-level Full TimeHyderabad, India23h ago
-
Sr. Snowflake Data Engineer - Risk Technology INR 2500K-4000KClustering keys | ELT | ETL | Micro-partitioning | PythonSenior-level Full TimePune, India23h ago
-
Principle Software Engineer INR 3380K-4600KAPI Gateway | AWS | AWS Lambda | Amazon API | Amazon API GatewaySenior-level Full TimeBangalore1d ago
-
Full Stack Developer INR 1800K-3000KAgents | Agile | CI/CD | Chainlit | Cloud FunctionsCareer growth | Innovation culture | Professional developmentMid-level Full TimeBengaluru, Pune1d ago
-
Cloud Data Engineer INR 1500K-2500KAccess Control | Apache Airflow | Apache Kafka | Azure Bicep | Azure DataProfessional growthMid-level Full TimePune, Bengaluru1d ago