Azure Data Engineer - Analyst
Tasks
- Apply Lakehouse layer concepts Bronze Silver and Gold
- Build Python and PySpark transformations
- Contribute to Microsoft Fabric pipelines lakehouse and notebooks
- Develop and maintain ADF pipelines for ingestion and transformation
- Implement incremental and delta loads and error handling
- Ingest data from databases APIs SFTP and SharePoint into ADLS Blob
- Monitor and troubleshoot data pipelines
- Process data across Raw Staging and EDW layers
- Write and optimize SQL queries and stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Blob Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehouse | Delta Loading | Incremental loading | Lakehouse | PySpark | Python | SQL | Stored Procedures
Education
N/A
Roles
Related jobs
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India16h ago
-
Senior Machine Learning Engineer INR 3100K-4500KA/B | A/B Testing | B testing | Cloud Computing | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Consultant Machine Learning Engineer INR 3380K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsMid-level Full TimeBangalore, India R18h ago
-
Entry-level Full TimeBangalore North, India19h ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore19h ago
-
Senior-level Full TimeIN-TN-Chennai20h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India20h ago
-
Azure Data Engineer - Analyst INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeGurugram, India20h ago
-
Entry-level Full TimeHyderabad, Telangana, India21h ago
-
Senior AI Engineer (Agents) INR 2500K-4500KA/B | A/B Testing | API Integration | Agent Assist | B testingEmployee benefits | Flexible work environment | Remote work option | Self-care supportSenior-level Full TimeChennai, India21h ago
-
Business Intelligence Engineer INR 805K-1024KAgile | Dashboard Design | Data Governance | Data Quality | Data VisualizationFlexible hybrid schedule | Health and life insurance | Hybrid work model | Paid time off | Pension and retirement benefitsMid-level Full TimeHyderabad, India22h ago
-
Sr. Snowflake Data Engineer - Risk Technology INR 2500K-4000KClustering keys | ELT | ETL | Micro-partitioning | PythonSenior-level Full TimePune, India22h ago
-
Principle Software Engineer INR 3380K-4600KAPI Gateway | AWS | AWS Lambda | Amazon API | Amazon API GatewaySenior-level Full TimeBangalore22h ago
-
Full Stack Developer INR 1800K-3000KAgents | Agile | CI/CD | Chainlit | Cloud FunctionsCareer growth | Innovation culture | Professional developmentMid-level Full TimeBengaluru, Pune23h ago
-
Cloud Data Engineer INR 1500K-2500KAccess Control | Apache Airflow | Apache Kafka | Azure Bicep | Azure DataProfessional growthMid-level Full TimePune, Bengaluru1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior AI Engineer INR 3125K-5000KAI Studio | AWS Bedrock | AWS SageMaker | Asynchronous programming | AutogenSenior-level Full TimeBangalore, Karnataka, IN1d ago
-
Senior Data Engineer INR 2520K-3380KApache Airflow | Apache Druid | Apache Kafka | Apache Spark | BigQueryApollo health checkups | German English classes | Hybrid work | Internal webinars | Medical insuranceSenior-level Full TimeBangalore, Karnātaka, India1d ago
-
AI Engineer INR 2520K-3880KActive Learning | Azure Cognitive | Azure Cognitive Services | Azure OpenAI | Azure OpenAI ServiceFamily support | Learning and development opportunities | Life Coverage | Medical coverage | Relocation supportSenior-level Full TimeHyderabad, TS, India1d ago
-
Mid-level Full TimePUNE, MAHARASHTRA, India1d ago
-
Entry-level Full TimeBengaluru, KA, IN1d ago
-
Senior Applied AI Engineer INR 3384K-5000KAI orchestration | Context Management | Data Pipelines | Experimentation | Graph DatabasesDonation matching | Flexible PTO | Lunch stipend | Medical coverage | Team building eventsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Solution Engineer INR 1800K-3000KAI API | AI API integration | API Integration | Anthropic | AutomationMid-level Full TimeBangalore, India1d ago
-
ML Engineer - Generalist INR 2500K-4225KData Preprocessing | Data pipeline | Experimentation | Feature Engineering | Machine LearningAnnual learning and development | Health insurance | Inclusive work environment | Parental leave | Remote Team Collaboration SupportSenior-level Full TimeBengaluru, India1d ago
-
Snowflake DBT Developer INR 300K-370KAmazon Redshift | Apache Airflow | Azure Synapse | BigQuery | CI/CDRemote workSenior-level Full TimeMumbai, Maharashtra, India1d ago