Senior Azure Data Platform Engineer
Tasks
- Administer Azure SQL Managed Instance and Azure SQL databases
- Analyze execution logs and metrics
- Automate operational workflows for validation monitoring and remediation
- Contribute to CI CD practices for data platform deployments
- Coordinate with stakeholders and vendors to resolve issues and risks
- Design build and maintain ADF pipelines for batch and incremental loading
- Develop automation with Python or PowerShell
- Diagnose locking blocking and concurrency issues
- Implement backup, recovery, and high availability
- Implement durable repeatable fixes for pipeline failures
- Manage database schema changes with Azure DevOps
- Manage database security user access and role permissions
- Monitor schedule and handle ADF pipeline failures
- Own end to end data loading process from ingestion to validation
- Set up monitoring alerting and operational discipline
- Stabilize and standardize existing data pipelines
- Troubleshoot pipeline integration issues and performance bottlenecks
- Tune database performance
- Version and promote ADF pipelines
Perks/Benefits
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure DevOps | Azure SQL | Azure SQL Database | Azure SQL Managed Instance | Backup and Recovery | CI/CD | Concurrency Control | Data Factory | Data Pipeline Engineering | Data pipeline | Database performance | Database performance tuning | Database security | Execution Plans | High Availability | Indexing | Locking and Blocking | Managed Instance | Monitoring and Alerting | Performance Tuning | Pipeline engineering | Powershell | Python | Query Execution | Query Optimization | Query execution plans | Role-Based Access | Role-Based Access Control | SQL | SQL Database | SQL Managed Instance | SQL Query Optimization | SQL query
Education
N/A
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R29d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R29d ago
-
Senior AI & ML Engineer USD 194K-228KAPIs | Agent Orchestration | Agent routing | Agents SDK | Cloud infrastructureSenior-level Full TimeUnited States - Remote R17h ago
-
Senior MLOps Engineer (Full Remote from France) EUR 55K-70KArgoCD | Bash | BigQuery | CI/CD | Cloud StorageFull remote workSenior-level Full TimeParis, IDF, France R18h ago
-
Data Engineer PHP 420K-480KAPI Development | AWS | Amazon Web Services | Apache Airflow | Apache SparkGlobal Training Network | Health insurance | Mentorship | Sports discount | Sports voucherMid-level Full TimeAlabang, Philippines (Hybrid) R20h ago
-
Ingénieur de recherche Bioinformatique EUR 30K-34KATAC sequencing | Clustering | Comparative Genomics | High Performance | High-Performance ComputingFamily health insurance | Meal benefits | RTT benefits | Sports facilities | TeleworkEntry-level Full TimeFrance, Paris R21h ago
-
Access Control | Ansible | Apache Spark | CI/CD | CPU Resource ManagementConcierge services | Employee representative council support | Employee savings plan | Meal benefits | Paid leaveEntry-level Full TimeDAM Île-de-France R22h ago
-
Ansible | Apache Spark | CI/CD | CPU Scheduling | CompliancePaid leave | TeleworkEntry-level Full TimeDAM Île-de-France R22h ago
-
AI Savvy Data Analyst MXN 480K-480KAnomaly Detection | Cloud APIs | Data Governance | Data Management | Data ModelingAdditional day off for birthday | Competitive benefits package | Flex days | Flexible work hours | Remote workMid-level Full TimeGuadalajara, Jalisco, Mexico R22h ago
-
AI Savvy Data Analyst USD 127K-220KAnomaly Detection | Cause analysis | Cloud APIs | Colab | Data GovernanceAdditional day off for birthday | Competitive benefits package | ESG focused company | Flex days between Christmas and New Year | Flexible work hoursMid-level Full TimeDenver, CO, United States R23h ago
-
Generative AI / Sr. Associate Director, Tech SME INR 1400K-2200KAWS | Active Directory | Ansible | Azure | CI/CDMid-level Full TimePune, Maharashtra, India R23h ago
-
Databricks SME (Subject Matter Expert) USD 180K-247KAmazon Web Services | Apache Spark | Azure | CI/CD | Cloud platformCareer advancement | Flexible remote work | Professional development | Supportive work environmentSenior-level ContractRemote R1d ago
-
Data SME (Subject Matter Expert) USD 125K-155KAmazon Web Services | Business Intelligence | Cloud platform | Data Architecture | Data CleansingCareer advancement | Flexible working conditions | Professional development | Remote work | Supportive work environmentSenior-level ContractRemote R1d ago
-
Azure Data engineer con inglés alto. EUR 30K-35KAzure Data | Azure Data Factory | Data Factory | Databricks | Microsoft AzureEnglish communication | Remote workEntry-level Full TimeMadrid, MD, Spain R1d ago
-
Tech Lead DataOps EUR 46K-60KAgile | Alerting | Apache Airflow | Automation | CI/CDAgile environment | Career growth | Fully remote | Multicultural teamSenior-level Full TimeMálaga, AN, Spain R1d ago
-
AWS | Azure | CI/CD | CircleCI | CloudFormationCareer growth | Collaborative innovation driven engineering culture | Continuous learning | Fully remote friendly work environment | MentorshipSenior-level Full TimeIndia R1d ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Apache Spark | CI/CD | Cloud platform | DBT | DatabricksDental insurance | Education Discounts | Fully remote work | Health insurance | Healthcare service discountsSenior-level Full TimeBrazil R1d ago
-
Applied AI Engineer | $150K-$175K + Hybrid + Equity | High Growth AI Operational Intelligence Startup A USD 150K-175KAI Agents | AI orchestration | APIs | LLM | Model EvaluationEquity | Health medical and vision coverage | Hybrid work | One day per week onsite | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
Associate AI Engineer (Entry Level) USD 100K-110KAPI Development | AWS | Agentic AI | Autogen | AzureEntry-level Full TimeRemote, Remote R1d ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIIndependent contractor arrangement | International collaboration | Remote workSenior-level Full TimeRemote R1d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R1d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R1d ago