Senior Azure Data Engineer
USD 120K-150K (estimate) Senior-level Contract Full Time
Tasks
- Define coding standards and release management
- Design and build data ingestion pipelines
- Design dimensional and data vault models
- Develop ELT workflows with pushdown
- Develop and optimize PySpark notebooks
- Implement CI/CD for data pipelines
- Implement medallion architecture
- Implement slowly changing dimensions and change data capture
- Instrument pipelines with logging monitoring and auditing
- Lead legacy to cloud migrations
- Perform workload assessment capacity planning and cost modeling
- Provide production incident response
- Tune Synapse distributed SQL workloads
Perks/Benefits
- N/A
Skills/Tech-stack
ARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Monitor | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Change Data Capture | Common table expressions | Data Capture | Data Factory | Data Lake Storage Gen2 | Data Vault | Databricks | Dedicated SQL Pool | Delta Lake | Dimensional Modeling | ELT | Entra ID | Execution Plan | Execution Plan Analysis | KQL | Key Vault | Kimball | Log Analytics | Managed Identities | Microsoft Fabric | Pandas | Parquet | Performance Tuning | Plan analysis | Private Endpoints | Private Networking | PySpark | Pytest | REST API | SQL Performance | SQL Performance Tuning | SQL Pool | Serverless SQL | Serverless SQL Pool | Service principals | Slowly Changing Dimensions | Spark Pools | Synapse Analytics | T-SQL | Terraform | Unit Testing | Unity Catalog | VNet integration | Window Functions
Education
N/A
Roles
Related jobs
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | DHCP | DNSDental insurance | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsMid-level Full TimeSeattle, Washington, United States R17h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch Processing | ChunkingCommunity of Practice | Hybrid work schedule | Mentorship opportunitiesSenior-level Full TimeHartford CT- Home Office, United States R17h ago
-
APIs | AWS ECS | AWS Lambda | AWS S3 | AgentsSenior-level Full TimeOffice Location or Remote - USA R20h ago
-
API Development | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R20h ago
-
Principal Embedded Software Engineer USD 180K-220KARM | ARM-based SoCs | Board Support | Board Support Package | C#Hybrid schedule | Onsite days Monday Wednesday ThursdaySenior-level Full TimeLos Angeles R20h ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R22h ago
-
Airflow | CI/CD | DBT | Databricks | GitQuarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R23h ago
-
Senior Data Engineer I USD 119K-201KApache Airflow | Dagster | Data Modeling | Data orchestration | ETLHealth insurance | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R23h ago
-
Lead Software Engineer USD 121K-155KCI/CD | CodeWhisperer | Docker | ETL | GitHub CopilotFlexible hybrid work model | Health and life insurance | Paid time off | Personal and family care leave | Retirement benefitsSenior-level Full TimeJersey City, NJ, United States R23h ago
-
Senior Cloud Engineer USD 140K-204KAWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Lake FormationFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R1d ago
-
Machine Learning PhD Intern, Economics (Fall) USD 100K-125KApplied Econometrics | Causal Inference | Experimental data | Keras | Observational dataFlexible work location | In-person events | Remote workEntry-level InternshipUnited States - Remote R1d ago
-
Data Engineer USD 120K-160KAWS | Apache Airflow | DBT | Data Warehousing | ELT401k plan | Commuter benefits | Employee Meals Snacks | FSA | Flexible time offSenior-level Full TimeLos Angeles; New York; Remote; San … R1d ago
-
Data Engineer - Data & Analytics USD 150K-205KAWS | Airflow | Amplitude | BigQuery | CI/CD401k match | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceMid-level Full TimeUnited States R1d ago
-
Quantum Software Engineer II USD 103K-154KCUDA-Q | Cirq | Debugging | End to End | End-to-End TestingMid-level Full TimeHybrid (New Haven, CT, US) R1d ago
-
Lead Data Engineer - Data Platform Engineering (Hybrid) USD 130K-165KApache Airflow | Apache Hadoop | Apache Spark | BigQuery | Cloud Healthcare APIHybrid work environmentSenior-level Full TimeMelville, Suffolk, United States R1d ago
-
Senior Applied AI Engineer USD 160K-210KAPI Design | AWS | CI/CD | Circuit Breakers | DockerDynamic work environment | Flexible working hoursSenior-level Full TimeUS - Remote, Canada - Remote R1d ago
-
Data Engineer with Python and React - Remote USD 105K-120KAWS | Airflow | Azure | Data Modeling | Data WarehousingRemote workSenior-level Full TimeJersey City, New Jersey, United States R1d ago
-
Senior Data Engineer (Hybrid Eligible*) USD 135K-173KAPI Integration | Access Control | CI/CD | Change Data Capture | Cost Optimization401k plan | Bonus programs | Employee assistance programs | Health insurance | Life and AD D InsuranceSenior-level Full TimeSeattle, WA, United States R1d ago
-
Principal Data Engineer USD 141K-166KAWS | Agile | Amazon Web Services | CI/CD | ConfluenceRemote work within United StatesSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
Senior-level Full TimeUS - VA - Remote, United … R1d ago
-
AI Engineer USD 66K-145KAWS | Azure | CI/CD | Deep learning | DockerHealth benefits | Home-based work | Paid time off | Retirement contributionsMid-level Full TimeUS - VA - Remote, United … R1d ago
-
Analytics Engineer, AV Safety Engineering USD 160K-250KAccess Management | CI/CD | Cloud Computing | Containerization | Data PipelinesFlexible work location with commute requirement | Remote workSenior-level Full TimeWork From Home - United States, … R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | CachingMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AWS | Ansible | Azure | CAD Integration | CI/CDMid-level Full TimeUnited States - Remote R1d ago