Senior Azure Data Engineer
Springfield, IL - Remote
R
USD 120K-150K (estimate) Senior-level Contract Full Time
Tasks
- Define coding standards and release management
- Design and build data ingestion pipelines
- Design dimensional and data vault models
- Develop ELT workflows with pushdown
- Develop and optimize PySpark notebooks
- Implement CI/CD for data pipelines
- Implement medallion architecture
- Implement slowly changing dimensions and change data capture
- Instrument pipelines with logging monitoring and auditing
- Lead legacy to cloud migrations
- Perform workload assessment capacity planning and cost modeling
- Provide production incident response
- Tune Synapse distributed SQL workloads
Perks/Benefits
- N/A
Skills/Tech-stack
ARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Monitor | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Change Data Capture | Common table expressions | Data Capture | Data Factory | Data Lake Storage Gen2 | Data Vault | Databricks | Dedicated SQL Pool | Delta Lake | Dimensional Modeling | ELT | Entra ID | Execution Plan | Execution Plan Analysis | KQL | Key Vault | Kimball | Log Analytics | Managed Identities | Microsoft Fabric | Pandas | Parquet | Performance Tuning | Plan analysis | Private Endpoints | Private Networking | PySpark | Pytest | REST API | SQL Performance | SQL Performance Tuning | SQL Pool | Serverless SQL | Serverless SQL Pool | Service principals | Slowly Changing Dimensions | Spark Pools | Synapse Analytics | T-SQL | Terraform | Unit Testing | Unity Catalog | VNet integration | Window Functions
Education
N/A
Roles
Related jobs
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAWS | Airflow | Alerting | Apache Spark | Compute OptimizationComprehensive benefits | Equity | Hybrid/Remote flexibilitySenior-level Full TimeSan Francisco, CA R11h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA; Los Angeles, California, … R13h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA; San Francisco, California, … R13h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | Cloud Composer | Cloud DataStream | Cloud Dataflow401k retirement program | Dental insurance | Disability insurance | Employer 401k match | Flexible time offMid-level Full TimeLisle, IL, United States R16h ago
-
Continuous Delivery | Continuous integration | Databases | DevOps | DockerFlexible scheduling for students | Fully remote work | Online teaching toolsMid-level Full TimeChur, Institut für Data Analysis, Artificial … R20h ago
-
Forward Deployed AI Engineer – Claude 2026 - US USD 200K-305KAPIs | AWS | Access Control | Agents | AnthropicRemote work within the USMid-level Full TimeAtlanta, GA - Remote R1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Artificial IntelligenceDental insurance | Employee assistance program | Health coaching program | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
AI Services | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AICareer advancement | Certification opportunities | Exposure to cutting-edge technologies | Mentorship programs | Ongoing trainingMid-level Full TimeUnited States - Remote R1d ago
-
AI/ML Engineer - Higher Ed USD 101K-163KAWS Bedrock | AWS Lambda | Amazon ECS | Amazon SageMaker | Anthropic APIMid-level Full TimeVirtual US IL, United States R1d ago
-
AI/ML Engineer - School USD 101K-163KAWS Bedrock | AWS Lambda | Amazon ECS | Amazon SageMaker | Anthropic APIMid-level Full TimeVirtual US IL, United States R1d ago
-
Automatic Clustering | CI/CD | DBT | Data Modeling | Data WarehousingHybrid work schedule | Onsite 3 days per weekSenior-level ContractTrenton, NJ R1d ago
-
Senior Staff Data Engineer USD 225K-290KAI | Alerting | Astronomer Airflow | BigQuery | Blameless postmortemsFlexible work environment | Inclusive culture | Stakeholder mindsetSenior-level Full TimeU.S. - California, United States R1d ago
-
API | Agile | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid workMid-level Full TimeBoston, MA R1d ago
-
Data Engineer/Data Scientist USD 53K-106KAPIs | Amazon S3 | Auto Loader | Automated testing | CI/CDFlexible time off | Learning and developmentEntry-level Full Time999 REMOTE, United States R1d ago
-
API Development | Apache Spark | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid workMid-level Full TimeBoston, MA R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code reviewCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior Learning Data Visualization Engineer USD 80K-110KAPI Integration | Azure Synapse | Azure Synapse Analytics | Data Governance | Data ModelingOccasional travel | Remote workSenior-level Full TimeRemote US, United States R1d ago
-
Full Stack Engineer, Experimentation USD 145K-235KAWS | Agile | Azure | CI/CD | Design PatternsDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R1d ago
-
Senior Data Engineer, Knowledge & Information USD 153K-238KAWS | Alerting | Apache Airflow | Apache Spark | CI/CD401k company match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeUnited States R1d ago
-
Staff AI Engineer USD 170K-220KAPI Development | API Integration | Anthropic API | Artificial Intelligence | Backend Development401k match | Commuter benefits | Employee assistance program | Flexible spending accounts | Gym Fitness Discount ProgramSenior-level Full TimeRemote- US R1d ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R1d ago
-
Senior, ML Engineer - Auto Tagger USD 177K-212KAWS | Apache Arrow | Apache Beam | Apache Spark | Cloud platform401k match | Company holiday office closures | Company-paid medical, dental & vision | Disability insurance | Flexible scheduleSenior-level Full TimeAnn Arbor, MI, Remote - US R1d ago
-
Senior AI Engineer USD 160K-250KAPI Design | Agent Orchestration | Agent systems | Audit Logging | Authentication401k eligibility | Flexible work environment | Hybrid work option | Paid time off | Parental leave eligibilitySenior-level Full TimeUnited States (Remote) R1d ago
-
Software Engineer II, Computational Platform USD 124K-154KAPIs | AWS | Cloud Networking | Data Modeling | Docker401k plan | Commuter support | Company-provided laptop | Flexible paid time off | Holiday payMid-level Full TimeRemote; Watertown, Massachusetts, United States R1d ago
-
Senior-level Full TimeRemote - United States R1d ago