Data Warehouse Engineer
Tasks
- Create runbooks and troubleshooting guides
- Design and build Azure Data Factory pipelines for ETL and ELT
- Design build and operate Azure data platform
- Implement data validation reconciliations and anomaly detection
- Implement incremental loads CDC idempotent retries and error handling
- Ingest batch and incremental data from file and API sources
- Integrate Microsoft Purview for data lineage and catalog
- Maintain data dictionary and metadata with PII tags
- Monitor Azure pipelines and respond to incidents
- Optimize Azure Synapse cost and performance
- Optimize pipeline performance data freshness and query runtimes
- Perform root cause analysis and drive corrective actions
- Support BI users with SQL and Power BI connectivity
- Support PCI DSS and SOC 2 security reviews
- Triage resolve data integration failures
- Write and optimize T SQL in Azure Synapse SQL pools
Perks/Benefits
- 401k match
- Career development and advancement
- Employer sponsored dental insurance
- Employer sponsored health insurance
- Employer sponsored vision insurance
- Paid Holidays
- Paid sick leave
- Paid time off
- Remote work option
Skills/Tech-stack
ARM Templates | Anomaly Detection | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2 | Azure DevOps | Azure Monitor | Azure Synapse | Azure Synapse Analytics | Bicep | CDC | CI/CD | Data Catalog | Data Factory | Data Lake Gen2 | Data Lineage | Data Modeling | Data Quality | Data Validation | Dimensional Modeling | Error Handling | Git | IaC | Idempotent Processing | Incremental loading | Indexing | KQL | Key Vault | Log Analytics | Managed Identity | Microsoft Purview | Partitioning | Power BI | Private Endpoints | Private Link | Query Optimization | RBAC | Reconciliation | SCD Type-2 | SQL | Snowflake Schema | Star Schema | Statistics | Synapse Analytics | T-SQL | Terraform | Type 2) | Virtual Networks | Workload management
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23d ago
-
Data Engineer USD 91K-114KANSI SQL | API | Amazon Redshift | Apigee | Azure401k with company match | Bereavement leave | Employee assistance program | Employee discount program | Family planning benefitsMid-level Full TimeRemote - Nationwide, United States R20h ago
-
Senior Data Engineer USD 111K-139KAPI Integration | Amazon Redshift | Apigee | Azure | BI Publisher401k match | Bereavement leave | Dental insurance | Employee assistance program | Employee discountsSenior-level Full TimeRemote - Nationwide, United States R20h ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R1d ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Data Engineer USD 160K-200KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Continuing education support | Employee assistance program | Flexible spending accounts | Generous paid time offSenior-level Full TimeAuburn Hills, MI, US R1d ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R1d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 115K-175KAWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAACharitable giving program | Company-Paid Holidays | Dental insurance | Flexible PTO | Life insuranceSenior-level Full TimeMassachusetts - Boston R1d ago
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R1d ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild401k | PTO | Paid Company Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache HudiContinuing education | Dental insurance | FSA | HSA | Health insuranceSenior-level Full TimeRochester, MN, United States R1d ago
-
AI Engineer II USD 125K-145KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | Amazon APICareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid HolidaysMid-level Full TimeRemote US R1d ago
-
Apache Airflow | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Kafka StreamsContinuing education | Dental insurance | Flexible spending account | Health savings account | Medical insuranceSenior-level Full TimeRochester, MN, United States R1d ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R1d ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI strategy | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Paid leave | RetirementSenior-level Full TimeHanover, MD R1d ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R2d ago
-
Principal Data Engineer USD 190K-210KAmazon Kinesis | Containerization | Helm | Infrastructure as Code | JuliaEquity | In person office hubs | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R2d ago
-
Principal Software Engineer, Data USD 190K-210KAmazon Kinesis | Containerization | Data Engineering | Event Processing | HelmEquity | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R2d ago
-
AWS | Agile | Apache Hive | Apache Spark | Cloudera Data PlatformRemote workSenior-level ContractLincoln, United States R2d ago
-
Middle Data Engineer (Azure Databricks) USD 160K-223KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimeMadrid, MD, Spain R2d ago
-
Senior AI Engineer USD 155K-175KAWS | Agile | Azure | Computer Vision | GitCareer development | High responsibility | Remote workSenior-level Full TimeJersey City, New Jersey, United States R2d ago
-
Senior Data Engineer, Platform USD 116K-146KAWS | AWS DMS | Airflow | CI/CD | CloudFormationBonus | Equity | Health benefitsSenior-level Full TimeRemote - US, United States R2d ago
-
AI Engineer (Data Intelligence Analyst) - Remote USD 110K-160KAnomaly Detection | Automation | Azure | Azure Fabric | Data GovernanceRemote workMid-level Full TimeLocation Los Angeles, California, United States R2d ago