Data Warehouse Engineer
Tasks
- Build ETL/ELT data pipelines
- Create runbooks and troubleshooting guides
- Design azure data platform pipelines
- Document pipeline architecture and schemas
- Ensure data quality with validation checks
- Implement CDC and incremental loads
- Implement security and governance controls pci dss and soc 2 support
- Integrate sponsor bank data and api sources
- Maintain data dictionary and metadata
- Maintain data lineage and governance with purview
- Monitor azure monitor log analytics and synapse jobs
- Operate data pipelines and ensure uptime
- Optimize query performance and costs
- Perform root cause analysis and post-mortems
- Respond to pipeline incidents
- Support power bi connectivity and refresh scheduling
- Triage data integration failures
- Write and optimize t sql in synapse
Perks/Benefits
- 401k matching
- Career development
- Dental insurance
- Health insurance
- Paid Holidays
- Paid sick days
- Paid time off
- Vision insurance
Skills/Tech-stack
ARM | Anomaly Detection | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2 | Azure DevOps | Azure Monitor | Azure Purview | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Lake Gen2 | Data Lineage | Data Modeling | Data Quality | Data Validation | Dimensional Modeling | ELT | ETL | Git | GitHub Actions | Incremental loading | Indexing | KQL | Key Vault | Log Analytics | Managed Identity | Network Security | Partitioning | Power BI | Private Endpoint | Query Optimization | RBAC | SCD Type-2 | SQL | Statistics | Synapse Analytics | T-SQL | Terraform | Type 2) | Watermarking | Workload management
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
APIs | AWS | CData | Change Data Capture | Cloud Native401k retirement plan | Adoption Assistance | Dental coverage | Education assistance | Employee Learning and DevelopmentSenior-level Full TimeNEO - Tamer Rashid Building OA, … R20h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R21h ago
-
Machine Learning Research Engineer USD 200K-330KAWS | Azure | Benchmarking | CUDA | DDP401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R1d ago
-
Machine Learning Engineer USD 155K-228KAWS | Airflow | Argo CD | Azure | CI/CDGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R1d ago
-
Senior Data Engineer (Databricks) USD 180K-248KAI tools | Agile | Apache Spark | Azure Data | Azure Data Factory401k match | Employee awards | Industry certifications support | Recognition programs | Remote or hybrid workSenior-level Full TimeUnited States R1d ago
-
Sr. Forward Deployed Engineer (FDE) - Retail USD 182K-250KAWS | Apache Spark | Azure | CI/CD | Data EngineeringCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeRemote - California R1d ago
-
Senior Staff Software Engineer, Data USD 235K-300KAccess Control | Amazon Redshift | Apache Airflow | BigQuery | Compliance401k employer match | Cell phone reimbursement | Competitive PTO | Corporate wellness program | Employee resource groupsSenior-level Full TimeUSA Remote R1d ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R1d ago
-
Senior-level Full TimeWork from home, VA, United States R1d ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R1d ago
-
Senior-level Full TimeWork from home, VA, United States R1d ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Argo CD | ArgoCD | Bash | Cluster APIAttend conferences and working groups | Company outings | Hackathons | Professional development and training | Tech talksExecutive-level Full TimeBoston, MA, United States R1d ago
-
Apache Airflow | Azure DevOps | Data Cataloging | Data Governance | Data QualityChildcare discounts | Employee assistance program | Employee discounts | Healthcare coverage | Paid HolidaysMid-level Full TimeRemote, United States R1d ago
-
Solutions Engineer, Data USD 45K-85KAWS | Cloud Computing | Containers | Data Architecture | Data CurationDomestic travel | TelecommutingMid-level Full TimeHoffman Estates, IL, United States R1d ago
-
Senior DevOps Engineer (Storage) - remote, US/EU USD 202K-290KAir-gapped | Air-gapped environments | Argo CD | ArgoCD | BashConference attendance | Hackathons | Professional development and training | Remote work | Tech talksExecutive-level Full TimeAustin, TX, United States R1d ago
-
Apache Airflow | Azure DevOps | Data Cataloging | Data Governance | Data ModelingDiscounts | Employee assistance program | Health insurance | Paid Holidays | Pension plansMid-level Full TimeRemote, United States R1d ago
-
Azure DevOps | Data Catalog | Data Engineering | Data Governance | Data LakehouseChildcare service discounts | Employee assistance program | Employee discounts | Healthcare | Paid HolidaysMid-level Full TimeRemote, United States R1d ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R1d ago
-
Machine Learning Engineer USD 131K-177KAWS | Cassandra | Classification | Cloud Migration | Computer VisionLearning opportunities | Professional development | Work from homeMid-level Full TimeRemote, NY, US R1d ago
-
Health IT Data Engineer USD 100K-125KData Governance | Data Lineage | Data Modeling | Data Quality | Data ReconciliationMid-level Full TimeRemote, United States R1d ago
-
Data Engineer - Top Secret Clearance USD 140K-170KAWS | Agile | Apache Flink | Apache Kafka | ArgoCDComprehensive benefits package | Continuous professional developmentSenior-level Full TimeDC Metro Area / Hybrid Flexibility R1d ago
-
Data Engineer - Top Secret Clearance USD 140K-170KAI machine learning | Apache Flink | Apache Kafka | ArgoCD | Bitbucket N/ABest in class company culture | Comprehensive employee benefits package | Continuous professional development | On call support availability for production issuesSenior-level Full TimeDC Metro Area / Hybrid Flexibility R1d ago
-
Data Insights & Analytics Lead USD 120K-180KAmplitude | Blockchain Analytics | Contract analytics | Data Visualization | Dune AnalyticsCollaborative work culture | Dental insurance | Global team | Health insurance | Professional developmentSenior-level Full TimeCayman R1d ago
-
Senior Data Engineer (DBA) USD 91K-163KAmazon Web Services | Ansible | Azure | Capacity Planning | Cloud platformCareer development | Comprehensive benefits package | On-call rotation | Telecommute flexibilitySenior-level Full TimeHartford, Connecticut, UNITED STATES; REMOTE R1d ago