Senior Data Engineer
Tasks
- Build and integrate messaging workflows with Azure Service Bus and Event Grid
- Build and maintain Azure data pipelines
- Design and optimize database schemas and queries
- Design scalable secure data architectures on Azure
- Develop data transformations and orchestration workflows
- Develop event driven data processing solutions
- Ensure HIPAA HITRUST compliant data integrity security and governance
- Implement ETL ELT processes for multi source integration
- Implement data quality consistency and lineage tracking
- Implement database DevOps with schema versioning and deployments
- Integrate REST APIs and build data APIs in Python
- Maintain technical documentation and data dictionaries
- Provide technical leadership mentorship and architecture review support
- Support Power BI semantic models reports and dashboards
- Support on call production incident escalation
- Troubleshoot and resolve complex production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Management | API Versioning | ARM Templates | Azure | Azure AI | Azure API | Azure API Management | Azure Bicep | Azure Blob | Azure Blob Storage | Azure Container | Azure Container Apps | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Grid | Azure Functions | Azure Logic | Azure Logic Apps | Azure SQL | Azure SQL Database | Azure Service | Azure Service Bus | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Container Apps | Contract testing | Cosmos DB | DAX | Data Factory | Data Governance | Data Lake Storage | Database DevOps | ELT | ETL | Event Driven | Event Grid | Event-driven architecture | FastAPI | Flask | Git | GitHub Copilot | HIPAA | HITRUST | Infrastructure as Code | Logic Apps | Machine Learning | Metadata Management | OpenAPI | PostgreSQL | Power BI | Python | REST APIs | RedGate Flyway | SQL Database | SQL Server | Schema versioning | Service Bus | Swagger | Synapse Analytics | T-SQL | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Data Science & AI Specialist GBP 28K-28KAWS Bedrock | Apache Pulsar | Apache Spark | Artificial Intelligence | CI/CDCarers leave bonus | Discounted mobile and broadband | Equalized maternity paternity and adoption leave | Holiday purchase scheme | Paid carer’s leaveMid-level Full TimeLondon, GB, E1 8EP R6h ago
-
Senior MLOps Engineer BRL 156K-180KAPIs | AWS | CI/CD | Data Catalog | Data GovernanceCareer growth opportunities | Emotional wellbeing program | Flexible schedule | Healthcare dental and life insurance | Home office reimbursementSenior-level Full TimeBrazil (Remote) R16h ago
-
Sr. Embedded Software Engineer USD 100K-130KARM Cortex | ARM Cortex A | Assembly | Bash | Buildroot401k match | Career growth and professional development opportunities | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeRemote (United States) R17h ago
-
Data Engineer USD 100K-150KAgile | Apache Spark | Azure | Data Warehousing | Databricks401k matching | Dental insurance | Education assistance | Medical insurance | Paid time offMid-level Full TimeRemote R17h ago
-
Data Engineer - Azure & Microsoft Fabric CAD 85K-166KARM Templates | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsFlexible location within Eastern or Central time zones | Hybrid workMid-level Full TimeRemote R19h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R20h ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R20h ago
-
Embedded Software Verification & UI Programmer USD 90K-120KC# | DO-178B | DO-178C | LDRA | MCDC401k match | Certification assistance | Flexible workplace | Health dental life disability insurance | Professional development supportSenior-level Full TimeRemote R20h ago
-
APIs | DevOps | Distributed Systems | Docker | Enterprise IntegrationsOccasional evening collaboration | Remote work | Strong growth potentialSenior-level Full TimeRemote job R21h ago
-
Staff Machine Learning Systems Engineer (MLOps) USD 210K-250KAWS EKS | Alerting | Autoscaling | CI/CD | ClickHouseFlexible remote work | Healthcare industry domain experienceSenior-level Full TimeUS Remote R22h ago
-
Senior Data Engineer USD 140K-170KData Governance | Data Management | Data Modeling | Data Quality | Data sharesComprehensive benefits package | Flexible hybrid schedule | Opportunities for promotion | Supportive work community | Training and developmentSenior-level Full TimeNew York, New York, United States; … R23h ago
-
Analytics Engineer EUR 122K-122KAirflow | Canonical Data | DBT | Data Contracts | Data ModelingQuarterly in person surges | Remote-firstMid-level Full TimeHybrid - Luxembourg R1d ago
-
CAG | DBT | Data Modeling | Elasticsearch | GrafanaEmployee discounts | Employee events | Flexible working hours | Free drinks | Health offersSenior-level Full TimeHinterm Hauptbahnhof 3-5, 76137 Karlsruhe R1d ago
-
DBT | Elasticsearch | Grafana | Looker | PostgreSQLEmployee discounts | Employee events | Flexible working hours | Health offers | Hybrid workSenior-level Full TimeRevaler Straße 28-31, 10245 Berlin R1d ago
-
API | AWS S3 | Apache Airflow | Apache NiFi | Azure DataDental insurance | Gym membership | Health insurance | Life insurance | Meal voucherEntry-level Full TimeRemoto, Brasil R1d ago
-
Computer Vision | Data Pipelines | MLOps | Machine Learning | Model versioningHybrid work | Innovation teamMid-level Full TimeSão Paulo, State of São Paulo, … R1d ago
-
Data Engineer (Azure Databricks) EUR 42K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryCertification programs | Health insurance | Internal mobility | Mentorship | Professional development opportunitiesMid-level Full TimeBarcelona, CT, Spain R1d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data FactoryHealth insurance | Internal mobility | Internship opportunities | Mentorship | Professional development programsMid-level Full TimeŁódź, Łódź Voivodeship, Poland R1d ago
-
Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Internship opportunities | MentorshipMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeMálaga, AN, Spain R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeŁódź, Łódź Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Mentorship | Professional development | Relocation programMid-level Full TimePoznań, Greater Poland Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Mentorship | Professional development opportunities | Relocation program | Remote work flexibilityMid-level Full TimeWrocław, Lower Silesian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) PLN 276K-276KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional development programsMid-level Full TimeGdańsk, Pomeranian Voivodeship, Poland R1d ago
-
Middle Data Engineer (Azure Databricks) EUR 45K-57KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Mentorship programs | Professional development | Relocation program | Remote work flexibilityMid-level Full TimeZaragoza, AR, Spain R1d ago