Senior Data Engineer
Tasks
- Build and integrate messaging workflows with Azure Service Bus and Event Grid
- Build and maintain Azure data pipelines
- Design and optimize database schemas and queries
- Design scalable secure data architectures on Azure
- Develop data transformations and orchestration workflows
- Develop event driven data processing solutions
- Ensure HIPAA HITRUST compliant data integrity security and governance
- Implement ETL ELT processes for multi source integration
- Implement data quality consistency and lineage tracking
- Implement database DevOps with schema versioning and deployments
- Integrate REST APIs and build data APIs in Python
- Maintain technical documentation and data dictionaries
- Provide technical leadership mentorship and architecture review support
- Support Power BI semantic models reports and dashboards
- Support on call production incident escalation
- Troubleshoot and resolve complex production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Management | API Versioning | ARM Templates | Azure | Azure AI | Azure API | Azure API Management | Azure Bicep | Azure Blob | Azure Blob Storage | Azure Container | Azure Container Apps | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Grid | Azure Functions | Azure Logic | Azure Logic Apps | Azure SQL | Azure SQL Database | Azure Service | Azure Service Bus | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Container Apps | Contract testing | Cosmos DB | DAX | Data Factory | Data Governance | Data Lake Storage | Database DevOps | ELT | ETL | Event Driven | Event Grid | Event-driven architecture | FastAPI | Flask | Git | GitHub Copilot | HIPAA | HITRUST | Infrastructure as Code | Logic Apps | Machine Learning | Metadata Management | OpenAPI | PostgreSQL | Power BI | Python | REST APIs | RedGate Flyway | SQL Database | SQL Server | Schema versioning | Service Bus | Swagger | Synapse Analytics | T-SQL | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R21d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R21d ago
-
Mid-level Full TimeZagreb, Hrvatska (Hybrid) R2h ago
-
AWS | Cloud Data | Cloud Data Services | Cloud platform | Data ComplianceRemote workSenior-level Full TimeRemote R5h ago
-
DevOps Engineer GBP 85K-112KAWS | Amazon VPC | ArgoCD | Artifact Registries | BashHealthcare | Long-term contract | Multilingual multinational multicultural environment | Remote work | Stable project pipelineMid-level Full TimeRemote R5h ago
-
Data Engineer (m/w/d) EUR 60K-76KAirbyte | Backfill | DBT | Data Compliance | Data GovernanceCompany events | Company pension plan | Corporate benefits discounts | Deutschlandticket subsidy | Dog-friendly officeMid-level Full TimeBerlin, Hybrid R8h ago
-
Software Engineer (Python, Kubernetes, AI/ML) USD 153K-258KAI Inference | Autoscaling | Container Orchestration | Docker | GPU schedulingExtra Paid Sick Leave | Extra paid vacation | Flexible working hours | Language courses | Modern office amenitiesSenior-level Full TimePoland, Serbia, Cyprus, Georgia R9h ago
-
SASE Automation Engineer USD 151K-237KAnsible | CI/CD | DevOps | Docker | NetskopeFlexible working hours | Hybrid work | Internal training sessions | Remote work | Training budgetMid-level Full TimeCairo, Egypt R10h ago
-
SASE Automation Engineer BRL 143K-152KAnsible | CI/CD | Docker | Netskope | Network AutomationFlexible working hours | Fully remote | Hybrid work option | Training budget | Training sessionsMid-level Full TimeBrasília, Brazil R11h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPI Development | Language Model | Language Model Evaluation | Language Models | Language Processing401k | Dental insurance | Health savings account | Medical insurance | Paid time offEntry-level Full TimeNew York, NY, US, NY 10019 R12h ago
-
AI Security | Amazon Web Services | Azure | CI/CD | Cloud NativeCareer development | Hybrid work | Paid time off | Work flexibilitySenior-level Full TimeDeutschlandweit & Hybrid Work R13h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R13h ago
-
Lead Data Integration Engineer INR 3200K-4000KAirflow | Airflow DAGs | Autosys | Bitbucket | CI/CDFlexible work arrangements | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R14h ago
-
Senior-level Full TimeHeredia, Heredia, Costa Rica R16h ago
-
Staff Analytics Engineer AUD 150K-170KAnomaly Detection | CI/CD | DBT | Data Quality | Data TestingEmployee assistance program | Fitness Passport membership | Flexible work | Hybrid work | Mental health supportSenior-level Full TimeSydney, New South Wales 2000, Australia R16h ago
-
API Development | Artificial Intelligence | Cloud Computing | Data Pipelines | Data integrationMid-level Full TimeRemote, China R17h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R17h ago
-
AI Architect CAD 120K-140K.Net Core | API Integration | AWS | Autogen | AzureDeferred profit-sharing | Dental insurance | Health insurance | Hybrid work | Paid time offSenior-level Full TimeRemote (Canada) with optional hybrid work … R19h ago
-
Prompt Engineering Architect USD 100K-150KAgentic Workflows | Embeddings | Evaluation Frameworks | Fine Tuning | Language ModelsSenior-level Full TimeUnited States - Remote R19h ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backup | CRUSH maps | CSI | Capacity PlanningBenefits | Long term multi year engagement | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent Systems | Embedded Systems | Fault detectionRemote workMid-level Full TimeUnited States - Remote R19h ago
-
Senior Data Engineer - Remote - Multiple Levels USD 85K-141KAWS Data | AWS Data Migration | AWS Data Migration Service | AWS Lambda | Airflow401k retirement plan | Dental insurance | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeHome Office: Tysons, VA, United States R19h ago
-
AWS DMS | AWS IAM | AWS Lambda | Airbyte | AlertingCareer coaching | Certification and skill development allowance | Flexible hours | Paid time off | Performance-based rewardsMid-level Full TimeVietnam - Remote R19h ago
-
GenAI Prototyping Specialist GBP 115K-165KAPI Integration | AWS Bedrock | Agentic Workflows | Anthropic Claude | AutogenClient office collaboration sessions | Flexible remote days | Hybrid workMid-level Full TimeLondon, United Kingdom R19h ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Batch Processing | C plus plus | Data Pipelines | Data PreprocessingSenior-level Full TimeSan Mateo, CA, United States R19h ago