Senior Data Engineer
Tasks
- Build medallion layer pipelines
- Design CDC and incremental load strategies
- Develop Bronze to Gold transformations
- Enforce data quality rules
- Implement event driven ingestion pipelines
- Implement platform observability logging and monitoring
- Maintain AI model data feeds
- Manage schema validation and schema evolution
- Set up CI CD environment promotion
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure Key Vault | Azure Log Analytics | Azure Service | Azure Service Bus | CDC | Change Data Feed | DAX | Data Factory | Data Governance | Data Quality | Data feed | Delta Lake | Delta Transaction Log | Event Hubs | Git | KQL | Key Vault | Log Analytics | Microsoft Fabric | Microsoft Purview | NumPy | OData | Pandas | Power BI | PySpark | Python | SQL | Schema evolution | Service Bus | Time Travel | Transaction log | VACUUM
Education
N/A
Roles
Related jobs
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R3h ago
-
AI/ML | AKS | Audit Logs | Azure DevOps | Azure MonitoringLocal only candidates required | Onsite 2 days per week | Remote 3 days per weekSenior-level Full TimeAustin, TX R3h ago
-
API Development | Anthropic Claude | App Insights | Asynchronous programming | Azure App100 percent remote work | B2B contract | Flexible working environment | Long-term engagement | Modern AI LLM technology stackSenior-level ContractRemote R4h ago
-
Active Directory | Azure Active Directory | Azure DevOps | Azure Functions | Azure PurviewRemote workSenior-level ContractRemote R4h ago
-
Data Engineer Intern USD 42K-57KData Analysis | Data Modeling | Data Quality | Data consolidation | Database DesignProfessional mentorship | Remote workEntry-level Internship Part TimeRemote R4h ago
-
Senior-level ContractRemote R5h ago
-
Real-Time Data Engineering Lead GBP 72K-95KCI/CD | Capacity Management | Cloud platform | Data Enrichment | Data LineageContributory pension scheme | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcareSenior-level Full TimeSheffield, United Kingdom R6h ago
-
Senior AI Engineer DKK 516K-580KAI Agents | Accuracy Monitoring | Data Drift | Data Drift Detection | Deterministic testingHealth insurance | Hybrid work model | Lunch scheme | Pension scheme | Professional development supportSenior-level Full TimeAarhus N, Denmark R9h ago
-
Applied AI Engineer (f/m/div.) EUR 46K-55KAI Observability | API | CrewAI | Embeddings | JSONCanteen | Career progression | Discounts in partnerships | Flexible benefits platform | Flexible work conditionsSenior-level Full TimeBraga, Portugal R9h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1000K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | DockerFlexible working | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R11h ago
-
Machine Learning Experts: Linear Algebra Exam Audit USD 150K-180KComponent analysis | Eigenvalues | JSON | Linear Algebra | Matrix OperationsRemote workSenior-level Full TimeUnited States R12h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R12h ago
-
Senior Backend JavaScript Developer CNY 240K-480KAWS S3 | AWS SQS | Asynchronous processing | Backpressure | Data ModelingOn-call rotationSenior-level Full TimeBeijing, CN R13h ago
-
Software Engineer II USD 100K-158KAWS | Agile | Angular | Azure | BitbucketHybrid work arrangementMid-level Full TimeCyberjaya, Selangor, Malaysia R13h ago
-
Software Engineer, Embedded Systems USD 197K-270KAAC | AC3 | API Design | AV1 | Adaptive streamingCommuter benefits | Disability benefits | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R15h ago
-
AWS | Access Control | Azure | CI/CD | DBTAgile collaborative environment | Data governance exposure | Fully remote | Opportunity to work with modern cloud data technologies | Professional growthMid-level Contract Full TimeBrazil R15h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R16h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R19h ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2600KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R19h ago
-
Data Engineer RON 140K-140KAWS | AWS CDK | Apache Spark | Azure | Azure BicepFlexible working hours | Health and wellbeing programs | Hybrid work | Meal allowance | Team eventsMid-level Full TimePiata Consiliul Europei 2C, 300627, Timisoara, … R19h ago
-
Staff AI Engineer USD 151K-332KC++ | CUDA | CUDA kernel | CUDA kernel development | Cache ManagementHybrid work | In-person work | Remote work | Work-life balance supportSenior-level Full TimeSeattle (WA), United States R19h ago
-
Staff AI Engineer - Zoom AI Services Platform USD 177K-387KAI Inference | AI Platform | AI Platform Engineering | API Design | C++Hybrid work | Remote workSenior-level Full TimeSeattle (WA), United States R19h ago
-
Senior AI Engineer USD 113K-182KAWS | AWS CDK | Agent Orchestration | Autogen | AzureDental insurance | Employer-funded retirement | Free tuition program | Medical insurance | Mental health resourcesSenior-level Full TimeRemote (United States), United States R19h ago
-
AI Solutions Architect (LLMs & AI Agents) MXN 950K-1300KAWS | Agent Orchestration | Agent guardrails | Autogen | AzureFlexible work arrangements | Hybrid work | In-person collaboration | Inclusive workplaceSenior-level Full TimeMX446 - DXC Mexico City Lago … R19h ago
-
Analytics Engineer SEK 775K-969KAgile | Data Governance | Data Lineage | Data Literacy | Data ModelingBonus based on performance | Comprehensive benefits package | Inclusive work environment | Remote work opportunitiesMid-level Full TimeSolna, Sweden R19h ago