Staff Data Engineer
Tasks
- Build AWS data pipelines
- Design build operate Databricks medallion lakehouse architecture
- Enforce policy as code consent using Open Policy Agent
- Implement FHIR to OMOP mapping pipelines
- Implement data governance and data residency controls
- Implement tamper evident audit logging and schema evolution
- Ingest transform and serve data using Delta Live Tables
- Integrate Kafka streaming with lakehouse layers
- Maintain certification and compliance documentation
- Maintain data quality standards and lineage tracking
- Optimize data platform performance cost and reliability
Perks/Benefits
Skills/Tech-stack
AWS CDK | AWS CloudFormation | AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Access Control | Access Controls | Amazon Athena | Amazon MSK | Apache Kafka | Apache Spark | CI/CD | Caching | Cluster Sizing | Compaction | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Residency | Databricks | Databricks Unity | Databricks Unity Catalog | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption at rest | Encryption in Transit | GDPR | HIPAA | Idempotency | Infrastructure as Code | Kinesis | Observability | Open Policy Agent | Partitioning | Policy Agent | PySpark | Python | Redshift | Role-Based Access | Role-Based Access Control | Schema evolution | Schema on read | Slowly Changing Dimensions | Streaming ETL | Terraform | Unity Catalog | “as-code”
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R14h ago
-
Pre-Sales Data Scientist USD 70K-90KAPIs | AUC | Credibility Testing | Cross-validation | Data AnalysisCompany sponsored volunteering days | Discounted private health insurance | Extra paid time off | Fully remote within continental United States | Generous parental leaveMid-level Full TimeCarlsbad, CA, United States R14h ago
-
Senior-level Full TimeBogota, CO R14h ago
-
Freelance Creative Technologist, Applied AI USD 150K-190KAPI | Agentic Workflows | ComfyUI | ControlNet | Embeddings401k match | Dental | Healthcare | Paid Holidays | Paid time offMid-level FreelanceUnited States R16h ago
-
Senior Analytics Engineer BRL 78K-108KA/B | A/B Testing | Apache Airflow | B testing | BigQueryRemote workSenior-level Full TimeBrasil R17h ago
-
Senior AI/ML Engineer USD 192K-240KAWS | Agentic Orchestration | Automated Labeling | Automated Labeling Pipelines | AzureHybrid work scheduleSenior-level Full TimeRedwood City, CA (Hybrid); San Francisco, … R18h ago
-
Senior Software Engineer, Data Platform USD 146K-230KAPI Gateway | API Versioning | AWS Lambda | AWS RDS | AWS S3401k match | Catered lunch | Commuter benefit | Dental insurance | Fully paid parental leaveSenior-level Full TimeNew York, New York, United States R19h ago
-
Senior Forward Deployed AI Engineer USD 160K-226KData Pipelines | DevOps | Distributed Systems | Edge Computing | JAX401k match | Continuing education support | Function health subscription | Health & wellness stipend | Health, dental, vision benefitsSenior-level Full TimeAustin, TX R19h ago
-
Machine Learning Engineer – Search & Retrieval Systems USD 225K-280KA/B | A/B Testing | ANN indexing | B testing | CTR401k plan | Company holidays | Equity stock options | Flexible PTO | Fully remote United StatesSenior-level Full TimeRemote - USA R21h ago
-
Data Scientist III - AI & Machine Learning USD 126K-149KAI Pipelines | Airflow | Apache Spark | Bayesian Inference | Bias Variance401k matching | Equity options grant | Flexible time off | Get Out Get Active funds | Health benefitsSenior-level Full TimeMissoula, Montana, United States R21h ago
-
Senior Data Engineer (Hybrid) MXN 1148K-1474KAPIs | AWS | Airbyte | Airflow | DAGCatered lunch | Employee resource groups | Flexible time off | Hybrid work schedule | Meal reimbursementSenior-level Full TimeMexico City R22h ago
-
Data Engineer - Costa Rica USD 91K-111KAWS | AWS Lambda | Azure | Data Governance | Data LakeBereavement leave | Dental insurance | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeCosta Rica R23h ago
-
Finance Analytics Engineer USD 76K-95KAI | Acceptance Testing | Dashboarding | Data Modeling | Data Pipelines401k matching | Bereavement leave | Employee assistance program | Employee discount program | Health and dental insuranceSenior-level Full TimeRemote - Nationwide, United States R23h ago
-
Senior Staff Data Engineer USD 127K-158KAI machine learning | API Integration | AWS | Amazon ECR | Amazon S311 company-paid holidays | 401k match | Employee assistance program | Employee ownership program | Life and AD and D insuranceSenior-level Full TimeRemote United States R23h ago
-
Data Engineer Lead dl USD 166K-225KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingAnnual team trip | Birthday off | Extra vacation week | Food credits | In-company English lessonsSenior-level Full TimeArgentina R23h ago
-
Data Engineer Senior dl USD 166K-225KApache Spark | Batch Processing | Cloud Computing | DBT | Data ContractsAnnual team trip | Birthday off | Extra vacation week | Food credits | In-company English lessonsSenior-level Full TimeArgentina R23h ago
-
Data Engineer USD 120K-160KAWS | Airflow | DBT | Data Warehousing | ELT401k plan | Commuter benefits | Employee Meals Snacks | FSA | Flexible time offSenior-level Full TimeLos Angeles; New York; Remote; San … R1d ago
-
Agile | Backend Development | Code review | Data Science | DebuggingFully remote | Mentorship | Paid apprenticeshipEntry-level Apprenticeship ContractRemote (United States) R1d ago
-
AI Software Engineer - Minneapolis USD 80K-120KAI coding | AI coding assistant | Agents | Automation | C#Collaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeSt. Louis Park, Minnesota, United States R1d ago
-
Machine Learning Engineer USD 130K-194KAI machine learning | AWS AI | AWS AI Machine Learning | Amazon DynamoDB | Amazon EC2Professional development | Work from homeMid-level Full TimeRemote, NY, US R1d ago
-
Senior Optimization Engineer USD 140K-180KAPIs | Asynchronous orchestration | Auditability | CP-SAT | Combinatorial OptimizationRemote workSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Data Scientist, Analytics (Technical Leadership) USD 160K-190KAI Workflow Optimization | AI workflow | Agent Orchestration | Bias Mitigation | Causal InferenceCareer development | World class analytics communitySenior-level Full TimeRemote, US | Bellevue, WA | … R1d ago
-
Senior Data Analytics Developer USD 140K-170KAgile | Azure Data | Azure Data Factory | BI Data modeling | DAX401k match | Accident insurance | Critical illness insurance | Dental insurance | Hospital indemnity insuranceSenior-level Full TimeEden Prairie, MN, 55344, USA R1d ago
-
Machine Learning Engineer/Data Scientist USD 130K-150KAWS | Azure | Data Preprocessing | Deep learning | Feature EngineeringMentorship | Personal development budget | Remote workMid-level Full TimeChicago, IL R1d ago
-
Machine Learning Engineer/Data Scientist USD 130K-150KAWS | Azure | Google Cloud | Matplotlib | NumPyAccess to mentors | Daily meals in office | Diverse team | Personal development time | Remote work weeksMid-level Full TimeChicago, IL R1d ago