Sr. Data Engineer
Madison, WI, United States
USD 117K-160K (estimate) Senior-level Full Time
Tasks
- Apply data governance access control and compliance
- Automate deployments with CI/CD and IaC
- Build and maintain dashboards and visualizations
- Design Databricks platform architecture on Azure and AWS
- Design ETL pipelines on Databricks
- Develop Databricks notebooks datasets and jobs
- Document data models and procedures
- Enable self service analytics with governed data products
- Implement data quality checks and validations
- Ingest transform and harmonize biological data
- Model and curate genetics subject areas
- Optimize pipeline performance and data latency
- Orchestrate bioinformatics pipelines
- Support cloud governance and cost optimization
- Troubleshoot pipeline and report issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Amazon RDS | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Bioinformatics | CI/CD | Data Factory | Data Modeling | Data Warehousing | Databricks | Delta | Delta Lake | ELT | ETL | FASTQ | GWAS | Genomics | Infrastructure as Code | LIMS | Plink | Python | SNP | SQL | SQL Server | Stored Procedures | Stored functions | T-SQL | Terraform | VCF | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Partner Engineer, Generative AI USD 173K-247KAWS | Agent Orchestration | Azure | Bias Mitigation | C plus plusSenior-level Full TimeMenlo Park, CA2h ago
-
Data Curation | Experimental Design | Generative AI | Language Models | Large Language ModelsWork authorization supportMid-level Full TimeMenlo Park, CA2h ago
-
Senior AI / ML Engineer USD 24KDocker | Git | Image Processing | Object Detection | Object-Oriented401k match | Flexible time off | Health insurance | Health savings account | MacBook providedSenior-level Full TimeBeavercreek, OH11h ago
-
Data Engineer (Mid-Level) USD 85K-137KAccess Control | Data Modeling | Data Quality | Data loading | Database DesignMid-level Full TimeCharlottesville, VA, Charlottesville, VA, US | …12h ago
-
Data Engineer USD 100K-181KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse Analytics401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeColumbus, OH, United States12h ago
-
Data Engineer Intern USD 42K-50KAgile | Azure | Data Warehousing | SQLHands-on projects | Mentorship | Onsite internshipEntry-level Full Time InternshipColumbus, OH, United States12h ago
-
AI Data Engineer USD 130K-150KAPI Design | Agentic Systems | Data Pipelines | Distributed Systems | EmbeddingsGlobal career advancement opportunities | High impact on risk management | Professional growth | Talent dense teamMid-level Full TimeUnited States - Remote R14h ago
-
Staff Software Engineer USD 210K-210KAWS | CI/CD | Data Enrichment | Data Processing | Dataset creationSenior-level Full TimeAnn Arbor, MI18h ago
-
Senior AI Engineer USD 190K-240KAgentic Systems | Anthropic API | Artificial Intelligence | Embeddings | Evaluation Frameworks401k plan | Flexible time off | Flexible work schedules | Health and wellness benefits | In-person offsitesSenior-level Full TimeSan Francisco, CA / Remote (US) R19h ago
-
AI Engineer, Quality USD 170K-220KEmbeddings | Evaluation Frameworks | LLM orchestration | Langfuse | Langgraph401k | Flexible PTO | Flexible work schedules | Technology reimbursement | Therapy sessionsEntry-level Full TimeSan Francisco, CA or Remote (USA) … R19h ago
-
Staff AI Engineer USD 240K-310KAgent Orchestration | Distributed Systems | Embedding pipelines | Embeddings | Guardrails401k plan | Flexible time off | Flexible work schedules | Health and wellness benefits | In-person offsitesSenior-level Full TimeSan Francisco, CA / Remote (US) R19h ago
-
AI/ML Developer Relations - US (San Francisco) USD 150K-170KComputer Vision | Machine Learning | NumPy | PyTorch | PythonAnnual leave | In-person culture | Public holidaysEntry-level Full TimeSan Francisco19h ago
-
ML Engineer USD 140K-220KAWS SageMaker | Agentic Workflows | C++ | Fine Tuning | Foundation Models401k | Health/Vision/Dental | Team mealsEntry-level Full TimeMountain View, CA, US / San …19h ago
-
Applied Audio ML Engineer USD 150K-260KAudio signal processing | Cloud Computing | Data Pipelines | Deep learning | Machine Learning401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US19h ago
-
Senior Data Engineer USD 165K-200KAzure Data | Azure Data Factory | Azure SQL | Azure SQL Database | Azure Synapse401k match | Certification programs | Mentorship | Paid time off | Remote work flexibilitySenior-level Full TimeRemote (United States) R1d ago
-
Senior/Staff AI Engineer - Large Language Models (LLM) USD 160K-210KDecision Making | Language Models | Large Language Models | Machine Learning | Multimodal Machine Learning401k match | Paid time off | Parental leave | Premium healthcare | Tuition reimbursementSenior-level Full TimeEast Palo Alto, CA1d ago
-
Senior Data Engineer USD 180KAWS Glue | AWS Lambda | Airflow | Amazon RDS | Amazon S3Hybrid work | Remote work allowedSenior-level Full TimeRemote , United States R1d ago
-
eCom Data Engineer Specialist USD 64K-132KAWS | Agile | Amazon Redshift | Apache Airflow | Apache KafkaDental insurance | Dependent care reimbursement account | Disability insurance | Employee assistance program | Medical insuranceMid-level Full TimePurchase, NY, United States1d ago
-
Senior-level Full TimeLos Angeles, CA1d ago
-
Sr. Back-End Software Engineer - Machine Learning USD 200K-250KC++ | Computer Vision | Deep learning | Distributed Systems | Language Processing401k matching | Commuter benefits | Employee referral program | Flexible spending accounts | Life insuranceSenior-level Full TimeSanta Clara, CA1d ago
-
Senior Platform Engineer (Embedded Linux) USD 160K-240KC# | C++ | Embedded Linux | HTTP | Linux Kernel401k plan | Dental insurance | Medical insurance | Vision insuranceSenior-level Full TimeMountain View, CA1d ago
-
Software Engineer - Data Platform USD 120K-200KAmazon Aurora | Amazon SageMaker | Argo Workflows | Avro | Chroma401k | Dental insurance | Flexible vacation policy | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, CA1d ago
-
Developer Relations Engineer USD 150K-185KAPI | Content Strategy | Documentation | Generative AI | JavaScriptDental insurance | Health insurance | Paid time off | Premium Hardware Setup | Vision insuranceMid-level Full TimeBoulder, CO1d ago
-
Scientific Data Engineer USD 120K-160KData Ingestion | Data Transformation | Data Warehousing | Data cleaning | Database Queries401k matching | Dental insurance | Health insurance | Paid time offMid-level Full TimeSan Francisco, New York1d ago
-
Platform Engineer - Generative AI USD 120K-160KAPI Integration | Caching | Continuous Deployment | Database Design | Fine Tuning401k employer contribution | Dental insurance | Health insuranceMid-level Full TimeNew York, San Francisco, Munich or …1d ago