Senior Data Engineer
Primary location: Eden Prairie, Minnesota
USD 91K-163K Senior-level Full Time
Tasks
- Build and optimize LLM and RAG workflows
- Collaborate on architecture improvements and design standards
- Design data management and AI solutions
- Detect data quality issues and manage data audits
- Develop ETL and ELT pipelines
- Enable reusable AI ready datasets
- Generate embeddings and perform vector ingestion
- Implement DevOps and CI/CD pipelines
- Implement feature engineering frameworks
- Lead data acquisition and integration
- Manage data warehouses and analytics
- Monitor data pipeline quality and drift
- Operationalize machine learning pipelines
- Perform Diagnostics and Monitoring
- Use Azure Cloud for data engineering projects
Perks/Benefits
- 401k contribution
- Comprehensive benefits package
- Equity stock purchase
- Incentive and recognition programs
- Telecommuting within United States
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Cause analysis | Data Factory | Data Quality | Data Warehousing | Databricks | DevOps | ELT | ETL | Feature Engineering | Generative AI | GitHub | GitHub Actions | Language Models | Large Language Models | Machine Learning | Prompt engineering | Python | RAG | Root Cause Analysis | Root cause | SQL | Scala | Snowflake | Terraform | Vector embeddings
Regions
Countries
States
Cities
Related jobs
-
Software Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k contribution | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland7h ago
-
Anomaly Detection | Clustering | Data Analysis | Elasticsearch | Exploratory Data Analysis11 federal holidays | 24 days PTO | 401k match | Educational assistance | Healthcare coverageSenior-level Full TimeFort Meade, Maryland7h ago
-
Software Engineer 1 - (Python, LLMs, UI/UX) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k matching | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland7h ago
-
Systems Engineer 3 - (AI, Terraform, LLMs) USD 233K-284KArtificial Intelligence | Cloudflare | Confluence | Content Delivery Network | Content delivery401k 100 Percent Vested | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland7h ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R8h ago
-
C++ | Caffe | Deep and Wide | Deep learning | GBDTMid-level Full TimeSeattle, Washington, United States11h ago
-
C++ | Computer Vision | Data Mining | Deep learning | GoEntry-level Full TimeSan Jose, California, United States11h ago
-
Big Data | Data Modeling | Data Processing | Data Warehousing | Data analyticsDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States11h ago
-
Algorithms | C++ | Computer Vision | Data Mining | Data StructuresEntry-level Full TimeSeattle, Washington, United States11h ago
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA12h ago
-
Senior Full Stack Engineer, Gen AI USD 232K-258KAWS | AWS Bedrock | AWS CDK | Angular | CI/CDHybrid work | Remote work flexibility | Work-life balanceSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL13h ago
-
AWS Data Engineer USD 91K-155KAgile | Amazon Elastic Container Service | Amazon Web Services | Apache Airflow | Apache SparkRemote workSenior-level Full TimeMadrid, MD, Spain13h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R13h ago
-
MLOps Engineer USD 140K-175KApache Airflow | Dagster | Data Engineering | Distributed Computing | DockerMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL13h ago
-
Senior DevOps Engineer USD 124K-170KAWS | AWS CDK | AWS CloudFormation | Amazon CloudWatch | ArgoCDSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Senior Data Engineer, Databricks USD 119K-145KApache Spark | Asset bundles | Auto Loader | Azure Data | Azure Data Factory401k company match | Accrued vacation time off | Dental insurance | Long-term disability | Medical insuranceSenior-level Full TimeDENVER, CO, US18h ago
-
C# | C++ | CVS | Communication Protocols | Confluence401k match | Disability insurance | Education reimbursement | Health insurance | Health savings accountMid-level Full TimeSaint Paul, MN, United States19h ago
-
Research Engineer, Agentic Systems USD 175K-275KData sets | Evaluation Frameworks | Experimentation | Fine Tuning | Language Models401k employer match | Catered lunch | Commuter benefits | Dinner stipend | Generous PTO policyMid-level Full TimeUnion Square, New York City22h ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …23h ago
-
APIs | Agent Orchestration | Chunking | Cloud infrastructure | Context AssemblyDirect collaboration with founders | High ownership | In-office Flexibility | In-office collaboration | Remote workSenior-level Full TimeSan Francisco, CA; New York, New …23h ago
-
Mid-level Full TimeCoral Springs, Florida, United States23h ago
-
AI Engineering Specialist USD 110K-182KAPI Development | CI/CD | Cloud | Containers | Generative AISenior-level Full TimeCoral Springs, Florida, United States23h ago
-
Insights & Analytics Senior Specialist USD 93K-140KAPI Integration | AWS | Attention Mechanisms | Automated testing | Bias MitigationDental insurance | Health insurance | Paid time off | Retirement programs | Vision insuranceSenior-level Full TimeUS - Gaithersburg - MD, United …23h ago
-
Senior Data Analytics Engineer USD 145K-206KAWS | CRM | DBT | Data Model | Data Modeling401k match | Disability insurance | Employee assistance program | Flexible spending account | Health Savings Account contributionSenior-level Full TimeBRIC, United States R23h ago
-
Data Engineer – Python/AI USD 122K-179KArtifactory | CI/CD | Data Modeling | Data Quality | Data TransformationCareer development | Flexible benefits | Inclusive workplaceSenior-level Full TimeCharlotte, United States23h ago