Data Engineer in St. Louis, MO
Tasks
- Build ETL processes for source to target migration
- Create data models and schemas
- Design scalable data architectures for migration
- Develop and maintain data pipelines
- Develop data access controls and audit trails
- Develop data extraction transformation loading workflows
- Document data architectures and processes
- Ensure compliance with data protection regulations
- Implement data cleansing routines
- Implement data security measures
- Implement real-time and batch processing pipelines
- Integrate data solutions with migrated applications
- Monitor and tune data pipelines
- Monitor data quality metrics
- Optimize data processing and storage in cloud
- Participate in agile ceremonies
- Plan and execute data migration strategies
- Troubleshoot data issues during migration
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Apache Spark | Azure Data | Azure Data Factory | Cloud Computing | Cloud Dataflow | Data Factory | Data Modeling | Data Pipelines | Data Quality | Data Security | Data orchestration | Databricks | ETL | Google Cloud | Google Cloud Dataflow | Palantir | PySpark | Python | SQL | Snowflake
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R7h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | APIs | Automation | Backend Development | IntegrationDirect impact on company growth | Equity | Hybrid work | Significant ownership | Unlimited PTOMid-level Full TimeKing of Prussia, PA, United States R8h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Accelerate | Azure | C++ | DeepSpeedExperience bonus | Hybrid work model | QGroup communities | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States8h ago
-
Active Learning | DPO | Data Privacy | Deep learning | Few-Shot Learning401k match | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Machine Learning Engineer, Agentic Application USD 139K-216KAPI Design | Distributed Systems | Generative AI | Language Models | Language Processing401k match | ESPP | Family leave | Flexible spending account | Flexible time offEntry-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
C++ | DistributedTraining | ETL | Go | Huggingface401k matching | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
C++ | Distributed Training | ETL Pipelines | Go | Hugging Face401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Abstractive summarization | Active Learning | DPO | Few-Shot Learning | Few-shotFlexible work persona | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Senior Machine Learning Engineer USD 203K-267KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data PipelinesExperience bonus | Hybrid work model | Mental health benefits | Unlimited sick days | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Engineer II USD 167K-220KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data CleansingExperience bonus | Hybrid work model | Mental health benefits | QGroup communities | Unlimited sick daysMid-level Full TimeSeattle, Washington, United States9h ago
-
AI/ML Engineer USD 67K-114KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Cloud platform401k company match | Company paid disability plans | Company paid life insurance | Company-provided tools | Diversity and inclusionEntry-level Full TimeAnniston, Alabama, United States10h ago
-
Machine Learning Engineer USD 155K-228KAWS | Airflow | Argo CD | Azure | CI/CDGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R11h ago
-
Data Visualization Engineer - Advanced Engineering USD 74K-125KAccess Control | Alarm Prioritization | Change Management | Client-Server | CybersecurityMid-level Full TimeHeath, OH, United States13h ago
-
Associate AI Software Engineer USD 65K-100KAgile | Confluence | Data Analysis | Data Modeling | Data Visualization401k company match | Adoption Assistance | DailyPay | Dental insurance | Disability insuranceMid-level Full TimeSt. Louis Park, MN, United States13h ago
-
Intern, AI/ML Engineer (Fall 2026) USD 36K-40KArtificial Intelligence | Automation | CI/CD | Machine Learning | Python401k matching | Educational assistance | Employee stock purchase plan | Housing stipend | Paid HolidaysEntry-level InternshipTampa, Florida, United States13h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior-level Full TimeWork from home, VA, United States R14h ago
-
Scientific Computing and Data Management SME USD 150K-185KAgile | Data Lifecycle Management | Data Security | Data lifecycle | DevOpsPublic Trust Clearance | Remote work | Security clearance based access | Travel as neededSenior-level Full TimeWork from home, VA, United States R14h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data QualityContract award contingent | Hybrid work | Public trust clearance support | Technical documentation updates | Travel 15 percent or lessMid-level Full TimeFAIRFAX, VA, United States14h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R14h ago
-
Mid-level Full TimeFAIRFAX, VA, United States14h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Apache Spark | Azure Active Directory | Data Quality | Data SkippingOnsite work | Public Trust background investigationSenior-level Full TimeArlington, VA, United States14h ago
-
Senior-level Full TimeWork from home, VA, United States R14h ago