Data Engineer III
Tasks
- Build automated data pipelines
- Build data catalogs for data discovery
- Build scalable ML inference systems
- Collaborate with analysts and data scientists to optimize data architecture
- Connect Databricks with enterprise data warehouses streaming platforms and business applications
- Create ETL ELT workflows for batch and streaming
- Create automated testing frameworks for analytical and ML workloads
- Create data models for machine learning and business intelligence
- Create monitoring and alerting for model performance data drift system health
- Design scalable data and machine learning infrastructure
- Design self service ML capabilities for model deployment and monitoring
- Develop data quality monitoring and validation systems
- Establish data lineage tracking quality monitoring and compliance controls
- Implement MLOps workflows with model training validation deployment monitoring
- Implement data governance standards and metadata management
- Implement medallion architecture
- Implement security and compliance controls
- Integrate ML systems with Tableau PowerBI Qlik Sense
- Integrate with Palantir Foundry systems
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Automated testing | Batch Processing | Data Catalog | Data Drift | Data Governance | Data Lineage | Data Quality | Data drift monitoring | Databricks | Drift monitoring | ELT | ETL | MLOps | MLflow | Machine Learning | Machine Learning Inference | Medallion Architecture | Metadata Management | Model Deployment | Model Monitoring | Model Validation | Palantir Foundry | PowerBI | PySpark | Python | Qlik Sense | Spark SQL | Streaming Data | Tableau
Education
N/A
Roles
Related jobs
-
Senior Research Engineer, Voice + Speech USD 200K-400KData Pipelines | LLM | Language Processing | Machine Learning | Model EvaluationDaily meals snacks | Disability benefits | Fertility benefits | Life insurance | Medical/Dental/VisionSenior-level Full TimeNew York City4h ago
-
Staff Research Engineer, Voice + Speech USD 200K-400KConversational AI | Data Pipelines | Deep learning | Information Retrieval | LLM DeploymentDaily lunches and snacks | Disability benefits | Fertility and family building benefits | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeNew York City4h ago
-
Senior Research Engineer, Voice + Speech USD 200K-400KData Pipelines | Deep learning | Information Retrieval | LLM Deployment | Language ModelsDaily meals | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSan Francisco5h ago
-
API Gateway | AWS Glue | Access Control | Apache Airflow | Apache AtlasSenior-level Full TimeFAIRFAX, VA, United States5h ago
-
Senior Enterprise Data Operations Support Engineer (Tier-3 Expert Engineering Support) USD 125K-153KAWS GovCloud | Apache Airflow | Apache Kafka | Apache Spark | Azure GovernmentSenior-level Full TimeFAIRFAX, VA, United States5h ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R5h ago
-
Enterprise Data Engineering & Operations Lead SME USD 107K-190KAWS GovCloud | Access Control | Apache Kafka | Apache Spark | Azure GovernmentSenior-level Full TimeFAIRFAX, VA, United States5h ago
-
Software/Embedded Systems Engineer USD 135K-158KAgile Development | C++ | Change Control | DoD Systems | Embedded SoftwareTravel 25%Senior-level Full TimeArlington, VA, United States5h ago
-
Data/ML Scientist SME USD 105K-150KAWS GovCloud | Anomaly Detection | Apache Spark | Bayesian Causal Inference | Bayesian MethodsMid-level Full TimeFAIRFAX, VA, United States5h ago
-
Lead AI Engineer USD 180K-280KCI/CD | ColBERT | Docker | Faiss | Fine Tuning401k match | Bonus | Childcare benefits | Dental insurance | Disability insuranceSenior-level Full TimeQuincy, MA, United States6h ago
-
API Integration | AWS | AWS Glue | Batch Processing | Code reviewSenior-level Full TimeIndianapolis, IN, United States R7h ago
-
Senior-level Full TimeUnited States7h ago
-
Senior-level Full TimeUnited States7h ago
-
Software engineer, generative AI USD 119K-292KAWS | Agentic Workflows | Asyncio | Azure | Docker401k | Cancer testing support | Company holidays | Company off-sites | Company stock optionsMid-level Full TimeSan Francisco, CA7h ago
-
AI engineer USD 152K-315KAWS | Azure | Cloud Computing | Deep learning | GCP401k | Company offsites | Dental insurance | Fertility support | Flexible spending accountMid-level Full TimeSan Francisco, CA7h ago
-
Computational Biologist - Protein Engineering USD 150K-250KAWS | Amazon Web Services | CUDA | Conda | Deep learningRelocation supportEntry-level Full TimeSan Francisco, CA, US8h ago
-
Entry-level Full TimeSan Francisco, CA, US8h ago
-
Applied Math Libraries Engineer (SPU) USD 120K-170KArithmetic intensity | Atomics | BLAS | Bandwidth) | C#Entry-level Full TimeRedwood City8h ago
-
Kernel Engineer — Scientific Computing (SPU) USD 120K-170KAtomic operations | C++ | CUDA | Concurrency | DebuggingEntry-level Full TimeRedwood City8h ago
-
Senior Google Cloud Data Engineer USD 170K-240KAlerting | Anomaly Detection | Apache Beam | Apache PubSub | Batch Data ProcessingCareer advancement | Dental insurance | Health savings account | Hybrid work options | Medical insuranceSenior-level Full TimeNew York City9h ago
-
API Testing | Bash | C# | CI/CD | JUnitEntry-level Full TimePennsylvania, Exton10h ago
-
Machine Learning Engineer Intern (E-Commerce Knowledge Graph - CV/Multimodal/NLP) - 2026 Summer (BS/MS) USD 122K-243KEntity Linking | Graph Modeling | Knowledge graphs | Language Processing | Machine LearningDevelopment workshops | Social eventsEntry-level InternshipSeattle, Washington, United States10h ago
-
Senior Software Engineer, AI Coding Tools USD 244K-588KDeep learning | Fine Tuning | GPU | Inference acceleration | Language ModelsSenior-level Full TimeSan Jose, California, United States10h ago
-
Machine Learning Engineer Intern (E-commerce-Supply Chain & Logistics) - 2026 Summer (MS) USD 136K-237KClassification | Data Mining | Deep learning | Forecasting | Knowledge graphsEntry-level InternshipSeattle, Washington, United States10h ago
-
Software Engineer, Generative AI, Workspace USD 147K-211KC++ | Distributed Systems | Generative AI | Information Retrieval | Integration TestingBenefits | Bonus | EquityMid-level Full TimeBoulder, CO, USA11h ago