Data Engineer III
Tasks
- Build automated data pipelines
- Build data catalogs for data discovery
- Build scalable ML inference systems
- Collaborate with analysts and data scientists to optimize data architecture
- Connect Databricks with enterprise data warehouses streaming platforms and business applications
- Create ETL ELT workflows for batch and streaming
- Create automated testing frameworks for analytical and ML workloads
- Create data models for machine learning and business intelligence
- Create monitoring and alerting for model performance data drift system health
- Design scalable data and machine learning infrastructure
- Design self service ML capabilities for model deployment and monitoring
- Develop data quality monitoring and validation systems
- Establish data lineage tracking quality monitoring and compliance controls
- Implement MLOps workflows with model training validation deployment monitoring
- Implement data governance standards and metadata management
- Implement medallion architecture
- Implement security and compliance controls
- Integrate ML systems with Tableau PowerBI Qlik Sense
- Integrate with Palantir Foundry systems
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Automated testing | Batch Processing | Data Catalog | Data Drift | Data Governance | Data Lineage | Data Quality | Data drift monitoring | Databricks | Drift monitoring | ELT | ETL | MLOps | MLflow | Machine Learning | Machine Learning Inference | Medallion Architecture | Metadata Management | Model Deployment | Model Monitoring | Model Validation | Palantir Foundry | PowerBI | PySpark | Python | Qlik Sense | Spark SQL | Streaming Data | Tableau
Education
N/A
Roles
Related jobs
-
Senior Data Engineer, Machine Learning USD 205K-235KApache Spark | Data Lakes | Data Modeling | Data Privacy | Data SecuritySenior-level Full TimeMenlo Park, CA3h ago
-
Software Engineer, AI/ML, Platforms and Devices USD 147K-211KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Distributed SystemsMid-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-252KC++ | Code Reviews | Computer Vision | Data Processing | Data StorageSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Computer Vision | Data Processing | Debugging | Distributed Computing | Fine TuningSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Staff Software Engineer, YouTube Ads Machine Learning USD 207K-300KC plus plus | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA3h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud AI USD 207K-300KAlgorithms | Computer Vision | Data Preparation | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, Machine Learning, Core ML USD 174K-252KC++ | Compiler optimization | Data Processing | Data parallelism | DebuggingSenior-level Full TimeMountain View, CA, USA3h ago
-
Software Engineer III, AI/ML Computer Vision, AR USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeSan Jose, CA, USA3h ago
-
Staff AI Research Engineer, Large User Models USD 207K-300KAlgorithms | Artificial Intelligence | Attention Mechanisms | BERT | Data StructuresSenior-level Full TimeMountain View, CA, USA3h ago
-
Software Engineer, Google Cloud Storage EngProd USD 174K-252KAlgorithms | Artificial Intelligence | C# | C++ | Cloud platformMid-level Full TimeSeattle, WA, USA3h ago
-
Software Engineer, AI/ML, Google Cloud USD 147K-211KAccelerated Linear Algebra | C++ | Data Processing | Debugging | FP8Mid-level Full TimeMountain View, CA, USA3h ago
-
Algorithms | Backend architecture | C++ | Cloud Spanner | Data StructuresMid-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, BigQuery Continuous Queries USD 174K-252KAutoscaling | BigQuery | C++ | Data Processing | Database InternalsSenior-level Full TimeKirkland, WA, USA3h ago
-
Senior Software Developer, Machine Learning USD 174K-252KC++ | Machine Learning | Python | Video Compression | Video EncodingSenior-level Full TimeMountain View, CA, USA; Waterloo, ON, …3h ago
-
Lead Software Engineer - Python/Cloud/AI/ML USD 173K-190KAWS | Agile | Apache Cassandra | Apache Kafka | Application ResiliencyBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePlano, TX, United States4h ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600768h ago
-
Research Scientist - LLM USD 225K-400KAudio Models | Evaluation Frameworks | Language Models | Language Processing | Large Language ModelsCommuter reimbursement | Internet reimbursement | Medical/Dental/Vision insurance | Phone bill reimbursement | Relocation providedSenior-level Full TimeSan Francisco Bay Area8h ago
-
Research, Mid-Training USD 225K-380KContext Length Extension | Data Filtering | Data weighting | Deep learning | Distributed TrainingMid-level Full TimeSan Francisco Bay Area9h ago
-
Mid-level Full TimeSeattle11h ago
-
Senior Staff Machine Learning Engineer USD 201K-352KAlgorithms | Code Tuning | Code profiling | Design Patterns | Java401(k) plan match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, CALIFORNIA, United States14h ago
-
Staff Computer Vision and Robotics Engineer USD 159K-309K3D Object Recognition | 3D data | 3D data processing | AWS | AgileSenior-level Full TimeMountain View, USA15h ago
-
Applied AI ML Lead - ML Ops, CTC USD 175K-210KAWS | CI/CD | Docker | ELK Stack | FastAPIBackup childcare | Financial coaching | Health insurance | Mental health support | On-site wellness centersSenior-level Full TimeJersey City, NJ, United States15h ago
-
Senior Staff AI Research Engineer, AI Platform USD 236K-295KAWS | Azure | Benchmarking | Fine Tuning | GCPEducational reimbursement | Employee insurance plans | Unlimited vacation | Wellness reimbursementSenior-level Full TimeNew York, NY16h ago
-
Agent Orchestration | CI/CD | Chunking Strategies | Context engineering | Databricks401k match | Counseling membership | Dental insurance | Flexible time off | Health insuranceMid-level Full Time-REMOTE, USA- R16h ago
-
Senior Data Engineer USD 114K-142KAWS S3 | Agile | Amazon Athena | Amazon QuickSight | Amazon Redshift401k | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeAustin, TX17h ago