Principal Data Engineering Lead - Services Special Project
Tasks
- Build and operate real time data processing platform
- Deploy and optimize LLM inference in production
- Design ETL/ELT pipelines
- Develop data architecture and analytics schemas
- Implement distributed data processing jobs
- Integrate ML inference and embedding pipelines
- Lead data engineering infrastructure
- Manage streaming data ingestion
- Optimize real time inference performance
- Set up workflow orchestration
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Beam | Apache Flink | Apache Hadoop | Apache Iceberg | Apache Kafka | Apache Spark | Big Data | CI/CD | Cassandra | DVC | Data Architecture | Data Governance | Data Lake | Data Modeling | Data Privacy | Data Security | Delta Lake | Dimensional Modeling | Docker | ELT | ETL | Faiss | Google BigQuery | Graph Databases | Hadoop HDFS | Java | Jenkins | Kubernetes | Milvus | NoSQL | PGVector | PostgreSQL | Presto | PySpark | Python | Redis | SQL | Scala | Snowflake | TigerGraph | Trino | Vector Databases
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Mid-level Full TimeUS-Kansas-Wichita3h ago
-
Cloud Native | Column-stores | Database Design | Distributed Systems | Document DatabasesSenior-level Full TimeSeattle, Washington, United States3h ago
-
Gen AI Developer Specialist USD 118K-204KAI Evaluation | AWS | AWS Bedrock | Access Management | Cause analysisSenior-level Full TimeUnited States3h ago
-
Data Engineer (Multiple Positions) USD 148K-300KBig Data | Data Modeling | Data Quality | Data Reliability | ETLEntry-level Full TimeSeattle, Washington, United States3h ago
-
Mid-level Full TimeUS-Kansas-Wichita4h ago
-
Cloud Computing | Column-stores | Database Design | Distributed Systems | Document DatabasesEntry-level Full TimeSan Jose, California, United States4h ago
-
Data cleaning | Data collection | Deep learning | Machine Learning | Model EvaluationSenior-level Full TimeSan Jose, California, United States4h ago
-
AI | CPU | GPU | Kubernetes | Machine LearningSenior-level Full TimeSan Jose, California, United States4h ago
-
Containerd | Docker | Go | Java | KubernetesSenior-level Full TimeSeattle, Washington, United States4h ago
-
AI | AI workloads | C++ | CPU | Distributed SystemsSenior-level Full TimeSeattle, Washington, United States4h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-450KCUDA | Deep learning | Distributed Training | GPU Performance | Language ModelsEntry-level Full TimeSan Jose, California, United States4h ago
-
Backup and Recovery | Disaster Recovery | Fault Tolerance | High Availability | Monitoring and AlertingSenior-level Full TimeSan Jose, California, United States4h ago
-
Software Development Engineer - Cloud Native Databases USD 148K-300KBlob Storage | Database Schema | Database schema management | Distributed Systems | Distributed TransactionsAgile collaborative environment | On-call rotationMid-level Full TimeSeattle, Washington, United States4h ago
-
Alerting | Backup and Restore | Cloud infrastructure | Disaster Recovery | Distributed SystemsEntry-level Full TimeSeattle, Washington, United States4h ago
-
AI Engineer Graduate (Client Arch) - 2027 Start USD 100K-118KArtificial Intelligence | Automation | CI/CD | Code Refactoring | Continuous DeliveryEntry-level Full TimeSan Jose, California, United States4h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresDevelopment workshops | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States4h ago
-
Data Engineer Graduate (Monetization Data) - 2027 Start USD 115K-177KAmazon Redshift | Apache Airflow | Apache Flink | Apache Hive | Apache KafkaEntry-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Recommendation-Global E-Commerce) - 2027 Start USD 116K-177KC++ | Computer Vision | Data Mining | Data Pipelines | DatabasesEntry-level Full TimeSeattle, Washington, United States4h ago
-
Machine Learning Engineer, AI Agent USD 148K-180KAI Agents | Agent systems | C++ | Context engineering | Deep learningMid-level Full TimeSan Jose, California, United States4h ago
-
Advertising Systems | Algorithms | C# | C++ | Data StructuresEntry-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning/Research Engineer Graduate (Monetization Technology-Ads Core Global) - 2027 Start (PhD) USD 113K-250KAlgorithms | C++ | Computer Vision | Counterfactual Optimization | Data StructuresEntry-level Full TimeSan Jose, California, United States4h ago
-
Agent Registry | Agentic AI | C++ | Computer Vision | Feature StoreEntry-level Full TimeSan Jose, California, United States4h ago
-
ML Infra Engineer Intern (Ads Infra) - 2027 Summer USD 113K-250KAutomated Operations | C++ | Cloud Native | Data Pipelines | Data QualityEntry-level InternshipSan Jose, California, United States4h ago
-
(General Hire) Machine Learning Engineer Graduate (Performance Monetization) - 2027 Start (PhD) USD 118K-250KC++ | Debugging | Go | MXNet | Machine LearningEntry-level Full TimeSan Jose, California, United States4h ago