Principal Data Engineering Lead - Services Special Project
Tasks
- Architect data models for analytics
- Build real time data ingestion and streaming pipelines
- Coordinate with business groups and stakeholders
- Deploy and optimize machine learning inference pipelines
- Design build and operate data infrastructure
- Develop ETL and ELT pipelines
- Implement distributed data processing with Apache Spark
- Integrate LLM and embedding model inference
- Lead data processing systems
- Manage data versioning and lake tables
- Orchestrate data workflows and jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Beam | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | BigQuery | CI/CD | Cassandra | Data Architecture | Data Governance | Data Lake | Data Lake Architecture | Data Modeling | Data Privacy | Data Security | Dimensional Modeling | Docker | EKS | ELT | ETL | Embedding Models | Faiss | Graph Databases | Hadoop | Inference Server | Java | Jenkins | Kubernetes | LLM | Milvus | NoSQL | ONNX Runtime | PGVector | PostgreSQL | Presto | PySpark | Python | Redis | SQL | Scala | Snowflake | TensorRT | TigerGraph | Torchserve | Trino | Triton Inference | Triton Inference Server | VLLM | Vector Search
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
Research Engineer, Computer Vision USD 147K-208KAR/VR | Algorithm Development | Artificial Intelligence | C++ | Computer VisionSenior-level Full TimeSunnyvale, CA1h ago
-
Data Engineer, Product Analytics (University Grad) USD 173K-196KCompliance | Data Modeling | Data Quality | Data Security | Data TransformationCareer growth | Skill developmentNone Full TimeMenlo Park, CA | New York, …1h ago
-
Senior Staff Software Engineer, AI/ML, Google Ads USD 262K-364KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA2h ago
-
Applied Machine Learning | C++ | Concurrency | Distributed Systems | GoSenior-level Full TimeSan Jose, CA, USA2h ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | Application Performance Tuning | Application performance | C++ | CI/CDSenior-level Full TimeMountain View, CA, USA; New York, …2h ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States4h ago
-
Data Governance Activation Manager USD 124K-174KAI Data | AI data readiness | Business acumen | Change Management | Data Catalog401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimePiscataway, NJ, US5h ago
-
PIIM Analytics Lead USD 105K-160KBigQuery | DAX | Data Governance | Data Quality | Data VisualizationDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeClay, NY, US8h ago
-
Senior Engineer, Big Data USD 134K-170KAmazon Web Services | Apache Spark | Automated testing | Azure | CI/CDSenior-level Full TimeUnited States10h ago
-
Data Management | Data Quality | Databases | Knowledge graphs | Machine LearningSenior-level Full TimeGarching bei München (Munich), DE, 8574811h ago
-
Software Engineer, Data Engineering USD 70K-200KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeIrvine, CA12h ago
-
Embedded Software Engineer, Perception (All Levels) USD 154K-212KARM | C++ | CSI-2 | CUDA | Device treeMid-level Full TimeLos Angeles, CA12h ago
-
Senior-level Full TimeHouston, TX, US12h ago
-
Director, Data Engineering & Analytics USD 243K-401KAI | AI Agents | AWS | Applied statistics | Artificial Intelligence401k employer match | Dental insurance | Disability insurance | Flexible spending account | Life insuranceExecutive-level Full TimeSeattle, Washington, United States13h ago
-
Staff Software Engineer - Streaming USD 182K-247KApache Spark | Data Storage | Database systems | Distributed Systems | Latency optimizationSenior-level Full TimeSeattle, Washington13h ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …13h ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …13h ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …13h ago
-
Finance & Analytics USD 100K-155KBudgeting | Business Intelligence | Chart of Accounts | Data Modeling | Data QualityFeedback Focused Environment | Growth mindset | In-person work culture | Owner mentality | Startup flexibilitySenior-level Full TimeAustin, TX14h ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco14h ago
-
AWS Glue | AWS Glue Catalog | AWS S3 | Apache Atlas | Apache FlinkSenior-level Full TimeCupertino14h ago
-
Senior AI Engineer - Services Special Projects USD 150K-260KAdversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content ModerationSenior-level Full TimeSan Francisco Bay Area14h ago
-
AWS | Adversarial evaluation | C++ | Cloud platform | Content ModerationSenior-level Full TimeSan Francisco Bay Area14h ago
-
Manager, BI + Analytics Engineer USD 150K-180KAirflow | BigQuery | DBT | Dashboarding | Data ModelingMid-level Full TimeWashington, D.C.14h ago