Staff / Principal Data Engineer
New York, New York, United States
USD 182K-270K (estimate) Senior-level Full Time
Tasks
- Build low latency batch and streaming pipelines
- Deploy and operate platform on Kubernetes
- Design build and operate data lake and ingestion platform
- Develop pipelines for generative AI embeddings and retrieval
- Establish data quality freshness completeness lineage observability
- Ingest normalize enrich and serve model ready data
- Integrate new data sources into pipeline
- Own CI CD and operational reliability
- Own data platform and data lake
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch data | Batch data pipelines | CI/CD | Data Lineage | Data Observability | Data Pipelines | Data Quality | Data completeness | Data freshness | Embeddings | Generative AI | Information Retrieval | Kubernetes | Streaming Data | Streaming data pipelines | Threat Intelligence | Threat modeling | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer | Staff Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL12h ago
-
Lead Data Engineer USD 110K-120KAmazon Redshift | Amazon Web Services | Azure | Azure Synapse | CDCSenior-level Full TimeWarsaw, IN, US13h ago
-
Business Intelligence | Dashboard Development | Data Architecture | Data Modeling | Data PipelinesSenior-level ContractLansing, United States13h ago
-
Software Infrastructure Developer (Agentic AI Focus) USD 160K-213KAWS | Agent SDK | Anthropic API | Asynchronous | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL14h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresEntry-level InternshipSan Jose, California, United States14h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Search Quality) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Evaluation | Information RetrievalEntry-level Full TimeSan Jose, California, United States14h ago
-
C++ | Computer Vision | Data Mining | Data Pipelines | DatabasesEntry-level Full TimeSan Jose, California, United States14h ago
-
Machine Learning Engineer Intern (TikTok-Data-Search-Basic Ranking) - 2027 Start (PhD) USD 136K-205KAlgorithms | Data Pipelines | Data Structures | Databases | Distributed SystemsEntry-level InternshipSan Jose, California, United States14h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Basic Ranking) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Information Retrieval | Language ModelsEntry-level Full TimeSan Jose, California, United States14h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States14h ago
-
Algorithms | Backend Services | C++ | Data Mining | Data PipelinesEntry-level InternshipSan Jose, California, United States14h ago
-
Backend systems | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States14h ago
-
Machine Learning Engineer Intern (TikTok-Data-Search-Visual Search) - 2027 Start (PhD) USD 136K-205KData Mining | Data Pipelines | Distributed Systems | Experimentation | Information RetrievalEntry-level InternshipSan Jose, California, United States14h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSan Jose, California, United States14h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Visual Search) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Evaluation | Information RetrievalEntry-level Full TimeSan Jose, California, United States14h ago
-
Research Engineer Graduate (Monetization Technology - Business Integrity) - 2027 Start USD 145K-250KAgentic Systems | Computer Vision | Data Pipelines | Debugging | DeepSpeedEntry-level Full TimeSan Jose, California, United States14h ago
-
Distributed Systems | Embedding Ingestion | Engine design | Intent detection | LLM AgentsSenior-level Full TimeSeattle, Washington, United States14h ago
-
Computer Vision | Distributed Systems | Evaluation | Information Retrieval | Language ModelsEntry-level Full TimeSeattle, Washington, United States14h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSeattle, Washington, United States14h ago
-
Backend Development | C++ | Computer Vision | Data Mining | Data PipelinesEntry-level Full TimeSeattle, Washington, United States14h ago
-
Big Data | C# | C++ | Data Pipelines | Distributed StorageDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States14h ago
-
A/B | A/B Testing | Apache Flink | Apache Hive | Apache SparkEntry-level Full TimeSan Jose, California, United States14h ago
-
Computer Vision | Deep learning | Generative AI | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States14h ago
-
ML Infra Engineer Graduate (Ads Infra) - 2027 Start USD 113K-250KAI Agents | C plus plus | Cloud Native | Data Pipelines | Data ProcessingEntry-level Full TimeSan Jose, California, United States14h ago