Staff / Principal Data Engineer
New York, New York, United States
USD 182K-270K (estimate) Senior-level Full Time
Tasks
- Build low latency batch and streaming pipelines
- Deploy and operate platform on Kubernetes
- Design build and operate data lake and ingestion platform
- Develop pipelines for generative AI embeddings and retrieval
- Establish data quality freshness completeness lineage observability
- Ingest normalize enrich and serve model ready data
- Integrate new data sources into pipeline
- Own CI CD and operational reliability
- Own data platform and data lake
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch data | Batch data pipelines | CI/CD | Data Lineage | Data Observability | Data Pipelines | Data Quality | Data completeness | Data freshness | Embeddings | Generative AI | Information Retrieval | Kubernetes | Streaming Data | Streaming data pipelines | Threat Intelligence | Threat modeling | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer | Staff Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)28d ago
-
AI Integration - Backend Services USD 207K-300KC++ | Cloud platform | Distributed Systems | Docker | GoCross-functional collaboration | Mentorship | On-call rotationSenior-level Full TimeUS-CA-San Jose4h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Data Pipelines | Deep learning | Infrastructure Optimization | Machine LearningSenior-level Full TimeSan Jose, California, United States4h ago
-
AI and Data Science Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerDiscretionary annual incentive program | Mentorship programs | Professional development opportunities | US travel opportunitiesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …4h ago
-
AWS | Agile | Airtable | Anthropic | Artificial IntelligenceMentorship | Professional development | Travel opportunitySenior-level Full TimePittsburgh, Pennsylvania, United States4h ago
-
Data Engineer, Product Analytics (University Grad) USD 171K-196KAI tools | Compliance | Data Modeling | Data Pipelines | Data PrivacyCareer Growth & Development | Work authorization supportNone Full TimeBellevue, WA | Menlo Park, CA …5h ago
-
Staff Software Engineer, Roads Data Quality, Geo USD 207K-301K3D Mapping | C# | C++ | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA5h ago
-
Data Engineer USD 76K-121KAWS | Airflow | Apache Airflow | Cloud Data | Cloud Data Warehouse401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimePiscataway, NJ, US9h ago
-
Advanced Analytics - Vet USD 109K-155KAutomation | Cloud Storage | Data Engineering | Data Governance | Data ModelingMid-level Full TimeOverland Park, KS, US9h ago
-
Advanced Analytics - Retail USD 109K-155KAWS | Cloud Computing | Cloud Storage | Data Governance | Data Pipelines401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeOverland Park, KS, US9h ago
-
AWS | Alerting | CI/CD | Databricks | DatadogSenior-level Full TimeJersey City, NJ, United States15h ago
-
Data Engineer, Infrastructure FinOps USD 146K-194KAPI Design | BigQuery | CI/CD | CloudFormation | DBTMid-level Full TimeCosta Mesa, California, United States15h ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Amazon Athena | Apache Iceberg | Apache Spark | AzureSenior-level Full TimeCosta Mesa, California, United States15h ago
-
Ad Ranking | Agentic Workflows | Automl | Deep learning | Distributed Systems401k matching | Dental insurance | Employee assistance program | Health insurance | Paid time offSenior-level Full TimePalo Alto, California, USA17h ago
-
AI Full Stack Developer & Architect USD 140K-161KCloud Run | Kubernetes | MLOps | Machine Learning | Next.jsSenior-level Contract Full TimeSan Jose, CA, United States21h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R22h ago
-
Senior Data Engineer USD 140K-160KApache Airflow | CI/CD | Change Data Capture | Cluster Sizing | Data Capture401k | Dental insurance | Health insurance | Hybrid work | Paid leaveSenior-level Full TimeNorth Hollywood, CA, United States22h ago
-
Senior Data Engineer USD 140K-160KAirflow | Auto Loader | CI/CD | Change Data Capture | Data CaptureSenior-level Full TimeNew York, NEW YORK, United States22h ago
-
Equities Data Engineer USD 175K-200KApache Iceberg | Apache Kafka | Apache Spark | CI/CD | Linux401k employer match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeChicago, New York23h ago
-
Senior Engineer, Inference Control Plane USD 139K-174KAPI Gateway | Capacity Planning | Distributed Systems | Fault Tolerance | GPU UtilizationEmployee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning access | Reimbursement for training and educationSenior-level Full TimeSeattle23h ago
-
Mid-level Full TimeNew York23h ago
-
Machine Learning Engineer USD 72K-131KCI/CD | Data Fusion | Data Pipelines | Data analytics | Deep learningHybrid work environment | MentorshipSenior-level Full TimeMelbourne, Florida, United States23h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Anthropic API | Autogen | Chroma | Cloud servicesClient facing work environment | Client site travel | Professional development opportunitiesMid-level Full TimeCleveland | Tampa | San Diego …23h ago
-
Junior Machine Learning Engineer USD 64K-106KCI/CD | Data Fusion | Data analytics | Data sets | Deep learningComprehensive benefits package | Hybrid work environment | Supportive work environment | US security clearance supportedEntry-level Full TimeMelbourne, Florida, United States23h ago
-
A/B | A/B Testing | Agentic Frameworks | Artificial Intelligence | B testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States1d ago