Staff / Principal Data Engineer
New York, New York, United States
USD 182K-270K (estimate) Senior-level Full Time
Tasks
- Build low latency batch and streaming pipelines
- Deploy and operate platform on Kubernetes
- Design build and operate data lake and ingestion platform
- Develop pipelines for generative AI embeddings and retrieval
- Establish data quality freshness completeness lineage observability
- Ingest normalize enrich and serve model ready data
- Integrate new data sources into pipeline
- Own CI CD and operational reliability
- Own data platform and data lake
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch data | Batch data pipelines | CI/CD | Data Lineage | Data Observability | Data Pipelines | Data Quality | Data completeness | Data freshness | Embeddings | Generative AI | Information Retrieval | Kubernetes | Streaming Data | Streaming data pipelines | Threat Intelligence | Threat modeling | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer | Staff Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Senior-level Full TimeOrlando, FL, United States6h ago
-
Senior-level Full TimeHoboken, NJ, United States9h ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States9h ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA12h ago
-
Staff Software Engineer, AI/ML, Google Cloud Security USD 207K-301KAgentic AI | Cloud platform | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeReston, VA, USA; New York, NY, …12h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R18h ago
-
Senior-level Full TimeMountain View, CA20h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA20h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States23h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R23h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States23h ago
-
Senior-level Full TimeSan Jose, CA, United States23h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningCareer growthMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Equal opportunity employment | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringKnowledge sharing | Long-term career growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Ingestion | Data Lineage | Data ModelingRemote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code review100 percent remote | Benefits | Career growth potentialMid-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Prompt Engineering USD 100K-150KAgentic Workflows | Chunking | Cost Optimization | Embeddings | Evaluation FrameworksBenefits | Full-time W2 employment | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Senior Data Integration Operations Engineerr USD 130K-189KAWS | Access Control | Automation | Azure | Best practices24 7 availability on rotating basis | Documentation and knowledge management support | Hybrid work schedule | Rotating on-callSenior-level Full TimeNU Boston Campus, United States23h ago