Principal Data Engineer (New York)
Tasks
- Architect AI ML infrastructure for feature stores and vector databases
- Architect cloud-based data solutions
- Automate testing and security scanning
- Build CI/CD pipelines
- Collaborate with data scientists analytics and stakeholders
- Deploy containerized data applications
- Design AI enhanced data pipelines
- Drive data platform modernization
- Ensure data quality, reliability, and governance
- Establish branching strategies
- Implement PostgreSQL and MongoDB data solutions
- Implement real-time inference pipelines
- Integrate LLMs for automated data quality checks
- Lead design data pipeline architecture end to end
- Mentor data engineers and conduct architecture reviews
Perks/Benefits
- Comprehensive healthcare offerings
- Employee resource groups
- Global parental leave plan
- Hybrid work two days per week on site
- Matched donation programs
- Paid volunteer days
- Retirement planning
- Training and leadership development programs
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS EKS | Amazon EMR | Amazon Q | Amazon RDS | Apache Airflow | ArgoCD | Autogen | BDD | CCPA | CI/CD | Confluence | Databricks | Datadog | Docker | Feature Stores | GDPR | GitHub | GitHub Actions | GitHub Copilot | GitOps | Glue | Java | Jira | Kafka | Kinesis | Kubernetes | LLMs | Lambda | Langchain | Llamaindex | Model Context Protocol | MongoDB | Playwright | PostgreSQL | Prompt engineering | RAG | Real Time | Real-time Inference | S3 | SOC 2 | Snowflake | Spring Boot | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R5h ago
-
Software Engineer, Product USD 208K-269KAgentic Frameworks | Anthropic | Claude Code | Cursor | DocumentationDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA5h ago
-
Sr. Manager Data Engineering USD 125K-188KAutomated testing | Bitbucket | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeSouthlake, TX, United States8h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States11h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States11h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R12h ago
-
AI Engineer USD 105K-115KAPI Cost Modeling | API Integration | API Wrappers | Anthropic API | Conversation DesignCalm health employee membership | Company social events | Comprehensive benefits package | Employee referral incentive program | Employee resource groupsEntry-level Full TimeCincinnati, OH, US12h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States12h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA13h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA14h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA14h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City14h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work cultureSenior-level Full TimeHQ-San Francisco14h ago
-
API Design | Data Modeling | Low Latency | Low-Latency Systems | Rate LimitingHybrid work culture | In person meeting once per quarterSenior-level Full TimeHQ-San Francisco14h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work culture | In person once per quarter for remote rolesSenior-level Full TimeHQ-San Francisco14h ago
-
Software Engineer, Optimized Checkout & Link USD 161K-213KAPI Development | Automated testing | End to End | End-to-End Testing | GraphQL401k plan | Company bonus | Equity | Medical, dental, and vision benefits | TelecommutingMid-level Full TimeUS Remote R14h ago
-
Lead Data Analyst, Product Analytics USD 150K-180KA/B | A/B Testing | Analytics engineering | B testing | BigQuerySenior-level Full TimeRemote, US R15h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R15h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA16h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R16h ago
-
AI | Application Programming | Application Programming Interfaces | Backend Development | Cloud ComputingFlexible-hybrid work | Hybrid schedule 3 days on site per weekSenior-level Full TimeSan Francisco, CA16h ago