Principal Data Engineer (New York)
Tasks
- Architect AI ML infrastructure for feature stores and vector databases
- Architect cloud-based data solutions
- Automate testing and security scanning
- Build CI/CD pipelines
- Collaborate with data scientists analytics and stakeholders
- Deploy containerized data applications
- Design AI enhanced data pipelines
- Drive data platform modernization
- Ensure data quality, reliability, and governance
- Establish branching strategies
- Implement PostgreSQL and MongoDB data solutions
- Implement real-time inference pipelines
- Integrate LLMs for automated data quality checks
- Lead design data pipeline architecture end to end
- Mentor data engineers and conduct architecture reviews
Perks/Benefits
- Comprehensive healthcare offerings
- Employee resource groups
- Global parental leave plan
- Hybrid work two days per week on site
- Matched donation programs
- Paid volunteer days
- Retirement planning
- Training and leadership development programs
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS EKS | Amazon EMR | Amazon Q | Amazon RDS | Apache Airflow | ArgoCD | Autogen | BDD | CCPA | CI/CD | Confluence | Databricks | Datadog | Docker | Feature Stores | GDPR | GitHub | GitHub Actions | GitHub Copilot | GitOps | Glue | Java | Jira | Kafka | Kinesis | Kubernetes | LLMs | Lambda | Langchain | Llamaindex | Model Context Protocol | MongoDB | Playwright | PostgreSQL | Prompt engineering | RAG | Real Time | Real-time Inference | S3 | SOC 2 | Snowflake | Spring Boot | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
Principal AI/ML Scientist USD 150K-207KAWS | AWS GovCloud | Artificial Intelligence | Azure | Azure AIPublic trust suitabilitySenior-level Full TimeARLINGTON, VA, United States5h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States7h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD8h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon9h ago
-
AI-assisted software development | AWS | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon9h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …10h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …10h ago
-
Data Platform & Engineering Specialist USD 100K-130KAWS | Amazon Kinesis | Azure | Azure Event | Azure Event HubsDental insurance | Educational assistance | Flexible spending accounts | Health insurance | Health savings accountsMid-level Full TimeLincoln, Nebraska10h ago
-
Machine Learning Leader - Optical Solutions USD 180K-300KAnomaly Detection | Data analytics | Image Processing | Java | Machine LearningAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeFremont, California10h ago
-
AI Architect USD 134K-237KAI Search | AI Security | API Gateway | API Integration | AWS BedrockAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountsSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …10h ago
-
API Design | Agent systems | Agentic Workflows | Apache Beam | Artificial IntelligenceSenior-level Full TimeSunnyvale, CA, USA; Cambridge, ON, Canada12h ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | Apache Kafka | Automated testingEntry-level Full TimeDenver, Colorado, United States14h ago
-
Senior Software Engineer - Database Engineering USD 200K-287KAutomated testing | Debugging | Distributed Systems | Distributed key-value stores | Failure recoverySenior-level Full TimeUS-CA-Menlo Park17h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R18h ago
-
Principal AI Architect Engineer USD 118K-195KAWS | AWS Lambda | Amazon Bedrock | Amazon EC2 | Amazon EKSSenior-level Full TimeNew York, United States23h ago
-
Senior Software Engineer (AI/ML) - Vice President USD 150K-210KAPI Security | Algorithms | Cloud Platforms | Data Structures | DatabricksSenior-level Full Time1 New York Plaza, United States23h ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Financial benefits | Health insurance | Life insuranceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …23h ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), …23h ago
-
AI Developer USD 77K-176KAWS | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health benefits | Life insurance | Paid leaveMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …23h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code review100 percent remote | Career growth | Full-time employment | H1B transfer support | W2 employmentMid-level Full TimeUnited States - Remote R23h ago
-
Senior Data Engineer USD 120K-224KAb Initio | Agile | DB2 | Datamover | Foundation ServerHybrid work scheduleSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …23h ago
-
Data Engineer III USD 74K-84KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data WarehouseAdoption Assistance | Behavioral health solutions | Employee resource groups | Mentorship programs | Paid caregiver leaveSenior-level Full TimeUSA - TX - Carrollton - …23h ago