Palantir Data Pipeline & Metadata Lead
GH Office: Tysons Corner, VA (Headquarters), United States
USD 149K-248K Senior-level Full Time
Tasks
- Define and enforce metadata standards data models ontologies and data dictionaries
- Drive data governance and lifecycle management including schema versioning lineage tracking and auditability
- Enable AI ready data foundations for semantic search entity resolution and analytics
- Engage stakeholders to define data strategy prioritize initiatives and translate requirements into solutions
- Ensure alignment of pipelines and metadata with enterprise architecture and system of record requirements
- Establish and govern data quality validation and exception handling processes
- Lead and mentor teams providing technical direction and quality oversight
- Lead design development and governance of enterprise data pipelines and metadata frameworks
- Operate within an Agile delivery model to manage backlog prioritization and iterative delivery
- Oversee end to end pipeline implementation including ingestion validation transformation and delivery
- Oversee integration across AWS Databricks and Palantir ensuring reliable secure data exchange
- Partner with data science and engineering teams to support AI ML use cases
- Serve as technical and functional lead for data ingestion transformation and metadata management
- Support document based ingestion workflows including OCR ICR outputs
Perks/Benefits
- 401k retirement plan
- Adoption Assistance
- Dental insurance
- Disability insurance
- Employee referral program
- Flexible spending accounts
- Health insurance
- Health savings account
- Learning opportunities
- Life insurance
- Mobility stipend
- Paid Holidays
- Parental leave
- Student loan paydown
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Spark | Auditability | Data Architecture | Data Engineering | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Validation | Data dictionaries | Data integration | Databricks | ETL | Entity Resolution | Exception Handling | ICR | Lakehouse Architecture | Metadata Management | OCR | Ontology | Palantir AIP | Palantir Foundry | Python | SQL | Schema versioning | Semantic Search
Related jobs
-
Senior AI Engineer USD 120K-180KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks401k match | Career growth | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R4h ago
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R4h ago
-
Sr. Manager, Data Platforms USD 133K-195KAPIs | Access Controls | Batch Processing | Data Catalog | Data EngineeringContractor and partner support | Cross functional stakeholder collaboration | Hybrid work environmentSenior-level Full TimeCuyahoga Falls, OH, United States6h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States7h ago
-
.NET | Agentic AI | Agile | Auditability | Azure DevOps100 percent remote except first day equipment pickupSenior-level ContractPhoenix, United States R7h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US7h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States7h ago
-
Agios AI Foundation Software Engineer USD 165K-261KAgent Frameworks | Audio Processing | Autogen | Bias Mitigation | Computer VisionSenior-level Full TimeRedmond, WA10h ago
-
Senior Software Engineer, AI/ML, Youtube Ads USD 174K-252KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA10h ago
-
C++ | CSS | Database Development | HTML | HTTPMid-level Full TimeAnn Arbor, MI, USA10h ago
-
Automated Monitoring | C++ | Cloud platform | Dashboards | Data ModelingEntry-level Full TimeSunnyvale, CA, USA10h ago
-
Data Engineer, AI Solutions, Global Affairs USD 130K-187KData Modeling | Data Pipelines | ETL | LLM APIs | PythonMid-level Full TimeNew York, NY, USA; Chicago, IL, …10h ago
-
ATA | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Evaluation | Experiment design401k matching | Health coverage | Paid time off | Parental leaveMid-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States16h ago
-
Software Engineer, Robotics & Autonomous Systems USD 180K-225K3D data | 3D data processing | AWS | Airflow | C++Commuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA18h ago
-
Senior Software Engineer (AI/ML) USD 150K-222KAPI Gateway | API Management | Cloud Native | Containers | Data Warehousing401k match | Dental insurance | Federal Holidays | Flexible PTO | Flexible spending accountSenior-level Full TimePatrick SFB, FL19h ago
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R20h ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States20h ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States20h ago
-
Full Stack AI Engineer USD 220K-270KAI Agents | Cloud Storage | Cloud platform | Django | Google CloudSenior-level Full TimeMountain View20h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent systems | Autogen | Chroma | Cloud services | Embedding pipelinesClient site travel | Commuting within reasonable distanceMid-level Full TimeCleveland | Tampa | San Diego …20h ago
-
Design Optimization Engineer - Postdoctoral Researcher USD 122K-143KAdjoint method | C# | C++ | CUDA | Data Science401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R20h ago
-
Full Stack AI Software Engineer USD 216K-283KAPI contracts | AWS | Azure | Classification | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | ESPPExecutive-level Full TimeSan Mateo, CA, United States20h ago
-
Data Engineer III USD 113K-127KAPIs | AWS Redshift | AWS Step Functions | Agile | Amazon EC2Healthcare benefits | Occasional travel | Remote workSenior-level Full TimeColumbia, MD, US20h ago