Palantir Data Pipeline & Metadata Lead
GH Office: Tysons Corner, VA (Headquarters), United States
USD 149K-248K Senior-level Full Time
Tasks
- Define and enforce metadata standards data models ontologies and data dictionaries
- Drive data governance and lifecycle management including schema versioning lineage tracking and auditability
- Enable AI ready data foundations for semantic search entity resolution and analytics
- Engage stakeholders to define data strategy prioritize initiatives and translate requirements into solutions
- Ensure alignment of pipelines and metadata with enterprise architecture and system of record requirements
- Establish and govern data quality validation and exception handling processes
- Lead and mentor teams providing technical direction and quality oversight
- Lead design development and governance of enterprise data pipelines and metadata frameworks
- Operate within an Agile delivery model to manage backlog prioritization and iterative delivery
- Oversee end to end pipeline implementation including ingestion validation transformation and delivery
- Oversee integration across AWS Databricks and Palantir ensuring reliable secure data exchange
- Partner with data science and engineering teams to support AI ML use cases
- Serve as technical and functional lead for data ingestion transformation and metadata management
- Support document based ingestion workflows including OCR ICR outputs
Perks/Benefits
- 401k retirement plan
- Adoption Assistance
- Dental insurance
- Disability insurance
- Employee referral program
- Flexible spending accounts
- Health insurance
- Health savings account
- Learning opportunities
- Life insurance
- Mobility stipend
- Paid Holidays
- Parental leave
- Student loan paydown
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Spark | Auditability | Data Architecture | Data Engineering | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Validation | Data dictionaries | Data integration | Databricks | ETL | Entity Resolution | Exception Handling | ICR | Lakehouse Architecture | Metadata Management | OCR | Ontology | Palantir AIP | Palantir Foundry | Python | SQL | Schema versioning | Semantic Search
Related jobs
-
Senior-level Full TimeWork from home, VA, United States R6h ago
-
Entry-level Full TimeFAIRFAX, VA, United States6h ago
-
Analytic Engineer USD 124K-166KAWS | Anomaly Scoring | Apache Airflow | Apache Spark | Cloud platformSecurity ClearanceSenior-level Full TimeFAIRFAX, VA, United States6h ago
-
Data Governance & Enablement Manager USD 120K-150KAI Governance | AWS | Accountability | Agile | AlationMid-level Full TimeMiami Lakes, FL, United States6h ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 140K-200KAI Foundry | AWS | AWS Bedrock | Artificial Intelligence | AutogenHybrid workSenior-level Full TimeMiami Lakes, FL, United States R6h ago
-
Data Integration & Pipeline Lead USD 106K-160KAWS | Agile | DBT | Data Architecture | Data GovernanceSenior-level Full TimeMiami Lakes, FL, United States6h ago
-
Agentic AI Engineer (Active TS/SCI Clearance) USD 153K-207KABAC | API Gateway | AWS | AWS CloudFormation | AWS LambdaActive Top Secret SCI clearanceSenior-level Full TimeChantilly, Virginia7h ago
-
Sr AI Platform Engineer USD 119K-261KAPI Governance | Agent tooling | Automated testing | Azure Databricks | CDCSenior-level ContractFrisco, United States8h ago
-
Access Control | Backup and Recovery | Business Objects | Cognos | Data DictionaryMid-level ContractAustin, United States8h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-198K.NET | AWS | Agile | Angular | AzureMentorship | Professional development | Travel allowanceSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …9h ago
-
Analyst, Senior Data Engineering USD 106K-130KAPI Development | Boto3 | CI/CD | Data Pipelines | Data TransformationSenior-level Full TimeUSA-Texas-Houston9h ago
-
Senior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Entry-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Entry-level Full TimeUSA-VA-Arlington9h ago
-
Subject Matter Expert (SME) AI/ML Engineer USD 116K-194KAPI Development | AWS SageMaker | Apache Airflow | Apache Spark | CI/CDSenior-level Full TimeUSA-VA-Arlington9h ago
-
Team Leader - Data Engineering (Shared Infrastructure) USD 135K-230KAnnotation pipelines | Architecture | Data Engineering | Data Quality | Data integration401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton10h ago
-
Team Leader - Data Engineering (Shared Infrastructure) USD 135K-230KAnnotation pipelines | Automated Evaluation | Data Engineering | Data Pipelines | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York10h ago
-
Production Engineering USD 155K-200KAI | API | Agent Orchestration | Bias Mitigation | C++Career development | On call rotation shared | Work on large-scale systemsSenior-level Full TimeBellevue, WA | Menlo Park, CA …11h ago
-
Photos Mission Tech Lead, Applied AI, Full Stack USD 262K-365KArtificial Intelligence | C++ | CSS | Computer Vision | Data StorageSenior-level Full TimeMountain View, CA, USA11h ago
-
Network Engineer, Data Center Management USD 126K-181KAccess Control | Access Control List | Address translation | Automation | C++Mid-level Full TimeAtlanta, GA, USA; Reston, VA, USA11h ago
-
System Development Engineer, Silicon, Google Cloud USD 138K-198KBash | Cloud systems | Cloud systems design | Configuration Management | DeploymentMid-level Full TimeSunnyvale, CA, USA11h ago
-
Staff AI Research Engineer, Large User Models USD 207K-300KAttention Mechanisms | Data Quality | Data Structures | Data Structures and Algorithms | Deep learningSenior-level Full TimeMountain View, CA, USA11h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-300KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, AI/ML, Ads Safety USD 174K-252KComputer Science | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeLos Angeles, CA, USA; Pittsburgh, PA, …11h ago
-
Artificial Intelligence Engineer II USD 128K-170KBatch Processing | Benchmarking | Data Analysis | Data Validation | Data VersioningMid-level Full TimeHouston, TX, US13h ago