Palantir Data Pipeline & Metadata Lead
GH Office: Tysons Corner, VA (Headquarters), United States
USD 149K-248K Senior-level Full Time
Tasks
- Define and enforce metadata standards data models ontologies and data dictionaries
- Drive data governance and lifecycle management including schema versioning lineage tracking and auditability
- Enable AI ready data foundations for semantic search entity resolution and analytics
- Engage stakeholders to define data strategy prioritize initiatives and translate requirements into solutions
- Ensure alignment of pipelines and metadata with enterprise architecture and system of record requirements
- Establish and govern data quality validation and exception handling processes
- Lead and mentor teams providing technical direction and quality oversight
- Lead design development and governance of enterprise data pipelines and metadata frameworks
- Operate within an Agile delivery model to manage backlog prioritization and iterative delivery
- Oversee end to end pipeline implementation including ingestion validation transformation and delivery
- Oversee integration across AWS Databricks and Palantir ensuring reliable secure data exchange
- Partner with data science and engineering teams to support AI ML use cases
- Serve as technical and functional lead for data ingestion transformation and metadata management
- Support document based ingestion workflows including OCR ICR outputs
Perks/Benefits
- 401k retirement plan
- Adoption Assistance
- Dental insurance
- Disability insurance
- Employee referral program
- Flexible spending accounts
- Health insurance
- Health savings account
- Learning opportunities
- Life insurance
- Mobility stipend
- Paid Holidays
- Parental leave
- Student loan paydown
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Spark | Auditability | Data Architecture | Data Engineering | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Validation | Data dictionaries | Data integration | Databricks | ETL | Entity Resolution | Exception Handling | ICR | Lakehouse Architecture | Metadata Management | OCR | Ontology | Palantir AIP | Palantir Foundry | Python | SQL | Schema versioning | Semantic Search
Related jobs
-
Applied AI Engineer USD 101K-150KA/B | A/B Testing | AWS | Agile | B testingOnsite work 4 days per weekMid-level Full TimeDallas, TX, United States9h ago
-
Data Engineer- Consumer/Small Business USD 76K-125KAWS | AWS EC2 | AWS Glue | Adobe Analytics | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States10h ago
-
Data Integration & Pipeline Manager USD 96K-125KAWS | AWS Glue | Agile | Amazon Athena | Amazon EC2Mid-level Full TimeMiami Lakes, FL, United States10h ago
-
Director of AI & Data Analytics USD 240K-322KAWS | Anomaly Detection | Apache Airflow | Azure | DBT401k match | Autonomy | Collaborative culture | Generous PTO | Health and wellness benefitsExecutive-level Full TimeDallas, TX, US10h ago
-
Lead CyberSecurity Engineer USD 119K-258KAlation | BigID | Cloud apps | Data Classification | Data GovernanceHybrid work | In-person collaboration | Work-life balanceSenior-level Full TimeAlpharetta, GA, United States10h ago
-
Senior Data Engineer USD 119K-180KANSI SQL | AWS S3 | Amazon Redshift | Azure Container | Azure Container AppsSenior-level Full TimeOrlando, FL, United States11h ago
-
AI Safety | AI Search | AWS | Amazon SageMaker | Application development401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States11h ago
-
Senior-level ContractBellevue, United States13h ago
-
API Integration | Asynchronous processing | Containerization | Data Pipelines | Deep learningSenior-level ContractAnnapolis, United States R13h ago
-
Azure CycleCloud | Cloud Migration | Compliance | HPC architecture | Image Builder100% remote | Contract employment | No Third Party Use | Unlimited growthSenior-level Full TimeUnited States, United States R14h ago
-
Technical Architect USD 109K-188KAdobe AEM | Adobe Experience | Adobe Experience Platform | Data Management | ETLSenior-level Full TimeRaleigh, North Carolina, United States14h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationSenior-level Full TimeBellevue, WA16h ago
-
AI Agents | C++ | Data Structures | Data Structures and Algorithms | Generative AISenior-level Full TimeNew York, NY, USA16h ago
-
Solutions Architect, Data, Google Cloud USD 183K-265KBigQuery | Cloud infrastructure | Data Migration | Data Modeling | Data WarehousingSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA16h ago
-
ML Engineer, Query Understanding, Search Ads USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Deep learningMid-level Full TimeMountain View, CA, USA16h ago
-
Customer Engineer, Data Analytics, Financial Services USD 153K-222KApache Spark | Batch Processing | Big Data | Cloud Computing | Cloud platformSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …16h ago
-
BigQuery | Cloud platform | Data Processing | Deep learning | Distributed SystemsMid-level Full TimeKirkland, WA, USA16h ago
-
Software Engineer III, AI/ML, Google Play USD 147K-211KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA16h ago
-
Senior Software Engineer, AI/ML, Payments Platform USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA16h ago
-
Staff Software Engineer, AI/ML Machine Repairs USD 207K-300KArtificial Intelligence | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Senior ML/AI Software Engineer, Chrome AI USD 174K-252KAgent Orchestration | Algorithms | Automated testing | C++ | Computer VisionSenior-level Full TimeMountain View, CA, USA16h ago
-
Staff Software Engineer, AI/ML, Agent Assist USD 207K-300KAgentic AI | Cloud Computing | Data Processing | Debugging | Deep learningSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Mid-level Full TimeIndianapolis, IN, 46254, USA17h ago
-
Sr. Data Engineer USD 131K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityConvenient location | Group insurance | Hospitalization insurance | Meal vouchers | Open company cultureSenior-level Full TimeUnited States, FL, US, 56007621h ago
-
Embedded Systems Engineer USD 100K-200KC# | C++ | CAN | Circuit design | Debugging Tools401k | Dental insurance | Disability insurance | Employee stock ownership plan | Employer paid medical insuranceSenior-level Full TimeGoleta, CA, US22h ago