Data Engineer (Palantir Foundry)
Tasks
- Architect data pipelines
- Build ELT pipelines
- Build ETL pipelines
- Configure data connections in Palantir Foundry
- Develop Ontology objects
- Develop data pipelines using PySpark
- Develop data processing using Python
- Develop transformations using Spark SQL
- Ensure end to end data flow integration
- Ensure semantic consistency
- Explore GenAI integration
- Identify workflow automation opportunities
- Ingest and transform data into ontology driven applications
- Lead feedback loop for Foundry improvements
- Maintain data frameworks
- Maintain platform stability
- Maintain version control in Foundry
- Manage Contour
- Manage Pipeline Builder
- Manage code repositories
- Mentor junior engineers
- Model data into ontology driven applications
- Monitor and report data costs
- Optimize data workflows
- Perform data cleansing
- Perform data transformation
- Provide technical guidance
- Stay current with Foundry updates
- Translate requirements into data solutions
- Translate requirements into scalable data solutions
- Troubleshoot data issues
- Tune data pipeline performance
- Validate data quality
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
Access Control | Azure | Contour | Data Governance | Data Modeling | Data Security | Data connections | Generative AI | Metadata Management | Ontology management | Palantir Foundry | Pipeline Builder | PySpark | Python | Snowflake | Spark SQL
Education
N/A
Related jobs
-
Automation Scripting | Bare Metal | C plus plus | C# | CANHealth insurance | Professional development opportunities | Retirement plansSenior-level Full TimeHuntington Beach, CA9h ago
-
Analytics Engineer USD 140K-190KCI/CD | DBT | Data Modeling | Data Quality | Data Testing401k match | Flexible time off | Growth opportunities | Health benefits | Remote-friendlySenior-level Full TimeUnited States (Remote) R10h ago
-
Analytics Engineer USD 110K-120KAmazon Redshift | BigQuery | Data Modeling | Data Pipelines | DatabricksCareer progression | Cross-functional collaboration | Equity | Remote-first workMid-level Full TimeRemote, United States R11h ago
-
Software Engineer, Data Integration USD 165K-225KAWS | Automated testing | Azure | Cloud Computing | Data IngestionSenior-level Full TimeRemote - US Only R12h ago
-
Software Engineer - AI Developer Productivity USD 165K-330KAudit Logging | Authentication | Authorization | CI/CD | Context ManagementCompany facilitated 401k | Fertility and family building stipend | Flexible PTO | Medical dental vision insurance 100 percent | Paid parental leaveSenior-level Full TimeSan Francisco R12h ago
-
Telemetry Data Engineer USD 110K-128KAnomaly Detection | Azure Data | Azure Data Explorer | Data Engineering | Data Explorer401k retirement plan | Medical/Dental/VisionMid-level ContractRedmond, Washington, USA R12h ago
-
Software Engineer, Applied AI Infrastructure USD 193K-352KAttention | Batching | CI Failure Attribution | Cloud infrastructure | Context handlingSenior-level Full TimeMountain View, California (HQ)12h ago
-
ETL Data Engineer W2 Hiring. USD 111K-150KAPIs | Access Control | Agile | Data Governance | Data ModelingSenior-level Contract Full TimeColumbus, OH, United States12h ago
-
Senior-level Full TimeAustin, Texas13h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R13h ago
-
AWS | AWS EC2 | Automation | Azure | Azure Virtual401k match | ESPP | Family leave programs | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R13h ago
-
Principal, Data Analyst/BI Engineer USD 108K-145KAWS | BigQuery | Cloud platform | Data Governance | Data Modeling401k match | Healthcare Dental Vision | Paid Holidays | Paid time off | Parental leaveSenior-level Full TimeUnited States R13h ago
-
Data Engineer USD 133K-220KAI machine learning | Cloud Computing | Data Governance | Data Lineage | Data ModelingLeadership development | Professional developmentSenior-level Full TimeHerndon, VA13h ago
-
Sr. Analytics Engineer/ Data Scientist USD 205K-249KAirflow | Amazon Redshift | Anomaly Detection | BigQuery | CI/CD401k | Bi annual company offsites | Commuter stipend | Dental insurance | EquitySenior-level Full TimeSan Francisco, CA R14h ago
-
Entry-level Full TimeNorth Chicago, IL, United States14h ago
-
Senior Software Engineer - Cortex AI - FDE USD 200K-270KCloud Native | Cloud Native Architecture | Database Internals | Distributed State | Distributed SystemsSenior-level Full TimeUS-CA-Menlo Park R14h ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R14h ago
-
Staff AI Engineer USD 198K-260KAgentic Workflows | Containerization | Docker | Experiment design | Generative AI401k plan participation | Annual performance bonuses | Company equity grants | Disability insurance | Life insuranceSenior-level Full TimeNew York, New York, United States R14h ago
-
Staff Applied Scientist USD 300K-390KAWS | Experimentation | Heuristics | Huggingface | Language Models401k match | Flexible PTO | Flexible spending accounts | Medical/Dental/Vision | Teladoc HealthSenior-level Full TimeNew York City, New York14h ago
-
Staff Embedded Security Engineer USD 276K-311KBootloader development | C# | C++ | Code review | CryptographyCompetitive equity package | Hybrid workSenior-level Full TimeSunnyvale R14h ago
-
Data Engineer II USD 80K-115KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure FunctionsMid-level Full TimeSmyrna, Georgia, United States14h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R14h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R14h ago
-
Software Engineer, ML Inference Platform USD 160K-240KC++ | Compilers | Data Pipelines | Distributed Systems | Hardware accelerationSenior-level Full TimeMountain View, California (HQ)15h ago
-
Senior/Staff Software Engineer, ML Inference Platform USD 193K-352KC++ | Compiler | Continuous Testing | Data pipeline | Distributed SystemsSenior-level Full TimeMountain View, California (HQ)15h ago