Lead, Data Engineer
Tasks
- Build dashboards for actionable insights
- Conduct data architecture review sessions
- Conduct data cleansing
- Create architectural artifacts and documentation
- Develop data pipelines architecture
- Ensure adherence to data standards
- Maintain data frameworks
- Maintain ontologies and ontology resources
- Manage data governance metadata and ontology standards
- Orchestrate data pipelines
- Oversee data ETL ELT pipelines
- Perform requirements decomposition
- Provide design reviews for data sourcing and pipelines
- Recommend data platform improvements
- Use Palantir Foundry for data integration
Perks/Benefits
- 401k match
- Company-Paid Holidays
- Disability insurance
- Education assistance
- Employee assistance program
- Flexible spending accounts
- Health insurance
- Paid time off
- Parental leave
- Work-life balance
Skills/Tech-stack
Azure Data | Azure Data Factory | Business Intelligence | Data Architecture | Data Cleansing | Data Factory | Data Governance | Data Modeling | Data Pipeline Development | Data Warehousing | Data integration | Data pipeline | Databricks | ELT | ETL | Generative AI | JavaScript | LLM integration | Metadata Management | Ontology management | OpenAI | Palantir Foundry | Pandas | Pipeline Development | PySpark | Python | RAG | Retrieval-Augmented Generation | SDLC | SSIS | Semantic Search | Snowflake Cortex | Spark SQL | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Data Engineer GBP 723KAWS | AWS CDK | Amazon Redshift | Amazon Web Services | BitbucketBike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leave | Health cash planMid-level Full TimeManchester / Hybrid, England, United Kingdom R6h ago
-
Senior Staff Engineer (LLM) GBP 80K-109KAgent systems | Anthropic API | Authentication | Chunking | EmbeddingsSenior-level Full TimeRemote, United Kingdom R8h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R9h ago
-
AWS | Autoscaling | Bash | CI/CD | Data PipelinesFully remote work | Healthcare coverage | Paid parental leave | Relocation assistance | Technical ownershipMid-level Full TimeRomania R11h ago
-
A/B | A/B Testing | AWS | Alerting | AutoscalingFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimeItaly R11h ago
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimePortugal R11h ago
-
AWS | Bash | Cloud platform | Databricks | DatadogEquity package | Fully remote Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeNetherlands R11h ago
-
A/B | A/B Testing | AWS | Alerting | AzureFully remote Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimeIreland R11h ago
-
A/B | A/B Testing | AWS | Azure | B testingFully remote work | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeSwitzerland R11h ago
-
AWS | Autoscaling | Azure | Bash | CI/CDEquity package | Fully remote work within Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeFrance R11h ago
-
A/B | A/B Testing | AWS | Autoscaling | B testingEquity package | Fully remote work Europe | Healthcare coverage | Paid parental leave | Professional growthMid-level Full TimeSpain R11h ago
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote work Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeGermany R11h ago
-
Conversational AI Engineer EUR 75K-125KAI orchestration | API Integration | Agentic AI | JSON | JavaScriptMid-level Full TimeRemote, Any Location, ES R14h ago
-
Senior-level Full TimeRemote, KA, IN R14h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R14h ago
-
A/B | A/B Testing | B testing | Cost Optimization | Data PipelinesEquity packages | Flexible leave | Parental leave | Remote within Australia | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R14h ago
-
Staff Data Platform Engineer USD 216K-270KApache Airflow | Apache Kafka | CI/CD | DBT | Data Governance401k | BetterUp coaching | Company holidays | Flexible paid time off | Learning and development stipendSenior-level Full TimeAll Hubs R16h ago
-
Software Engineer, Optimized Checkout & Link USD 161K-213KAPI Development | Automated testing | End to End | End-to-End Testing | GraphQL401k plan | Company bonus | Equity | Medical, dental, and vision benefits | TelecommutingMid-level Full TimeUS Remote R16h ago
-
Lead Data Analyst, Product Analytics USD 150K-180KA/B | A/B Testing | Analytics engineering | B testing | BigQuerySenior-level Full TimeRemote, US R17h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R17h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R17h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R18h ago
-
Senior Software Engineer, MLOps CAD 175K-220KAgile | Airflow | Batch Processing | DBT | Data PipelinesCharitable donation match | Flexible time off | Medical/Dental/Vision | Paid parental leave | Professional development budgetSenior-level Full TimeRemote - Alberta, Canada R18h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R18h ago