Lead, Data Engineer
Tasks
- Build dashboards for actionable insights
- Conduct data architecture review sessions
- Conduct data cleansing
- Create architectural artifacts and documentation
- Develop data pipelines architecture
- Ensure adherence to data standards
- Maintain data frameworks
- Maintain ontologies and ontology resources
- Manage data governance metadata and ontology standards
- Orchestrate data pipelines
- Oversee data ETL ELT pipelines
- Perform requirements decomposition
- Provide design reviews for data sourcing and pipelines
- Recommend data platform improvements
- Use Palantir Foundry for data integration
Perks/Benefits
- 401k match
- Company-Paid Holidays
- Disability insurance
- Education assistance
- Employee assistance program
- Flexible spending accounts
- Health insurance
- Paid time off
- Parental leave
- Work-life balance
Skills/Tech-stack
Azure Data | Azure Data Factory | Business Intelligence | Data Architecture | Data Cleansing | Data Factory | Data Governance | Data Modeling | Data Pipeline Development | Data Warehousing | Data integration | Data pipeline | Databricks | ELT | ETL | Generative AI | JavaScript | LLM integration | Metadata Management | Ontology management | OpenAI | Palantir Foundry | Pandas | Pipeline Development | PySpark | Python | RAG | Retrieval-Augmented Generation | SDLC | SSIS | Semantic Search | Snowflake Cortex | Spark SQL | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AI Engineer Senior EUR 39K-48KAPI Integration | Agents | Automated testing | CI/CD | CachingAccess to certifications | Childcare tickets | Events meetups techdays | Extra days off | Flexible compensation planSenior-level Full TimeMadrid, Spain R8h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R9h ago
-
Senior LLMOps Engineer AUD 147K-180KAlerting | Dashboarding | Data Modeling | Data Pipelines | DatadogEquity | Fertility support | Health and wellness allowance | Home office budget | Learning and development budgetSenior-level Full TimeMelbourne R10h ago
-
Staff Machine Learning Engineer, Gen AI | Voice & Speech USD 150K-220KBigtable | Cloud Computing | Cloud Native | Cloud-native infrastructure | Data integrationRemote US basedSenior-level Full TimeUS Remote R10h ago
-
Amazon Redshift | Automated testing | Branching | CI/CD | Cloud DataCollaborative culture | Distributed international team | Equity stock options | Mentorship | OwnershipSenior-level Full TimeCanada R12h ago
-
Data Analyst Lead (12-months) M/F USD 125K-173KCorrelation Analysis | Dashboard Development | Data Cleansing | Data Governance | Data ModelingSenior-level Contract TemporaryAsia, Malaysia R12h ago
-
Apache Spark | Cloud Computing | DBT | Data Ingestion | Data ModelingFlexible project allocation | International collaboration | Project variety | Remote-first | Technical autonomySenior-level ContractBrazil R12h ago
-
AWS | Airflow | Alerting | Aurora | CI/CDAnnual goal based bonuses | Birthday day off | Childcare assistance | Corporate training platform | Coworking accessSenior-level Full TimeBrazil R12h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R13h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R15h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R15h ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R15h ago
-
Lead Data Scientist GBP 85K-126KAgentic Systems | Artificial Intelligence | Cloud Computing | Data Architecture | Data Science30 days holiday | Flexible working | Hybrid working | Job share | Parental leaveSenior-level Full TimeLondon 33 Old Broad Street, United … R15h ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R15h ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R15h ago
-
Senior Data Engineer JPY 8600K-9700KData Architecture | Data Cleansing | Data Engineering | Data Modeling | Data PipelinesFinancial wellbeing support programs | Flexible work schedule | Healthcare coverage | Mental health resources | Paid time offSenior-level Full TimeJPN - Tokyo Prefecture - Tokyo … R15h ago
-
Senior Data Engineer JPY 8600K-9700KData Cleansing | Data Engineering | Data Governance | Data Modeling | Data PipelinesFinancial security support | Flexible work culture | Healthcare coverage | Mental health resources | Paid time offSenior-level Full TimeJPN - Tokyo Prefecture - Tokyo … R15h ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Bitbucket | Atlassian Confluence | Atlassian Jira | Bare Metal | C++401k match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R20h ago
-
Principal Embedded Software Engineer USD 160K-200KBare Metal | Bitbucket | C++ | Cameo | Confluence401k employer match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R20h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R22h ago
-
Data Platform Tech Lead ILS 420K-510KApache Spark | Automation | Azure | Cloud Computing | Columnar DatabasesSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R1d ago
-
AI tools | Ash Framework | Backend Development | Elixir | Frontend DevelopmentFlexible working hours | High ownership | Leadership opportunities | Long-term growth | Remote workExecutive-level Full TimeBangkok, Bangkok, Thailand R1d ago
-
C++ | Contact Rich Control | Control Theory | Data collection | DebuggingCompetitive compensation | Equity | Open source contributions | Research focused cultureMid-level Full TimeSingapore R1d ago
-
Devops Team Lead Full Remote-X959VW9R RON 296K-430KAWS | Alerting | Automation | Disaster Recovery | GitOn-call rotation | Remote workSenior-level Full TimeBucharest, Romania R1d ago
-
💎 Computational Materials Scientist 💎 USD 90K-140KAWS EC2 | Artificial Intelligence | Bash | Enterprise Linux | GPU ComputingFree food and snacks | Health care plan | Life insurance | Long-term disability | Paid time offMid-level Full TimeWalnut Creek, California, United States R1d ago