Data Engineer / Lead Data Engineer
Tasks
- Apply data governance and security controls
- Build and maintain batch data pipelines
- Conduct code reviews and deployment
- Define engineering standards and best practices
- Develop Spark Python and SQL transformations
- Document and maintain code with version control
- Implement data quality checks
- Ingest Workday and legacy source data
- Lead complex integrations and data workstreams
- Mentor engineers and provide technical guidance
- Model Bronze Silver and Gold data
- Monitor pipeline reliability
- Orchestrate and schedule data workloads
- Use Unity Catalog for access management
- Validate and test pipeline outputs
Perks/Benefits
- Charitable giving initiatives
- Professional development opportunities
- Remote work options
- Work-life balance
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Factory | Data Governance | Data Modeling | Data Quality | Databricks Workflows | Git | Microsoft Fabric | Python | SQL | Unity Catalog
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R21d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R3h ago
-
Airflow | Amazon Web Services | CI_CD | Dagster | Delta_LakeCareer growth opportunities | Collaborative international team | Equity participation | Flexible work arrangements | Fully remote workMid-level Full TimeFrance R4h ago
-
AWS | Access Control | Access Management | Apache Airflow | Apache IcebergCareer growth opportunities | Flexible work arrangements | Fully remote | Knowledge sharing | Ownership and autonomyMid-level Full TimeSwitzerland R4h ago
-
AWS | Access Control | Access Management | Airflow | CI/CDCareer growth | Equity participation | Flexible work arrangements | Fully remote | High ownership and autonomyMid-level Full TimeIreland R4h ago
-
AWS | Access Control | Access Management | Apache Airflow | CI/CDCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | High ownership and autonomyMid-level Full TimeNetherlands R4h ago
-
AWS | Access Control | Access Management | Airflow | Apache IcebergAutonomy | Career growth | Equity participation | Flexible work arrangements | Knowledge sharing international teamMid-level Full TimeSpain R4h ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R5h ago
-
AWS | Access Management | Airflow | CI/CD | DagsterCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | International collaborationMid-level Full TimeGermany R6h ago
-
Appium | Cypress | Java | Python | Quality AssuranceCareer coaching | Continuous learning support | Group benefits | Partial vacation reimbursement | Reduced work tripsSenior-level Full TimeMontbonnot-St-Martin, FR R7h ago
-
Senior Applied AI Engineer USD 205K-238KAgentic Methodologies | Agentic Workflows | Deep learning | Fine Tuning | Generative AIFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R9h ago
-
Lead Data Engineer BGN 90K-105KApache Spark | Data Processing | Distributed Systems | Kafka | PythonAcademic teaching and speaking engagements | Certification and Training | Dental allowance | Flexible working hours | Health insuranceSenior-level Full TimeSofia, Sofia City Province, Bulgaria - … R9h ago
-
Data Engineer BRL 136K-176KAWS | Apache Kafka | Apache Spark | CI/CD | Data ModelingInternational remote first environment | Professional growth | Remote workMid-level Full TimeBrasília, DF, Brazil R10h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R10h ago
-
Senior Analytics Engineer USD 157K-185KAirflow | Anonymization | BigQuery | Compliance | DBT401k match | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Family planning benefitsSenior-level Full TimeRemote U.S. R11h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R12h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agent systems | Agentic AI | Agile | AlgorithmsHybrid work environment | Remote work flexibilitySenior-level Full TimeArlington, VA R12h ago
-
AWS DMS | Change Data Capture | Cloud Computing | Data Capture | Data MigrationData modernization initiatives | International project | Remote workSenior-level Full TimeRemote job R12h ago
-
Senior Machine Learning Engineer / MLOps (Stone) BRL 18K-18KAWS | Apache Kafka | Azure | CI/CD | DBTChildcare support | Dental insurance | Health insurance | Home office support | Life insuranceSenior-level Full TimeRemoto R13h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid environment | Remote work option | Security clearance supportSenior-level Full TimeDayton, OH R14h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid remote work | Security clearance supportSenior-level Full TimeArlington, VA R14h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work options | Security clearance supportSenior-level Full TimeWoburn, MA R14h ago
-
SR AI Engineer BRL 18K-18KAPI Governance | API Optimization | Agent systems | CI/CD | Clean CodeChildcare support | Dental insurance | Education incentive | Extended maternity leave | Extended paternity leaveSenior-level Full TimeRemoto R14h ago
-
AI Engineer I BRL 18K-18KAPI Cost Optimization | CI/CD | Clean Code | Cost Optimization | Design PatternsAccess to learning materials for children | Childcare assistance | Dental insurance | Discounted air travel | Education incentiveEntry-level Full TimeRemoto R14h ago
-
Sr. Data Engineer (Snowflake) CLP 49980K-58800KApache Airflow | BigQuery | DBT | Dagster | Data GovernanceFlexible work arrangements | Generous vacation policy | Inclusive workplace | Mentorship | Training budgetSenior-level Full TimeSantiago R15h ago