Lead Data Engineer
Tasks
- Architect data solutions
- Attend daily standups
- Design data pipelines
- Develop Python based ELT pipelines
- Develop data pipelines
- Develop technical design specs
- Estimate and plan work effort
- Extract load and transform data
- Maintain CI/CD pipelines
- Maintain data documentation
- Optimize BigQuery SQL queries
- Support GCP data pipelines
- Tune SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | BigQuery | Build tool | Business Intelligence | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | DBT | Data Build | Data Build Tool | Dataproc | ELT | Google Cloud | Google Cloud Platform | Google Cloud Storage | Machine Learning | Python | SQL | Shell Scripting | Unix/Linux
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
(Senior) Data Engineer (m/w/d) - Remote EUR 62K-78KAccess Control | CI/CD | Cloud platform | Code review | Commerce platforms100% remote work | 30 days vacation | Career development opportunities | Employee discount | Employer pension planSenior-level Full TimeRemote R11h ago
-
Data Engineer EUR 54K-74KAWS | Athena | Azure | Azure Blob | Azure Blob StorageHealth insurance | Hybrid workSenior-level Full TimeLuxembourg, Karlsruhe, Karlsruhe R12h ago
-
AI Engineer bei der JUST ADD AI (all genders) EUR 54K-54KComputer Vision | Data Analysis | Deep learning | LLM-based tools | Language ModelsAnnual offsites | Bike benefit | Company fitness | E-Learning Course Reimbursement | Flexible work timeEntry-level Full TimeBremen // Hamburg // Hybrid R13h ago
-
AI Developer (Microsoft Stack) EUR 46K-75KAgentic AI | Authentication | Azure AI | C# | Copilot StudioFlexible hours | Free parking | Health insurance | Home office setup budget | Lunch discountsSenior-level Full TimeVilnius LT R14h ago
-
AI Engineer – Python & Automation (m/w/d) EUR 60K-80KAzure | CI/CD | Claude | Cloud platform | DjangoCorporate discounts | Flat hierarchies | Flexible working hours | Remote work | Team eventsMid-level Full TimeHybrid R14h ago
-
Senior data engineer HUF 14400K-22882KAzure | Databricks | ETL | Hadoop | PySparkCafeteria allowance | Career Development Programs | Childcare support | Coaching and mentoring | Commute cost coverageSenior-level Full TimeBudapest, Hungary R15h ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R16h ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R17h ago
-
Senior AI Engineer USD 127K-150KAccuracy | Benchmarking | CI/CD | Cloud infrastructure | EvaluationSenior-level Full TimeRemote, UK R18h ago
-
AWS | Azure | CI/CD | Containers | DNS401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R20h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R20h ago
-
AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache AirflowHealth insurance | Life insurance | Mentoring | Paid Holidays | Paid time offMid-level Full TimeManila, PH R22h ago
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R22h ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R22h ago
-
AWS | Access Control | Audit Logging | Authentication | AuthorizationMid-level Full TimeSingapore, Singapore, Singapore R22h ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R23h ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R23h ago
-
Senior Data Engineer USD 140K-170KAPIs | Azure DevOps | DBT | Data Architecture | Data GovernanceDiscretionary bonus | Hybrid work schedule | Training and developmentSenior-level Full TimeNew York, New York, United States R1d ago
-
Staff Software Engineer, Data Warehouse Foundation USD 177K-364KApache Airflow | Apache Flink | Apache Spark | Apache Superset | Data PipelinesSenior-level Full TimePalo Alto, CA, US; Remote, US R1d ago
-
Principal Computer Vision Engineer ILS 420K-540KC++ | CUDA | Deep learning | Feature Matching | HomographyFlex first work arrangement | In-person eventsSenior-level Full TimeIsrael - Hybrid (3 days/week in … R1d ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R1d ago
-
Senior Data Engineer- People Analytics USD 180K-207KAccess Control | Airflow | Amazon Redshift | CI/CD | Cloud platformSenior-level Full TimeUnited States R1d ago
-
Senior Data Visualization Engineer USD 114K-142KAdobe Illustrator | Adobe Photoshop | ArcGIS | Cartography | D3Employee assistance program | Home office reimbursement | Paid parental leave | Tuition reimbursement | Wellness programSenior-level Full TimeSan Francisco, CA R1d ago
-
Senior Engineering Manager-People Analytics USD 175K-201KAI | Access Controls | Airflow | CI/CD | DBTSenior-level Full TimeUnited States R1d ago
-
Staff Software Engineer, Applied AI USD 200K-260KDataset curation | FastAPI | Golden datasets | Langchain | Langgraph401k retirement plan | Annual learning and development stipend | Employer HSA contribution | Equity incentive plan | Flexible vacation policySenior-level Full TimeU.S. Remote R1d ago