Lead Data Engineer
Poland - Remote
Globaldev Group
Globaldev drives businesses to maximize their potential with our custom software development and staff augmentation services.Responsibilities:
- Manage the end to end data pipelines that pull data from operational system and from different end points, transform and load the data to the company data lake
- Current environment is set up on hadoop, but the team will be responsible to complete migration to a new Spark based environment on AWS
Qualifications:
- 4+ years of hands-on experience as a Data Engineer
- BA/BSc in a related field such as CS, engineering, information systems, or equivalent.
- High proficiency in SQL & Python
- Experience working with cloud-hosted data warehouses (Hive, Snowflake)
- Hands-on experience with developing end-to-end ETL/ELT processes (Spark and SQL)
- Experience with the Hadoop framework and parallel computing (EMR, HIVE, Presto/Trino/Athena, Glue)
- Proven experience with data warehousing, modeling paradigms, and architectures, proficient in DWH methodologies and best practices
Will be a plus:
- Familiar with Kafka, Confluent, Fluentd, Spark, and Airflow
- Experience with data visualization tools such as Tableau
- Experience with the media or TV industry - an advantage
Soft skills:
- Strong analytical skills and attention to detail
- Team player
- Ability to handle several tasks simultaneously
- Comfortable working independently and leading projects from end to end
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
3
1
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Airflow Architecture Athena AWS Data pipelines Data visualization Data Warehousing ELT Engineering ETL Hadoop Kafka Pipelines Python Snowflake Spark SQL Tableau
Regions:
Remote/Anywhere
Europe
Country:
Poland
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Principal Data Engineer jobsPower BI Developer jobsSr. Data Engineer jobsBI Developer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsData Science Intern jobsDevOps Engineer jobsJunior Data Analyst jobsData Science Manager jobsSoftware Engineer II jobsData Manager jobsData Analyst Intern jobsLead Data Analyst jobsStaff Software Engineer jobsBusiness Data Analyst jobsAccount Executive jobsData Specialist jobsAI/ML Engineer jobsSr. Data Scientist jobsData Governance Analyst jobsBusiness Intelligence Analyst jobsSenior Backend Engineer jobsData Engineer III jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsLinux jobsEconomics jobsKPIs jobsJavaScript jobsKafka jobsTerraform jobsGitHub jobsData Warehousing jobsPostgreSQL jobsRDBMS jobsScikit-learn jobsNoSQL jobsComputer Vision jobsStreaming jobsClassification jobsBanking jobsPhysics jobsGoogle Cloud jobsPrompt engineering jobsRAG jobsOracle jobs
Pandas jobsHadoop jobsR&D jobsBigQuery jobsData warehouse jobsScala jobsdbt jobsLooker jobsGPT jobsReact jobsScrum jobsPySpark jobsDistributed Systems jobsLangChain jobsCX jobsELT jobsIndustrial jobsMicroservices jobsSAS jobsJira jobsRedshift jobsOpenAI jobsJenkins jobsModel training jobsRobotics jobs