Junior / Mid Big Data Engineer
Poznań, WP, PL, 61-569
GFT Technologies
Wir unterstützen unsere Kunden mit modernsten IT-Lösungen, Technologien und Beratung in der digitalen Transformation.Your Tasks
- Design, implement, and optimize data pipelines and workflows leveraging tools and technologies within the Hadoop ecosystem, including: HDFS, YARN, Spark, HBase, Impala, HIVE
- Java Expertise for APIs and Batch Processes
- Build and deploy RESTful APIs using Java Spring Boot to facilitate seamless data integration and interoperability across systems
- Design and maintain batch processes using Java, ensuring the efficient execution of data workflows and business logic
- Implement robust error handling, logging, and monitoring solutions
- Database Management
- Maintain, and optimize relational database solutions using Oracle DB
- Write complex and efficient SQL & Spark SQL queries to ensure optimal database
Your skills
- At least 2 years of commercial experience as a Data Engineer
- Strong SQL knowledge
- Experience with Hadoop ecosystem including: HDFS, YARN, Spark, HBase, Impala, HIVE
- Proficiency in distributed computing frameworks and data processing at scale
- Experience with ETL pipelines and data modelling
- Solid understanding of cluster management, big data troubleshooting, and API development using Java Spring
- Strong analytical and problem-solving skills with attention to detail
We offer you
- Working in a highly experienced and dedicated team
- The first contract is for 6 months, with the possibility of extension
- Competitive salary and extra benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.)
- On-line training and certifications fit for career path
- On-line foreign language lessons
- Social events
- Access to e-learning platform
- Ergonomic and functional working space
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
3
1
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: API Development APIs Big Data Data pipelines ETL Hadoop HBase HDFS Java Oracle Pipelines RDBMS Spark SQL
Perks/benefits: Career development Competitive pay Health care Team events
Region:
Europe
Country:
Poland
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Staff Machine Learning Engineer jobsData Engineer II jobsData Scientist II jobsBI Developer jobsStaff Data Scientist jobsPrincipal Data Engineer jobsData Manager jobsJunior Data Analyst jobsData Science Manager jobsSenior AI Engineer jobsResearch Scientist jobsBusiness Data Analyst jobsData Specialist jobsLead Data Analyst jobsPrincipal Software Engineer jobsData Science Intern jobsData Analyst Intern jobsSr. Data Scientist jobsData Analyst II jobsSoftware Engineer II jobsData Engineer III jobsSoftware Engineer, Machine Learning jobsBI Analyst jobsAzure Data Engineer jobsData Engineering Manager jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsData Warehousing jobsRDBMS jobsComputer Vision jobsHadoop jobsAirflow jobsMLOps jobsGoogle Cloud jobsKafka jobsNoSQL jobsBanking jobsJavaScript jobsKPIs jobsClassification jobsData warehouse jobsScikit-learn jobsScala jobsStreaming jobsPhysics jobsOracle jobsLooker jobsPostgreSQL jobs
R&D jobsTerraform jobsSAS jobsPySpark jobsBigQuery jobsPandas jobsData Mining jobsGitHub jobsScrum jobsCX jobsJira jobsDistributed Systems jobsIndustrial jobsdbt jobsRedshift jobsRobotics jobsUnstructured data jobsMicroservices jobsJenkins jobsPharma jobsReact jobsGPT jobsData strategy jobsMySQL jobsE-commerce jobs