Data Engineer - Price Optimization

Description

Data Engineer

Fetcherr experts in deep learning, algo-trading, e-commerce, and digitization, Fetcherr disrupts traditional systems with its cutting-edge AI technology. At its core is the Large Market Model (LMM), an adaptable AI engine that forecasts demand and market trends with precision, empowering real-time decision-making. Specializing initially in the airline industry, Fetcherr aims to revolutionize industries with dynamic AI-driven solutions.

We're looking for a Data Engineer to help us grow our data engineering capabilities. The ideal candidate is a python engineer with a solid background in building data-intensive applications, familiar with industrial best practices who is self-driven, motivated, independent, and sharp.

You as a member of the data engineering team will take an active part in all development phases, including research, design, development, testing and deployment using technologies like Python, Dagster, Kubernetes, BigQuery, Clickhouse, Ray.

Requirements

You’ll be a great fit if you have:

• B.Sc or Master’s degree in Computer Science or equivalent STEM degree
• Strong Python programming skills, including:
• 3+ years of production experience
• Working with highly parallel computations
• Optimizing memory consumption
• Optimizing IO operations at scale
• Fluency in SQL and data modeling within both OLAP and OLTP databases
• Vast experience in building ETL(ELT) pipelines with diverse architectures (streaming, batching) using any orchestration tools (i.e. Dagster, Airflow, Prefect, Luigi, etc.)
• Fluent with commonly used data engineering libraries like pandas, pyarrow, numpy, Jinja, dbt
• Hands-on experience in containerized environments (Docker, Kubernetes, Podman, etc.)
• You’re a team player, ready to help others
• Have a readiness and willingness to continuously learn while working
• Readiness to work in stressful environment with strict deadlines and SLA’s 

Nice to have:

• Strong experience with Dagster
• Practical experience with functional programming. Any language, conceptual knowledge is more important
• Familiarity with cloud computing (ideally GCP)
• Test-driven development mindset
• Experience with CI/CD tooling i.e. GitlabCI, Github Actions, etc.