Consultant Data Engineering ( Ukraine )

Tasks

• Apply AI and GenAI concepts to production scenarios
• Build and optimize Apache Spark workloads
• Defend system architecture decisions
• Develop and integrate machine learning models
• Develop and operate Spark Structured Streaming pipelines
• Implement data pipelines for AI ML workflows
• Manage Databricks deployments with Databricks Asset Bundles
• Process data with Python for ML and AI
• Use Terraform to provision infrastructure
• Write and optimize Spark SQL queries
• Write production grade high performance code

Perks/Benefits

• Christmas holidays
• Health insurance

Skills/Tech-stack

Apache Spark | Artificial Intelligence | Asset bundles | Databricks | Databricks (asset) | Databricks Asset Bundles | Generative AI | Linux | Machine Learning | Python | Spark SQL | Spark Structured Streaming | Structured Streaming | Terraform