Senior Data Engineer (Databricks Migration)
Kyiv, Kyiv city, Ukraine
UAH 1377K-1549K (estimate) Senior-level Full Time
Tasks
- Analyze ETL ELT workloads and define migration approach
- Build and optimize Spark data processing solutions with PySpark
- Collaborate on architecture discussions and technical solution design
- Conduct code reviews and improve platform reliability
- Design and implement Lakehouse architecture with Delta Lake
- Design and maintain medallion Bronze Silver Gold layers
- Develop and optimize data pipelines for large volume analytics
- Implement data governance and security with Unity Catalog
- Implement incremental processing strategies
- Migrate analytical platform from BigQuery to Databricks
- Support production deployments and platform modernization
- Troubleshoot and optimize SQL and Spark workloads
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Cloud platform | Data Processing | Data Warehousing | Databricks | Delta Lake | Delta Lake Optimization | Dimensional Modeling | Distributed data | Distributed data processing | ELT | ETL | Google Cloud | Google Cloud Platform | Incremental processing | Medallion Architecture | PySpark | Python | SQL | Spark SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly work environmentMid-level Full TimeDnipro, Ukraine3d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R3d ago
-
Senior Artificial Intelligence/Machine Learning Engineer UAH 1377K-1549KAsynchronous programming | Benchmarking | Docker | Evaluation Frameworks | Fine TuningCompany-paid certifications | Conferences | Financial consultations | Language courses | Legal consultationsSenior-level Full TimeUkraine R3d ago
-
Data Engineer (GCP) UAH 500KBigQuery | Cloud platform | Data Governance | Data Modeling | Data ValidationChristmas holidays | Health insuranceMid-level Full TimeKyiv, UA4d ago
-
Data Engineer UAH 60K-88KCI/CD | Docker | Git | Graph Databases | Integration TestingCompany-paid certifications | Conference and workshop support | Financial consultations | Language courses | Legal consultationsMid-level Full TimeUkraine R4d ago
-
Senior Full-Stack Engineer UAH 1377K-1549KAWS | Autoscaling | Event Driven | Event-driven architecture | High AvailabilitySenior-level Full TimeKyiv, Kyiv city, UA5d ago
-
Senior Data Engineer UAH 1377K-1549KAbstract syntax tree | Automated testing | CI/CD | Code Analysis | CypherCompany paid medical insurance | Company-paid certifications | Financial and legal consultations | Internal events meetups conferences workshops | Language coursesSenior-level Full TimeUkraine R5d ago
-
Asynchronous programming | CI/CD | Docker | Git | Inference EnginesCompany-paid certifications | Conference access | Financial and legal consultations | Language courses | Medical insuranceMid-level Full TimeUkraine R5d ago
-
Senior Azure/Fabric Data Engineer | KD Pharma UAH 1377K-1549KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2 | Azure DevOpsClient facing advisory | Hands-on implementationSenior-level Full TimeRemote (Europe-based candidates only) R6d ago
-
AI/ML Engineer UAH 132K-180KAWS | AWS Bedrock | Agile | Azure | CI/CDEnglish courses | Health and wellness programs | Meetups | Offline Internal Events | Pet-friendly officeMid-level Full TimeL'viv, Ukraine6d ago
-
Lead AQA Data Engineer UAH 1377K-1549KAgile | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon SQS | Apache AirflowSenior-level Full TimeOdesa, UA7d ago
-
Cloud | Data Enrichment | Data Normalization | Data logging | DeduplicationFlexible schedule | Learning budget | Medical insurance | Mentorship | Psychological counselingEntry-level Full TimeKyiv | Київ, UA8d ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Friendly atmosphere | Hands-off management | Remote-friendly, distributed teamMid-level Full TimeKharkiv, Ukraine8d ago
-
Senior-level Full TimeKyiv8d ago
-
API Integration | AWS Bedrock | Access Control | ETL | EmbeddingsAutonomy in decision-making | Cross-functional collaboration | Flexible working hours | Remote workSenior-level Full TimeKyiv, Ukraine10d ago
-
ARM toolchain | Access Point | Access Point Mode | Antenna systems | BSPBeta testing participation | Discounts on company products | Discounts on partner services | English language classes | Medical insuranceSenior-level Full TimeKyiv10d ago
-
ARM | Assembly | Bash | Bootloader | C plus plusCorporate library access | Medical insurance | Mental health counseling | Paid professional training | Remote work up to 10 days per yearMid-level Full TimeKyiv | Київ, UA11d ago
-
Senior ML & AI Engineer UAH 1377K-1549KDeep learning | Embeddings | Generative AI | Langchain | LanggraphFlexible schedule | Licensed software | Provided laptop | Remote workSenior-level Full TimeUkraine - Remote R11d ago
-
Senior Data Engineer UAH 1377K-1549KAWS IAM | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AirflowAgile team | Occasional offline meetings | Ownership and experimentation | Remote workSenior-level Full TimeLviv, Kyiv R11d ago
-
Junior Analytics Engineer UAH 380K-540KA/B | A/B Testing | Analytics | B testing | Data GovernanceFree mental health support platform | Health insurance | Learning allowance | Learning and development budget | Leave allowanceEntry-level Full TimeKyiv R11d ago
-
Analog Signal | Analog signal processing | C++ | CC13XX | Device DriversBeta testing participation | Corporate English classes | Medical insurance | Training reimbursementEntry-level Full TimeKyiv12d ago
-
AWS | Airflow | Anomaly Detection | Apache Flink | Apache SparkFree mental health support | Health insurance | Learning and development budget | Time offMid-level Full TimeKyiv12d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote-friendlyMid-level Full TimeLviv, Ukraine13d ago
-
Senior AI Engineer UAH 1377K-1549KAWS Bedrock | AWS Lambda | Amazon CloudWatch | Amazon DynamoDB | Amazon OpenSearchCertification support | Company events | English classes | International work environment | Professional trainingSenior-level Full TimeUkraine, Ukraine, UA13d ago
-
Senior Security Software Engineer ID80138 UAH 1377K-1549KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeІвано-Франківськ, Ukraine13d ago