Senior Data Engineer (Databricks Migration)
Lviv, Lviv Oblast, Ukraine
UAH 1377K-1549K (estimate) Senior-level Full Time
Tasks
- Analyze ETL ELT workloads and define migration approach
- Build PySpark data processing solutions
- Design lakehouse architecture with Databricks and Delta Lake
- Develop and optimize data pipelines for large volume datasets
- Implement data governance and security with Unity Catalog
- Implement incremental processing strategies
- Implement medallion architecture bronze/silver/gold
- Migrate data platform from BigQuery to Databricks
- Optimize SQL and Spark workloads
- Support production deployments and platform modernization
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | CI/CD | Databricks | Delta Lake | Delta lake architecture | Dimensional Modeling | Distributed Systems | ELT | ETL | GCP | Incremental processing | Performance Tuning | PySpark | Python | SQL | Spark performance tuning | Unity Catalog
Education
N/A
Roles
Related jobs
-
Ansible | CRUSH | CSI | Capacity Planning | CephSenior-level Full TimeUkraine - Remote R13h ago
-
Senior Data Engineer (Databricks Migration) UAH 1377K-1549KAirflow | Apache Spark | CI/CD | Cloud platform | Data ProcessingSenior-level Full TimeKyiv, Kyiv city, Ukraine21h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly work environmentMid-level Full TimeDnipro, Ukraine3d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R3d ago
-
AWS Lambda | Backpressure | Chunking | Cloudflare Workers | Data DeduplicationCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeUkraine - Kyiv R3d ago
-
Senior Artificial Intelligence/Machine Learning Engineer UAH 1377K-1549KAsynchronous programming | Benchmarking | Docker | Evaluation Frameworks | Fine TuningCompany-paid certifications | Conferences | Financial consultations | Language courses | Legal consultationsSenior-level Full TimeUkraine R4d ago
-
Data Engineer (GCP) UAH 500KBigQuery | Cloud platform | Data Governance | Data Modeling | Data ValidationChristmas holidays | Health insuranceMid-level Full TimeKyiv, UA4d ago
-
Data Engineer UAH 60K-88KCI/CD | Docker | Git | Graph Databases | Integration TestingCompany-paid certifications | Conference and workshop support | Financial consultations | Language courses | Legal consultationsMid-level Full TimeUkraine R5d ago
-
Senior Full-Stack Engineer UAH 1377K-1549KAWS | Autoscaling | Event Driven | Event-driven architecture | High AvailabilitySenior-level Full TimeKyiv, Kyiv city, UA6d ago
-
Senior Data Engineer UAH 1377K-1549KAbstract syntax tree | Automated testing | CI/CD | Code Analysis | CypherCompany paid medical insurance | Company-paid certifications | Financial and legal consultations | Internal events meetups conferences workshops | Language coursesSenior-level Full TimeUkraine R6d ago
-
Asynchronous programming | CI/CD | Docker | Git | Inference EnginesCompany-paid certifications | Conference access | Financial and legal consultations | Language courses | Medical insuranceMid-level Full TimeUkraine R6d ago
-
Senior Azure/Fabric Data Engineer | KD Pharma UAH 1377K-1549KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2 | Azure DevOpsClient facing advisory | Hands-on implementationSenior-level Full TimeRemote (Europe-based candidates only) R7d ago
-
AI/ML Engineer UAH 132K-180KAWS | AWS Bedrock | Agile | Azure | CI/CDEnglish courses | Health and wellness programs | Meetups | Offline Internal Events | Pet-friendly officeMid-level Full TimeL'viv, Ukraine7d ago
-
Lead AQA Data Engineer UAH 1377K-1549KAgile | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon SQS | Apache AirflowSenior-level Full TimeOdesa, UA7d ago
-
Cloud | Data Enrichment | Data Normalization | Data logging | DeduplicationFlexible schedule | Learning budget | Medical insurance | Mentorship | Psychological counselingEntry-level Full TimeKyiv | Київ, UA8d ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Friendly atmosphere | Hands-off management | Remote-friendly, distributed teamMid-level Full TimeKharkiv, Ukraine8d ago
-
Senior-level Full TimeKyiv9d ago
-
API Integration | AWS Bedrock | Access Control | ETL | EmbeddingsAutonomy in decision-making | Cross-functional collaboration | Flexible working hours | Remote workSenior-level Full TimeKyiv, Ukraine11d ago
-
ARM toolchain | Access Point | Access Point Mode | Antenna systems | BSPBeta testing participation | Discounts on company products | Discounts on partner services | English language classes | Medical insuranceSenior-level Full TimeKyiv11d ago
-
ARM | Assembly | Bash | Bootloader | C plus plusCorporate library access | Medical insurance | Mental health counseling | Paid professional training | Remote work up to 10 days per yearMid-level Full TimeKyiv | Київ, UA11d ago
-
Senior ML & AI Engineer UAH 1377K-1549KDeep learning | Embeddings | Generative AI | Langchain | LanggraphFlexible schedule | Licensed software | Provided laptop | Remote workSenior-level Full TimeUkraine - Remote R11d ago
-
Senior Data Engineer UAH 1377K-1549KAWS IAM | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AirflowAgile team | Occasional offline meetings | Ownership and experimentation | Remote workSenior-level Full TimeLviv, Kyiv R12d ago
-
Junior Analytics Engineer UAH 380K-540KA/B | A/B Testing | Analytics | B testing | Data GovernanceFree mental health support platform | Health insurance | Learning allowance | Learning and development budget | Leave allowanceEntry-level Full TimeKyiv R12d ago
-
Analog Signal | Analog signal processing | C++ | CC13XX | Device DriversBeta testing participation | Corporate English classes | Medical insurance | Training reimbursementEntry-level Full TimeKyiv12d ago
-
AWS | Airflow | Anomaly Detection | Apache Flink | Apache SparkFree mental health support | Health insurance | Learning and development budget | Time offMid-level Full TimeKyiv12d ago