DataBricks Developer (IoT sphere)
Tasks
- Build Medallion Architecture Bronze Silver Gold pipelines
- Create reusable data transformation frameworks with Python and PySpark
- Design scalable data pipelines with Databricks
- Develop batch and real-time data processing
- Document data flows and operational procedures
- Ensure data quality with validation monitoring and automated testing
- Implement REST API integrations for data ingestion
- Integrate data from multiple internal and external systems
- Optimize Spark jobs and Databricks workloads
- Troubleshoot production issues and improve observability
Perks/Benefits
- Additional vacation days
- Flexible schedule
- Health insurance
- Hybrid work
- Internal conferences and meetups
- Mentorship
- Referral program
- Remote work
- Sports activities
- Training
Skills/Tech-stack
AWS | AWS Glue | Agile | Apache Kafka | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Governance | Data Monitoring | Data Quality | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | Medallion Architecture | PySpark | Python | REST APIs | Real Time | Real-time Data | SQL | Spark | Unity Catalog
Education
Roles
Related jobs
-
Amazon Athena | Amazon EKS | Amazon EMR | Amazon EMR Serverless | Amazon IAMAdditional vacation days | Flexible work options | Health insurance | Hybrid work | Internal conferences and meetupsSenior-level Full TimePoland R10h ago
-
AI Engineer PLN 206K-287KAPI Integration | Agent Frameworks | Automation | Business Intelligence | CRMMid-level Full TimeKraków, Małopolskie, PL R22h ago
-
[CMI] AI engineer PLN 237K-340KAI Safety | API Development | AWS | Cloud platform | Generative AIExternal training | Flexible employment | Insurance | Internal training | International business tripsSenior-level Full TimeKraków, Lesser Poland Voivodeship, Poland R1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Fully remoteSenior-level Contract Full TimePoland R1d ago
-
API | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNSAutonomy | Collaborative team environment | Flexible work location | Fully remote | Operational excellence focusSenior-level Full TimePoland R1d ago
-
Infrastructure & AI Lead PLN 179K-280KAI Deployment | Access Management | Artificial Intelligence | Fintech | IT administrationFitness allowance | Hybrid work | Meal allowance | Phone allowance | Private healthcareSenior-level ContractWarsaw, Poland, Poland (Hybrid) R1d ago
-
Data Engineer (Databricks) PLN 129K-136KCloud platform | Cluster management | Data Lake | Data Modeling | Data QualityHybrid work model | Private health care | Savings plans | Sport cards | Stock plansMid-level Full TimeWARSAW PLANT & GO, Poland R1d ago
-
524 | Senior Data Support Engineer PLN 206K-350KAWS | DBT | DBT Cloud | Data Ingestion | Data ModelingSenior-level Full TimePoland - Remote R2d ago
-
AI/ML Engineer PLN 153K-240KAWS | Azure | Deep learning | Docker | EmbeddingsContinuous learning | Diverse and inclusive culture | Flexible work modelMid-level Full TimeKatowice, Śląskie, PL, 40-202 R2d ago
-
Senior GenAI Engineer PLN 234K-254KAWS | Autogen | Azure | CI/CD | DockerCoaching | Continuous learning | Flexible work arrangement | Inclusive cultureSenior-level Full TimeKatowice, Śląskie, PL, 40-202 R2d ago
-
1122 | Python/AI Agent Engineer PLN 242K-287KAzure AI | Azure OpenAI | Data Mapping | Data Normalization | Data TransformationSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland - Remote R2d ago
-
Alerting | Data Pipelines | Distributed Systems | Inference | JAXMid-level Full TimePoland R3d ago
-
General Pipeline - FullStack Applied AI Engineer USD 150K-250KAWS | Access Control | Asynchronous programming | Authentication | AuthorizationSenior-level Full TimeUnited States R3d ago
-
Software Developer / Data Engineer PLN 276K-276KAPI Design | AWS | Access Layer | Airflow | AngularContinuous learning culture | Hybrid work schedule | MentorshipMid-level Full TimePoland - Warsaw R3d ago
-
AI Engineer PLN 176K-176KAzure | CI/CD | Cloud Native | Cloud Native Services | Distributed SystemsFlex fund | Mentoring programs | Partially remote work | Training | Voluntary charity programsEntry-level Full TimeWARSAW DOWNTOWN OFFICE, Poland R3d ago
-
Cybersecurity Engineer, Data & AI SME PLN 195K-268KAI Security | AI/ML | AI/ML Security | Automation | Capacity ManagementAnnual bonus | Family benefits | Free parking | Hybrid work | Learning and developmentMid-level Full TimePoznan Business Garden, Poland R3d ago
-
Senior Analytics Engineer USD 144K-192KAirflow | Apache Superset | BigQuery | DBT | Data PipelinesEducation reimbursement | Equipment reimbursement | Fully remote | Mental health care program | Overseas conferencesSenior-level Full TimeKazakhstan R3d ago
-
Senior AI/ML Engineer PLN 242K-255KAgentOps | Azure | Azure Bicep | Azure Cloud | Azure Cloud StorageCommunity involvement | Community service day | Electricity bill allowance | Employee resource groups | Flexible working hoursSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland R4d ago
-
Senior Software Engineer, Generative AI PLN 206K-254KAWS | Azure | Cloud Computing | Cloud platform | Data ScienceHybrid work environment | Talent community job alertsSenior-level Full TimePOL GPC Krakow, Poland R4d ago
-
Access Permissions | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseExtra vacation days | Flexible work (remote/hybrid) | Health insurance | Internal conferences and meetups | MentorshipMid-level Full TimePoland R6d ago
-
Robotics & Software Engineer PLN 4750K-6250KAPI Integration | Heuristics | Industrial robotics | Management systems | Operating SystemEnglish-speaking environment | Equity | Flexible working hours | Partial remote work | Relocation packageMid-level Full TimeWarsaw, Poland R6d ago
-
Senior Robotics & Software Engineer PLN 6500K-8000KAPI Development | Industrial Automation | Python | Robot Control | RoboticsEnglish-speaking environment | Equity | Flexible working hours | Partly remote work | Play with robots dailySenior-level Full TimeWarsaw, Poland R6d ago
-
Data Engineer PLN 276K-276KAST Parsing | CI/CD | Data Cleansing | Data Transformation | DockerCompany paid premium medical | Company-paid certifications | Full remote work | Language courses | Meetups conferences workshopsMid-level Full TimePoland R6d ago
-
Data Engineer PLN 276K-276KAST Parsing | CI/CD | Docker | Git | Integration TestingCompany-paid certifications | Internal Meetups Conferences Workshops | Language courses | MyBenefit Cafeteria Platform | Premium medical packageMid-level Full TimePoland R6d ago
-
Senior Data Engineer - Superior Retail Execution PLN 154K-242KApache Spark | Artificial Intelligence | Azure | CI/CD | Cloud OperationsPrivate healthcare | Savings plans | Sport cards | Stock plans | Training and certificationsSenior-level Full TimeWARSAW PLANT & GO, Poland R7d ago