Senior Data Engineer (ADB, Spark)
Bulgaria, Georgia, Poland, Romania, Uzbekistan
USD 130K-170K (estimate) Senior-level Full Time
Tasks
- Build PySpark jobs on Databricks
- Conduct code reviews
- Create and maintain technical documentation
- Define best practices and coding standards
- Develop and maintain Spark applications
- Handle columnar data formats such as Parquet
- Implement data processing and transformation workflows
- Migrate SQL stored procedures to Spark SQL or PySpark
- Optimize spark performance
- Troubleshoot technical issues and ensure reliability
Perks/Benefits
- Hybrid or remote flexibility
- International projects
- Medical healthcare
- Ongoing learning reimbursement
- Referral bonuses
- Sports compensation
- Team events and local benefits
- Top tier equipment provision
- Well-being program
Skills/Tech-stack
Azure Blob | Azure Blob Storage | Azure Cloud | Azure Data | Azure Data Lake | Azure SQL | Azure Service | Azure Service Bus | Blob Storage | Data Lake | Databricks | Delta Lake | Docker | FastAPI | Kubernetes | Langchain | Langgraph | Microservices Architecture | MongoDB | Multi-Modal | Multi-Modal LLMs | Pandas | Parquet | Polars | PySpark | Python | RAG | Redis | SQL | Service Bus | Spark | Spark SQL
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Data Engineer / ROR PLN 276K-276KApache Spark | Big Data | Data Processing | Data Quality | Data SecurityCertification funding | Charitable initiatives | Conference participation | Flexible benefits | Inclusive cultureMid-level Full TimeWarsaw, Masovian Voivodeship, Poland8h ago
-
ML Engineer, Foundation Model Infrastructure USD 175K-215KBayesian Inference | C++ | CI/CD | Distributed Systems | Experiment trackingSenior-level Full TimeMountain View, CA, USA; San Francisco, …11h ago
-
AI Foundry | AI Services | AKS | Azure AI | Azure AI FoundryCareer growth | Continuous learning | High ownership | Remote workSenior-level Full TimeRomania R14h ago
-
Staff Machine Learning Engineer – VLM/LLM Evaluation USD 238K-302KC++ | Data Pipelines | Deep learning | Distributed Systems | Evaluation Frameworks401k match | Dental insurance | Disability insurance | Health insurance | HolidaysSenior-level Full TimeMountain View, CA, USA; San Francisco, …14h ago
-
Data and MLOps Engineer PLN 206K-300KAWS | Azure | Azure DevOps | CI/CD | DatabricksFlexible work environment | Inclusive workplace | Long-term career developmentMid-level Full TimeKatowice, Slaskie, PL14h ago
-
AWS | AWS S3 | Amazon EMR | Amazon Kinesis | Apache Flink401k | Employee discount | Health benefits | Long-term disability | Paid HolidaysSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN …14h ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Senior Software Engineer - Machine Learning (Remote US) USD 230K-270KAI workflows | APIs | Backend Development | Cloud Native | Context engineeringRemote workSenior-level Full TimeUSA R15h ago
-
Deployed Engineer (Chicago) USD 150K-250KAWS | Agent architecture | Azure | Cloud Computing | Containerization401k plan | Flexible vacation | Meals on in office days | Medical, dental, and vision coverage | Travel up to 40 percentSenior-level Full TimeChicago, IL15h ago
-
Bioinformatics | C++ | CUDA | Cloud Computing | Computer VisionSenior-level Full TimeBaltimore, MD, United States16h ago
-
Staff AI Engineer USD 228K-288KArtificial Intelligence | Cloud infrastructure | Data Science | Distributed Systems | Graph Databases401k match | Company-sponsored life and disability insurance | Flexible spending accounts | Learning and development stipend | Mental health resourcesSenior-level Full TimeOakland, California, United States16h ago
-
Investment AI Solutions Analyst USD 133K-200KAgent systems | Analytics | Autogen | BigQuery | CrewAIFlexibility to work from home | Hybrid work | Travel for deployments | Work-life balanceSenior-level Full TimeBaltimore, Maryland, United States16h ago
-
Staff Partner Engineer, AI Partnerships USD 150K-206KAI integration | Agent Frameworks | Architecture | Cost Optimization | EvaluationGlobal travelSenior-level Full TimeNew York City, New York; San …16h ago
-
Staff Embedded Software Engineer USD 160K-190KBare Metal | Bash | C# | C++ | CAN401k match | Education reimbursement | Flexible time off | Medical, dental, and vision coverage | Paid parental leaveSenior-level Full TimeIrvine, CA16h ago
-
Staff Analytics Analyst, Full Stack (Revenue) USD 220K-280KAI enablement | Access Control | Apache Spark | BI Dashboards | DBTDental insurance | Employee stock purchase plan | Flexible spending wallet | Health insurance subsidized | Remote-firstSenior-level Full TimeRemote US R16h ago
-
Solution Engineer USD 138K-181KMachine Learning | Python | SQL401k | Flexible PTO | Health, dental, vision insurance | Professional development budgetSenior-level Full TimeUS-NY-New York17h ago
-
AI Research Engineer USD 200K-400KAgent systems | Constrained decoding | Data Curation | Evaluation Harness | Hugging FaceMid-level Full TimeNew York City17h ago
-
Data Engine & Annotation Systems Engineer USD 130K-190KAPIs | Active Learning | Auto-labeling | Bash | Computer VisionMid-level Full TimeSan Francisco Bay Area17h ago
-
Customer Facing Applied AI Engineer, Retail Perception USD 106K-128KComputer Vision | Data Engineering | Data Pipelines | Data Validation | GitMid-level Full TimeSan Francisco Bay Area17h ago
-
Senior Computer Vision / Applied AI Engineer USD 150K-235KActive Learning | Annotation QA | Barcode Decoding | CUDA | Computer VisionSenior-level Full TimeSan Francisco Bay Area17h ago
-
Principal / Staff Robotics Perception Engineer USD 150K-261KC++ | CUDA | Camera Calibration | Depth Estimation | Edge inferenceSenior-level Full TimeSan Francisco Bay Area17h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Distributed ComputingFlexible work hybrid model | Health and wellness programs | Time away from workSenior-level Full TimeMountain View, CA, United States17h ago