Senior Data Engineer (Databricks / AWS)
Tasks
- Build data ingestion pipelines
- Build data transformation pipelines
- Design lakehouse data platform
- Develop data quality frameworks
- Direct AI agents for code generation
- Implement CDC
- Implement data governance catalog
- Integrate data quality into CICD pipelines
- Integrate data sources
- Investigate legacy data quality issues
- Manage schema evolution
- Optimize Delta Lake tables
- Optimize data workflows
- Orchestrate data pipelines with Airflow
- Write Python scripts
- Write SQL queries
Perks/Benefits
- Dental coverage
- Employee referral program
- Extra holidays
- Family insurance
- Flexible hybrid working
- Free parking
- Health insurance
- Remote work option
- Social events
- Sports card sponsorship
- Training budget
Skills/Tech-stack
AWS | Amazon Kinesis | Amazon S3 | Apache Airflow | CDC | CI/CD | Data Quality | Databricks | Delta Lake | Great Expectations | Kafka | PySpark | Python | SQL | Schema evolution | Unity Catalog
Education
N/A
Roles
Related jobs
-
AI Evaluation | CI/CD | Cloud | DevOps | LLMPaid in USD | Remote workSenior-level Full TimeGuatemala, Guatemala (Remote) R21h ago
-
AC DC Sizing | AC/DC | Arc Flash | Artificial Intelligence | AutomationMultiple project extensions | Paid on time | Remote work optionSenior-level Full TimeJuno Beach, FL R22h ago
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R22h ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States23h ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago
-
3D Rendering | A/B | A/B Testing | Agentic AI | AlgorithmsSenior-level Full TimeSan Jose, California, United States1d ago
-
C++ | Computer Vision | Data Processing | Deep learning | Domain AdaptationEntry-level Full TimeSan Jose, California, United States1d ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Agent Development | Agent Development Kit | Benchmarking | C++ | EvaluationEquity | Health insurance | Paid time off | Performance bonus | Retirement plansSenior-level Full TimeWarsaw, Poland1d ago
-
Agentic Orchestration | C++ | Data Onboarding | Data Pipeline Engineering | Data pipelineSenior-level Full TimeSan Jose, CA, USA1d ago
-
Staff Engineer, Search Intelligence INR 3000K-5000KAudio Processing | C++ | Classifiers | Data Processing | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Software Engineer, AI/ML, Core USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1d ago
-
Staff Software Engineer, Search Local Ads Data Platform USD 207K-300KC plus plus | CSS | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1d ago
-
AI & Data Engineer (60%-100%) CHF 95K-150KAPI | Azure | CI/CD | Cloud Architecture | Data PrivacyCareer growth | Flexible working hours | International collaboration | Professional development opportunities | Training opportunitiesMid-level Part TimeZürich - Rehalp1d ago
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia1d ago
-
Senior Cloud Engineer - AI-ML Platform (all genders) USD 130K-250KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CI/CDInclusion and belonging | Professional growth opportunitiesSenior-level Full TimeCairo, Egypt, EG, 117871d ago
-
Data Engineer USD 90K-122KData Warehousing | Database Design | ETL | Power BI | Power QueryCollaborative work environment | Continuous learning | Global career growth | Inclusive workplace | Professional developmentMid-level Full TimeOragadam, IN, 602 1051d ago
-
Analytics Data Engineer USD 94K-130KAzure Data | Azure Data Factory | CI/CD | Data Analysis | Data FactoryRemote workMid-level Full TimeFlagstaff, AZ, US1d ago
-
Senior-level Full TimeErlangen, DE1d ago
-
Senior Data Engineer PLN 240K-328KAPI Development | Access Control | Anomaly Detection | Apache Spark | Azure DataHybrid workSenior-level Full TimeKraków, PL1d ago
-
AI Application & Cloud Operations Engineer (Mid level) USD 108K-117KAWS | AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLinkMid-level Contract Full TimePlano, TX, United States1d ago
-
Benchmarking | C plus plus | CUDA | Computational Engineering | Distributed Computing401k match | Generous paid time off | Medical, dental & vision coverage | Stock options | WFH Hardware ReimbursementSenior-level Full TimeSunnyvale, CA R1d ago
-
Software Engineer, Applied AI USD 173K-250KABAC | Agentic Frameworks | Apache Airflow | Audit trails | BIMDental insurance | Generous PTO | Health insurance | Retirement or Pension Plan | Vision insuranceMid-level Full TimeSan Francisco, CA1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago