Senior Data Engineer
Tasks
- Automate workflows using Databricks Workflows or Jobs API
- Build test and orchestrate data pipelines in Databricks
- Collaborate with developers and analysts to ensure reliability
- Design and optimize data structures, schemas, and ETL processes
- Diagnose data gaps and quality issues and design validation test cases
- Integrate code into GitHub or GitLab
- Manage database objects in development environments
- Support CI/CD practices
- Translate business use cases into SQL queries, reports, and dashboards
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Apache Airflow | Apache Spark | Azure | CI/CD | Cloud platform | Data Quality | Databricks | Databricks Workflows | ETL | GitHub | GitLab | Google Cloud | Google Cloud Platform | Jobs API | Kafka | SQL
Education
Roles
Regions
Countries
States
Related jobs
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States8h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States8h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States8h ago
-
Senior Software Engineer - Experiment Platform USD 159K-235KA/B | A/B Testing | B testing | Data Pipelines | Data Quality401k plan | Basic life insurance | Dental insurance | Flexible time off | Long-Term Disability coverageSenior-level Full TimeSeattle, Washington, United States9h ago
-
Sr. Applied AI Engineer USD 160K-200KAPIs | Cloud Computing | Generative AI | Machine Learning | PythonHome-office equipment | Hybrid work model | Self-development budget | Top of market equity and cash compensation packageSenior-level Full TimeNew York Office9h ago
-
Applied AI Engineer USD 110K-160KGenerative AI | Machine Learning | Python | REST APIs | SQLEquipment provided | Hybrid work | Mentorship | Self-development budgetMid-level Full TimeNew York Office10h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R10h ago
-
AWS | Azure | CI/CD | Cloud platform | Data PipelinesLong-term contractSenior-level Contract Full TimeDallas, TX, United States11h ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R12h ago
-
Senior AI ML Engineer USD 137K-188KAPI Integration | AWS | AWS Bedrock | AWS Fargate | AWS GlueCareer growth opportunities | Flexible work schedule | Remote-first work environmentSenior-level Contract Full TimeUnited States12h ago
-
Staff AI Research Engineer USD 220K-331KArtificial Intelligence | Computer Vision | Feature Engineering | Fine Tuning | Language ModelsCollaboration | Learning opportunities | Mentorship | Professional developmentSenior-level Full TimePittsburgh, PA13h ago
-
Senior Machine Learning (ML) Engineer USD 165K-218KAir-gapped | Air-gapped systems | Airflow | Anomaly Detection | Apache Spark401k match | Caregiver leave | Commuter benefits | Dental benefits | Generous time offSenior-level Full TimeFort Collins, Colorado, United States14h ago
-
Software Engineer, Infrastructure - Autonomy & Robotics USD 130K-285KAlgorithms | Data Processing | Data Structures | Distributed Systems | Distributed data401k match | Basic life insurance | Commuter benefits match | Dental benefits | Disability insuranceMid-level Full TimeSan Francisco, CA14h ago
-
Senior Consumer Analytics Engineer I USD 130K-180KAirflow | CI/CD | DBT | Dagster | Data Governance401k program | Employee resource groups | Fitness and wellness memberships | Flexible work environment | Learning and development stipendSenior-level Full TimeAustin14h ago
-
Senior Data Engineer USD 160K-190KAWS | AWS Glue | Apache Spark | Azure | CI/CD401k match | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeProvo, Utah16h ago
-
Software Engineer in Data Science USD 180K-253KAPIs | AWS | Airflow | Code review | Continuous DeliveryCompetitive benefits package | In office five days per weekSenior-level Full TimeHouston, TX, United States16h ago
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R16h ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMassachusetts R17h ago
-
AI Tooling | Apache Airflow | Data Architecture | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMinnesota R17h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeIllinois R17h ago
-
Airflow | Analytics engineering | Data Architecture | Data Compliance | Data GovernanceAccess to cutting-edge technologies | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeIdaho R17h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data ObservabilityAccess to cutting-edge technologies | Collaborative work environment | Continuous learning | Flexible work hours | Health and wellness programsSenior-level Full TimeColumbia R17h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeColorado R17h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeFlorida R17h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeCalifornia R17h ago