Senior Data Engineer
Tasks
- Automate workflows using Databricks Workflows or Jobs API
- Build test and orchestrate data pipelines in Databricks
- Collaborate with developers and analysts to ensure reliability
- Design and optimize data structures, schemas, and ETL processes
- Diagnose data gaps and quality issues and design validation test cases
- Integrate code into GitHub or GitLab
- Manage database objects in development environments
- Support CI/CD practices
- Translate business use cases into SQL queries, reports, and dashboards
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Apache Airflow | Apache Spark | Azure | CI/CD | Cloud platform | Data Quality | Databricks | Databricks Workflows | ETL | GitHub | GitLab | Google Cloud | Google Cloud Platform | Jobs API | Kafka | SQL
Education
Roles
Regions
Countries
States
Related jobs
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States7h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R8h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R11h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States11h ago
-
Senior-level Full TimeCanada R11h ago
-
Capacity Analysis | Cloud Computing | Continuous Improvement | Data Visualization | Data Warehousing401k | Dental insurance | Discounts | Health insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States12h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R14h ago
-
Analytics Engineer USD 150K-190KDBT | Data Governance | Data Modeling | Data Monitoring | Data Pipelines401k | Catered lunches | Dental insurance | Equity | Free coffee snacksMid-level Full TimeNYC Office14h ago
-
Bioinformatics Engineer USD 125K-150KBAM | BED | BWA | Batch | Bismark401k match | Dependent care assistance | Educational benefits | Employee referral bonus | Flexible spending accountMid-level Full TimeRockville, MD15h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R15h ago
-
Data Scientist I (Prescriptive AI) USD 99K-135KCPLEX | DB2 | Data Warehousing | Discrete Event Simulation | Discrete eventCross training | Onsite Work Authorization SupportMid-level Full TimeLittle Rock, AR16h ago
-
Software Engineer - Medical Applications & Algorithms USD 130K-150KAWS CodeBuild | AWS CodePipeline | Agile | Amazon Web Services | C++Cross-functional team collaboration | Hybrid work environment | Medical device industry domainMid-level Full TimeSan Francisco, California, United States17h ago
-
Senior-level Full TimeIrving, TX17h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R17h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R18h ago
-
Senior Lead AI/ML and Full Stack Engineer - R01567102 USD 150K-237KAccess Control | Agent systems | Azure | CMDB | Context ManagementHybrid work environmentSenior-level Full TimeMiami, Florida, US R18h ago
-
Senior Healthcare Data Engineer USD 104K-199KConditional Aggregation | Data Modeling | Data Quality | Data Reconciliation | Data Validation401k matching | Employee assistance program | Family building benefits | Flexible spending accounts | HolidaysSenior-level Full TimeSeattle, Washington, United States R18h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Artificial Intelligence | Azure | C++ | Code reviewCommunity groups | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States19h ago
-
Data Engineer USD 130K-165KAPI Development | Airflow | Amazon Redshift | Amazon S3 | AvroCollaborative work environment | Dental insurance | Equity | Health insurance | Retirement benefitsMid-level Full TimeWilmington, MA20h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R20h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Drift401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R20h ago
-
Data Engineer USD 105K-130KAPIs | Data Governance | Data Modeling | Data Monitoring | Data Quality401k employer matching | Childcare reimbursement | Company events social hours | Company paid parking or MTS pass | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States21h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US21h ago
-
Machine Learning Engineer USD 223K-260KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | BigQuery401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeNew York City, NY21h ago
-
Machine Learning Engineer USD 187K-260KA/B | A/B Testing | AWS | Amazon RDS | Amazon S3401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careMid-level Full TimeSan Francisco, CA22h ago