Senior Data Engineer
Carlsbad, California, United States
USD 121K-161K Senior-level Full Time
Tasks
- Architect data models for analytics platforms
- Automate CI/CD
- Build batch data pipelines
- Build ingestion and transformation processes
- Collaborate with data scientists analysts and machine learning engineers
- Deliver reliable data products
- Design real-time data pipelines
- Establish engineering best practices
- Implement integration testing
- Implement unit testing
- Improve data platform and pipeline processes
- Maintain documentation
- Optimize SQL queries
- Perform code reviews
- Propose and prototype new approaches
- Provide production support
- Tune data warehouse performance
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Azure | CD | CI | CI/CD | Data Modeling | Databricks | Delta Lake | Docker | Integration Testing | Kubernetes | Octopus | Python | Query Optimization | RESTful API | SQL | Snowflake | TeamCity | Unit Testing | Unity Catalog | Workflows
Education
N/A
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R14d ago
-
Ansible | CI/CD | Cloud Native | Cloud-native technologies | Data Pipelines401k match | Home office and equipment plan | Industry leading pay schedule | Life insurance | Long-term disabilityMid-level Full TimeDayton, OH11h ago
-
Apache Airflow | Argo Workflows | Batch inference | CI/CD | ClearML401k match | Dental insurance | Disability insurance | Health insurance | Home office & equipment planSenior-level Full TimeDayton, OH11h ago
-
Data & ML Engineer USD 125K-195KAirflow | Amazon S3 | Apache Spark | Batch Processing | Data Analysis401k retirement plan | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco Office12h ago
-
AI Safety | AI Search | AWS SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Sr. Data Engineer USD 140KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Birthday benefit | Boot camp classes | Dental insurance | Health insuranceSenior-level Full TimeRemote, US R12h ago
-
Data Engineer - Sr. Consultant level USD 152K-243KAWS | Apache Spark | CI/CD | Cloud Migration | Cloud platform401k | Dental insurance | FSA/HSA | Life insurance | Medical insuranceSenior-level Full TimeBellevue, WA, United States14h ago
-
Robotics Engineer, Deployment & Testing - San Mateo USD 100K-300KC# | C++ | Embedded Systems | Go | Machine LearningMid-level Full TimeSan Mateo15h ago
-
Analytics Engineer USD 220K-335KData Modeling | Data Visualization | Data pipeline | ETL | LookerHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco15h ago
-
Senior Data Engineer USD 121K-161KAPI Design | Airflow | Apache Spark | Azure | CI/CDMedical benefitsSenior-level Full TimeManhattan, New York, United States15h ago
-
Senior-level Full TimeAndover, Massachusetts, United States15h ago
-
Senior AI Engineer (Databricks) USD 166K-225KAPI | Agile | Databricks | Deep learning | Distributed SystemsCell phone allowance | Comprehensive health coverage | Equity compensation | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote US R16h ago
-
AI Specialist - #2911 USD 77K-176KAPI Development | Amazon Web Services | Azure | Cloud Computing | Cloud platform401k | Dental insurance | Disability coverage | Education reimbursement | Employee resource groupsMid-level Full TimePittsburgh, PA16h ago
-
AI Specialist - #2910 USD 77K-176KAPI Development | AWS | Azure | Deep learning | Docker401k | Dental insurance | Education reimbursement | Employee resource groups | Employee stock programMid-level Full TimePittsburgh, PA16h ago
-
Data Engineer USD 92K-125KAWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Kinesis401k match | Comprehensive benefits | Flexible PTO | Gym reimbursement | Mental health supportMid-level Full TimeHerndon, VA, United States16h ago
-
Space Operations Engineer (Dragon) USD 95K-130KAttitude control | Avionics | C++ | Communication Systems | Flight Operations401k plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical/Dental/Vision insuranceEntry-level Full TimeHawthorne, CA16h ago
-
Senior Platform Analytics Engineer USD 192K-264KAWS | Airflow | Apache Spark | Big Data | DBTHybrid work schedule | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Staff Machine Learning Platform Engineer USD 224K-308KAWS | Airflow | Apache Airflow | Cockroach DB | DatabricksFlex day availability | Hybrid work 3 days per week | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Active Learning | Bayesian optimization | Coarse Grained Modeling | Computer Vision | Data Pipelines401k eligibility | Employee assistance program | Health and wellness benefits | Paid Holidays | Paid parental leaveSenior-level Full TimeMentor, OH, United States17h ago
-
Embedded Software Engineer I USD 116K-174KC# | C++ | DRIVE OS | Device Drivers | Embedded LinuxAnnual bonus | Benefits | Equity compensation | Hybrid work environmentEntry-level Full TimeMountain View, California17h ago
-
CX Analytics Engineer USD 152K-179KAirflow | DBT | Data Governance | Data Modeling | Data MonitoringMid-level Full TimeRemote - USA R17h ago
-
Senior Analytics Engineer USD 184K-220KAirflow | Anomaly Detection | Automated testing | BigQuery | BugsnagHealthcare benefits | Paid Holidays | Paid Scopely free days | Pet insurance | Retirement benefitsSenior-level Full TimeUS - Culver City, United States17h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Databricks | Fine Tuning | Langchain | Language ModelsSenior-level Full TimeSan Francisco, CA, United States17h ago
-
Senior Robot Perception Engineer - Smart Robotics USD 170K-200KAutomated retraining | CUDA | Camera systems | Computer Vision | Data PipelinesSenior-level Full TimeSan Francisco, California18h ago
-
API Design | Airflow | Athena | BigQuery | C++401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeRemote, United States R19h ago