Senior Data Engineer
Andover, Massachusetts, United States
USD 130K-150K Senior-level Full Time
Tasks
- Architect data models for analytics
- Build batch data pipelines
- Collaborate with data scientists and analysts
- Design real-time data pipelines
- Develop data ingestion and transformation processes
- Gather requirements and design technical solutions
- Implement data pipeline orchestration
- Implement unit testing and integration testing
- Maintain documentation and engineering best practices
- Optimize SQL queries
- POC new data platform improvements
- Perform code reviews
- Provide production support end to end
- Set up CI CD automation
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Airflow | Apache Spark | Azure | Azure Databricks | CI/CD | Data Modeling | Data Warehousing | Delta Lake | Docker | Integration Testing | Java | Kubernetes | Kubernetes orchestration | Machine Learning | Machine Learning Pipelines | Python | Query Optimization | RESTful API | RESTful API design | SQL | Scala | Snowflake | Unit Testing | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R14d ago
-
Ansible | CI/CD | Cloud Native | Cloud-native technologies | Data Pipelines401k match | Home office and equipment plan | Industry leading pay schedule | Life insurance | Long-term disabilityMid-level Full TimeDayton, OH11h ago
-
Apache Airflow | Argo Workflows | Batch inference | CI/CD | ClearML401k match | Dental insurance | Disability insurance | Health insurance | Home office & equipment planSenior-level Full TimeDayton, OH11h ago
-
Data & ML Engineer USD 125K-195KAirflow | Amazon S3 | Apache Spark | Batch Processing | Data Analysis401k retirement plan | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco Office12h ago
-
ADAS | Autonomous Driving | Build systems | Compute hardware | Configuration Management100 percent paid medical dental vision | 401k employer match | Accidental death and dismemberment insurance | Flexible schedule | Holiday office closuresSenior-level Full TimeRemote - U.S, Ann Arbor, MI R12h ago
-
AI Safety | AI Search | AWS SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Sr. Data Engineer USD 140KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Birthday benefit | Boot camp classes | Dental insurance | Health insuranceSenior-level Full TimeRemote, US R12h ago
-
Data Engineer - Sr. Consultant level USD 152K-243KAWS | Apache Spark | CI/CD | Cloud Migration | Cloud platform401k | Dental insurance | FSA/HSA | Life insurance | Medical insuranceSenior-level Full TimeBellevue, WA, United States14h ago
-
Robotics Engineer, Deployment & Testing - San Mateo USD 100K-300KC# | C++ | Embedded Systems | Go | Machine LearningMid-level Full TimeSan Mateo15h ago
-
Analytics Engineer USD 220K-335KData Modeling | Data Visualization | Data pipeline | ETL | LookerHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco15h ago
-
Senior Data Engineer USD 121K-161KAPI Design | Airflow | Apache Spark | Azure | CI/CDMedical benefitsSenior-level Full TimeManhattan, New York, United States16h ago
-
Senior-level Full TimeCarlsbad, California, United States16h ago
-
Senior AI Engineer (Databricks) USD 166K-225KAPI | Agile | Databricks | Deep learning | Distributed SystemsCell phone allowance | Comprehensive health coverage | Equity compensation | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote US R16h ago
-
AI Specialist - #2911 USD 77K-176KAPI Development | Amazon Web Services | Azure | Cloud Computing | Cloud platform401k | Dental insurance | Disability coverage | Education reimbursement | Employee resource groupsMid-level Full TimePittsburgh, PA16h ago
-
AI Specialist - #2910 USD 77K-176KAPI Development | AWS | Azure | Deep learning | Docker401k | Dental insurance | Education reimbursement | Employee resource groups | Employee stock programMid-level Full TimePittsburgh, PA16h ago
-
Data Engineer USD 92K-125KAWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Kinesis401k match | Comprehensive benefits | Flexible PTO | Gym reimbursement | Mental health supportMid-level Full TimeHerndon, VA, United States16h ago
-
Space Operations Engineer (Dragon) USD 95K-130KAttitude control | Avionics | C++ | Communication Systems | Flight Operations401k plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical/Dental/Vision insuranceEntry-level Full TimeHawthorne, CA16h ago
-
Senior Platform Analytics Engineer USD 192K-264KAWS | Airflow | Apache Spark | Big Data | DBTHybrid work schedule | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Staff Machine Learning Platform Engineer USD 224K-308KAWS | Airflow | Apache Airflow | Cockroach DB | DatabricksFlex day availability | Hybrid work 3 days per week | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Active Learning | Bayesian optimization | Coarse Grained Modeling | Computer Vision | Data Pipelines401k eligibility | Employee assistance program | Health and wellness benefits | Paid Holidays | Paid parental leaveSenior-level Full TimeMentor, OH, United States17h ago
-
Distinguished AI Engineer- Talent Marketplace USD 248K-406KAI architecture | Agentic AI | Artificial Intelligence | Machine Learning | Technical leadershipHybrid work | Mentorship and growth opportunitiesExecutive-level Full TimeSunnyvale, CA, United States17h ago
-
Embedded Software Engineer I USD 116K-174KC# | C++ | DRIVE OS | Device Drivers | Embedded LinuxAnnual bonus | Benefits | Equity compensation | Hybrid work environmentEntry-level Full TimeMountain View, California17h ago
-
Distinguished Software Engineer - AI Infrastructure USD 248K-406KAI infrastructure | Data Engineering | Data Infrastructure | Distributed Databases | Distributed SystemsExecutive-level Full TimeMountain View, CA, United States17h ago
-
Principal Software Engineer (AI) ( US) USD 132K-145KAI RMF | Agentic Systems | Alerting | Artificial Intelligence | Audit LoggingContinuous development support | Employee assistance program | Employee recognition | Flexible paid time off | Parental and caregiver leavesSenior-level Full TimeRemote - US R17h ago
-
CX Analytics Engineer USD 152K-179KAirflow | DBT | Data Governance | Data Modeling | Data MonitoringMid-level Full TimeRemote - USA R17h ago