Senior Data Engineer
Tasks
- Build data lakes on AWS Databricks
- Build distributed automated data processing systems
- Collaborate with engineers architects and data scientists
- Create data pipelines
- Create diagrams and technical documentation
- Define business metrics
- Deploy and maintain data systems
- Develop and integrate with external APIs
- Develop and integrate with internal APIs
- Document data engineering systems
- Ingest data from diverse data sources
- Monitor data quality
- Monitor data system adoption
- Optimize computational efficiency
- Optimize storage efficiency
- Orchestrate data workflows
- Track and validate data pipelines
- Validate incoming and outgoing data
- Write unit tests
- Write validation tests
Perks/Benefits
- 401k matching
- FSA benefits
- Medical, dental, and vision insurance
- Paid Holidays
- Paid time off
- Roth 401k matching and immediate vesting
Skills/Tech-stack
API Development | AWS Databricks | AWS Glue | Airflow | Apache Kafka | Data Modeling | Data Warehousing | Databricks | Docker | ETL | Jupyter | Kubernetes | Pandas | PySpark | Python | SQL | Snowflake
Education
Roles
Related jobs
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US2h ago
-
ML Engineer USD 190K-320KCost Optimization | Data Versioning | Dataset Operations | Dataset curation | Eval Frameworks401k matching | Dental insurance | Employee assistance program | Health insurance | Stock optionsSenior-level Full TimeSan Francisco4h ago
-
Senior-level Full TimeOklahoma City6h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R6h ago
-
Staff Machine Learning Engineer USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability coverage | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA9h ago
-
Staff Machine Learning Engineer USD 152K-261KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA9h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …9h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | CI testing | Cluster scheduling | Data Pipelines | Distributed SystemsSenior-level Full TimeNew York City, New York9h ago
-
Senior AI Solutions Engineer, Enterprise Knowledge Work USD 260K-325KAgentic Systems | Dspy | Evaluation | LLM orchestration | LanggraphCollaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …10h ago
-
Senior AI Solutions Engineer, Software Engineering USD 260K-325KAgentic Software | Agentic Software Engineering | Agentic Workflows | Benchmarking | Code generationCollaborative culture | Five days per week | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …10h ago
-
Principal, AI Platform Engineer USD 125K-187KAWS | Azure | CI/CD | Data leakage | Deterministic executionSenior-level Full TimeAtlanta, Georgia, US United States, 3034010h ago
-
AI Engineer USD 100K-143KAPI Development | AWS | Automation | Azure | Cloud platform401k | Dental insurance | Disability insurance | EAP | Gym reimbursementMid-level Full TimeOcala, Florida, United States10h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States11h ago
-
Robotics Integration Engineer USD 170K-250KAutomation | Behavior Trees | C++ | Control Systems | GitMid-level Full TimeSan Jose, CA12h ago
-
Applied Scientist - ML/Ai USD 156K-310KComputer Vision | Convolutional Neural Networks | Data Processing | Deep Neural Networks | Deep learning401k | Dental insurance | Life insurance | Medical insurance | Unlimited PTOSenior-level Full TimeMiami, Florida, United States; Office - …12h ago
-
Astrodynamics | C++ | Conjunction analysis | Embedded Systems | Estimation TheorySenior-level Full TimeChantilly, VA or Aurora, CO12h ago
-
AI Engineer USD 150K-250KAPI Integration | Agents | Data integration | Debugging | Evaluation401k | Dental insurance | Health insurance | Vision insuranceMid-level Full TimeSan Francisco13h ago
-
Internal Systems Engineer (Applied AI) USD 140K-160KAgentic Workflows | CI/CD | DAG | Freshdesk | Gitbook401k | Catered lunch | Flexible PTO | Flexible spending accounts | Great coffeeEntry-level Full TimeColumbus13h ago
-
Senior Machine Learning Engineer USD 200K-230KBatching | Cloud Inference | Computer Vision | Deep learning | Edge ComputingDental insurance | Flexible PTO | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, US or Canada - NYC … R13h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R13h ago
-
Spatial Data Engineer II USD 79K-133KData Normalization | Database Design | ETL | Geospatial Data | PostgreSQL401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysMid-level Full TimeRedlands, CA14h ago
-
Embedded Device Firmware Engineer USD 90K-128KAutomated testing | C# | C++ | CI/CD | Computer ArchitectureMid-level Full TimeSanta Clara, CA14h ago
-
Senior Embedded Systems Engineer USD 170K-226KACAP | Ansible | Bash | Cellular networking | DNS401k match | Dental insurance | Medical insurance | PTO | Sick days without limitSenior-level Full TimeChicago / Remote R14h ago
-
Senior Data Engineer, Data Foundations & AI Platform USD 153K-207KAPIs | Alerting | Apache Spark | CI/CD | Data Lineage401k with company match | Disability insurance | Flexible time off | Health, dental, and vision insurance | Leave of absenceSenior-level Full TimeUnited States (Remote) R14h ago
-
Staff Software Engineer, Data Engineering USD 130K-285KAirflow | Apache Flink | Data Modeling | Data pipeline | Distributed Computing401k matching | Basic life insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA; Seattle, …15h ago