Senior Data Engineer
Tasks
- Build API serving views
- Coordinate schema contracts with downstream consumers
- Define Kafka topic schema contracts
- Design columnar warehouse pipelines
- Design materialized views
- Design scalable data models
- Evolve S3 data lake table layouts
- Implement parity validation tooling
- Monitor bloat and latency regressions
- Optimize query planning and cost
- Own OLAP analytics layer
- Partner on OLTP serving tables
- Tune indexing and autovacuum
Perks/Benefits
Skills/Tech-stack
Amazon Redshift | Apache Hudi | Apache Iceberg | Apache Pinot | Autovacuum | BigQuery | CDC | CTE | ClickHouse | Consumer Group | Delta Lake | Dimensional Modeling | Exactly once | Indexing | Kafka | Kafka Exactly Once | Logical replication | Materialized views | Parquet | PostgreSQL | Prometheus | Python | Rust | S3 | SCD | SQL | Schema evolution | Snowflake | Snowflake Schema | Star Schema | Window Functions
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Staff Engineer, Datacenter Server Lifecycle USD 320K-405KAWS | Asset tracking | Coreboot | Decommissioning | Firmware verificationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …6h ago
-
AI & Robotics Data Collection Engineer (Intern) USD 68K-82KContainerization | Linux | Python | ROS2 | Shell ScriptingFully stocked kitchen | Meals provided | Onsite workEntry-level InternshipMilpitas, CA7h ago
-
Mid-level Full TimeTysons, VA, United States7h ago
-
Mid-level Full TimeRemote, United States R7h ago
-
Senior AI Infrastructure Engineer - Training Platform USD 216K-270KAWS | Admission controllers | C++ | CUDA | Custom ResourcesCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …7h ago
-
Data Analyst, Payments Performance USD 124K-187KCode review | Data Visualization | Data analytics | Git | Python401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeSeattle, WA8h ago
-
Analytics Engineer USD 124K-187KCode review | Data Visualization | Git | Python | SQL401k plan | Company bonus | Dental benefits | Equity | Medical benefitsSenior-level Full TimeSeattle, WA8h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | Data AnalysisCommuter benefits | Generous time off | Healthcare benefits | Income protection | Mental health resourcesSenior-level Full TimeCosta Mesa, California, United States9h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboCaregiver leave | Commuter benefits | Dental benefits | Fertility coverage | Healthcare benefitsSenior-level Full TimeQuincy, Massachusetts, United States9h ago
-
Principal Sales Engineer – Warehouse Robotics Systems USD 100K-300KAPI | AutoCAD | AutoMod | EDI | Emulate3DTravel to customer sitesSenior-level Full TimeSan Mateo, CA9h ago
-
Mid-level Full TimeScottsdale, AZ11h ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ11h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R11h ago
-
Data Science and AI Intern USD 50K-50KAWS | Cloud Computing | DBT | Data Visualization | ETLFree daily on site lunches | Free on site EV charging | Latest hardware | On-site gym | Open & transparent cultureEntry-level InternshipMenlo Park, CA12h ago
-
Machine Learning Engineer, Growth USD 0K-0KFeature Engineering | Machine Learning | Model Deployment | Model Evaluation | Model TrainingCell phone allowance | Childcare allowance | Company holidays | Dogfood budget | Family planning benefitMid-level Full TimeSan Francisco, CA12h ago
-
Software Engineer USD 153K-237KAPI | API Gateway | API Management | AWS | Apache Airflow401k employer match | Employer Disability Insurance | Employer health insurance | Employer life insurance | Paid HolidaysSenior-level Full TimeChantilly, VA12h ago
-
Machine Learning Engineer, PhD Intern USD 123K-161KAWS | Azure | Code review | Data Analysis | ExperimentationIn office work 5 days per week | Mentorship | Structured intern programming | Team eventsEntry-level InternshipSan Francisco, CA12h ago
-
Senior ML/AI Engineer USD 130K-160KAgent Frameworks | Artificial Intelligence | Evaluation | Fine Tuning | Inference401k match | Company housing | Company technology package | Dental insurance | Flexible vacationSenior-level Full TimeSan Francisco13h ago
-
Staff, Data Scientist USD 90K-180KBigQuery | Data Wrangling | DeepAR | Hive | Keras401k | Company discounts | Health insurance | Paid time off | Parental leaveSenior-level Full TimeBentonville, AR, United States13h ago
-
Data Engineer II USD 150K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Argo Workflows401k match | CLEAR Plus membership | Catered lunches | Family building benefits | Flexible time offMid-level Full TimeNew York, NY, United States13h ago
-
Senior AI Engineer USD 143K-215KAPI Integration | Agent systems | Authentication | Authorization | Autogen401k | Annual learning stipend | Health/Dental/Vision | Paid time offSenior-level Full TimeGreater Boston, MA; Los Angeles, CA; …14h ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R14h ago
-
AI Value Partner, Customer Analytics USD 120K-160KA/B | A/B Testing | B testing | Causal Inference | Experimental DesignFlexible vacation time | Gym allowance | Lunch and dinners stipend | Medical, dental, vision plans | Paid parental leaveMid-level Full TimeUnited States (Remote) R14h ago
-
Principal Software Engineer - Storage Cache USD 295K-345KActive/Active | Alertmanager | C++ | Chaos Engineering | Container OrchestrationEquity compensationSenior-level Full TimeSan Mateo, CA, United States R14h ago
-
Research Engineer, Robotics USD 118K-178KControl Systems | Debugging | GPU Simulation | Hardware Integration | Motion PlanningFamily leave | Healthy work-life balance | Paid sick leave | Paid vacationMid-level Full TimeSeattle, WA14h ago