Sr Data Engineer
USA - CA - 2450 Broadway, United States
USD 148K-199K Senior-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build data pipelines for marketing acquisition reporting
- Create technical design docs and run code reviews
- Design ingestion frameworks for vendor data
- Develop metadata driven parameterized pipeline components
- Implement data quality checks monitoring and remediation
- Improve pipeline performance reliability logging and observability
- Integrate SLA incident detection logging alerting and auto recovery workflows
- Mentor junior engineers and support architectural decisions
- Migrate SQL transformations to Databricks Unity Catalog
- Transform marketing data into analytics ready datasets
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Airflow | CI/CD | CSV | Data Governance | Data Modeling | Data Processing | Databricks | Delta Lake | Distributed data | Distributed data processing | ELT | ETL | Git | GitHub | JSON | Lakehouse | Parquet | PySpark | SQL | Snowflake | Spark SQL | Unity Catalog
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-221KAnalytics Warehousing | Apache Spark | Batch Processing | Big Data | Cloud ComputingSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …14h ago
-
Embedded Systems Engineer USD 90K-120KAUTOSAR | Automated testing | C++ | CAN | CANoe401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeChillicothe, IL16h ago
-
Senior Machine Learning Engineer USD 171K-270KAWS | Agentic Systems | Amazon EKS | Azure | CI/CD25 annual days of vacations | Coffee and fruit | Flexible working hours | Gym allowance | Health insuranceSenior-level Full TimeLisbon IT Campus - Swiss Post17h ago
-
Senior Full Stack AI Developer USD 125K-185KAWS | Application development | Azure | CI/CD | Cloud EngineeringEmployee benefits | Government security clearance assistance | Remote workSenior-level Full TimeWork from home, VA, United States17h ago
-
Mid-level Full TimeARLINGTON, VA, United States17h ago
-
Data Engineer Stf - E4 USD 94K-175KData Modeling | Data Recovery | Data Security | Data Warehousing | Data pipeline401k match | EAP | Education assistance | Flexible spending accounts | Flexible work arrangementsMid-level Full TimeLexington, KY, US20h ago
-
Data Engineer - E2 USD 80K-163KAuthentication | Authorization | Backup and Recovery | Data Modeling | Data Security401k match | Education assistance | Employee assistance program | Flexible schedules | Flexible spending accountsMid-level Full TimeFort Worth, TX, US20h ago
-
Entry-level Full TimeCambridge, MA, Arlington, VA, Seattle, WA22h ago
-
AWS | Azure | CI/CD | Containers | DNS401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R23h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R23h ago
-
Data Scientist Graduate Co-op USD 76K-125KAgile | Artificial Intelligence | Computer Vision | Data Modeling | Data VisualizationAgile work environment | Collaborative team cultureEntry-level Full TimeCambridge, MA, Arlington, VA1d ago
-
Platform & Data Engineer USD 150K-205KAPI Design | API Versioning | Aggregation Pipeline | Authentication | Capacity PlanningSenior-level Full TimeCupertino1d ago
-
AI/ML Solutions Engineer USD 139K-200KAI Explainability | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States1d ago
-
Senior Software Engineer, Data Infrastructure USD 200K-400KAWS | Airflow | Amazon Redshift | Apache Flink | AzureDaily lunches and snacks | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSan Francisco1d ago
-
Solutions Architect - Media USD 152K-209KAWS | Apache Spark | Azure | Delta Lake | Distributed SystemsSenior-level Full TimeLos Angeles, California1d ago
-
Senior Data Engineer USD 140K-170KAPIs | Azure DevOps | DBT | Data Architecture | Data GovernanceDiscretionary bonus | Hybrid work schedule | Training and developmentSenior-level Full TimeNew York, New York, United States R1d ago
-
Mid-level Full TimeNew York, Austin, Miami, Dallas, City …1d ago
-
Data Architect / Engineer USD 150K-206KAirflow | Change Data Capture | Data Capture | Data Governance | Data IngestionSenior-level Full TimeNew York, Austin, Miami, Dallas, City …1d ago
-
Staff Software Engineer, Data Warehouse Foundation USD 177K-364KApache Airflow | Apache Flink | Apache Spark | Apache Superset | Data PipelinesSenior-level Full TimePalo Alto, CA, US; Remote, US R1d ago
-
Tech Lead, Software Infrastructure and Fleet Management USD 150K-294KAPIs | Alerting | C plus plus | CI/CD | Configuration ManagementSenior-level Full TimePalo Alto1d ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R1d ago
-
Lead AI Engineer | Onsite - Delaware USD 56K-196KAI Agents | AI Observability | AWS Bedrock | Agent systems | CI/CD401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States1d ago
-
Senior Data Engineer- People Analytics USD 180K-207KAccess Control | Airflow | Amazon Redshift | CI/CD | Cloud platformSenior-level Full TimeUnited States R1d ago
-
Senior Data Visualization Engineer USD 114K-142KAdobe Illustrator | Adobe Photoshop | ArcGIS | Cartography | D3Employee assistance program | Home office reimbursement | Paid parental leave | Tuition reimbursement | Wellness programSenior-level Full TimeSan Francisco, CA R1d ago
-
Semantic AI Engineer USD 158K-202KAPI | CI/CD | Data integration | Entity Resolution | FAIR-Data401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeNorth Chicago, IL, United States1d ago