Senior Data Engineer (1043) - DataSF - Office of City Administrator
San Francisco, CA, United States
USD 143K-174K (estimate) Entry-level Full Time
Tasks
- Administer Snowflake data warehouse
- Build and maintain data pipelines
- Design data infrastructure
- Develop streaming and batch ingestion
- Document and maintain data models
- Implement access control and security policies
- Manage data platform monitoring and troubleshooting
- Optimize SQL performance
- Provide data engineering best practices
- Use Terraform for infrastructure as code
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | BigQuery | DBT | Dagster | Data Factory | Data Governance | Data Modeling | Data Privacy | Data Security | Databricks | ELT | Kafka | Kinesis | Machine Learning | Pandas | PySpark | Python | SQL | Snowflake | Snowpipe | Terraform
Education
Associate Degree | Bachelor of Engineering | Bachelor of Engineering in Computer Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
API Integration | ARM | Angular | Appian | Azure DevOpsFlexible extensions contract | Hybrid work schedule | Knowledge transfer coaching | Onsite work with mission teamsSenior-level ContractAustin, United States3h ago
-
Senior-level Full TimeUSA-VA-Herndon3h ago
-
Data Engineer Intern (Ads Data) - 2026 Summer (BS/MS) USD 113K-177KData Governance | Data Modeling | Data Monitoring | Data Pipelines | Data ProcessingDevelopment workshops | Hands-on experience | Social eventsEntry-level InternshipSan Jose, California, United States4h ago
-
Data Science Team Leader USD 165K-165KCI/CD | Cloud platform | Docker | Google BigQuery | Google CloudSenior-level Full TimeDenver, Colorado, United States5h ago
-
Software Engineer, Systems ML USD 141K-208KC plus plus | CUDA | Co-design | Compiler optimization | Deep learningSenior-level Full TimeBellevue, WA | Menlo Park, CA …5h ago
-
Network Engineer, Foundation & Support USD 120K-184KAI Assisted Development | Automation | C# | C++ | Distributed SystemsGlobal team collaboration | Mentorship | On-the-job trainingEntry-level Full TimeDenver, CO | Reston, VA | …5h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-198KASIC design | Code review | Machine Learning | Machine Learning Accelerators | Memory hierarchyMid-level Full TimeSunnyvale, CA, USA5h ago
-
Agentic Workflows | Automated testing | Computer Vision | Data Processing | Function CallingSenior-level Full TimeMountain View, CA, USA5h ago
-
Technical Lead, AI/ML Infrastructure USD 207K-301KC# | C++ | Compute architecture | Cryptography | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Research Software Engineer USD 207K-301KData Structures | Data structures algorithms | Distributed Computing | Information Retrieval | Language ModelsBonus | Career development | Equity | Health insurance | Paid time offSenior-level Full TimeMountain View, CA, USA5h ago
-
Data Engineer USD 96K-137KApache Airflow | Cloud platform | DBT | Git | Google Cloud401k matching | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimePiscataway, NJ, US8h ago
-
Data Analytics Engineer - Boulder, Colorado USD 100K-120KDBT | Data Modeling | Data Pipelines | Data Quality | Data Troubleshooting401k matching | Annual learning budget | Health coverage | Life insurance | Paid vacationMid-level Full TimeBoulder, Colorado, United States11h ago
-
Principal AI Platform Engineer USD 104K-166KAPIs | Access Control | Audit trails | Data Engineering | Data GovernanceSenior-level Full TimeSan Francisco, CA14h ago
-
Artificial Intelligence Developer (AI) USD 114K-218KAmazon Web Services | C++ | Conda | Data Modeling | ETL401k matching | Employer Covered Dental Insurance | Employer Covered Disability Insurance | Employer Covered Vision Insurance | Employer-covered health insuranceMid-level Full TimeChantilly, VA15h ago
-
Sr. Embedded Software Engineer - Radar & DSP USD 165K-220KAgile | Anomaly Detection | C# | C++ | ClassificationHealth insurance | Onsite work | Professional development | Retirement plansSenior-level Full TimeHuntington Beach, CA15h ago
-
Distinguished Machine Learning Engineer - Safety USD 399K-457KComputer Vision | Data Architecture | Data Processing | Distributed Systems | Language ModelsEquity compensation | Onsite work schedule | Workplace inclusion cultureSenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Data Engineer USD 125K-160KAWS | AWS AppFlow | AWS CloudFormation | AWS Glue | AWS LambdaIn-office workSenior-level Full TimeMeridian, ID, US16h ago
-
Data Engineer Senior Principal (Hybrid) USD 144K-195KAmazon S3 | Amazon Web Services | Amazon Web Services (AWS) | Apache Airflow | Apache Flink401k match | Health insurance | Hybrid work | Paid time offSenior-level Full TimeUSA NC Fort Bragg - 2929 … R16h ago
-
Gen AI Engineer USD 112K-168KAKS | AWS | Agile | Agile frameworks | Apache Spark401k match | Dental insurance | Financial education resources | Health insurance | Life insuranceMid-level Full TimeGA-ATLANTA, 740 W PEACHTREE ST NW, …16h ago
-
Lead Cloud Data and AI/ML Engineer, AVP USD 90K-157KAPI | AWS | AWS Lambda | Agentic AI | AirflowDental insurance | Employee assistance program | Family care benefits | Health insurance | Incentive compensationSenior-level Full TimeQuincy, Massachusetts, United States16h ago
-
Data Engineer II USD 93K-100KAmazon Web Services | CI/CD | Cloud platform | Deep learning | Distributed ComputingPaid Holidays | Paid time off | Remote workMid-level Full TimeColumbia, MD, US17h ago
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York17h ago
-
Senior Analytics Engineer USD 158K-220KAutomation | CI/CD | Code review | DBT | Data LineageBetterUp coaching | Charitable contribution 401k self contribution | Company holidays | Development plan | Flexible paid time offSenior-level Full TimeUnited States (Hybrid) R17h ago
-
Senior Embedded Software Engineer (C++) USD 141K-224KAutomated testing | C++ | CI/CD | CMake | Computer VisionCompany holidays | Health insurance | Life insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States17h ago
-
AWS | AWS CDK | AWS Glue | Airflow | Athena401k | Health insurance | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R18h ago