Senior Data Engineer (1043) - DataSF - Office of City Administrator
San Francisco, CA, United States
USD 143K-174K (estimate) Entry-level Full Time
Tasks
- Administer Snowflake data warehouse
- Build and maintain data pipelines
- Design data infrastructure
- Develop streaming and batch ingestion
- Document and maintain data models
- Implement access control and security policies
- Manage data platform monitoring and troubleshooting
- Optimize SQL performance
- Provide data engineering best practices
- Use Terraform for infrastructure as code
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | BigQuery | DBT | Dagster | Data Factory | Data Governance | Data Modeling | Data Privacy | Data Security | Databricks | ELT | Kafka | Kinesis | Machine Learning | Pandas | PySpark | Python | SQL | Snowflake | Snowpipe | Terraform
Education
Associate Degree | Bachelor of Engineering | Bachelor of Engineering in Computer Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Software Engineer, Systems ML USD 141K-208KC plus plus | CUDA | Co-design | Compiler optimization | Deep learningSenior-level Full TimeBellevue, WA | Menlo Park, CA …3h ago
-
Data Engineer USD 96K-137KApache Airflow | Cloud platform | DBT | Git | Google Cloud401k matching | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimePiscataway, NJ, US7h ago
-
Data Analytics Engineer - Boulder, Colorado USD 100K-120KDBT | Data Modeling | Data Pipelines | Data Quality | Data Troubleshooting401k matching | Annual learning budget | Health coverage | Life insurance | Paid vacationMid-level Full TimeBoulder, Colorado, United States9h ago
-
Principal AI Platform Engineer USD 104K-166KAPIs | Access Control | Audit trails | Data Engineering | Data GovernanceSenior-level Full TimeSan Francisco, CA13h ago
-
Artificial Intelligence Developer (AI) USD 114K-218KAmazon Web Services | C++ | Conda | Data Modeling | ETL401k matching | Employer Covered Dental Insurance | Employer Covered Disability Insurance | Employer Covered Vision Insurance | Employer-covered health insuranceMid-level Full TimeChantilly, VA13h ago
-
Sr. Embedded Software Engineer - Radar & DSP USD 165K-220KAgile | Anomaly Detection | C# | C++ | ClassificationHealth insurance | Onsite work | Professional development | Retirement plansSenior-level Full TimeHuntington Beach, CA13h ago
-
Distinguished Machine Learning Engineer - Safety USD 399K-457KComputer Vision | Data Architecture | Data Processing | Distributed Systems | Language ModelsEquity compensation | Onsite work schedule | Workplace inclusion cultureSenior-level Full TimeSan Mateo, CA, United States R14h ago
-
Data Engineer USD 125K-160KAWS | AWS AppFlow | AWS CloudFormation | AWS Glue | AWS LambdaIn-office workSenior-level Full TimeMeridian, ID, US14h ago
-
Data Engineer II USD 93K-100KAmazon Web Services | CI/CD | Cloud platform | Deep learning | Distributed ComputingPaid Holidays | Paid time off | Remote workMid-level Full TimeColumbia, MD, US15h ago
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York15h ago
-
Senior Analytics Engineer USD 158K-220KAutomation | CI/CD | Code review | DBT | Data LineageBetterUp coaching | Charitable contribution 401k self contribution | Company holidays | Development plan | Flexible paid time offSenior-level Full TimeUnited States (Hybrid) R15h ago
-
Senior Embedded Software Engineer (C++) USD 141K-224KAutomated testing | C++ | CI/CD | CMake | Computer VisionCompany holidays | Health insurance | Life insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States16h ago
-
AWS | AWS CDK | AWS Glue | Airflow | Athena401k | Health insurance | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R16h ago
-
Machine Learning Engineer (NCG 2026) USD 140K-160KAgentic AI | C++ | Context engineering | Data Pipelines | Deep learningSenior-level Full TimeSan Jose, California, United States16h ago
-
Compression | Computer Vision | CoreML | Data Curation | Dense PredictionCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation and personal days | Global employee assistance programSenior-level Full TimeSan Francisco, CA, USA16h ago
-
Senior Data Engineer USD 130K-160KAlerting | Batch Processing | Data Governance | Data Modeling | Data Pipelines401k matching | Company paid insurance | Company-Provided Technology Package | Company-provided housing | Flexible vacationSenior-level Full TimeSan Francisco R16h ago
-
Senior Machine Learning Engineer USD 130K-160KData Pipelines | Deep learning | Distributed Training | Experimentation | Feature Engineering401k plan | Company paid life insurance | Company-Provided Technology Package | Health savings account | Hybrid workSenior-level Full TimeSan Francisco R17h ago
-
Senior Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work model | Onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R17h ago
-
Applied AI Engineer, Advertising Agents USD 135K-185KA/B | A/B Testing | Agent Orchestration | Artificial Intelligence | Asynchronous programming401k match | Commuter benefits | Dental insurance | Flexible spending account | Health insuranceEntry-level Full TimeMountain View, California, United States17h ago
-
Data Infrastructure Engineer (contract) USD 126K-136KAlways On | Always On Availability | Always On Availability Groups | Availability Groups | CentOSMid-level ContractMountain View, CA17h ago
-
Senior AI Integrations Engineer USD 115K-173KAI | C# | C++ | Compression | DebuggingCommute subsidy | Employee assistance program | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeSan Francisco, CA, USA17h ago
-
Senior Software Engineer - Data Clean Room/ AI Data Hub USD 200K-287KAI/ML | Cloud Computing | Data Privacy | Database systems | Developer APIsSenior-level Full TimeUS-WA-Bellevue17h ago
-
Data Science Engineer USD 130K-160KA/B | A/B Testing | B testing | Data pipeline | Deep learning401k matching | Company housing for 90 days | Company technology package | Dental insurance | Flexible vacationSenior-level Full TimeSan Francisco R17h ago
-
Senior AI Engineer - Customer Agent USD 148K-222KAWS | Alembic | Amazon SQS | Apache Spark | Asynchronous processingSenior-level Full TimeBoston, MA18h ago
-
Sr. Lead AI Engineer USD 216K-324KAWS | Alembic | CI/CD | Celery | DjangoCross hub collaboration | Health and wellbeing benefits | Hybrid work 3x/week | Mentorship | Professional developmentSenior-level Full TimeBoston, MA18h ago