Senior Data Engineer (1043) - DataSF - Office of City Administrator
San Francisco, CA, United States
USD 143K-174K (estimate) Entry-level Full Time
Tasks
- Administer Snowflake data warehouse
- Build and maintain data pipelines
- Design data infrastructure
- Develop streaming and batch ingestion
- Document and maintain data models
- Implement access control and security policies
- Manage data platform monitoring and troubleshooting
- Optimize SQL performance
- Provide data engineering best practices
- Use Terraform for infrastructure as code
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | BigQuery | DBT | Dagster | Data Factory | Data Governance | Data Modeling | Data Privacy | Data Security | Databricks | ELT | Kafka | Kinesis | Machine Learning | Pandas | PySpark | Python | SQL | Snowflake | Snowpipe | Terraform
Education
Associate Degree | Bachelor of Engineering | Bachelor of Engineering in Computer Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Data Engineer USD 40K-52KData Quality | Data quality monitoring | OCaml | Python | Quality monitoringGroup discussions | Mentorship | Project ownershipEntry-level Full TimeNew York, New York, United States7h ago
-
Batch Processing | Bias Mitigation | C++ | Data Processing | Experimentation401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R7h ago
-
AWS | Apache Iceberg | Application refactoring | Architectural Reviews | Cloud ComputingFlexible work culture | Mentorship | Work-life balanceSenior-level Full TimeNew York, New York, USA8h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R8h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States9h ago
-
Forward Deployed AI Engineer USD 90K-110KAPI Integration | AWS | Access Management | Agentic AI | Automated testingEntry-level Full TimeChicago, IL, United States11h ago
-
Intern, AI Engineer (3 Months, Full-Time) USD 50K-50KAPI Integration | Agentic AI | Chunking | Code Automation | FastAPI401k with company match | Career advancement | Employee assistance program | Flexible time off | Health savings accountEntry-level Full Time InternshipScottsdale, Onsite11h ago
-
Senior Data Engineer USD 120K-126K3NF | API Design | API Management | Apache Airflow | Auditing401k match | Charitable Gift Matching | Community giving day | Dental insurance | Discounted personal insuranceSenior-level Full TimeWestern States or Midwest11h ago
-
Senior-level Full TimeDeerfield, IL, United States R11h ago
-
Data Engineer USD 115K-135KAPIs | Anomaly Detection | CI/CD | Cause analysis | Change Data Capture401k matching | Dental insurance | Health insurance | Paid Maternity Leave | Paid time offSenior-level Full TimeChicago, Illinois, United States13h ago
-
Artificial Intelligence Machine Learning USD 99K-200KC# | Data Engineering | Data Governance | Data Modeling | Data PipelinesDental insurance | Employee referral bonus | Health insurance | Identity theft protection | Legal protectionMid-level Full TimeAnnapolis Junction, Maryland13h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | Agile | Build systems | C++ | CI/CD401k match | Health insurance | Paid time off | Relocation not availableSenior-level Full TimeWaltham, MA, United States13h ago
-
Senior Data Engineer - Databricks USD 180K-247KAWS | Access Control | Apache Spark | Azure | CI/CD401k match | Career development program | Corporate Benefit Program | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeDenver, CO R14h ago
-
AWS | AWS Config | Checkov | CloudTrail | CloudWatchDomestic travel up to 100 percent | On-call support | Remote workMid-level Full TimeRemote - USA R14h ago
-
Senior-level Full TimeOrlando, FL, United States15h ago
-
AWS | Agile | Apache Spark | Azure | Big DataMid-level Full TimeUnited States15h ago
-
Data Engineer I USD 87K-137KAPIs | Clay | Data Governance | Data Modeling | Data Quality401k match | Conference attendance support | Employee resource groups | Flexible PTO | Flexible work scheduleMid-level Full TimeMorrisville, United States15h ago
-
Global Total Cost and TVM Data Analytics Engineer USD 128K-166KAlteryx | Artificial Intelligence | Benchmarking | Dashboard Development | Data ModelingChild care subsidy | Dental insurance | Employee resource groups | Flexible family care | Medical insuranceSenior-level Full TimeAllen Park, MI, United States15h ago
-
Generative AI Engineer USD 138K-213KAWS | Azure | Caching | Cloud platform | Databricks401k matching | Generous paid time off | Health, dental, vision benefits | Work from home equipment providedSenior-level Full TimeNew York, NY, United States16h ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States16h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k plan | Company holidays | Floating holidays | Paid time off | Remote workSenior-level Full TimeUnited States R17h ago
-
Software Engineer, Scientific Computing USD 90K-160KCUDA | Debugging | Deployment | Numerical Methods | Performance optimizationEntry-level Full TimeRedwood City17h ago
-
Entry-level Full TimeRedwood City17h ago