Senior Data Engineer, Solutions Architecture
San Francisco, California, United States
USD 110K-145K Senior-level Full Time
Tasks
- Build ETL/ELT workflows
- Collaborate with analytics engineers data scientists and stakeholders
- Create SQL transformations
- Create technical documentation and data dictionaries
- Design scalable data infrastructure
- Develop dbt models
- Establish data lineage tracking and privacy controls
- Implement automated testing and deployment automation
- Implement data validation testing monitoring
- Implement role based access controls and encryption
- Lead CI/CD for data pipelines
- Manage Snowflake instances
- Manage version control and infrastructure as code
- Monitor and optimize cloud infrastructure costs
- Optimize query performance and resource utilization
- Orchestrate data pipelines with Dagster
- Set up pipeline alerting monitoring and incident response
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Access Control | Airflow | Azure | Azure Blob | Azure Blob Storage | Blob Storage | CI/CD | Cloud Cost Optimization | Cloud Storage | CloudFormation | Clustering | Cost Optimization | DBT | Dagster | Data Lineage | Data Monitoring | Data Quality | Data Validation | ELT | ETL | Encryption | GCP | GitLab | GitLab CI | GitLab CI/CD | Google Cloud | Google Cloud Storage | Infrastructure as Code | LLM | Language Models | Large Language Models | Modal | OpenAI | Python | Role-Based Access | Role-Based Access Control | S3 | SQL | Snowflake | Terraform | Virtual Warehouses | “as-code”
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)26d ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Agent architecture | Browser technologies | Chrome DevTools | Chrome DevTools ProtocolSenior-level Full TimeSan Francisco4h ago
-
Sr Technical Solutions Engineering USD 130K-178KAWS | Automated Patch Deployment | Azure | Bash | CloudFormation24x7 on-call support | Secure facility accessSenior-level Full TimeMcLean, Virginia8h ago
-
Staff Technical Solution Engineering USD 153K-210KAir-gapped | Air-gapped networks | Automation | Bash | Cloud infrastructure24x7 on call coverage flexibility | Benefits package | Secure facility onsite workSenior-level Full TimeMcLean, Virginia8h ago
-
Mid-level Full TimeCosta Mesa, California, United States9h ago
-
AWS | Apache Spark | Big Data | Cloud platform | Data EngineeringSenior-level Full TimeMcLean, Virginia; Washington, D.C.10h ago
-
AWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference and meetup promotion | Equity eligibility | Performance bonus eligibility | Travel opportunitiesSenior-level Full TimeMaryland; Virginia; Washington, D.C.10h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Databricks | Python401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, San Francisco, CA; New … R10h ago
-
Software Engineer (Embedded) USD 100K-145KC# | C++ | Calibration | Closed Loop | Closed loop control401k | Casual dress | Employer paid medical/dental/vision | Flexible work hours | Free catered dinnerMid-level Full TimeLos Angeles, CA (On-site)10h ago
-
Staff Software Engineer, AI Native Web Platform USD 198K-272KCI/CD | CMS | Design Systems | JavaScript | LLMSenior-level Full TimeMountain View, California10h ago
-
Senior AI Engineer, Real-World Data USD 125K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | Agile deliverySenior-level Full TimeUS Remote R10h ago
-
Senior-level Full TimeNew York, NY11h ago
-
GTM AI Engineer USD 192K-238KAPI Integration | Claude | Data Enrichment | Data Pipelines | Error HandlingAdoption leave | Commuter benefits | Dental insurance | Disability insurance | ESPPMid-level Full TimeSan Mateo, CA, United States11h ago
-
Sr AI Engineer USD 84K-105KC# | Data Preprocessing | Digital Signal | Digital Signal Processing | Edge AICommuter benefits | Dental insurance | Employee resource groups | Flexible spending account | Life insuranceSenior-level Full TimeColumbia, MARYLAND, United States12h ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data Governance401k match | Health savings account | Life insurance | Paid Holidays | Parental leaveSenior-level Full TimeEl Segundo, CA12h ago
-
A/B | A/B Testing | B testing | C++ | Cloud Computing401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R12h ago
-
Connected Factory AI Engineer USD 73K-138KAPIs | Agentic Workflows | Artificial Intelligence | Cloud Computing | Code Reviews401k | Paid time offEntry-level Full TimeNorth Chicago, IL, United States12h ago
-
Senior Analytics Engineer USD 147K-190KAgile | Airflow | CI/CD | DBT | Data GovernanceCasual environment | Company retreats | Learning from leaders | Wellness programSenior-level Full TimeNew York, New York12h ago
-
Data Analytics Engineer USD 95K-115KCursor | DBT Core | GitHub Copilot | SQL | Salesforce401k matching | Health insurance | Learning budget | Life insurance | Paid vacationMid-level Full TimeBoulder, Colorado, United States12h ago
-
Data Analytics Integrator USD 92K-158KData Engineering | Data Modeling | Data Pipelines | Data Quality | Data Reconciliation401k | Dental insurance | Discretionary PTO | Health insurance | Professional development opportunitiesMid-level Full TimeAtlanta, GA12h ago
-
Senior Backend Engineer- AI Agents (Remote) USD 180K-240KA/B | A/B Testing | API Design | AWS | AzureFlexible vacation policy | Health insurance coverage | Team offsites and in person collaboration | Work with distributed teamSenior-level Full TimeUnited States R13h ago
-
Senior AI/ML Architect, Applied Field Engineering USD 165K-216KAWS | Apache Airflow | Apache Spark | As-a-Service | Cloud platformSenior-level Full TimeUS-NY-New York13h ago
-
Senior Data Engineer, Solutions Architecture USD 110K-145KAPI Integration | AWS | Access Control | Airflow | AnthropicCompany-provided meals and events | Hybrid work environmentSenior-level Full TimeSan Diego, California, United States14h ago
-
Senior Data Engineer, Solutions Architecture USD 110K-145KAPI Integration | AWS | Access Control | Anthropic | AzureAutonomous role | Hybrid work environment | Opportunities for professional growthSenior-level Full TimeScottsdale, Arizona, United States14h ago
-
Software Engineer, Machine Learning USD 150K-215KAPI Design | AWS | AWS CloudWatch | Artificial Intelligence | AzurePartial telecommutingMid-level Full TimeBoston, MA14h ago