Senior Data Engineer, Solutions Architecture
Scottsdale, Arizona, United States
USD 110K-145K Senior-level Full Time
Tasks
- Build and orchestrate ETL/ELT workflows
- Create SQL transformations for analytics
- Create technical documentation and data dictionaries
- Design scalable data infrastructure
- Develop and maintain dbt models
- Develop automated data pipelines
- Establish data lineage tracking and privacy controls
- Implement automated testing and deployment automation
- Implement data encryption and security best practices
- Implement data validation, testing, and monitoring
- Implement role-based access controls
- Implement workflow automation and dependency management
- Lead CI/CD for data pipelines
- Manage Snowflake instances
- Manage version control
- Monitor and optimize cloud infrastructure costs
- Optimize query performance and resource utilization
- Set up alerting and monitoring for pipelines
- Use infrastructure as code
Perks/Benefits
Skills/Tech-stack
API | AWS | Access Control | Airflow | Azure | Azure Blob | Azure Blob Storage | Blob Storage | CI/CD | Cloud Storage | CloudFormation | DBT | Dagster | Data Connectors | Data Lineage | Data Monitoring | Data Testing | Data Validation | Encryption | GCP | GitLab | Google Cloud | Google Cloud Storage | Gradio | Incident Response | Infrastructure as Code | Injection prevention | Language Models | Large Language Models | Linux | Prompt injection | Prompt injection prevention | Python | Role-Based Access | Role-Based Access Control | S3 | SQL | Snowflake | Streamlit | Terraform | “as-code”
Education
Roles
Related jobs
-
Mid-level Full TimeFAIRFAX, VA, United States4h ago
-
Actuators | C++ | Coordinate frames | Docker | GitMentorship | Training and documentation support | Travel 30 to 40 percentEntry-level Full TimeChicago, IL, United States6h ago
-
Deloitte Technology-US Associate GenAI Engineer USD 70K-86K.Net Core | AWS | Agile | Algorithms | AngularMid-level Full TimeHermitage, Tennessee, United States9h ago
-
Databricks Engineering Consultant USD 93K-155KAmazon Web Services | Apache Spark | Auto Loader | Cloud platform | Data ModelingMentorship | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …9h ago
-
Data Engineer II USD 97K-171KAgile | Amazon Web Services | Atlassian | Confluence | Data GovernanceMid-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Consultant - Data Science / Data Lake USD 107K-188KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Apache StormEntry-level Full TimeChicago, Illinois, United States9h ago
-
Agile | Amazon Web Services | Cloud Platforms | Cloud platform | Data EngineeringMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …9h ago
-
Java Full Stack Developer-Software Engineer II USD 93K-155KAPI Design | AWS | Ansible | Benchmarking | Best practicesMid-level Full TimeDallas, Texas, United States9h ago
-
Anthropic Forward Deployed Engineer - GPS USD 97K-171KAPI Integration | AWS | Airflow | Anthropic Claude | Anthropic Claude APIMentorship | Professional development opportunities | Reasonable accommodations | Travel 50% | US government security clearance supportMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …9h ago
-
Lead Forward Deployed Engineer - AWS USD 189K-372KAPI Integration | AWS | Airflow | Amazon Bedrock | Bedrock AgentsMentorship | Professional developmentSenior-level Full TimeSan Jose, California, United States9h ago
-
Cloud Engineer - Project Delivery Senior Analyst USD 103K-173KAWS CloudFormation | AWS CloudWatch | AWS Lambda | Amazon EKS | Amazon Web ServicesSenior-level Full TimeDallas, Texas, United States9h ago
-
Software engineer - AI Agent Infra USD 212K-450KAI Agent | AI Agent Frameworks | API Development | Access Control | Agent FrameworksEntry-level Full TimeSan Jose, California, United States9h ago
-
API Development | AWS | CI/CD | Distributed Systems | Docker401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York9h ago
-
AI Systems Engineer USD 99K-157K800-171 | AI RMF | Adversarial Testing | Agent Orchestration | Agent orchestration frameworksMid-level Full TimeAnnapolis Junction, MD9h ago
-
Production Engineer (University Grad) USD 182K-200KAI tools | API | Agent Orchestration | C++ | CDNTraining and development | Work authorization sponsorshipSenior-level Full TimeSunnyvale, CA | New York, NY10h ago
-
Software Engineer, SystemML - AI Networking USD 170K-251KC# | C++ | CUDA | Data-parallel | Deep learningMid-level Full TimeMenlo Park, CA10h ago
-
Senior Software Engineer, Applied AI, Commerce USD 174K-252KC++ | Deterministic testing | Gemini | Language Models | Language ProcessingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
Staff Software Engineer, Gemini Evals, GenAI, DeepMind USD 207K-300KAgent evaluation | Automated Retry | Distributed Systems | Error classification | InferenceSenior-level Full TimeMountain View, CA, USA; New York, …10h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-252KAgentic Applications | Automated testing | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA10h ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIEmployee discounts | Health insurance | Paid time off | Retirement plansMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …10h ago
-
Software Engineer III, Generative AI, Agent Engineering USD 147K-211KArtificial Intelligence | BigQuery | CI/CD | Cloud Storage | Computer VisionSenior-level Full TimeKirkland, WA, USA10h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-252KAPIs | Agent systems | Cloud platform | Conversational AI | DebuggingTravel opportunitiesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …10h ago
-
Artificial Intelligence | Automated Evaluation | Behavior analytics | C# | C++Senior-level Full TimeMountain View, CA, USA10h ago
-
Mechanical Engineer, Data Center Technology Systems USD 171K-248KASME B31 | C++ | Fire Protection | Fuel Systems | HVACSenior-level Full TimeSunnyvale, CA, USA10h ago