Senior Engineer
AZ - Chandler, United States
USD 70K-205K (estimate) Senior-level Full Time
Tasks
- Apply dbt tests and documentation
- Architect curated datasets aligned to upstream sources
- Build and maintain ETL/ELT processes
- Build training and inference workflows on Databricks
- Configure IAM roles and permissions
- Debug data pipeline failures with SQL and dbt tests
- Design and maintain Delta Lake pipelines with Medallion Architecture
- Execute code reviews and follow dbt and SQL standards
- Implement batch and micro batch processing with Spark
- Manage AWS lakehouse architectures with Amazon S3
- Manage data governance with Databricks Unity Catalog
- Monitor model inputs and outputs for data quality issues
- Perform data validation and cleansing
- Prepare and validate ML feature datasets
- Set up and monitor Databricks data and ML workloads
- Support LLM embedding generation
- Support retrieval augmented generation RAG
- Support semantic search
- Troubleshoot and optimize cloud AI and data workflows
- Write and optimize SQL transformations
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Amazon Web Services | DBT Core | Databricks | Databricks Unity | Databricks Unity Catalog | Delta Lake | ELT | ETL | Git | IAM | Medallion Architecture | Python | SQL | Spark | Unity Catalog | Web Services
Education
N/A
Related jobs
-
Defensive Security AI Scientist USD 240K-260KAccelerate | Artificial Intelligence | CISA KEV | CUDA | CVSS401k plan with company matching | Bereavement | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R4h ago
-
Senior Staff Data Engineer USD 120K-180KAPI Best Practices | API Development | Agile | Apigee | AvroSenior-level Full TimeNashville, TN, United States6h ago
-
AI Foundry | AI Search | Agent Service | Azure AI | Azure AI FoundrySenior-level Full TimeUnited States6h ago
-
AWS | Automation | Azure DevOps | CI/CD | Cloud DataAgile work environmentSenior-level Full TimeNewport Beach, CA, United States6h ago
-
Solution Architect – Microsoft Azure Data & Fabric USD 150K-180KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level ContractSeattle7h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 148K-152KAgile Development | Confluence | Jira | LLM | Process Engineering401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeFort George G Meade, United States8h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Senior-level ContractLos Angeles, United States8h ago
-
Sr.AI ML Developer (Python) USD 115KAgentic AI | Agile | Fine Tuning | Generative AI | Language ModelsSenior-level Full TimeUS-FL-Tampa9h ago
-
Sr.AI ML Developer (Python) USD 110KAgentic AI | Fine Tuning | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeUS-FL-Tampa9h ago
-
C++ | Cloud Storage | Data Analysis | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Seattle, WA, USA10h ago
-
Senior Software Engineer, Data USD 126K-189KAPI Development | AWS | Airflow | Docker | ETL401k plan | Commuting Stipend | Dental insurance | Dependent Care Flexible Spending Account | Employee assistance programSenior-level Full TimeSeattle, WA17h ago
-
Senior-level Full TimeNew York20h ago
-
Staff software engineer, data products USD 202K-255KBackend Development | Data Integrity | Data Modeling | Data Pipelines | Data TransformationIn office 4 days per week | Remote-friendlySenior-level Full TimeSan Francisco21h ago
-
Agentic AI Developer USD 140K-200KAgent Framework | Asynchronous programming | Autonomous Agents | Azure Cognitive | Azure Cognitive SearchMid-level Full TimeSan Francisco, CA, United States21h ago
-
Data Mining | Data labeling | Dataset creation | Deep learning | Knowledge DistillationSenior-level Full TimeFoster City, CA21h ago
-
Senior Data Engineer USD 82K-193KAgile | BigQuery | CI/CD | Data Engineering | Data PipelinesCompany-Paid Holidays | Dental insurance | Disability insurance | Employee assistance program | Life insuranceSenior-level Full TimeBridgewater, NJ, US21h ago
-
Senior-level Full TimeNashville, Tennessee, United States21h ago
-
Senior Firmware Engineer, Embedded Platform USD 132K-178KADC | ARM Cortex | ARM Cortex-M | Abstraction layer | Bash401k retirement savings plan | Dental insurance | Equity grants | FSA | Generous parental leaveSenior-level Full TimeSan Diego, CA22h ago
-
Senior Data Engineer USD 155K-190KAmazon Redshift | Apache Airflow | Dagster | Data Compliance | Data GovernanceSenior-level Full TimeNortheast22h ago
-
Senior Data Engineer USD 155K-190KAmazon Redshift | Apache Airflow | Dagster | Data Governance | Data QualitySenior-level Full TimeSan Francisco22h ago
-
Machine Learning Engineer - ETA Team USD 137K-299KAirflow | Apache Spark | Deep learning | Experimentation | Feature Engineering401k plan employer matching | Basic life insurance | Commuter benefits match | Dental insurance | Disability insuranceMid-level Full TimeSunnyvale, CA; San Francisco, CA; Seattle, …23h ago
-
Analytical Engineer USD 60K-80KDAX | Data Governance | Data Modeling | Data Streaming | Data ValidationMid-level Full TimeLancaster, PA, United States23h ago
-
Analytics Engineer, Sentry USD 146K-194KDashboarding | Data Engineering | Data Modeling | Data Pipelines | Data QualityCompetitive benefits | Health insurance | Paid time offMid-level Full TimeIrvine, California, United States23h ago
-
Manufacturing Engineer, Analytics USD 129K-171KLean Manufacturing | Microsoft Excel | PLSQL | PowerBI | PythonHealth benefits | Recovery BenefitsMid-level Full TimeCosta Mesa, California, United States23h ago
-
Senior-level Full TimeSeattle, Washington, United States23h ago