Lead Software Engineer - Data Engg. - Databricks / Snowflake
Plano, TX, United States
USD 176K-205K (estimate) Senior-level Full Time
Tasks
- Build control plane for enterprise data pipelines
- Collaborate on data management strategy and documentation
- Create configuration driven onboarding with guardrails
- Design and maintain data pipelines and processing workflows
- Design data processing solutions
- Develop fact and dimension models
- Develop self service APIs and SDKs
- Ensure data quality and security by design
- Implement observability for logs metrics and traces
- Lead full SDLC for pipeline services
- Mentor engineers and lead communities of practice
- Provide production support and incident response
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS Lambda | AWS Step Functions | Airflow | Alerting | Amazon ECS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | Avro | CI/CD | CSV | CloudFormation | Data Governance | Data Modeling | Data Quality | Databricks | Delta Lake | ELT | ETL | IAM | IAM least privilege | Infrastructure as Code | JSON | Jenkins | Least Privilege | Lineage | Logging | Monitoring | Observability | Parquet | PySpark | Python | SQL | Secrets management | Secure Coding | SonarQube | Spinnaker | Step Functions | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
APIs | AWS | Agile | Auditability | AzureMentoring and coaching | Remote work | Training and enablementSenior-level Full TimePlainsboro, NJ. R4h ago
-
AI Governance | AI guardrails | API Integration | Agent systems | AutoGPTLocal onsite days | Remote work 3 daysMid-level Full TimeAustin, TX R4h ago
-
AI Evaluation | AI Governance | AI guardrails | Agent systems | Agent workflowsSenior-level Full TimeAustin, TX R4h ago
-
Mid-level Full TimeAustin, TX R4h ago
-
Business Objects | Cognos | Data Dictionary | Data Marts | Data ModelingSenior-level Full TimeAustin, TX4h ago
-
Airflow | Apache Spark | CI/CD | Data Governance | Data LakehouseOnsite work required | Relocation possibleSenior-level Full TimeAustin, TX4h ago
-
AWS Bedrock | CI/CD | CUI | Data Governance | Data PipelinesGovernment furnished equipment | Pacific Time core hours support | Remote workEntry-level Full TimeMenlo Park, CA, United States5h ago
-
Analytics Engineer USD 119K-234KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeHouston, TX, United States R5h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R5h ago
-
Senior Research Engineer / Scientist -AI for Databases USD 207K-368KAWS | Architecture Search | Artificial Intelligence | Automated Model Tuning | C++401k match | Dental insurance | Disability coverage | Health insurance | Life insuranceSenior-level Full TimeSeattle, Washington, United States R6h ago
-
Data Engineer (Multiple Positions) USD 148K-300KBig Data | ClickHouse | Data Modeling | Data Query | Data Query Optimization401k savings plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSeattle, Washington, United States6h ago
-
Machine Learning System Scheduling Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256KAlgorithms | CUDA | Cloud Storage | Computer Science | ContainerizationEntry-level Full TimeSan Jose, California, United States6h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2027 Start (PhD) USD 162K-316KAI network | AI network optimization | C# | C++ | Computer Networking401k with company match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States6h ago
-
Student Researcher (AI Foundation Models Infrastructure - Seed Infra) - 2026 Start (PhD) USD 162K-162KC++ | CUDA | Compiler optimization | Distributed Computing | Machine LearningHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level Full TimeSeattle, Washington, United States6h ago
-
ARM Cortex | ARM Cortex M4 | AV1 | AVC | C++401-k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Diego, California, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KAI Agents | Batch Processing | Cloud infrastructure | Columnar Storage | Data Governance401k savings plan | Disability coverage | Health insurance | Life insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 86K-86KAlgorithms | Big Data | Cloud infrastructure | Columnar Storage | Data GovernanceHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSeattle, Washington, United States6h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KBatch Processing | Columnar Storage | Data Governance | Data Lake | Data ProcessingEntry-level Full TimeSeattle, Washington, United States6h ago
-
AUC Optimization | Apache Flink | Apache Hadoop | Apache Spark | Big Data401k savings plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States6h ago
-
Algorithms | CUDA | Computer Architecture | Data Structures | Deep Learning Training401k match | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States6h ago
-
Apache Doris | Apache Flink | Apache Hive | Apache Kafka | Apache Spark401k matching | Dental insurance | Life insurance | Long-Term Disability coverage | Medical insuranceEntry-level Full TimeSan Jose, California, United States6h ago
-
Machine Learning Engineer USD 170K-250KAzure ML | Azure ML Endpoints | Azure Machine Learning | Bayesian Methods | Boosted TreesSenior-level Full TimeAustin, Texas | Fremont, California | …6h ago
-
Data Structures | Data Structures and Algorithms | Deep learning | Ensemble learning | Graph theory401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityEntry-level Full TimeSeattle, Washington, United States6h ago
-
Deep Neural Networks | Ensemble learning | Graph theory | Hadoop | HiveHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSeattle, Washington, United States6h ago
-
Data Structures | Data Structures and Algorithms | Deep learning | Ensemble Methods | Graph theory401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSeattle, Washington, United States6h ago