Data Platform technical lead
Houston, TX, United States
A USD 134K-165K (estimate) Senior-level Full Time
Tasks
- Collaborate with cross-functional stakeholders
- Deliver on premises and cloud data solutions
- Design OLTP schemas normalization and indexing strategies
- Develop and optimize data pipelines
- Drive CI CD and touchless change management
- Drive data governance security privacy and quality
- Ensure SLA compliance and high data quality
- Implement data modeling and metadata management
- Implement lineage and governance using Unity Catalog
- Lead data platform architecture and design
- Manage transactions concurrency and deadlocks
- Monitor pipeline performance and troubleshoot issues
- Optimize performance and cost for Databricks workloads
- Translate technical concepts for executive communication
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Functions | CI/CD | Concurrency | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Databricks | Databricks Delta | Databricks Delta Lake | Delta Lake | Delta Live Tables | Delta Live) | Docker | FastAPI | GitHub Actions | Kubernetes | Lineage | Load Balancing | Logic Apps | Metadata Management | MySQL | Performance Tuning | PostgreSQL | Python | REST APIs | Reverse Proxy | SQL | SQL Server | Scala | Structured Streaming | Transaction management | Unity Catalog
Education
N/A
Related jobs
-
Director, AI Solutions Architect (Remote) USD 150K-223KAPI Gateway | AWS | Agent Orchestration | Amazon Bedrock | Azure OpenAIOccasional travel | Overtime as needed | Remote workSenior-level Full TimeOak Brook, IL, United States R4h ago
-
Enablement Engineer USD 105K-122KAPI Integration | Ansible | Bash | Connectwise | Git401k match | Dental insurance | Health insurance | Life insurance | Long-term disability insuranceSenior-level Full TimeDallas, TX, US5h ago
-
Forward Deployed Engineer, DeepMind USD 174K-253KAPI Integration | Benchmarking | Generative AI | JavaScript | Language ModelsMid-level Full TimeMountain View, CA, USA; New York, …10h ago
-
Software Engineer III, AI/ML, Retail Ads USD 147K-211KA/B | A/B Testing | B testing | C++ | Data StructuresSenior-level Full TimeMountain View, CA, USA10h ago
-
C++ | Co-design | Compilers | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
Senior-level Full TimeCanada R16h ago
-
Senior-level Full TimeUnited States R17h ago
-
Senior-level Full TimeUnited States R17h ago
-
Software Engineer, Inference Platform USD 220K-260KC++ | CI/CD | Debugging | Distributed Systems | GoMid-level Full TimeSunnyvale, CA20h ago
-
Data Engineer Data Pipelines and ETL USD 100K-147KAirflow | Anomaly Detection | Apache Kafka | Apache Spark | CDC401k plan | Bonus eligible | Dental insurance | Disability benefits | Life insuranceMid-level Full TimeBurbank, CA, US, 9150521h ago
-
Senior Software Engineer - AI Integrations USD 170K-240KAWS | Alerting | C++ | CSS | Continuous integrationSenior-level Full TimeMountain View, CA22h ago
-
Principal Software Engineer, Performance Tooling USD 139K-304KC++ | CUDA | Computer Architecture | DNN | Distributed SystemsSenior-level Full TimeRedmond, WA, US; Mountain View, CA, …22h ago
-
A/B | Asymmetric A B | C# | Cryptography | Delta CompressionSenior-level Full TimeSunnyvale, United States22h ago
-
Lead Data Engineer USD 170K-220KAccess Control | Automation | BI Tooling | Backups | Business Intelligence401k | Accessories allowance | Education stipend | Equity tax advisory service | Financial Wellness WebinarsSenior-level Full TimeNew York, NY22h ago
-
Jr. Feature Engineer USD 100K-107KAirflow | CI/CD | Cloud Platforms | Data Governance | Data ModelingEntry-level Full TimeUnited States22h ago
-
Senior-level Full TimeUnited States23h ago
-
Corporate AI Engineer USD 154K-200KAPI Integration | Access Control | Data Quality | Embeddings | Generative AIHybrid work schedule | Volunteer time offMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R23h ago
-
Staff Software Engineer, Inference Platform USD 180K-260KActive/Active | Alerting | C++ | CI/CD | DebuggingSenior-level Full TimeSunnyvale, CA1d ago
-
Agile | DAX | Data Modeling | Data Pipelines | Data QualityCampus facilities | Consultant support | Onsite work | Performance bonus | Project extensionsSenior-level Full TimeJuno Beach, FL1d ago
-
AI Automation Engineer USD 96K-140KAPI Integration | Automation | Confidence Thresholding | Connectwise | DocumentationMid-level Full TimeGrand Rapids, Michigan1d ago
-
AI Solutions Engineer USD 110K-156KAPI Integration | AWS | Agentic AI | CI/CD | Cloud platformOccasional travel | Security clearance eligibilitySenior-level Full TimeRaleigh, NC, US1d ago
-
Software Robotics Design Engineer USD 120K-150KC Sharp | C plus plus | Commissioning | Digital Twin | HMISenior-level Full TimeBoston, Massachusetts1d ago
-
Distinguished Engineer - AI Data Engine USD 266K-396KAPI Design | AWS | Agentic AI | Azure | C++Employee stock purchase plan | Health insurance | Life insurance | Paid leave options | Paid time offSenior-level Full TimeSan Jose, CA, USA Office (SANJOSE)1d ago
-
Embedded Software Engineer USD 110K-145KArtifactory | Atlassian Bamboo | Bash | Bitbucket | C++On-site workMid-level Full TimeLafayette, CO1d ago
-
AI Software Engineer-Senior USD 135K-200KAgile | CI/CD | Confluence | Data Engineering | Data PipelinesSenior-level Full TimeAnnapolis Junction, Maryland, United States1d ago