Lead Software Engineer-Big Data Python / Java , Databricks
Houston, TX, United States
USD 170K-195K (estimate) Senior-level Full Time
Tasks
- Adopt industry methods and delivery methodologies
- Advise cross-functional teams
- Build embedding workflows
- Create multi-agent workflows
- Define engineering standards for LLM applications
- Design RAG pipelines
- Design reusable software frameworks
- Develop secure production code
- Establish AI engineering governance
- Implement secure coding peer review automation
- Integrate AI tools with human in the loop controls
- Integrate vector stores
- Review mentor engineers
- Serve LLM models
Perks/Benefits
- Backup childcare
- Comprehensive health care coverage
- Financial coaching
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
API Design | AWS | Agent systems | Agentic AI | Airflow | Apache Iceberg | Apache Spark | Automated testing | Azure | Cause analysis | Code review | Data Governance | Data Lakes | Databricks | Dynatrace | Embeddings | GCP | Grafana | Human-in-the-loop | Incident root-cause analysis | Java | Kafka | LLM Observability | Language Models | Large Language Models | Memcached | Microservices | Model Serving | MongoDB | Multi-Agent | Multi-Agent Systems | NoSQL | Observability | PostgreSQL | Prompt engineering | PySpark | Python | Redis | Relational databases | Release readiness | Retrieval-Augmented Generation | Root Cause Analysis | Secure Coding | Splunk | Temporal | Testing | The Loop | Vector Databases
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Biostatistician Lead USD 73K-120KBiomedical Data | Biomedical Data Analysis | Clinical Trial Design | Clinical trial | Cohort StudySenior-level Full TimeUniversity2h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFort Lauderdale, United States4h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeBaltimore, United States4h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS | AWS Kinesis | Apache Airflow | Apache Kafka | Automated testingFlexible hours | Internal TechTalks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimePort Charlotte, United States4h ago
-
Senior Data Engineer ID71671 USD 155K-170KAmazon Web Services | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingFlexible hours | Internal TechTalks | Learning budget | Mentorship | No micromanagementSenior-level Full TimeAustin, United States4h ago
-
Databricks Engineer USD 175K-250KAmazon Web Services | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeMilpitas, United States4h ago
-
Project Data Scientist and Analytics USD 125K-208KAPI Development | APIs | Cloud Computing | Dashboards | Data ArchitectureSenior-level Full TimeSan Diego, California, United States4h ago
-
Data Generation | Data Processing | DeepSpeed | Direct Preference Optimization | Distributed TrainingEntry-level Full TimeSan Jose, California, United States4h ago
-
Embedding retrieval | Evaluation metrics | Experimentation | Information Retrieval | Language ProcessingHigh ownership | Opportunity to shape productSenior-level Full TimeMenlo Park, CA5h ago
-
AI Software Engineer, Systems ML - Wearables AI USD 146K-208KBias Mitigation | C plus plus | C# | Deep learning | Device Machine LearningSenior-level Full TimeSeattle, WA5h ago
-
Data Engineer/Sr Data Engineer, IT Analytics USD 38K-55KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake401 k program | Dental insurance | Discounts | Employee assistance program | Health benefitsSenior-level Full TimeFort Worth, TX, US9h ago
-
Embedded Software Engineer - E2 USD 91K-169KAssembly | C# | C++ | Cyber techniques | Cyber tools401k match | Dental | EAP | Education assistance | Flexible spending accountsMid-level Full TimeHanover, MD, US11h ago
-
Senior Power BI Software Engineer - Clearance Required USD 166K-309KBI Desktop | Containerization | DAX | Database Design | Database optimization401k match | EAP | Education assistance | Flexible spending accounts | Flexible work arrangementsSenior-level Full TimeAnnapolis Junction, MD, US11h ago
-
Embedded Software Engineer Stf - E4 USD 120K-224KAgile | Atlassian | C# | C++ | CI/CD401k match | EAP | Education assistance | Flexible work schedule | HolidaysMid-level Full TimeGrand Prairie, TX, US12h ago
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeAustin, TX15h ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R15h ago
-
Dynamic Scheduler DSP Algorithm Engineer USD 125K-175KCombinatorial Optimization | Convex Optimization | MATLAB | Optimization Solvers | PythonMid-level Full TimeLanham, Maryland, United States16h ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data Pipelines | Feature Engineering | Graph Neural Networks | Latency optimization401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefits programsSenior-level Full TimeRemote - United States R16h ago
-
AWS | Azure | CI/CD | Container Networking | Container networking interface401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R17h ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R17h ago
-
Senior-level Full TimeNew York, NY, United States17h ago
-
Principal Software Engineer- Embedded OS USD 125K-150KAgile | Artifactory | Atlassian Bamboo | Atlassian Confluence | BSPCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeDenver, Colorado, United States17h ago
-
Lead Data Analyst, Manufacturing USD 146K-194KCapacity Planning | Data Visualization | Kaizen | Lean Manufacturing | Manufacturing KPIsSenior-level Full TimeCosta Mesa, California, United States17h ago
-
Senior-level Full TimeDenver, CO - Hybrid; New York, … R17h ago
-
Staff+ Software Engineer, Safeguards Data USD 320K-485KAWS | Access Control | Cloud platform | Data Governance | Data LineageFlexible working hours | Generous vacation | Hybrid office policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R18h ago