Tech Lead, Data & Inference Engineer
Santa Clara, California, United States
A USD 170K-198K (estimate) Senior-level Full Time
Tasks
- Build batch and streaming pipelines
- Create data contracts and lifecycle processes
- Decide build versus buy for pipeline components
- Design data platform ingestion to insights
- Document lineage trade offs and reversibility
- Ensure data consistency and data quality
- Implement retrieval-augmented generation pipelines
- Manage model version control caching and evaluation
- Mentor engineers and review code
- Own reliability cost and service level objectives
- Run inference pipelines for enrichment scoring and quality assurance
- Scale API and internal service integrations
- Transform data sources and APIs into low latency systems
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | CI/CD | Cloud platform | DBT | Dagster | DuckDB | Google Cloud | Google Cloud Platform | Infrastructure as Code | Kubernetes | Language Models | Large Language Models | Microsoft Azure | Node.js | Observability | Prefect | Python | Retrieval-Augmented Generation | SQL | Web Services | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
Data and Insight Analyst USD 75K-110KAnomaly Detection | CI/CD | Data Modeling | Data Warehousing | Data pipeline401k | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeRemote, United States R10h ago
-
Data Governance Lead USD 117K-161KBusiness glossary | Dashboards | Data Catalog | Data Governance | Data Lineage401k retirement savings | Health, dental, and vision benefits | Life insurance | Long-term disability | Paid parental and caregiver leaveSenior-level Full TimeRemote US, United States R14h ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeChicago, Illinois, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | Distributed work | Equity | Full-timeSenior-level Full TimeNew Jersey, New Jersey, United States1d ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeJacksonville, Florida, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBoston, Massachusetts, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeStamford, Connecticut, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeConnecticut, Connecticut, United States1d ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeNew York, New York, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeCharlotte, North Carolina, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeFlorida, Florida, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeWashington D.C., District of Columbia, United …1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Jose, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeManhattan Beach, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | Equity | Full-time employmentSenior-level Full TimeTexas, Texas, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeMenlo Park, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeChicago, Illinois, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeMassachusetts, Massachusetts, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeAustin, Texas, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Francisco, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | Equity | Health benefits | Learning opportunities | Remote or distributed workSenior-level Full TimeIllinois, Illinois, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSeattle, Washington, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimePalo Alto, California, United States1d ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeGreenwich, Connecticut, United States1d ago