Tech Lead, Data & Inference Engineer
North Carolina, North Carolina, United States
A USD 170K-198K (estimate) Senior-level Full Time
Tasks
- Build and maintain batch and streaming pipelines
- Create data contracts and data product delivery processes
- Ensure reliability cost and service level objectives
- Guide data lake and pipeline architecture decisions
- Lead end to end data platform design and development
- Mentor engineers and review code
- Operate inference pipelines for data enrichment scoring and quality assurance
- Scale API and internal service integrations
Perks/Benefits
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache Spark | CI/CD | Cloud platform | DBT | Dagster | DuckDB | Google Cloud | Google Cloud Platform | Infrastructure as Code | Kubernetes | Language Models | Large Language Models | Microsoft Azure | Node.js | Observability | Prefect | Python | Retrieval-Augmented Generation | SQL | Web Services | “as-code”
Education
Related jobs
-
Data and Insight Analyst USD 75K-110KAnomaly Detection | CI/CD | Data Modeling | Data Warehousing | Data pipeline401k | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeRemote, United States R13h ago
-
Data Governance Lead USD 117K-161KBusiness glossary | Dashboards | Data Catalog | Data Governance | Data Lineage401k retirement savings | Health, dental, and vision benefits | Life insurance | Long-term disability | Paid parental and caregiver leaveSenior-level Full TimeRemote US, United States R17h ago
-
Senior-level Full Time142019-NC-300 South Brevard, Charlotte, United States17h ago
-
Analytics Lead, Data Analytics & Modeling USD 107K-140KData Architecture | Data Governance | Data Modeling | Data Pipelines | Data TransformationHybrid workSenior-level Full TimeMalvern, PA, United States17h ago
-
Lead Software Engineer - Data Infrastructure USD 200K-250KAPI Design | C# | C++ | Cloud Computing | Data ModelingHealth-focused mission | Hybrid workSenior-level Full TimeBoston or NYC1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeChicago, Illinois, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | Distributed work | Equity | Full-timeSenior-level Full TimeNew Jersey, New Jersey, United States1d ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeJacksonville, Florida, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSanta Clara, California, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBoston, Massachusetts, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeStamford, Connecticut, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeConnecticut, Connecticut, United States1d ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeNew York, New York, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeCharlotte, North Carolina, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeFlorida, Florida, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeWashington D.C., District of Columbia, United …1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Jose, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeManhattan Beach, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | Equity | Full-time employmentSenior-level Full TimeTexas, Texas, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBonus | EquitySenior-level Full TimeMenlo Park, California, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeChicago, Illinois, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeMassachusetts, Massachusetts, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeAustin, Texas, United States1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeSan Francisco, California, United States1d ago