Lead Data Engineer
Tasks
- Build distributed streaming data pipelines and analytics data stores
- Collaborate with agile teams to design develop test and support solutions
- Collaborate with machine learning and distributed services teams
- Influence best practices for data pipeline design and data architecture
- Lead design and build streaming data platform
- Lead engineering team to build data pipelines
- Perform unit testing and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Big Data | AWS Big Data Services | Agile | Amazon Redshift | Amazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Apache Spark Streaming | Big data services | CI/CD | Data Services | DynamoDB | Java | Linux | NoSQL | OpenSearch | Python | SQL | Scala | Shell Scripting | Snowflake | Spark Streaming | Unix | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R12h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States12h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States12h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States12h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R12h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States12h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R12h ago
-
Lead Data Engineer USD 115K-125KAI Automation | Agile | Cloud Data | Cloud Data Platforms | Data Modeling401k | Commuter benefits | Dental insurance | Disability coverage | EAPSenior-level Full TimeColumbia, MD, United States14h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R14h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R14h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States14h ago
-
kdb+ Contractor (Capital Markets) USD 150K-200KAWS | Azure | Electronic Trading | GCP | Kdb PlusContract opportunities | On site work 5 days per week | Permanent opportunitiesSenior-level ContractNew York, NY, United States15h ago
-
Senior kdb+ Engineer USD 150K-200KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible holiday allowance | Healthcare and wellbeing | Hybrid working | Leadership development | Paid certificationsSenior-level Full TimeNew York, NY, United States15h ago
-
Platform and Integrations Engineer USD 100K-200KAnthropic | GraphQL | Next.js | Node.js | OpenAIIn-person work | Medical/Dental/Vision | Significant equity upsideEntry-level Full TimeSan Francisco, CA, US15h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R15h ago
-
Senior Data Engineer (TS/SCI Clearance) USD 130K-220KData Visualization | Database performance | Database performance tuning | ETL | High PerformanceEmployee development | High employee morale | RetentionSenior-level Full TimeHuntsville, United States16h ago
-
Case design | Data Integrity | Database Testing | Database optimization | Defect ReportingSenior-level Full TimeAustin, TX R16h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York17h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton17h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
GenAI Engineer USD 73K-105KAWS Bedrock | Amazon SageMaker | Amazon Web Services | Data integration | Fine TuningCompetitive benefits package | Onsite work | Travel 0 to 25 percentEntry-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …17h ago
-
Data Engineer | TS/SCI Required USD 93K-155KApplication Security | Cloud Engineering | Data Management | Data Security | Full StackMid-level Full TimeTampa, Florida, United States17h ago
-
AI & Data Supply Chain Engineer USD 116K-229KCapacity modeling | Data Modeling | Demand Planning | Enterprise Resource Planning | Inventory PlanningTravel 50%Mid-level Full TimeSeattle, Washington, United States17h ago