Lead Data Engineer
Plano, TX, United States
USD 176K-205K (estimate) Senior-level Full Time
Tasks
- Build data modeling cataloging and access control
- Design scalable batch and streaming data pipelines
- Develop and operate workflow orchestration
- Drive data governance processes
- Mentor engineers and lead technical direction
- Optimize data pipeline performance and fault tolerance
- Perform quantitative analysis of large datasets
- Stay current with AWS data lake and Snowflake technologies
- Translate business requirements into data lake and data warehousing solutions
- Validate AI assisted outputs and ensure data handling compliance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Agile | Apache Flink | Apache Hudi | Apache Spark | BigQuery | Data Catalog | Data Governance | Data Lake | Data Modeling | Data Processing | Data Warehousing | Data pipeline | Distributed data | Distributed data processing | ETL | Erwin | Google Pubsub | Iceberg | Kafka | Performance Tuning | Redshift | SQL | Snowflake | Streaming Pipelines | Trino | Workflow Orchestration
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
ME00670-Database Engineer 3 USD 180K-240KBash | Cloud Computing | Data Guard | Data Modeling | Database AdministrationDental insurance | Group medical plan | Life insurance | Paid Holidays | Paid time offMid-level Full TimeAnnapolis Junction, MD23h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R1d ago
-
Lead Embedded Software Engineer USD 211K-286KAerospace Standards | Agile | Bitbucket | C++ | CentOSSenior-level Full TimePhoenix, AZ1d ago
-
Airflow | Decision Trees | Deep learning | Docker | EnsemblesSenior-level Full TimeSan Francisco, California, United States1d ago
-
AI Engineer USD 100K-160K.Net Core | API Development | AWS | Access Control | AnthropicHealthcare workflow domain experience optional | Office presenceMid-level Full TimeLittle Rock, AR, US1d ago
-
Mid-level Full TimeNew Jersey, New Jersey, United States1d ago
-
Sr. Data Engineer USD 61K-94KApache Flink | Apache Kafka | Apache NiFi | Apache Spark | Cassandra401k match | Accidental death and dismemberment insurance | Bonus plan | Commuter benefits | Flexible spending accountsSenior-level Full TimeCordova, TN, United States1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
Software Engineer IV USD 10KAgile | Apache NiFi | Bash | Configuration Management | Confluence401k contribution | Health allowance | Technology allowance | Technology lab access | Training and education benefitSenior-level Full TimeAnnapolis Junction, MD1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KARM | C# | C++ | Command and control | Communication ProtocolsMid-level Full TimeSan Francisco, CA1d ago
-
Embedded Software Engineer – Level 3 or 4 (AHT) USD 114K-171KAerospace Integration | Agile | Analog Input | Bitbucket | Board SupportOnsite work | Relocation assistance | Top secret clearance required | Travel 10 percentMid-level Full TimeVADU01, United States1d ago
-
Embedded Flight Software Engineer – Level 5 USD 169K-253KAgile | Atlassian Bitbucket | Atlassian Confluence | Atlassian Jira | C++Paid time off | Relocation assistance | Relocation providedSenior-level Full TimeMDLI02, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland2d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2d ago
-
Software Engineer 2 - (Cloud, Analytics, Spark) USD 208K-254KAlgorithm Development | Data Querying | MapReduce | NoSQL | NumPy11 federal holidays | 24 days PTO | 401k 100 Percent Vested | Education assistance | Healthcare coverageSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland2d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US2d ago