Lead Data Engineer
Plano, TX, United States
USD 176K-205K (estimate) Senior-level Full Time
Tasks
- Build data modeling cataloging and access control
- Design scalable batch and streaming data pipelines
- Develop and operate workflow orchestration
- Drive data governance processes
- Mentor engineers and lead technical direction
- Optimize data pipeline performance and fault tolerance
- Perform quantitative analysis of large datasets
- Stay current with AWS data lake and Snowflake technologies
- Translate business requirements into data lake and data warehousing solutions
- Validate AI assisted outputs and ensure data handling compliance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Agile | Apache Flink | Apache Hudi | Apache Spark | BigQuery | Data Catalog | Data Governance | Data Lake | Data Modeling | Data Processing | Data Warehousing | Data pipeline | Distributed data | Distributed data processing | ETL | Erwin | Google Pubsub | Iceberg | Kafka | Performance Tuning | Redshift | SQL | Snowflake | Streaming Pipelines | Trino | Workflow Orchestration
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R9d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R22d ago
-
AI | Alerting | Dashboards | Data Architecture | Data Governance401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York3h ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States4h ago
-
Mid-level Full TimeAtlanta, Georgia, United States; Dallas, Texas, …4h ago
-
Entry-level Full TimeChicago, Illinois, United States; Dallas, Texas, …4h ago
-
Apache Flink | Apache Hudi | Apache Iceberg | Apache Paimon | C plus plusEntry-level Full TimeSan Jose, California, United States5h ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-253KAds serving | C++ | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Software Engineer, AI/ML, Full Stack, Search Ads USD 147K-211KA/B | A/B Testing | Algorithms | Artificial Intelligence | B testingMid-level Full TimeMountain View, CA, USA6h ago
-
Analytical Lead, YouTube Brand Deals USD 152K-222KAI | Dashboards | Data Analysis | Data Modeling | Data PipelinesSenior-level Full TimeSan Bruno, CA, USA; New York, …6h ago
-
Senior Software Engineer, AI/ML, Creative Intelligence USD 174K-253KAd systems | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Data Mining | Data Processing | Debugging | Distributed Computing | Generative AIBenefits | Bonus | EquityMid-level Full TimeMountain View, CA, USA6h ago
-
Principal Engineer, Agentic AI Data and Insights USD 307K-428KANSI SQL | APIs | Agentic AI | Apache Iceberg | Apache SparkSenior-level Full TimeIrvine, CA, USA; San Jose, CA, …6h ago
-
Digital Process Optimization Lead USD 103K-155KAgile | Dashboards | Data Analysis | Digital Transformation | KPI ManagementSenior-level Full TimeGreenville, OH, US, 4533111h ago
-
Sr. Solutions Engineer USD 180K-247KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | AzureFlexible work arrangements | Travel reimbursementSenior-level Full TimeUnited States13h ago
-
Analytics Engineer, Hardware Test USD 146K-194KData Modeling | Data Quality | DataFrame | Ontology Modeling | PandasMid-level Full TimeCosta Mesa, California, United States13h ago
-
Mid-level Full TimeRaleigh, NC, US15h ago
-
AI Engineer (Org Wide) USD 119K-235KAI Builder | AI Foundry | AI Search | Azure AI | Azure AI FoundrySenior-level Full TimeFond du Lac, WI, US15h ago
-
Lead AI Architect - Data Platform USD 180K-240KAWS | AWS CDK | Airbyte | Amazon Bedrock | Apache AirflowSenior-level Full TimeUnited States15h ago
-
Lead Software Engineer - Machine Learning USD 170K-215KAI Assisted Development | AWS | Automated testing | Cause analysis | Cloud NativeSenior-level Full TimeJersey City, NJ, United States16h ago
-
Senior Data Engineer, People Analytics USD 179K-210KAWS | Access Control | Airflow | Airtable | Audit LoggingSenior-level Full TimeUnited States17h ago
-
Data Engineer USD 269K-317KDBT | Data Lineage | Data Modeling | Data Quality | Data WarehousingExtreme ownership | Flexible pace | Full autonomy | High-impact work | Remote-friendlySenior-level Full TimeAustin, TX18h ago
-
Machine Learning Engineer USD 269K-317KAgentic Systems | Data Pipelines | Fine Tuning | LLM APIs | Language ModelsSenior-level Full TimeAustin, TX18h ago
-
Anomaly Detection | Classification | Clustering | Data Processing | Distributed ComputingSenior-level Full TimeAustin; New York City18h ago
-
Anomaly Detection | Classification | Clustering | Data Processing | Distributed ComputingSenior-level Full TimeAustin; New York City18h ago