Lead Data Engineer
USD 143K-224K (estimate) Senior-level Full Time
Tasks
- Architect event driven data platforms
- Build and optimize data warehouses
- Collaborate on secure compliant data solutions
- Design and develop data pipelines
- Design, code, test, debug, and document
- Develop engineering standards and best practices
- Ensure data quality and governance
- Implement real-time streaming solutions
- Lead distributed systems and event streaming design
- Lead projects and mentor peers
- Manage incidents and perform root cause analysis
- Optimize BigQuery performance and cost
Perks/Benefits
Skills/Tech-stack
Agile | Apache Iceberg | Apache Kafka | Apache Spark | Autosys | BigLake | BigQuery | CI/CD | Cloud Storage | Cloud platform | DBT | Data Governance | Data Lineage | Dataflow | Dataplex | Dbt Plus | ETL | GitLab | Google Cloud | Google Cloud Platform | Google Cloud Storage | GraphQL | Jenkins | Kafka Streams | MS SQL | MS SQL Server | MongoDB | NoSQL | Observability | Pub/Sub | REST API | SQL Server | Spark Structured Streaming | Structured Streaming | Tekton | Teradata | Workload management
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R3h ago
-
Senior Software Engineer - Internal Observability USD 200K-287KAWS | Anomaly Detection | Azure | C++ | Cause analysisEntry-level Full TimeUS-CA-Menlo Park4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible remote work | Laid-back atmosphereMid-level Full TimeAtlanta, GA, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly relaxed atmosphere | Opportunity to work on impactful productMid-level Full TimeAustin, TX, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeBoston, MA, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth | Laid-back atmosphere | Remote-friendlyMid-level Full TimePortland, OR, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus opportunities | Equity opportunities | Friendly work environment | Remote-friendlyMid-level Full TimeMinneapolis, MN, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Flexible remote setting | Friendly work environmentMid-level Full TimeTempe, AZ, USA4h ago
-
Bash | Cloud Computing | Cloud platform | Data Processing | DockerAsynchronous culture | Friendly and laid-back atmosphere | Opportunity for career growth | Remote distributed settingMid-level Full TimeLas Vegas, NV, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management approachMid-level Full TimeDetroit, MI, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible management approach | Remote/distributed teamMid-level Full TimeKansas City, MO, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonus compensation | Equity compensation | Flexible work environment | Supportive team cultureMid-level Full TimeCincinnati, OH, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Remote or distributed workMid-level Full TimeBakersfield, CA, USA4h ago
-
Bash | Cloud platform | Docker | GCP | Google CloudMid-level Full TimeFort Collins, CO, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Laid-back atmosphere | Remote-friendlyMid-level Full TimeCollege Station, TX, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeSt. Petersburg, FL, USA4h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth opportunities | Distributed work | Flexible, hands-off management | Impactful missionMid-level Full TimeTallahassee, FL, USA4h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive benefits | Remote-friendlyMid-level Full TimeHartford, CT, USA4h ago
-
Bash | Cloud infrastructure | Cloud infrastructure as code | Cloud platform | Data ProcessingAsynchronous culture | Flexible remote work | Opportunity for impactMid-level Full TimeGreensboro, NC, USA4h ago
-
Staff Data Platform Engineer USD 164K-282KAWS | AWS CDK | AWS Serverless | Batch Processing | CI/CD401k match | Company paid life insurance | Company-paid disability insurance | Flexible schedule | HackathonsSenior-level Full TimeAustin, TX8h ago
-
Senior Embedded Platform Engineer - On Prem Hardware USD 140K-175KATCA | Ansible | CI/CD | CompactPCI | Datadog401K company matching | Catered team lunches | Drinks snacks in office | FSA | Life insuranceSenior-level Full TimeBoulder, CO10h ago
-
Agentic AI/ML Engineer USD 70K-300KAWS | Agent systems | Artificial Intelligence | Automated testing | AzureEntry-level Full TimeIrvine, CA10h ago
-
.NET | AI Foundry | Anthropic | Azure AI | Azure AI FoundryFull suite of benefits | Healthcare impact | Mentorship | Remote workSenior-level Full TimeOak Brook, IL, United States R10h ago
-
Senior AI Engineer USD 200K-220KCI/CD | Code review | Deep learning | Generative AI | LLM Evaluation401k retirement savings plan | Employer sponsored health dental vision | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeRemote, USA R11h ago
-
Senior Data Engineer USD 166K-275KAWS | Agile | Apache Airflow | CI/CD | Data Governance401k matching | Flexible unlimited time off | HSA FSA matching funds | Medical, dental, vision benefits | OneMedical subscriptionSenior-level Full TimeRemote - United States R11h ago