Lead Data Engineer
Tasks
- Coordinate data platform configuration and upgrades
- Design data integration solutions
- Fix data integration and ingestion issues
- Implement data ingestion enhancements
- Implement scheduling automation and monitoring
- Investigate root causes
- Maintain data platform and environment
- Manage on call support and off hours incidents
- Monitor and support data platform SLAs
- Perform software and server patching
- Recommend data ingestion code solutions
- Support dev QA production migrations
- Support release and change management
- Translate business requirements to data mappings
- Troubleshoot database performance issues
- Write technical documentation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Airflow | Apache Atlas | Apache NiFi | Apache Ranger | Apache Zeppelin | Azure | Bash | Cassandra | Couchbase | Csharp | DB2 | Docker | Entity Relationship Modeling | Entity relationship | Git | HBase | Hadoop | ITIL | Java | JavaScript | Jupyter | Jupyter Notebook | Kafka | Linux | MongoDB | PySpark | Python | REST APIs | RStudio | Relationship Modeling | SFTP | SQL | SQL Server | SVN | Scala | ServiceNow | Snowflake | Spark | Stored Procedures | Tableau | YARN | Zeppelin
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AI tool integration | Automated testing | Bias Mitigation | CSS | Ethical AISenior-level Full TimeMenlo Park, CA1h ago
-
Software Engineer, Audio Embedded Device USD 139K-200KAOSP | Android | Automated testing | C# | C++Mid-level Full TimeSunnyvale, CA | Redmond, WA | …1h ago
-
C++ | Caching | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Software Engineer, Google Cloud Storage USD 147K-211KAccess Control | Block Storage | C++ | Chaos Engineering | Cloud FunctionsMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA2h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Dashboards | Data Analysis | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA2h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KAccess Control | As-a-Service | Block Storage | C++ | Chaos TestingSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA2h ago
-
Algorithms | C++ | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Software Engineer, AI/ML, Creative Intelligence USD 147K-211KA/B | A/B Testing | B testing | C++ | Deep learningMid-level Full TimeMountain View, CA, USA2h ago
-
BigQuery | Cloud platform | Computer Vision | Data Processing | Data WarehousingSenior-level Full TimeKirkland, WA, USA2h ago
-
Full Stack AI Software Engineer USD 216K-283KAPI Development | AWS | Classification | Cloud platform | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | ESPPExecutive-level Full TimeSan Mateo, CA, United States8h ago
-
Aerospace software | C++ | Camera | EKF | Factor GraphsDental insurance | Equity | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeHawthorne, CA8h ago
-
AI Engineer — Learn Engine: Platform & Simulation USD 160K-223KA/B | A/B Testing | B testing | Browser Automation | Computer VisionMid-level Full TimeSan Francisco HQ9h ago
-
Machine Learning Engineer, LLM Evals & Observability USD 200K-300KData Pipelines | Distributed Systems | Go | Human Feedback | LLM Evaluation401k contribution | Education stipend | Generous time off | Healthy lunches daily | Home office improvement stipendMid-level Full TimeMountain View, CA9h ago
-
Automated testing | C# | C++ | CAN | CI/CD401k retirement | Dental insurance | Flexible Spending Account (FSA) | Health Savings Account (HSA) | Health insuranceSenior-level Full TimeHenderson, CO11h ago
-
Robotics Technician USD 100K-300KCAD | Cause analysis | Debugging | Electromechanical | Embedded SystemsSenior-level Full TimeSan Mateo11h ago
-
AWS | Analytics | Data Mining | Generative AI | Machine LearningMentorship | Training | Work-life balanceSenior-level Full TimeArlington, Virginia, USA13h ago
-
Senior Perception Engineer USD 154K-210KAWS | Computer Vision | Containerization | Data Annotation | Data AugmentationOnsite work five days per week | Startup environment high ownershipSenior-level Full TimeSan Francisco14h ago
-
Senior Software Engineer, Robotics Platform USD 140K-190KBuild systems | Cloud infrastructure | Data logging | Debugging | Device provisioningOnsite work five days a weekSenior-level Full TimeSan Francisco14h ago
-
Lead Data Analyst, Product USD 155K-170KA/B | A/B Testing | Anomaly Detection | Automation | B testing401k | Dental insurance | Flexible PTO | Learning and development reimbursement | Medical insuranceSenior-level Full TimeNew York City (Hybrid) R14h ago
-
Energy Data Engineer/Analyst USD 110K-130KApache Airflow | Data Modeling | Data Warehousing | Databricks | PythonMid-level Full TimeFoster City, California, United States14h ago
-
Robotics Software Test Engineer USD 130K-175KAutomated testing | CI/CD | Debugging | Docker | GazeboHigh-ownership environment | Onsite work 5 days per weekMid-level Full TimeSan Francisco14h ago
-
AI Engineer I - Hybrid USD 125K-135KAPI Development | Agentic Workflows | Azure | Azure Fabric | CI/CDSenior-level Full TimeWindsor, Colorado, United States R14h ago
-
API Integration | AWS | Autogen | Azure | Cloud platformHybrid work environmentSenior-level Contract Full TimeChicago, Illinois, United States15h ago
-
Senior/Staff Software Engineer - Perception & Sensing USD 195K-280K3D Object Detection | 3D segmentation | A/B | A/B Testing | B testingSenior-level Full TimeFoster City, CA15h ago
-
Adaptive filtering | Bayesian Inference | C# | C++ | Digital Signal401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeNewark, CA15h ago