Lead Data Engineer (Databricks, SQL)
IL-70 W Madison St, 8th Fl, United States
USD 150K-170K Senior-level Full Time
Tasks
- Automate testing and CI CD deployments
- Build ETL analytics and data consumption
- Continuously improve SDLC throughput using intake estimation and KPI management
- Define secure scalable data architecture
- Develop data pipelines for ingestion transformation optimization and reporting
- Drive modernization through proofs of concept
- Embed risk management and security privacy by design
- Ensure regulatory compliance and partner with compliance and audit teams
- Improve observability and operational resilience
- Own end to end delivery of data strategy capabilities
- Provide technical leadership and develop solutions using Databricks Python PySpark and SQL Server
- Translate business objectives into secure scalable cloud data solutions
Perks/Benefits
- 401k matching
- Dental insurance
- Disability insurance
- Health savings account
- Holidays
- Hybrid work arrangement
- Life insurance
- Medical insurance
- Paid time off
- Parental leave
- Recognition program
- Sick leave
- Vacation days
- Vision insurance
- Wellbeing support
Skills/Tech-stack
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Integration | Azure DevOps | Azure Functions | Azure SQL | Blob Storage | CI/CD | Cognos | Data Pipelines | Data integration | Databricks | Databricks Platform | Databricks SQL | Databricks Unity Catalog | ETL | GitHub Copilot | Integration Services | Jira | Observability | Power BI | PySpark | Python | REST APIs | Release Management | SDLC | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | SSIS | Scala | Security Compliance | Server Integration Services | Tableau | Test automation | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R18d ago
-
Senior AI Engineer USD 130K-245KAnomaly Detection | CI/CD | Classification | DataRobot | DatabricksSenior-level Full TimeMorristown, NJ, United States5h ago
-
Adobe Campaign | Automated testing | Azure | Azure Data | Azure Data FactorySenior-level ContractSan Francisco, United States8h ago
-
ANSYS | CAD | Git | NVIDIA Omniverse | PipEntry-level InternshipPennsylvania, Canonsburg9h ago
-
ANSYS Mechanical | Ansys Twin Builder | C++ | Control Systems | DrakeFinancial benefits | Health benefits | Internship program | Remote work | Wellness benefitsEntry-level InternshipCalifornia, US (California) Off-Site9h ago
-
Software Engineer, Data License Monitoring & Resiliency USD 160K-240KAIOps | Anomaly Detection | C# | C++ | Capacity Planning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York10h ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York10h ago
-
API Design | Agentic Workflows | C plus plus | Code review | Context ManagementSenior-level Full TimeRedmond, WA10h ago
-
Business Engineer, Business AI USD 147K-203KAgent Orchestration | Agentic AI | Agile | Bias Mitigation | Context engineeringCross-functional collaboration | Mentorship | Travel opportunitySenior-level Full TimeMenlo Park, CA | Seattle, WA …11h ago
-
Data Engineer, Product Analytics USD 192K-235KCompliance | Data Privacy | Data Quality | Data Security | Data WarehousingSenior-level Full TimeMenlo Park, CA11h ago
-
Data Engineer USD 185K-196KData Modeling | Data Warehousing | Dimensional Modeling | ETL | Object-OrientedMid-level Full TimeMenlo Park, CA11h ago
-
Data Engineer USD 183K-203KAnomaly Detection | Data Drift | Data Quality | Data Visualization | Feature DriftEntry-level Full TimeMenlo Park, CA11h ago
-
Data Engineer USD 185K-196KC++ | Data Migration | Data Modeling | Data Warehousing | Dimensional dataMid-level Full TimeMenlo Park, CA11h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | Compiler designMid-level Full TimeLos Angeles, CA, USA; Mountain View, …11h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA11h ago
-
Algorithms | C++ | Capacity Planning | Code Reviews | Data StructuresSenior-level Full TimeSeattle, WA, USA11h ago
-
Senior Software Engineer, Google Cloud AI USD 174K-252KArtificial Intelligence | C++ | Data Structures | Data Structures and Algorithms | Design and ArchitectureSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Lead SAP Data Engineer - IT USD 105K-152KCDS Views | Data Governance | Data Lineage | Data Modeling | Data PipelinesAdoption Assistance | Education assistance | Health and life insurance | Paid Holidays | Paid time offSenior-level Full TimeLibertyville, IL, US, 60048-378115h ago
-
A/B | A/B Testing | B testing | C++ | Content Understanding401k match | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeSunnyvale, CA17h ago
-
Forward Deployed AI Engineer/Data Scientist USD 78K-195KA/B | A/B Testing | B testing | Chatbot Platforms | Clustering401k matching | Basic life insurance | Employee stock purchase plan | Health, dental, vision coverage | Long-term disabilityMid-level Full TimeUnited States (Remote) R18h ago
-
Embedded Software Test Engineer USD 83K-93KAutomated testing | C++ | Case design | Cause analysis | Desktop testing401k matching | Dental insurance | Health insurance | Long-term disability | Paid HolidaysMid-level Full TimeTroy, MI, US20h ago
-
Senior-level Full TimeSan Francisco21h ago
-
AWS Cloud ETL Engineer - Cleared USD 118K-178KAWS CDK | AWS Glue | AWS IAM | AWS Lambda | AWS Step FunctionsSecurity ClearanceMid-level Full TimeWashington, DC, US22h ago
-
Robotics Engineer, Maritime USD 191K-253KAnomaly Detection | C++ | Cameras | Computer Vision | Data Analysis401k retirement plan | Commuter benefits | Dental benefits | Disability insurance | Healthcare benefitsSenior-level Full TimeBoston, Massachusetts, United States22h ago
-
Data Integration Lead USD 142K-178KData Architecture | Data Governance | Data Operations | Data Quality | Data Quality ManagementLeadership development | Professional developmentSenior-level Full TimeFort Belvoir, VA22h ago