Lead Data Engineer (Databricks, SQL)
IL-70 W Madison St, 8th Fl, United States
USD 150K-170K Senior-level Full Time
Tasks
- Automate engineering processes
- Build analytics and data consumption
- Design secure scalable cloud data solutions
- Develop ETL pipelines
- Develop solutions with Databricks Python PySpark and SQL Server
- Drive modernization with proofs of concept
- Ensure regulatory compliance
- Implement testing CI/CD and observability
- Improve SDLC throughput with intake estimation and KPI management
- Oversee risk management and security privacy by design
- Own end to end data strategy delivery
Perks/Benefits
- 401k
- Disability insurance
- Health savings account
- Holidays
- Hybrid work arrangement
- Life insurance
- Medical/Dental/Vision insurance
- MomentMakers recognition program
- Paid parental leave
- Paid sick leave
- Paid time off
- Purpose Day (paid day off)
- Wellbeing support
Skills/Tech-stack
API Management | Advanced Analytics | Automation | Azure | Azure API | Azure API Management | Azure Blob | Azure Blob Storage | Azure DevOps | Azure Functions | Azure Repos | Azure SQL | Blob Storage | CD | CI | CI/CD | Cognos | Data Ingestion | Data Optimization | Data Transformation | Data pipeline | Databricks | ETL | GitHub Copilot | Integration | Integration Services | Jira | Observability | Power BI | PySpark | Python | REST APIs | Reporting | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | SSIS | Scala | Server Integration Services | Tableau | Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R6h ago
-
Junior Data Engineer - Intern USD 42K-60KPython | SQLContribution to AI initiatives | Exposure to real datasets | Mentorship | Professional development opportunities | Real-world experienceEntry-level Full Time InternshipFAIRFAX, VA, United States6h ago
-
Senior Embedded Software Engineer USD 142K-182KAMD Xilinx | ARM Cortex | C# | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | Every other Friday off | FSASenior-level Full TimeCamarillo, CA, United States6h ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R6h ago
-
Analytics Engineer USD 89K-140KAnalytics | Azure Data | Azure Data Factory | DAX | Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeMurrysville, PA, United States6h ago
-
AWS Glue | Amazon Redshift | Amazon SageMaker | Data Modeling | Data PipelinesMid-level Full TimeHouston, TX, United States8h ago
-
Data Engineer USD 90K-125KAnomaly Detection | Azure | Data Analysis | Data Migration | Data Modeling401k | Dental insurance | Disability coverage | Employee assistance program | Flexible spending accountsMid-level Full TimeSt. Louis, MO, United States8h ago
-
Altium Designer | Bluetooth | CAN | CST | Cadence Allegro401k | Dental insurance | Domestic travel | Health insurance | HolidaysSenior-level Full TimeOrlando, FL, United States8h ago
-
Agile | Automation | Azure AD | Azure Monitor | Azure SentinelKnowledge transfer opportunities | Long-term contract | Onsite in Deerfield Beach FLSenior-level ContractDeerfield Beach, United States8h ago
-
AWS S3 | Amazon Redshift | Apache Airflow | Azure Storage | Cloud PlatformsSenior-level ContractLincoln, United States R8h ago
-
Machine Learning Engineer, Physical AI USD 150K-200KAWS | CUDA | Computer Vision | Deep learning | FastAIBi-annual offsites | Dental insurance | Flexible PTO | Health insurance | Learning and development budgetMid-level Full TimeSan Francisco, CA, US9h ago
-
Robotics Systems Engineer, Physical AI USD 150K-200KCalibration | Computer Vision | Data pipeline | Deep learning | DockerDental insurance | Flexible PTO | Health insurance | Learning and development budget | Monthly socialsMid-level Full TimeSan Francisco, CA, US9h ago
-
Head of AI USD 150K-300KAPI Integration | AWS | Artificial Intelligence | Automations | ChatGPT401k with company matching | Dental insurance | Fully remote work environment | Health insurance | Vision insuranceExecutive-level Full TimeAustin, Texas, Austin HQ, Dallas, Texas, … R9h ago
-
AWS Data Architect USD 140K-216KAPI Integration | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS LambdaOnsite daily at officeSenior-level Full TimeFremont, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Apache Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeTampa, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flextime with remote and office options | Mentorship | Personalized growth roadmapsSenior-level Full TimeJacksonville, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Amazon SageMaker | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeOrlando, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBaltimore, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRichmond, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS SageMaker | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Remote and office options | TechtalksSenior-level Full TimeMiami, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeAustin, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeHouston, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBlacksburg, United States10h ago