Software Engineer - Databricks & ETL
Remote US, United States
Full Time Senior-level / Expert USD 80K - 110K
Humana
Explore Medicare plans and health insurance coverage to fit your lifestyle. Turning 65 or recently qualified? Sign up for Medicare coverage! Start with healthy, start with Humana.We are seeking a skilled and motivated Software Engineer with a strong background in data lake architecture and Databricks development. In this role, you will design, develop, and optimize scalable data pipelines and analytics platforms, leveraging cloud-native technologies and the Databricks ecosystem. You will play a key role in enabling data-driven decision-making across the organization.
Key Responsibilities
- Design and implement scalable and secure data pipelines using Python, Apache Spark and Databricks on Azure.
- Develop and maintain ETL/ELT workflows to ingest structured and unstructured data into the data lake.
- Collaborate with data scientists, analysts, and other engineers to integrate, transform, and provision data for analytics and reporting.
- Optimize and tune Spark jobs for performance and cost efficiency.
- Manage and maintain data lake infrastructure, ensuring data quality, integrity, and compliance with security policies.
- Implement data governance practices including lineage, metadata management, and access controls.
- Create technical documentation, including architecture diagrams, pipeline specs, and operational runbooks.
- Participate in code reviews, CI/CD automation, and agile development processes.
Use your skills to make an impact
Required Skills & Experience
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering or software development roles.
- Proficient in PySpark, SQL, and Databricks Notebooks.
- Experience with cloud platforms like Azure Data Lake Storage, AWS S3, or Google Cloud Storage.
- Strong understanding of data lake architecture, data warehousing concepts, and big data frameworks.
- Experience building ETL/ELT pipelines using tools like Databricks, Azure Data Factory, Apache Airflow, or similar.
- Familiarity with version control (Git), CI/CD pipelines, and DevOps practices.
Preferred Skills
- Experience with Delta Lake, Unity Catalog, and Databricks REST APIs.
- Knowledge of data security best practices, including encryption, masking, and access control.
- Background in machine learning workflows or real-time data processing is a plus.
- Certifications in Azure, AWS, GCP, or Databricks.
Why Humana?
You'll experience the following perks as a full-time Humana employee:
Humana offers a variety of benefits to promote the best health and well-being of our employees and their families. We design competitive and flexible packages to give our employees a sense of financial security—both today and in the future, including:
- Health benefits effective day 1
- Paid time off, holidays, volunteer time and jury duty pay
- Recognition pay
- 401(k) retirement savings plan with employer match
- Tuition assistance
- Scholarships for eligible dependents
- Parental and caregiver leave
- Employee charity matching program
- Network Resource Groups (NRGs)
- Career development opportunities
Interview Format:
As part of our hiring process for this opportunity, we will be using an interviewing technology called HireVue to enhance our hiring and decision-making ability. HireVue allows us to quickly connect and gain valuable information from you pertaining to your relevant skills and experience at a time that is best for your schedule.
Work-At-Home Requirements
To ensure Home or Hybrid Home/Office employees’ ability to work effectively, the self-provided internet service of Home or Hybrid Home/Office employees must meet the following criteria:
At minimum, a download speed of 25 Mbps and an upload speed of 10 Mbps is required; wireless, wired cable or DSL connection is suggested.
Satellite, cellular and microwave connection can be used only if approved by leadership.
Employees who live and work from Home in the state of California, Illinois, Montana, or South Dakota will be provided a bi-weekly payment for their internet expense.
Humana will provide Home or Hybrid Home/Office employees with telephone equipment appropriate to meet the business requirements for their position/job.
Work from a dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information.
Social Security Task
Humana values personal identity protection. Please be aware that applicants may be asked to provide their Social Security Number, if it is not already on file. When required, an email will be sent from Humana@myworkday.com with instructions on how to add the information into your official application on Humana’s secure website.
Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required.Scheduled Weekly Hours
40Pay Range
The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc.
Description of Benefits
Humana, Inc. and its affiliated subsidiaries (collectively, “Humana”) offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities.Application Deadline: 06-05-2025About us
Humana Inc. (NYSE: HUM) is committed to putting health first – for our teammates, our customers and our company. Through our Humana insurance services and CenterWell healthcare services, we make it easier for the millions of people we serve to achieve their best health – delivering the care and service they need, when they need it. These efforts are leading to a better quality of life for people with Medicare, Medicaid, families, individuals, military service personnel, and communities at large.
Equal Opportunity Employer
It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment.
Tags: Agile Airflow APIs Architecture AWS Azure Big Data CI/CD Computer Science Databricks Data governance Data pipelines Data quality Data Warehousing DevOps ELT Engineering ETL GCP Git Google Cloud Machine Learning Pipelines PySpark Python Security Spark SQL Unstructured data
Perks/benefits: 401(k) matching Career development Competitive pay Flex hours Flex vacation Gear Health care Insurance Medical leave Parental leave Salary bonus Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.