Data Engineer

Position Summary

The Data Engineer is responsible for designing, building, and maintaining data pipelines, models, ETL (Extract, Transform, Load) processes and other data infrastructure to support the organization's data needs. The role collaborates with data scientists and analysts to understand data requirements and develops scalable solutions. They build and optimize data pipelines, integrating data from various sources, ensuring data quality and consistency, and implement data governance practices.

What will your job entail?

Key Responsibilities:

• Design, develop, and optimize scalable ETL pipelines using Databricks (Spark / PySpark).

• Integrate data from various structured and unstructured sources into our data lake and warehouse environments.

• Implement data quality checks, monitoring, and validation processes.

• Collaborate with Data Scientists, Analysts, and other Engineers to understand data needs and deliver solutions.

• Tune data jobs for performance, scalability, and reliability.

• Develop and maintain documentation around data systems, processes, and best practices.

• Assist in migrating legacy ETL jobs to modern cloud-native solutions (e.g., Databricks, Delta Lake).
   

Required Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.

• 3+ years of experience in data engineering or related field.

• Strong hands-on experience with Databricks, Spark (PySpark or Scala), and distributed data processing.

• Proficiency in SQL, data modeling, and performance tuning.

• Experience working with cloud platforms (e.g., Azure, AWS, GCP) and cloud-native data services.

• Solid understanding of ETL best practices and data pipeline architecture.

• Strong problem-solving skills and ability to work independently and collaboratively.
   

Preferred Qualifications:

• Experience with Delta Lake and structured streaming.

• Knowledge of CI/CD processes and DevOps practices for data engineering.

• Familiarity with other ETL tools like Informatica, Apache Airflow, or dbt.

• Experience with Snowflake, Redshift, or other cloud data warehouses.

• Python programming skills beyond Spark (e.g., scripting, automation).
   

What We Offer:

• Competitive salary and benefits package.

• Flexible work environment (remote/hybrid options available).

• Opportunity to work with modern technologies and help shape our data infrastructure.

• Supportive team culture focused on innovation, learning, and collaboration.

• Professional development opportunities and technical training.

Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.

How We Support Our Teammates 

Ryan Specialty seeks to offer our employees a comprehensive and best-in-class benefits package that helps them — and their family members — achieve their physical, financial, and emotional well-being goals. In addition to paid time off for company holidays, vacation, sick and personal days, Ryan offers paid parental leave, mental health services and more.

The target salary range for this position is $78,050.00 - $90,000.00 annually.

The wage range for this role considers many factors, such as training, transferable skills, work experience, licensure and certification, business needs, and market demands. The pay range is subject to change and may be modified in the future. Full-time roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards, visit our website https://benefits.ryansg.com/. 

 

We provide individuals with disabilities reasonable accommodations to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at HR@Ryansg.com 

 

The above is intended to describe this job's general requirements. It is not to be construed as an exhaustive statement of duties, responsibilities, or physical requirements. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.