Senior Data Engineer

POSITION OVERVIEW

NBME is looking for a Data Engineer to join a highly skilled and growing team of data engineers and BI developers. In this role you will be using your data engineering skills and problem-solving skills to deliver meaningful insights to Internal and external customers. The Data Engineer will be responsible for modernizing, expanding, and optimizing NMBE data platform by building data lake, complex data integration pipelines, supporting analytical needs for internal and external customers, as well as optimizing new/existing data flows.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and broader medical education.

RESPONSIBILITIES

• Code, test, deploy, orchestrate, monitor, document and troubleshoot cloud-based data engineering processing and associated automation in accordance with best practices and security standards throughout the development lifecycle
• Work closely with data scientists, data architects, ETL developers, other IT counterparts, and business partners to identify, capture, collect, and format data from the external sources, internal systems, and the data warehouse to extract features of interest
• Significantly contribute to the evaluation, research, experimentation efforts with batch and streaming data engineering technologies to keep pace with industry innovation while assessing business impact and viability for use cases associated with efforts in hand
• Work with data engineering related groups to inform on and showcase capabilities of emerging technologies and to enable the adoption of these new technologies and associated techniques
• Significantly contribute to the definition and refinement of processes and procedures for the data engineering practice
• Educate and develop ETL developers on data engineering cloud-bases initiatives to enable transition to data engineer and practice
• Assures the integrity and accuracy of the corporate data, with particular attention to data security.
• Responsible for ensuring high data quality for Data Services, Analytics and Master Data Management.
• Helps coordinate technical solutions, takes responsibility for designs, development, testing and delivery of solutions.
• Build automated, scalable, test-driven data pipelines.
• Utilize software development practices such as version control via Git, CI/CD, and release management to enhance existing CI/CD pipelines in AWS.
• Collaborate with Data Engineers, DevOps engineers and architects on improvement opportunities for DataOps tools and frameworks.

QUALIFICATIONS

Basic Qualifications:

• Bachelor's Degree
• At least 10 years of experience in application development (Internship experience does not apply)
• At least 4 years of experience in big data technologies
• At least 4 years' experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
• 4+ years of experience in application development including Python, SQL, Scala, or Java
• 4+ years' experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 4+ year experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 4+ years of data warehousing experience (Redshift)
• 6+ years of experience with UNIX/Linux including basic commands and shell scripting
• 8+ years of experience with Agile engineering practices
• 8+ years of experience with SQL optimization
• 4+ years of experience with PySpark
• 3+ year of experience with process orchestration including AirFlow, KubeFlow, AWS step functions, or Luigi

Preferred Qualifications:

• 3+ year of experience with Machine Learning
• Experience with building a Data-as-a-service platform
• Experience with building APIs

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME® Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination®, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

Compensation we are offering for this position is at $48,288 - $68,000/year. Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.