Senior Data Engineer

ABOUT IDELICIdelic is focused on driving the best possible insurance outcomes for the transportation industry through the combination of process and technology. The Idelic program combines the Driver Safety Playbook with Safety Suite®, the first end-to-end driver performance management platform, to help fleets consolidate their most relevant driver data into one platform, analyze it with proprietary machine learning models, and take action on new insights. Empowering fleets with a data-driven view of fleet safety through Idelic’s advanced AI-based Driver Watch List, broad integration network and proven driver professional development plans (PDPs), the Idelic Program is the most proactive and effective way to prevent crashes, reduce losses and produce better insurance outcomes.

OVERVIEW OF THE ROLEAs a Senior Data Engineer at Idelic, you'll be instrumental in advancing our Data Services Platform. Your focus will be on designing, building, and owning scalable infrastructure for extracting business insights from multiple data sources. In this data-rich industry, your innovation will help create invaluable solutions for our customers. Alongside developing features and optimizing the platform, you'll assist with mentoring the team and advocating for best practices. Your expertise will introduce new technologies, automate processes, and enhance our ETL/ELT capabilities. You'll also contribute to governance and access controls and leverage AWS  to improve data discoverability, ensure continuous assessment, and enhance the existing system.

WHAT YOU'LL DO

• Build, design, and own scalable, highly performant infrastructure for delivering clear business insights from a variety of raw data sources
• Introduce new technologies to evolve, scale, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, and enhancing our ETL/ELT data pipeline capabilities
• Design data models, assist with architectural decisions and data dictionaries to enable collaboration, maintainability, and usability of our data platforms and code
• Collaborate on governance, provide guidance, and recommend proper access controls to maintain consistency, quality, and business confidentiality as we scale across the customers
• Lead and mentor the team, as well as advocate for the Data Engineering team by developing and championing Data Engineering practices with the team and with the company at large
• Work with AWS technologies to improve data lake and data discoverability in the cloud
• Participate in internal reviews of code, software components, and systems and make data-driven decisions
• Work on any task and help solve problems when needed

WHAT YOU'LL NEED TO SUCCEED

• 8+ years of experience in a Data Engineer role 
• 2+ years experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Glue, Athena, Lambda, etc
• Strong proficiency with Python, Google Go (Golang), or similar language
• Experience with ETL tools (Databricks, Talend, etc.)
• Experience with relational SQL and NoSQL databases such as Postgres or Cassandra
• Experience using production job orchestration tools such as AirflowStrong quantitative and analytical background & process
• Knowledge of streaming technologies (Kafka, RabbitMQ)
• Knowledge of Jenkins, GitHub, and Reporting tools
• Experience writing unit, integration, and end-to-end test code
• Analytical and Problem Solving Skills
• Proven ability to work in a collaborative and fast-paced environment

WHAT WILL SET YOU APART

• Experience in the Logistics / Transportation industry
• Experience with various data sources (API, CSV, SFTP, RDBMS, etc.)
• Experience with distributed technologies like Kubernetes
• Experience working in an entrepreneurial or enterprise environment

THINGS THAT MAKE IDELIC A GREAT PLACE TO WORK

• Competitive Compensation Package Including Options
• Unlimited Paid Time Off (PTO)
• Medical, Dental, Vision, Disability, and Life Insurance
• 401(k) with Company Matching Funds
• Paid Parental Leave, Adoption Assistance, and Paid Military Leave
• Paid Volunteer Time to Support Your Local Community

If you’ve made it this far, we hope you're feeling excited about this role. Even if you don't feel you meet every single requirement, we still encourage you to apply. You may be surprised! We're eager to meet people who are passionate, believe in Idelic’s mission, and can contribute to our team in a variety of ways—not just candidates who check all the boxes.  
We do not and shall not discriminate on the basis of race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status in any of its activities or operations. We at Idelic are committed to providing an inclusive and welcoming environment for all members of our team, contractors, vendors, and clients. Idelic is an equal-opportunity employer. Our success depends heavily on the effective utilization of qualified people, regardless of their race, ancestry, religion, color, sex, age, national origin, sexual orientation, gender, identity, disability, veteran status, or any characteristic protected by law.
TYPICAL PHYSICAL DEMANDS & WORKING CONDITIONS The physical demands that are described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.  While performing the duties of this job, the employee is regularly required to hear and see. The employee is regularly required to stand and sit/ The employee is regularly required to practice manual dexterity sufficient to operate standard office equipment. Specific vision abilities required by this job include close vision and distant vision. While performing the duties of this job, the employee is exposed to standard office equipment. Occasionally called upon to work hours in excess of your normal daily schedule.