Sr. Data Engineer

USA - Colorado, United States

Compassion International

Through sponsorship, you can release a child from poverty in Jesus' name. Help us put a stop to child poverty by empowering local churches to care for children in need.

View all jobs at Compassion International

Apply now Apply later

The expected salary range for this position is $120,230.00 - $141,263.20. Employees in specific high cost of labor locations in the United States (such as San Francisco, CA and Seattle, WA) may qualify for a geographic differential. Compassion International is not responsible for third parties who omit this information when copying and re-posting job openings.

This senior professional engineer plays a pivotal role in building and operationalizing the minimally inclusive data necessary for ministry data and analytics initiatives following industry standard practices and tools. He or she is involved in enterprise-level projects and solves complex problems by building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers like business intelligence analysts, data scientists and others who need curated data for data and analytics use cases across the ministry. This incumbent ensures compliance and is a trusted resources and advisor and ensures compliance with ethical standards, data governance and data security requirements while implementing, improving, and operationalizing integrated and reusable data pipelines to enable faster data access, integrated data reuse and improved time-to-solution data and analytics initiatives. He or she is measured on his or her ability to deliver comprehensive solutions for the ministry's business processes and enhance data flow to the right decision-makers at the right moment to help release children from poverty in Jesus' name. At this career level, the incumbent generally works independently on large complex projects or leads a team on projects. He or she often coaches other data professionals.

What will you do?

  • Maintains a personal relationship with Jesus Christ. Is a consistent witness for Jesus Christ, maintains a courteous, Christ-like attitude in dealing with people within and outside of Compassion, and faithfully upholds Compassion’s ministry in prayer.

  • Acts as an advocate to raise the awareness of the needs of children. Understands Christ’s mandate to protect children. Commits to and prioritizes child protection considerations in all decision-making, tasks and activities across the ministry. Abides by all behavioral expectations in Compassion’s Statement of Commitment to Child Protection and Code of Conduct. Reports any concerns of abuse, neglect or exploitation of children through Compassion’s internal reporting process and appropriately supports responses to incidents if they occur.

  • Builds and manages data pipelines consisting of a series of states through which data flows from sources to integration and consumption and leads to do so. Solves complex problems, creates, maintains, and optimizes workloads to move from development to production for specific use cases. Architecting, creating and maintaining data pipelines is the primary responsibility of the senior data engineer.

  • Collaborates with information and data architects, data scientists, data analysts and other data consumers to work on the models and algorithms developed by them to optimize them for cost, data quality, security and governance and put them into production, leading to potentially large productivity gains.

  • Responsible for improving data science and business intelligence teams’ productivity by applying modern tools, techniques and architectures to help the teams innovate and partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks to minimize manual and error-prone processes.

  • Consults and works with renovating data management infrastructure to drive automation in data integration and management. Identifies and recommends integrations of AI-enabled metadata management tools and techniques, tracks data consumption patterns, performs intelligent sampling and caching, and monitors data schema changes toward recommending automations of existing and future integration flows.

  • Evangelizes effective data management practices and promotes better understanding of data and analytics. Promotes available data and analytics capabilities and expertise to business units and educates them on leveraging capabilities to achieve ministry goals.

  • Develops strategies around existing technology products to ensure these products produce expected results and benefit to data consumers at minimal cost. Manages the successful implementation of improvements across the organization and impacts across value streams and business units are considered.

  • Proactively collaborates and consults with various team members on plans to execute and evaluate performance and ways to reduce complexity.

  • Assists other data engineers and architects in preparing presentations and documentation of new or improved data governance and data standards to governing councils and stakeholders, such as the Architecture Review Board and Data Opportunities Council.

  • Serves as a subject matter expert on data pipelines, data processes, flow, data governance, and available data and analytics applications.

  • Coaches neighbours and teammates leveraging data and provide training and advice on Compassion's data pipeline.

What do you bring?

  • 10+ years of foundational data engineering and best data practices

  • Strong foundation in building scalable data pipelines using Java and Python, with the ability to design performant and maintainable systems

  • Deep expertise in writing and optimizing advanced SQL queries to support diverse analytical and machine learning workloads

  • Proven experience with AWS cloud services (e.g., Redshift, Lambda, S3, EMR) to architect and deploy robust data solutions

  • Hands-on proficiency in managing data warehouses with Snowflake, including schema design, performance tuning, and data lifecycle management

  • Practical knowledge of event-driven architectures and real-time data streaming, especially with tools like Apache Pulsar

Why work here?

  • The mission: Join a team that is motivated to release children from poverty in Jesus’ name.

  • Our benefits: Receive generous paid time off, 10% contribution to a 403(b) retirement fund on top of your salary, excellent healthcare coverage, free short-term professional counseling, and more.

  • Spiritual growth: Participate in regular chapel services, prayer groups, and department devotionals.

#LI-SP1 #LI-REMOTE

Apply now Apply later
Job stats:  0  0  0
Category: Engineering Jobs

Tags: Architecture AWS Business Intelligence Data governance Data management Data pipelines Data quality Engineering Java Lambda Machine Learning Pipelines Pulsar Python Redshift Security Snowflake SQL Streaming

Perks/benefits: Career development Team events

Regions: Remote/Anywhere North America
Country: United States

More jobs like this