Cloud Data Engineer
NC.Durham Office
Peter Millar
It's fun to work in a company where people truly BELIEVE in what they're doing!
We're committed to bringing passion and customer focus to the business.
The Cloud Data Engineer is responsible for leading the design and implementation of Microsoft Fabric-centric data platforms and data warehouses as well as developing and optimizing ETL/ELT processes within the Microsoft Azure ecosystem. Job expectations include providing technical leadership, collaboration with end users and leadership by reviewing business requirements and developing and implementing complex data solutions and interactions across multiple systems and domains.
This role is hybrid and would require the candidate to be in office 2-3 days a week located in our Durham, NC location.
Duties and Responsibilities:
- Ensure best practices in data governance, security, and privacy are adhered to throughout the data lifecycle.
- Perform data profiling, data cleansing, and troubleshooting to ensure high-quality data is available for reporting and analytics to support Data Scientists.
- Leveraging Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric to manage data pipelines and optimize workflows
- Solid understanding of ETL/ELT best practices
- Experience with ETL/ETL Mapping documentation
- Experience with scripting languages like Python, PowerShell
- Managing SQL tables, creating indexes, and querying databases for analysis
- Monitor and evaluate system performance.
- Automating processes and developing workflows to streamline data collection and management.
- Participate in Q&A for software deployment.
- Perform other job-related duties as assigned.
- Stay up to date with emerging technologies and trends in cloud-based data management
REQUIREMENTS:
- Bachelor’s degree in computer science or related field or directly related experience.
- 5+ years of Microsoft SQL experience
- Proficiency with data visualization tools such as Power BI.
- 2+ year(s) of Azure experience.
- Experience developing queries/views/stored procedures in Microsoft SQL Server.
- Strong experience working with XML, JSON, Microsoft SQL, C#, and PowerShell.
Excellent communication skills and ability to grasp requirements and work independently.
- Experience working closely with business stakeholders to understand business goals.
- Analytical thinker with excellent problem-solving, investigation, diagnostic, and teamwork skills.
DESIRED EXPERIENCE:
- Preferred candidates should have DP-600 certification
- Proven experience in data engineering and analytics on Azure cloud platforms.
- 2+ years developing and consuming APIs.
- Knowledge of Blue Cherry, KWI, VR Link, or RepSpark a plus
- Experience with Salesforce Commerce Cloud or OMS
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Azure Computer Science Data governance Data management Data pipelines Data visualization ELT Engineering ETL JSON Pipelines Power BI Privacy Python Salesforce Security SQL VR XML
Perks/benefits: Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.