Data Engineer
United States - Remote
We're seeking an experienced Data Engineer to design, develop, and maintain robust data pipelines and infrastructure for Acelab – B2B marketplace that connects architects and designers with building material manufacturers. This role will be crucial in managing our data ecosystem, implementing advanced analytics, and supporting our data science and engineering teams in delivering high-quality insights and products.
Key Responsibilities:
- Design, develop, and maintain pipelines for importing and cleaning semi-structured data from various sources
- Specify, deploy, and manage scalable and reliable data pipeline infrastructure
- Design and implement database schemas to efficiently store and retrieve complex and sparse data
- Collaborate closely with data science and engineering teams to reconcile datasets and ensure data consistency across systems
- Develop and maintain data quality checks and monitoring systems
- Optimize data storage and retrieval processes for improved performance and cost-effectiveness
- Participate in code reviews and contribute to best practices for data engineering
- Stay up-to-date with the latest trends and technologies in data engineering and big data processing
Requirements
- Ideal fit would be someone with experience in data-intensive industries such as e-commerce (e.g., Wayfair, Amazon, Shopify) or similar high-volume data environments
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field
- 3+ years of experience in data engineering or a similar role
- Strong proficiency in SQL, and at least one big data processing framework (e.g., Apache Spark, Hadoop)
- Some experience with .NET Web API
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services
- Solid understanding of data modeling, ETL processes, and data warehousing concepts
- Familiarity with version control systems (e.g., Git) and CI/CD practices
- Knowledge of data governance and security best practices
- Strong problem-solving skills and attention to detail
- Excellent communication skills and ability to work in a collaborative environment
- Experience with Agile development methodologies
Benefits
- Work with some of the brightest minds in AEC, including former CEO of Revit
- Unlimited PTO, Sick Days, Paid National Holidays, and more
- Medical, dental, vision, short-term/long-term disability plans, and 401(k)
- Opportunities for growth, creativity, and ownership
- Flexible and remote work schedules
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs AWS Azure Big Data CI/CD Computer Science Data governance Data pipelines Data quality Data Warehousing E-commerce Engineering ETL GCP Git Hadoop Pipelines Security Spark SQL
Perks/benefits: Flex vacation Health care Unlimited paid time off
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.