Big Data Engineer
United States - Remote
Job Title: Big Data Engineer (Junior-Mid Level)
Location: 100% Remote DMV Area (Preferred)
Our client is seeking a talented Big Data Engineer to work on internal technical initiatives in data engineering, data analytics, and software integration. This is a highly technical role in a true big data environment hosted on AWS Cloud. The ideal candidate will have 3-6 years of experience, with a strong focus on building data pipelines, optimizing algorithms, and advanced SQL querying, rather than traditional ETL pipelines.
Responsibilities:
- Design, build, and optimize data pipelines to support business initiatives.
- Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities.
- Optimize algorithms and work on complex SQL queries for data solutions.
- Work within an AWS environment, particularly EMR, to manage and process large data sets.
- Use Python, Java, or Scala for development, alongside test-driven development practices.
- Build and maintain unit tests to ensure code quality.
Required Skills:
- 3-6 years of hands-on experience in data engineering.
- Strong expertise in Python (or Java/Scala), with proven coding proficiency.
- Advanced experience in SQL, specifically for structuring complex queries.
- Experience building data pipelines (not ETL) and optimizing algorithms.
- Knowledge of AWS EMR and working in a big data environment.
- Familiarity with Spark and test-driven development.
Preferred Qualifications:
- Bachelor's degree in Computer Science, Mathematics, Physics, or Electrical Engineering.
- DMV area candidates preferred, though remote options may be available for exceptional candidates.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Big Data Computer Science Data Analytics Data pipelines Engineering ETL Java Mathematics Physics Pipelines Python Scala Spark SQL TDD
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.