Senior Data Engineer (Homes.com)
US-DC Washington DC
Full Time Senior-level / Expert USD 110K - 190K
CoStar Group
Job Description
- Design, build, test, deploy and maintain real-time and batch processed Data pipelines.
- Developing and maintaining data storage and retrieval systems.
- Ensuring data accuracy, consistency, and security.
- Integrating data from multiple source systems.
- Developing and maintaining data models.
- Developing and maintaining ETL/ELT processes.
- Collaborating with analytics team, data scientists and business analysts to ensure that data is available and accessible.
- Collaborating with other cross-functional engineering teams.
- Becoming a trusted team member in matters of technical architecture, workflow, design and code.
- Advocating for evolution and improvement - both technical and non-technical - within our teams. Includes new tech, tools and best practices
- Bachelor’s Degree required from an accredited, not for profit university or college, with degree preferably in Computer Science, Data Science, or related field. MSc or PhD is a plus.
- A track record of commitment to prior employers.
- A demonstrable record of accomplishment of building and launching successful products that use terabytes of data.
- 5+ years of data pipeline engineering experience, and deep database engineering experience.
- Ability to analyze technical requirements and design new architectures, data models and ETL/ELT strategies
- Hands-on experience with cloud-based relational and non-relational databases and proficiency in SQL.
- Deliver work products that meet specifications, are free of defects, with excellent performance.
- Define Architecture and Development best practices.
- Proficiency in programming languages such as Python, R, and SQL.
- Performance tuning of database queries (Snowflake, Databricks) .
- Proficiency in data modeling techniques.
- Experience with No-SQL databases (e.g. DynamoDB).
- Experience with data pipeline tools (e.g. Glue, Apache Airflow, Lambda).
- Experience using Confluent Kafka.
- Working knowledge in cloud computing platforms such as AWS, Azure, and Google Cloud.
- Knowledge and experience working with data frameworks (e.g. Apache Spark).
- Monitoring & dashboard metric management (e.g. CloudWatch, Kibana).
- Knowledge of data security and Privacy regulations.
- Familiarity with Data visualization tools such as Tableau, and Power BI.
- Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
- Life, legal, and supplementary insurance
- Virtual and in person mental health counseling services for individuals and family
- Commuter and parking benefits
- 401(K) retirement plan with matching contributions
- Employee stock purchase plan
- Paid time off
- Tuition reimbursement
- On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
- Access to CoStar Group’s Diversity, Equity, & Inclusion Employee Resource Groups
- Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks
CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing
Tags: Airflow Architecture AWS Azure Computer Science Databricks Data management Data pipelines Data visualization DynamoDB ELT Engineering ETL GCP Google Cloud Kafka Kibana Lambda PhD Pipelines Power BI Privacy Python R RDBMS Security Snowflake Spark SQL Tableau Testing
Perks/benefits: Career development Equity / stock options Fitness / gym Health care Snacks / Drinks Yoga
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.