Senior Data Engineer
Calabasas, CA, United States
Full Time Senior-level / Expert USD 118K - 147K
AMH
AMH Homes offers welcoming rental homes that have been renovated and maintained to our Certified Property standards. Our local in-house management professionals provide industry-leading service and utilize our enhanced technology to deliver a...Responsibilities:
- Design, develop, and maintain real-time or batch data pipelines to process and analyze large volumes of data. Designs and develops programs and tools to support ingestion, curation, and provisioning of complex first party and third-party data to achieve analytics, reporting, and data science. Design and develop Advanced Data Products and Intelligent API’s. Monitors the system performance by performing regular tests, troubleshoots, and integrates new features.
- Lead in analysis of data and the design the data architecture to support BI, AI/ML and data products.
- Designs and implements data platform architecture to meet organization analytical requirements. Ensures the solution designs address operational requirements such as scalability, maintainability, extensibility, flexibility, and integrity.
- Provide technical leadership and mentorship to team members. Leads peer development and code reviews with focus on test driven development and Continuous Integration and Continuous Development (CICD).
- Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required.
- Master’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field preferred.
- Minimum of eight (8) years of experience as a data engineer with full-stack capabilities
- Minimum of ten (10) years of Experience in programming
- Minimum of five (5) years in Cloud technologies like Azure, Aws or Google.
- Strong SQL Knowledge
- Experience in ML and ML Pipeline a plus
- Experience in real-time integration, developing intelligent apps and data products.
- Proficiency in Python and experience with CI/CD practices
- Strong background in IAAS platforms and infrastructure
- Hands-on experience with Databricks, Spark, Fabric, or similar technologies
- Experience in Agile methodologies
- Hands-on experience in the design and development of data pipelines and data products
- Experience in developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
- Hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
- Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, EventHub, etc.
- Extensive experience in designing data applications in a cloud environment.
- Intermediate experience in RESTful APIs, messaging systems, and AWS or Microsoft Azure.
- Extensive experience in Data Architecture and data modeling
- Expert in data analysis and data quality frameworks.
- Knowledgeable with BI tools such as Power BI and Tableau.
- Ability to work in a fast-paced, dynamic environment and manage multiple priorities effectively
- Excellent communication and collaboration skills
- Advanced understanding of data security best practices.
- Advanced understanding of systems and data integration architecture
- Critical thinking is a must.
- Problem-solving skills, including the ability to look for root causes and implementable, workable solutions, as well as process improvement ability.
- Proven ability to perform high-quality technical documentation and presentations.
- Excellent organization, time management, and communication skills.
- Ability to be an effective member of project teams.
- Demonstrate professionalism, flexibility/adaptability, and ability to multi-task and work in a team environment.
In the states of Colorado, California, Washington, and Illinois; the anticipated pay range/scale for this position is $118,162 - $147,702. Actual starting base pay within this range will depend on factors including geographic location, education, training, skills, and relevant experience.
Employees also have the opportunity to participate in medical, dental and vision insurance; flexible spending accounts and/or health savings accounts; dependent savings accounts; 401(k) with company matching contributions; employee stock purchase plan; and, a tuition reimbursement program. The Company provides 9 paid holidays per year and, upon hire, new employees will accrue paid time off (PTO) at a rate of 0.0577 hours of PTO per hour worked, up to a maximum of 120 hours per year.
Background check required. AMH will consider for employment qualified applicants with arrest or conviction records in accordance with all applicable federal, state and local laws, which may include the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Tags: Agile APIs Architecture AWS Azure Big Data Business Intelligence CI/CD Computer Science Data analysis Databricks Data pipelines Data quality Data warehouse Economics Engineering Kafka Machine Learning Mathematics ML models NoSQL Physics Pipelines Power BI Privacy Python Security Spark SQL Statistics Streaming Tableau
Perks/benefits: Career development Equity / stock options Flex hours Flex vacation Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.