Senior Data Engineer
Orlando, Florida, United States - Remote
Worth AI
Complete applications effortlessly with Worth Pre-Filling. Our AI-powered technology guarantees real-time accuracy and eliminates manual data entry.Worth AI, a leader in the computer software industry, is looking for a talented and experienced Senior Data Engineer to join their innovative team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence while fostering an environment of collaboration, and adaptability, aiming to make a meaningful impact in the tech landscape.. Our team values include extreme ownership, one team and creating reaving fans both for our employees and customers.
As a Senior Data Engineer, you will be responsible for designing and implementing robust data architectures and pipelines that support our AI initiatives. You will take a leadership role in managing data projects, working closely with data scientists and software engineers to ensure the seamless flow and quality of data throughout our systems. Your advanced expertise in database management, data modeling, and cloud platforms will be pivotal in driving our data strategy forward.
Responsibilities
- Design, build, code and maintain large-scale data processing systems and architectures that support AI initiatives.
- Develop and implement data pipelines and ETL processes to ingest, transform, and load data from various sources.
- Design and optimize databases and data storage solutions for high performance and scalability.
- Collaborate with cross-functional teams to understand data requirements and ensure data quality and integrity.
- Implement data governance and data security measures to protect sensitive data.
- Monitor and troubleshoot data infrastructure and pipeline issues in a timely manner.
- Stay up-to-date with the latest trends and technologies in data engineering and recommend improvements to enhance the company's data capabilities.
Requirements
- 7+ years of proven experience as a Senior Data Engineer or similar role, preferably in a software or technology-driven company with experience processing several to several hundreds of Gigabytes of data or more
- In-depth knowledge of data modeling, data warehousing, and database design principles.
- Strong programming skills in Python, SQL, and other relevant languages.
- Experience with relational and NoSQL databases, such as PostgreSQL, MySQL, MongoDB
- Proficiency in data integration and ETL tools, such as Apache Kafka, Apache Airflow, or Informatica.
- Familiarity with big data processing frameworks, such as Hadoop, Spark, or Flink.
- Knowledge of cloud platforms, such as AWS, Azure, or GCP, and experience with data storage and processing services in the cloud.
- Understanding of data governance, data privacy, and data security best practices.
- Strong problem-solving and troubleshooting skills, with a focus on data quality and system performance.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Prior collaborative work with data scientists or machine learning professionals with respect to sourcing, processing and scaling both input and output data
- Comfortable going through documentation of third-party API’s and identifying best procedures for integrating data from API’s into broader ETL processes
Benefits
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance
- Unlimited Paid Time Off
- 9 paid Holidays
- Family Leave
- Work From Home
- Free Food & Snacks (Access to Industrious Co-working Membership!)
- Wellness Resources
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS Azure Big Data Data governance Data pipelines Data quality Data strategy Data Warehousing Engineering ETL Flink GCP Hadoop Informatica Kafka Machine Learning MongoDB MySQL NoSQL Pipelines PostgreSQL Privacy Python Security Spark SQL
Perks/benefits: 401(k) matching Career development Health care Medical leave Unlimited paid time off Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.