Big Data Engineer [Spark, Python, Orchestration]

Our client, one of the largest accounting and consulting firms in the southeastern U.S., is seeking an individual who is energized by helping organizations navigate the next wave of innovation and change. This role is responsible for scheduling, orchestrating, and executing big data workflows and jobs using next-generation Data Workflow Orchestration platforms to meet needs for scale and speed. You will build fully managed workflows, enabling high throughput, horizontal scalability, and advanced parametrized, event-based scheduling. 
Your team will build an ETL framework for incremental data processing for increased data accuracy, freshness, and easy backfill to directly impact the cost and operational efficiency of Analytics and ML. You will join a collaborative, cross-functional team that values your insight, encourages you to take on new responsibilities, promotes continuous learning, and rewards innovation. We are seeking someone with knowledge of building next-gen capabilities on scalable and secure enterprise-grade platforms. You will collaborate with relevant business and technology partners across the firm and clients' multiple sectors.

Responsibilities

• Analyze and organize raw data 
• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results 
• Prepare data for prescriptive and predictive modeling
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability
• Identify opportunities for data acquisition
• Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Qualifications

• 5+ years of experience in data engineering
• Bachelor’s degree in Computer Science, Engineering or related STEM field
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages  (e.g. Java and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Data engineering certification (e.g IBM Certified Data Engineer)
• Experience in Orchestration, Spark and/or Big Data Analytics technologies

Additional Information

• Remote: LATAM
• Contract: 40 hrs/week
• CST Time Zone
• USD Compensation