Data Engineer
Bengaluru, Karnataka
Applications have closed
Koch
Food. Shelter. Clothing. Transportation. Creating life's basic necessities for people around the world through various businesses in multiple industries.Your Job
The Data Engineer will report to the Data Engineering & BI Lead of the KGSI and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. The will be a hands on role to buid ingestion pipelines and the datawarehouse.
Our Team
The Data Engineer will be a part of an global team that designs, develops, and delivers BI and Analytics solutions leveraging the latest BI and Analytics technologies for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch global services India(KGSI) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. As KGSI rapidly scales up its operations in India, it’s employees will get opportunities to carve out a career path for themselves within the organization. This role will have the opportunity to join on the ground floor and will play a critical part in helping build out the Koch global services India (KGSI) over the next several years. Working closely with global colleagues would provide significant global exposure to the employees. This role is a part of the Georgia Pacific team within the KGSI.
What You Will Do
· Be part of the data team to design and build a BI and analytics solution
· Implement batch and near real time data movement design patterns and define best practices in data engineering.
· Design and develop optimal cloud data solutions (lakes, warehouses, marts, analytics) by collaborating with diverse IT teams including business analysts, project managers, architects, and developers.
· Work closely with a team of data engineers and data analysts to procure, blend and analyze data for quality and distribution; ensuring key elements are harmonized and modeled for effective analytics, while operating in a fluid, rapidly changing data environment
· Build data pipelines from a wide variety of sources
· Demonstrate strong conceptual, analytical, and problem-solving skills and ability to articulate ideas and technical solutions effectively to external IT partners as well as internal data team members
· Work with cross-functional teams, on-shore/off-shore, development/QA teams/Vendors in a matrixed environment for data delivery
· Backtracking, troubleshooting failures and provide fix as needed
· Update and maintain key data cloud solution deliverables and diagrams
· Ensure conformance and compliance using Georgia-Pacific data architecture guidelines and enterprise data strategic vision
Who You Are (Basic Qualifications)
· Bachelor’s degree in Computer Science, Engineering, or related IT area with at least 5+ years of experience in software development.
· Primary Skill set : Data Engineering, Python (Especially strong in Object oriented Programming concepts), AWS (Glue, Lambda, EventBridge, Step functions and serverless architecture),Columnar DB(Redshift or Snowflake)
- Secondary Skill set: Working with APIs, Spark, GIT/CICD, SQL,SPARK,STEP FUNCTIONS
- At least 2+ of hands-on experience in designing, implementing, managing large-scale and ETL solutions.
- At least 3 years of hands-on experience in business intelligence, data modelling, data engineering, ETL, multi-dimensional data warehouses, cubes, with expertise in relevant languages and frameworks like SQL, Python etc.
- Hands on experience with designing and fine-tuning queries in Redshift
- Strong knowledge of Data Engineering, Data Warehousing, OLAP and database concepts
· Understanding of common DevSecOps/DataOps and CICD processes, methodologies, and technologies like GitLab, Terraform etc
· Be able to analyze large complex data sets to resolve data quality issues
What Will Put You Ahead
- AWS certifications like Solution Architect (SAA/SAP) or Data Analytics Specialty (DAS)
· Hands-on experience with AWS data technologies and at least one full life cycle project experience in building a data solution in AWS.
- Exposure to visualization tools, such as Tableau or PowerBI.
- Experience with OLAP technologies and Data Virtualization (using Denodo)
· Knowledge in Accounting and Finance
May participate in a 24x7 on call rotation once the development is complete.
Shift Time – 12 PM – 9 PM
At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.
Who We Are
{Insert company language from Company Boilerplate Language Guide}
At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture AWS Business Intelligence Computer Science Data Analytics DataOps Data pipelines Data quality Data visualization Data Warehousing Engineering ETL Finance Git GitLab Lambda OLAP Pipelines Power BI Python Redshift Snowflake Spark SQL Step Functions Tableau Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.