Data Engineer - BigData, Python and SQL
Telangana, Hyderabad, India
Job Description:
• To be part of Data Engineering team on-site
• Required to design, develop, and manage Data Pipelines & Data warehouse.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Designing and optimizing data storage solutions
• Monitoring data infrastructure for performance and reliability to address issues promptly.
• Documenting data pipelines, processes, and best practices for knowledge sharing.
• Knowledge of data governance principles, ensuring data quality, security, and compliance.
• Working with Bigdata platform is must have.
• Strong knowledge and experience in Data Modelling, Advanced SQL.
Skills Required:
• Build Data Pipelines, Data Analytics
• Experience working with Structured and Semi-structured data ingestion.
• Experience in Streaming data platform & analytics
• Experience working with Star/ Dimensional data modelling.
• Bigdata Stack –Scala, Hadoop, Spark, Hive, Shell Script, EMR, Step Function, Lambda, Glue, Sqoop, Flume/Kafka
• Databases – Amazon Redshift, Oracle , SQL Server
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Data Analytics Data governance Data pipelines Data quality Data warehouse Engineering Hadoop Kafka Lambda Oracle Pipelines Python Redshift Scala Security Spark SQL Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.