Senior Specialist, Data Engineer
IND - Telangana - Hyderabad (HITEC City), India
INR 1800K-2683K (estimate) Senior-level Full Time
Tasks
- Build automated data pipelines on AWS
- Collaborate with platform DevOps and analytics teams
- Conduct code reviews and change management with Git
- Deploy data workloads using CI CD with Terraform
- Design data transformation pipelines
- Ensure data quality, reliability, and compliance
- Ensure transformations are readable testable maintainable
- Implement DDL and schema evolution
- Maintain production data transformation logic
- Monitor and operate data pipelines
- Perform data enrichment cleansing parsing normalization
- Write Python scripts for data processing
- Write SQL for data transformations
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Spark | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Governance | Data Lakes | Data Modeling | Data Normalization | Data Quality | Data pipeline | Databricks | ETL | Git | Infrastructure as Code | Python | Relational databases | SQL | Spark SQL | Terraform | Testable Code | “as-code”
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
Machine Learning Engineer INR 2500K-3000KAWS | Automation | Google Cloud | Java | Language ModelsCollaborative team environment | Continuous learning | Professional development opportunitiesEntry-level Full TimeBengaluru, India6h ago
-
PySpark Data Engineer INR 1500K-2000KApache Airflow | Apache Hadoop | Apache Hive | Apache Spark | HDFSSenior-level Full TimeJaipur, India6h ago
-
Mid-level Full TimeBangalore South, India6h ago
-
Lead Consultant-Data Engineer INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore6h ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore6h ago
-
Amazon AWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore6h ago
-
Mid-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Staff Engineer, Data Analytics Engineering ( 6+ years Full Stack Developer - React, JavaScript, and Python / Node.js, AWS, SQL ) INR 2520K-4725KAI/ML | API Gateway | AWS Lambda | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, KA, India7h ago
-
API Gateway | AWS | Argo CD | Bash | CI/CDCharity matching | Corporate volunteering | Medical/Dental/Vision | Paid time off | Retirement planningMid-level Full TimeVadodara, GJ, IN7h ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Agile | Apache Spark | Application development | Big DataSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Software Engineer II - Databricks, Cloud Data Engineer INR 1500K-2500KAWS EMR | Agile | Apache Spark | Big Data | CI/CDMid-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Staff Software Engineer, Application Design Center INR 2040K-3200KAngular | Artificial Intelligence | Distributed Systems | Go | JavaSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4500KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | Language ModelsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior AI/ML Engineer II INR 2500K-4500KAzure | C++ | Deep learning | Generative AI | Hugging FaceCareer advancement programs | Dental insurance | Employee assistance program | Flexible work options | Health insuranceSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeIndia9h ago
-
Vice President, Data Management Engineer INR 1500K-4000KData Governance | Data Management | Data Privacy | Data Quality | Data SecurityExecutive-level Full TimePune, MH, India9h ago
-
Data Engineer - Chennai / Bengaluru INR 2000K-2040KAgile Scrum | Apache Airflow | Apache Hive | Apache Kafka | Apache SupersetSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Executive - Python+SQL INR 264K-360KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationExecutive-level Full TimeGurgaon, Haryana, India9h ago
-
Mgr, DevOps Engineering - Moveworks INR 3222K-4725KAWS | AWS KMS | Ansible | CI/CD | CloudFormationSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Agile | Apache Kafka | Apache Spark | Big Data | CI/CDHybrid work arrangementSenior-level Full TimeBengaluru, INDIA, India11h ago
-
Lead Software Engineer - Java , React and AI/ML INR 2000K-2200KAWS | Agile | Application Resiliency | CI/CD | CucumberSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Associate Process Manager INR 2200K-3000KAPI Design | AWS | Adapter-Tuning | Azure | C++Flexible shift timings | WFO/WFH FlexibilityMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Data & GenAI Engineer INR 2400K-3000KAngular | Apache Spark | CI/CD | Data Lineage | Data ValidationMid-level Full TimeBengaluru, KA, IN11h ago