Data Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Analyst
Hyderabad, Telangana, India
INR 1500K-2000K (estimate) Entry-level Full Time
Tasks
- Apply data modeling principles
- Build batch data pipelines
- Build streaming data pipelines
- Contribute to technical design standards
- Design schema and schema evolution
- Develop raw refined curated datasets
- Develop reusable pipeline tooling
- Ensure production ready pipelines
- Implement data quality validation
- Improve testing monitoring tooling
- Model temporal data
- Optimize data performance with partitioning and clustering
- Perform data reconciliation
- Refactor data flows
- Support distributed data processing
- Troubleshoot pipeline and dataset issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Avro | CI/CD | Cause analysis | Clustering | Containerization | Data Modeling | Data Quality | Data Reconciliation | Databricks | Hadoop | JSON | Java | Kafka | Kubernetes | Parquet | Partitioning | Python | Root Cause Analysis | Root cause | SQL | Schema evolution | Snowflake | Temporal Data | Temporal Data Modeling | Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Fullstack Data Engineer (Remote) INR 800K-2000KAPI Keys | AWS IAM | AWS S3 | AWS VPC | Apache SparkRemote work | UK shift scheduleSenior-level Full TimeMaharashtra, Pune, India R3h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4144KAWS | Agentic AI | Azure | Azure OpenAI | Cloud ComputingSenior-level Full TimeIndia-Pune4h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4725KAWS | Agentic AI | Azure OpenAI | Cloud platform | Deep learningSenior-level Full TimeIndia-Kolkata4h ago
-
Senior DevOps Engineer (AWS | MLOps | Kubernetes) INR 2500K-4000KAWS IAM | Amazon EKS | Amazon S3 | Amazon Web Services | Argo CDHybrid workSenior-level Full TimeMaharashtra, Pune, India5h ago
-
GenAI Azure INR 1800K-2500K.NET | API Management | ASP.Net Core | Access Control | Active DirectoryMid-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Staff Software Engineer, Cloud SQL Postgres INR 1500K-2400KC++ | Database Administration | PostgreSQL | Query Optimization | Relational databasesSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Actuarial - Data Science INR 1500K-3000KClassification | Data Preprocessing | Data Quality | Explainable AI | Feature EngineeringMid-level Full TimeBangalore, KA, India7h ago
-
Data Engineer II - Python, AWS & Pyspark INR 1500K-2200KAWS | Data Migration | Data Modeling | Data Warehouse | Data pipelineMid-level Full TimeHyderabad, Telangana, India8h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDSenior-level Full TimePune, MH, India9h ago
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India9h ago
-
Engineering-L2-Bengaluru-Vice President-Software Engineering INR 1500K-6000KApache Iceberg | Apache Spark | Avro | CI/CD | DatabricksExecutive-level Full TimeBengaluru, Karnataka, India10h ago
-
Software Engineer III - Data Engineer, AWS, ETL, Python INR 2000K-3500KAWS | CI/CD | Data Governance | Data Lake | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3200KANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia11h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Data Engineer INR 2755K-3500KAPI Development | AWS | Amazon Redshift | Azure | BashHybrid working | Inclusive culture | Learning and development programmesSenior-level Full TimeHyderabad, India11h ago
-
Director of Software Engineering - Big Data, Cloud INR 2000K-6000KAI machine learning | AWS | Agile | Azure | Big DataExecutive-level Full TimeMumbai, Maharashtra, India12h ago
-
Assistant Manager-GDC INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India13h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India13h ago
-
Software Engineer III - Databricks, SQL , Python INR 2000K-2800KApache Spark | Cloud technologies | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior-level Full TimeBangalore, Karnataka, India14h ago
-
Senior-level Full TimeBangalore, India17h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Agile | Apache Airflow | Batch Processing | BigQueryGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India18h ago