Senior Data Engineer (Python/ Spark/GCP)
111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India
Senior-level Full Time
Tasks
- Build APIs and data services for AI agents
- Build and optimize data pipelines
- Develop AI data products for semantic search and RAG
- Develop batch and streaming data solutions
- Drive automation CI CD monitoring and reusable frameworks
- Implement metadata lineage governance and observability
- Lead data platform initiatives
- Maintain data warehouse and analytics environment
- Oversee data integration and data modeling
- Resolve data engineering issues and deliver data engineering outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Migration | Cloud platform | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Quality | Dataplex | Docker | ELT | ETL | Git | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | Kafka | Knowledge graphs | Kubernetes | Langchain | MLOps | Metadata Management | Observability | PubSub | Python | RAG | REST APIs | Retrieval-Augmented Generation | SQL | Vector Search
Education
N/A
Roles
Related jobs
-
Microsoft Fabric Data Engineer INR 1100K-2600KData Governance | Data Ingestion | Data Pipelines | Data Quality | Data SecurityMid-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimePune City, India7h ago
-
Entry-level Full TimePune, India7h ago
-
Senior AI Engineer/ Senior Associate Director, Tech SME INR 1860K-2800KAPIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimePune, Maharashtra, India R7h ago
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R8h ago
-
Junior Data Engineer INR 400K-700KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | Azure DataEntry-level Full TimePune City, India8h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | COMTRADESenior-level Full TimeBangalore - Karnataka - India9h ago
-
Senior-level Full TimeBangalore - Karnataka - India9h ago
-
Senior AI Engineer INR 2500K-4500KAsync Programming | Azure | CI/CD | Data Ingestion | Data Ingestion PipelineDiversity-focused workplace | Equity and inclusion | Learning opportunitiesSenior-level Full TimeBangalore - Karnataka - India9h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | Dependency managementSenior-level Full TimeBangalore - Karnataka - India9h ago
-
Senior-level Full TimeBangalore - Karnataka - India9h ago
-
Senior-level Full TimeBangalore - Karnataka - India9h ago
-
Data Engineer ( 2 to 5 Years) INR 1500K-2100KAWS CDK | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaContinuous learning | Flexible working | Hybrid working | Inclusive cultureMid-level Full TimeBangalore - Karnataka - India9h ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R9h ago
-
Data Engineer INR 1500K-2700KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Noida/ Chennai, India9h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India10h ago
-
Senior-level Full TimePune, Maharashtra, India11h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101311h ago
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Data Processing | Data Storage | Debugging | Distributed SystemsSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India11h ago
-
Senior Data Engineer (Python, SQL, Snowflake, Devops, Azure/ AWS, Co-pilot, Kubernetes, Docker) INR 3200K-4131KAWS | Airflow | Automated Lineage | Azure | Azure BicepEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Mentorship | Volunteer time offSenior-level Full TimeChennai, TN, India12h ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryFlexible working | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R12h ago
-
Senior Data Engineer – Snowflake Developer INR 2800K-4000KAWS | Access Control | Airflow | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India12h ago
-
Senior II Data Engineer INR 3715K-4995KBI Dashboards | BICC | CI/CD | Data Augmentation | Data CatalogFlexible working options | Health benefitsSenior-level Full TimeIndia12h ago