Senior Software Engineer: Data Engineering, GCP, GenAI
111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Act as escalation point and guide junior staff
- Build batch and streaming migration pipelines
- Design and code data pipelines
- Enable data governance and lineage
- Handle large volume data transfers
- Implement cloud data migrations to GCP
- Lead data engineering initiatives
- Map schemas and reconcile migrated datasets
- Perform data transformation and validation
- Test and debug data migration programs
- Use GenAI for data discovery and migration automation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | Apigee | BigQuery | BigQuery ML | Bigtable | CDC | Cloud Composer | Cloud platform | Data Catalog | Dataplex | Dataproc | Embeddings | Generative AI | Google Cloud | Google Cloud Platform | Google Pubsub | Hive | Kafka | LLMs | MongoDB | MySQL | Prompt engineering | Python | REST APIs | SQL | Vertex AI
Education
N/A
Related jobs
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India1h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN2h ago
-
Consultant - AI Engineer INR 2000K-3500KAutogen | CI/CD | Claude | Cloud infrastructure | ContainerizationSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Staff GenAI Engineer INR 2000K-3500KAWS | Agentic AI | Azure | CI/CD | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India5h ago
-
API Testing | Apache Airflow | Azure | CI/CD | DatabricksEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India6h ago
-
Mid-level Full TimeGurugram, India6h ago
-
Software Test Engineer- Must have- ETL Testing, Pyspark, SQL, Good to have-playwright or selenium, databricks or snowflake INR 1632K-2156KAzure | Bitbucket | CI/CD | Databricks | DockerEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India6h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient-facing consulting experience | Growth mindset | Professional development opportunitiesSenior-level Full TimePune, Maharashtra, India7h ago
-
Data Scientist I INR 302K-420KAnomaly Detection | Cloud Computing | Data cleaning | Feature Engineering | Generative AIEntry-level Full TimeBangalore, KA, IN, 5600767h ago
-
Data Operation Engineer INR 2040K-3000KAsset bundles | Azure | Cloud platform | Confluence | DBTHybrid work arrangementMid-level Full TimeChennai, Tamil Nadu, India7h ago
-
AWS | Azure | Cloud platform | Deep learning | Generative AIContinuous learning and growth | Fully remote work | Technical excellence and experimentation cultureSenior-level Full TimeIndia R7h ago
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India7h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia7h ago
-
AI/ML Expert INR 2500K-4800KARIMA | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data AnalysisSenior-level Full Timecoimbatore, India8h ago
-
Senior-level Full TimeAnywhere in India R8h ago
-
Mid-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior Software Engineer (Python, Pyspark, Databricks, AWS, SQL) INR 2475K-2829KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon S3Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India9h ago
-
Staff Software Engineer - Data Platform INR 2755K-3465KAmazon Kinesis | Apache Beam | Apache Flink | Apache Hadoop | Apache KafkaSenior-level Full TimeBengaluru, India11h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Forward Deployed Engineer INR 2000K-3500KAI | APIs | Agent Orchestration | Agent-based | Agent-based AISenior-level Full TimeHyderabad, India12h ago
-
Senior AI Engineer (Agents) INR 2000K-3500KA/B | A/B Testing | Agent Assist | Anthropic | B testingEmployee benefits | Flexible culture | Remote work flexibilitySenior-level Full TimeHyderabad, India12h ago
-
Senior AI Engineer (Search/Retrieval) INR 2000K-3465KAWS | Azure | BM25 | CI/CD | Citation AccuracySenior-level Full TimeHyderabad, India12h ago
-
Computer Scientist ( Java Backend ) INR 2500K-3500KApache Kafka | CI/CD | Docker | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, India R13h ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R13h ago