Sr Engineer, Data Engineering
Tasks
- Analyze workloads for optimization opportunities
- Architect data ingestion transformation storage and consumption
- Build batch and streaming data pipelines
- Collaborate with stakeholders on architecture and cost recommendations
- Define metadata labeling and tagging standards
- Define standards for cloud native data engineering
- Design enterprise data platforms on GCP
- Develop cost dashboards KPIs and forecasting
- Establish SLIs SLOs and monitoring
- Establish cost governance and optimization programs
- Implement resource lifecycle governance controls
- Implement right sizing for compute storage and networking
- Improve Spark workload performance
- Manage cloud cost using FinOps practices
- Optimize BigQuery queries and storage patterns
- Optimize cluster sizing auto scaling and job scheduling
- Optimize data partitioning clustering indexing and caching
- Perform cloud cost analysis and chargeback showback
- Recommend GCP services for use cases
- Tune data pipelines for throughput and latency
Perks/Benefits
Skills/Tech-stack
AlloyDB | Apache Spark | Asset Inventory | Audit Logging | BigLake | BigQuery | BigQuery query optimization | Budgeting and forecasting | CI/CD | Capacity Planning | Chargeback | Cloud Asset Inventory | Cloud Composer | Cloud Cost Optimization | Cloud Monitoring | Cloud Profiler | Cloud Run | Cloud SQL | Cloud Storage | Cloud Trace | Cloud logging | Cloud platform | Committed Use | Committed Use Discounts | Compute Engine | Cost Allocation | Cost Optimization | Cost dashboards | Data Fusion | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Dataflow | Datastream | Docker | ELT | ETL | Encryption | FinOps | GKE | GitHub Actions | Google Cloud | Google Cloud Platform | IAM | Infrastructure as Code | Jenkins | Kubernetes | Labeling and Tagging | Lakehouse Architecture | Looker | Metadata Management | PubSub | PySpark | Python | Query Optimization | Resource Labeling | Resource labeling and tagging | SQL | Secrets management | Service accounts | Shell Scripting | Showback | Spanner | Streaming Architectures | Sustained Use Discounts | Terraform | VPC | “as-code”
Education
N/A
Roles
Related jobs
-
AI Agents | AI Governance | API Security | Auditability | Cloud SecurityHybrid work | Onsite supportMid-level Full TimeBengaluru, Karnataka, India R22h ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Analytics Engineer INR 2800K-4200KCI/CD | DBT | Dashboards | Data Quality | DatabricksHealth insurance | Hybrid work model | Mental health support | Paid time off | Transport allowanceSenior-level Full TimeBangalore (Hybrid) R1d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
Senior-level Full TimePune, MH, IN R1d ago
-
AWS | Ansible | As-a-Service | Azure | BIOSSenior-level Contract Full TimeIndia - Remote R1d ago
-
Data Science & Engineering Lead INR 3000K-4500KAPI Gateway | AWS Glue | AWS Lambda | Airbyte | Amazon EC2Senior-level Full TimeIndia - Remote R1d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India R1d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureFlexibility programmes | Hybrid work | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India R1d ago
-
A/B | A/B Testing | AIOps | AWS | Artificial IntelligenceFlexibility programmes | Hybrid work environment | MentorshipSenior-level Full TimeBengaluru Millenia, India R1d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Modeling | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangement | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India R1d ago
-
Senior AI Engineer INR 2500K-5000KAPI Management | AWS | Agile | Application Programming | Application Programming InterfacesSenior-level Full TimeKolkata, West Bengal, India R1d ago
-
Developer, Java,Spark and GCP INR 2771K-4064KApache Hadoop | Apache Spark | Cloud platform | GCP | Google CloudHybrid work | Work-life flexibilitySenior-level Full TimeChennai, India R1d ago
-
Staff Software Engineer, AI/ML INR 2500K-5000KAgent systems | Autogen | Cloud Platforms | CrewAI | EmbeddingsRemote work | Vacation packageSenior-level Full TimeBangalore, India R1d ago
-
Staff Enterprise AI Engineer - Agentic Workflows & Productivity INR 2500K-5000KAI Governance | API Integration | CI/CD | Compliance | ConfluenceHybrid work model | Mentorship | Training supportSenior-level Full TimeBangalore, India R1d ago
-
AI Engineer / Senior Java Engineer INR 2400K-3500KAPI & Integration patterns | API Integration | CI/CD | Claude Code | Code reviewSenior-level Full TimeBangalore, KA, IN R1d ago
-
Senior Salesforce Data Engineer INR 1800K-3500KAPEX Collections | Agile Scrum | Apex | BigQuery | Bulk APISenior-level Full TimeIN Bangalore Virtual, India R1d ago
-
Process Data Engineer I - Pharmaceutical Product Development INR 1000K-1986KAPI Integration | AWS | Agile | CI/CD | DBTMid-level Full TimeHyderabad, India R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R2d ago