Sr Engineer, Data,Smai
Hyderabad - Phoenix Aquila, India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Build data lineage and observability
- Collaborate with data scientists data analysts and product teams
- Define data models and data lake strategies
- Design data migrations to Google Cloud
- Design scalable data architectures
- Ensure data governance, security, and compliance
- Implement CI/CD pipelines for data workflows
- Implement batch and real-time processing
- Implement data validation monitoring and quality checks
- Implement query optimization and cost efficient designs
- Ingest large scale data streaming and batch
- Integrate structured, semi-structured, and unstructured data
- Optimize BigQuery queries and storage costs
- Translate business requirements into technical solutions
- Tune PySpark jobs on Dataproc
Perks/Benefits
- N/A
Skills/Tech-stack
Audit Logs | BigQuery | BigQuery audit logs | CI/CD | Cloud Build | Cloud Composer | Cloud Functions | Cloud Monitoring | Cloud Run | Cloud Workflows | Cloud logging | Cloud platform | Clustering | Cost Optimization | Data Compliance | Data Governance | Data Ingestion | Data Lakes | Data Lineage | Data Migration | Data Modeling | Data Monitoring | Data Quality | Data Security | Data Validation | Data Warehousing | Dataproc | ELT | ETL | GCS | Google Cloud | Google Cloud Platform | Kafka | Observability | Partitioning | PubSub | PySpark | Python | Query Optimization | Real Time | Real-time Processing | SQL | Schema Design | Spark | Streaming Data | Terraform | Time processing
Education
N/A
Roles
Related jobs
-
Software Engineer INR 1300K-2200KAcceptance Testing | Angular | Apache Solr | ArizeAI | Behavior-Driven DevelopmentMid-level Full TimeBangalore, Karnataka, India6h ago
-
Junior Data Scientist- Computer Vision INR 350K-360KComputer Vision | Convolutional Neural Networks | Deep learning | Machine Learning | MatplotlibEntry-level Full TimeBengaluru, India6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Data Engineer INR 1500K-2500KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS IAM | AWS LambdaMid-level Full TimeIN-TN-Chennai7h ago
-
Gen Ai INR 2000K-3000KAI Agents | AI Governance | AWS CodePipeline | Agent architecture | AuthenticationMid-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Mid-level Full TimeIN-TN-Chennai7h ago
-
Agentic AI Engineer INR 1800K-2500KAI orchestration | API Integration | Automated testing | Automation | Azure DevOpsMid-level Full TimeIndia, West Bengal, Kolkata7h ago
-
Senior-level Full TimeGurugram, India9h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior QA Engineer(Data Platform Testing) INR 2515K-2829KAPI Gateway | API Testing | AWS Lambda | Alerting | CI/CDReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India10h ago
-
AI Engineer- Associate Consultant INR 2000K-3000KAgent Orchestration | Amazon Web Services | Autonomous Agents | Azure | ClassificationCollaborative work environment | Continuous learning | Inclusive cultureMid-level Full TimeBangalore, Karnataka, India10h ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2500KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure DevOpsMid-level Full TimeBengaluru, KA, IN10h ago
-
Applied AI ML Associate INR 3799K-5000KAWS | Artificial Intelligence | Cloud platform | Data Analysis | Data PipelinesEntry-level Full TimeBengaluru, Karnataka, India10h ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Data Scientist and AI Engineer INR 2500K-5000KAlteryx | CI/CD | Classification | Cloud Build | Cloud FunctionsSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
API Testing | Allure | BDD | CI/CD | CucumberExecutive-level Full TimePune, India11h ago
-
GCP Data Engineer INR 1500K-2500KAPI Integration | BigQuery | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeGurugram, Haryana, India12h ago
-
VM Brakes - Algorithm Software Developer Indian OEM INR 3000K-3600KC# | C++ | Control Theory | Embedded Systems | Functional SafetySenior-level Full Timepune, India13h ago
-
VM Brakes - ASW Algorithm Software Developer [Indian OEM] INR 3200K-3870KC# | C++ | Control Theory | Embedded Systems | Functional SafetySenior-level Full Timecoimbatore, India14h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060415h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Mid-level Full TimePune, Maharashtra, India15h ago
-
Mid-level Full TimeBengaluru, Karnataka, India16h ago
-
APIs | CI/CD | Cloud Computing | Distributed Systems | JavaCoworking stipend | Flexible savings accounts | Health coverage | Remote work | Sick leaveSenior-level Full TimeBengaluru, Karnataka, India16h ago