Snr. Spec. Data Engineering Expert
Hyderabad (Office), India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Adopt platform AI capabilities
- Apply AI and agentic AI for automation and productivity
- Build data ingestion and transformation pipelines
- Build data observability and monitoring
- Collaborate with DevOps for CI CD deployments
- Create reusable platform components and libraries
- Design scalable data engineering solutions
- Develop ETL and ELT workflows
- Implement data quality checks and validation rules
- Implement pipeline orchestration
- Manage code via version control and peer reviews
- Monitor freshness completeness and schema drift
- Tune Spark jobs and SQL workloads
- Write unit testing and integration testing
Perks/Benefits
- N/A
Skills/Tech-stack
AI functions | AWS Lambda | AWS S3 | Agile | Alerting | Apache Spark | CI/CD | Data Modeling | Data Observability | Data Quality | Data Warehousing | Databricks | Databricks AI | Databricks AI Functions | ELT | ER Modeling | ETL | Lakehouse | Logging | MLflow | Monitoring | Pipeline Orchestration | PySpark | Python | SQL | Scrum | Unity Catalog
Education
N/A
Related jobs
-
GCP Data & Analytics Engineer/Senior Consultant Specialist INR 2000K-3000KAI machine learning | Access Management | Batch Processing | BigQuery | Clickstream analyticsContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R9h ago
-
Mid-level Full TimeIN-AP-Hyderabad9h ago
-
Senior Data Management Professional - Data Rates INR 2800K-4000KAgile | Alerting | Anomaly Detection | CSV | Cause analysisSenior-level Full TimePune9h ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Azure | Data Engineering | Data Governance | Data LakesCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Associate - Embedded AI & Data Analytics Engineer INR 980K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Associate - Agentic AI - Embedded System INR 2000K-2500KCI/CD | Distributed Systems | Edge AI | GPU Utilization | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | In-office 5 days a week | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Associate - Agentic AI - Data analytics engineer INR 1000K-1820KC++ | Classification | Data Modeling | Data Pipelines | Data PreprocessingAccess to cutting-edge technologies | Collaborative work environment | Professional growth opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Data Analytics Engineer INR 1500K-2400KAgile | Azure | BigQuery | Cloud Storage | Cloud platformCareer development | Hybrid workSenior-level Full TimePune, India10h ago
-
BI Developer (Power BI + Sigma Computing) INR 1500K-2209KAccess Control | CI/CD | Data Governance | Data Model | Data ModelingSenior-level Full TimeGurugram, Haryana, India11h ago
-
Software Engineering INR 1500K-2000KApache Spark | Azure | Azure AKS | Azure Compute | Azure DataOn-call rotationMid-level Full TimeBengaluru, KA, IN11h ago
-
Software Engineering INR 1500K-2000KAI-enabled | AI-enabled development | Apache Spark | C# | C++Career growth opportunities | On-call rotationMid-level Full TimeBengaluru, KA, IN11h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4500KAPI Integration | Agent systems | Cloud platform | CrewAI | Generative AISenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Software Engineer III, Full Stack, Cloud AI INR 2000K-3500KAgentic AI | Cloud Computing | Connectivity systems | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2400KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data pipelineFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R11h ago
-
API Testing | Apache JMeter | Automation Framework | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India11h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India12h ago
-
AI/ML | Agentic AI | Apache Airflow | Apache Kafka | CI/CDMid-level Full TimeHyderabad, Telangana, India R12h ago
-
AI Engineer(Python, SQL, and GenAI frameworks ,LLM architecture, RAGs, embeddings, prompt tuning,agentic AI INR 2000K-4000KAWS | Agentic AI | Azure | Containerization | DockerSenior-level Full TimeGurugram, HR, India12h ago
-
Senior ETL Developer, Data Management INR 1500K-2209KAgile | Autosys | Control-M | Data Quality | ETLRotational on-callSenior-level Full TimeBangalore, India13h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 56010313h ago
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 56010313h ago
-
Software Engineer II INR 1500K-2000KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeBengaluru, KA, IN13h ago
-
Senior AI Engineer INR 2500K-4500KAI Search | API Development | AWS Bedrock | AWS SageMaker | Apache AirflowSenior-level Full TimeHyderabad, TS, India14h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India14h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN14h ago