26-2253: Data Engineer, AI/BI: Hyderabad, India
Tasks
- Architect and manage data lake and data warehouse solutions
- Build and maintain feature stores
- Build and optimize analytical views and materialized models
- Construct and curate training and evaluation datasets
- Design build and maintain ELT ETL pipelines
- Develop semantic layers and BI ready data marts
- Ensure data quality lineage and observability
- Implement RBAC data masking and PII governance
- Implement data versioning and governance for AI compliance
- Implement real time and streaming data pipelines
- Integrate BI platforms with data warehouse sources
- Manage cloud data infrastructure with infrastructure as code
- Manage vector databases and embedding pipelines
- Monitor pipeline health data freshness and cost efficiency
- Support MLOps workflows with experiment tracking and model registries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Kinesis | Access Control | Airflow | Amazon Redshift | Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Azure Event | Azure Event Hubs | Azure ML | BigQuery | DBT | Dagster | Data Pipelines | Data masking | DataOps | Databricks | Databricks Feature Store | Distributed Processing | Embedding pipelines | Event Hubs | Feast | Feature Engineering | Feature Store | Git | Great Expectations | Infrastructure as Code | Kubeflow | LLM Data Pipelines | MLflow | Monte Carlo | PGVector | Pandas | Pinecone | Prefect | Pulumi | PySpark | Python | RBAC | Role-Based Access | Role-Based Access Control | SQL | SQLAlchemy | SageMaker | Snowflake | Tecton | Terraform | Vector Databases | Vertex AI | Weaviate | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, IND-TG, India13h ago
-
Mid-level Full TimeHyderabad, India17h ago
-
AI+DevSec Ops INR 2000K-4500KAKS | Active Directory | Amazon Web Services | Azure Active Directory | Azure DevOpsSenior-level Full TimeHyderabad, India17h ago
-
Entry-level Full TimeMaharashtra, Pune, India17h ago
-
Python - Bigdata INR 1500K-2800KBig Data | Data pipeline | Development Life Cycle | PySpark | PythonMid-level Full TimeIN-MH-Pune18h ago
-
Senior-level Full TimeIN-KA-Bangalore18h ago
-
Mid-level Full TimeIN-AP-Hyderabad18h ago
-
Data Engineer (PySpark, Database, Python) INR 1500K-2200KAb Initio | CI/CD | Data Governance | DynamoDB | HadoopMid-level Full TimeIN-TN-Chennai18h ago
-
Gen AI INR 1800K-2800KAI Services | AI Studio | Azure AI | Azure AI Services | Azure AI StudioHybrid workMid-level Full TimeIN-AP-Hyderabad18h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai18h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai18h ago
-
Data Warehouse Engineer INR 3000K-4000KAPI Integration | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsAccreditations | Annual excellence awards | Bike to work | Career development program | Educational assistanceSenior-level Full TimeNoida, UP, India18h ago
-
Predictive Analytics Data Scientist-AI Labs INR 2000K-3000KAWS | Anomaly Detection | Azure | Bias Mitigation | Data PrivacyMid-level Full TimeAhmedabad, Gujarat, India18h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2500KAWS CloudTrail | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon CloudWatchSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Senior-level Full TimeIndia19h ago
-
Senior Tech Lead - Data Engineering / Consultant Specialist INR 2040K-4000KAPI | Apache Airflow | Apache Beam | Autoscaling | BigQueryContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Practice Customer Engineer, Data Analytics INR 2000K-3000KApache Spark | Big Data | Cloud platform | DNS | Data ArchitectureSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India19h ago
-
Senior Software Engineer INR 1500K-2500KAccess Control | Agile | Anomaly Detection | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN20h ago
-
Junior GenAI Developer INR 300K-350KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R21h ago
-
Consultant - AI Engineer with Claude INR 2000K-4800KAWS | Autogen | Azure | Cloud Computing | ContainerizationSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Non-Mainly Manager # Proc. & SCM – Digital Transformation INR 1000K-2000KAWS | Agentic AI | Anomaly Detection | Apache Airflow | Apache SparkMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Junior GenAI Developer INR 300K-350KAWS | Agentic Workflows | Amazon Bedrock | Anthropic | ChromaHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R22h ago
-
Software Engineering Specialist INR 355K-500KAPI Development | CI/CD | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeBengaluru, IN, 56010322h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN23h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistanceSenior-level Full TimeMumbai, MH, IN23h ago