Gen Ai
Tasks
- Build SQL transformations and optimized queries
- Build vector and retrieval augmented generation data foundations
- Create dbt transformations and semantic models
- Design dimensional and data vault models
- Develop distributed processing pipelines with Spark and PySpark
- Implement data quality checks and monitoring
- Implement streaming and CDC ingestion systems
- Manage lakehouse storage formats and table optimization
- Orchestrate data workflows and pipelines
- Set up data catalog governance and lineage
Perks/Benefits
- N/A
Skills/Tech-stack
AI Search | AWS Glue | AWS Glue Catalog | AWS Step Functions | Airbyte | Alation | Amazon Kinesis | Amazon MSK | Amazon Redshift | Apache Airflow | Apache Beam | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Avro | Azure AI | Azure AI Search | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Event | Azure Event Hubs | Azure Fabric | Azure Synapse | Azure Synapse Analytics | Cloud Dataflow | Cloud Storage | Collibra | Confluent Kafka | DBT | Dagster | Data Factory | Data Lake Storage Gen2 | Databricks Feature Store | Databricks SQL | Datahub | Debezium | Delta Lake | Embedding | Event Hubs | Feast | Feature Store | Fivetran | Glue Catalog | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Storage | Google Pubsub | Google Vertex | Google Vertex AI | Great Expectations | Lake Formation | Microsoft Purview | Milvus | Monte Carlo | ORC | OpenSearch | PGVector | Parquet | Pinecone | PostgreSQL | Prefect | PySpark | Qlik Replicate | RAG | S3 | SQL | Snowflake | Soda | Step Functions | Structured Streaming | Synapse Analytics | Tecton | Unity Catalog | Vector Database | Vertex AI | Weaviate
Education
N/A
Related jobs
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India2h ago
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune3h ago
-
Senior Applied AI/ML Engineer INR 3500K-5000KAgentic Systems | Autonomous Agents | Bias Mitigation | Data Analysis | Deep learningSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Assistant Manager- Python Gen AI with GCP- Bangalore INR 1500K-2500KADK | AI Agents | API Development | Agile | Cloud platformWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R5h ago
-
Data Engineer (.NET Specialist) INR 2400K-3380K.Net Core | ASP.NET | Angular | App Service | Azure AppCustomer-facing role | On call support rewardsSenior-level Full TimePune, MH, India5h ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India7h ago
-
GenAI Engineer INR 2500K-5000KAPI Integration | Agent Orchestration | Anthropic Claude | Anthropic Claude Code | CRMInclusive workplace | Knowledge sharing | Mentoring | Professional developmentSenior-level Full TimePune, Maharashtra, India7h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2000KAWS Glue | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India7h ago
-
Business Intelligence Engineer - Power BI Developer INR 1500K-2000KAgile | BI Performance Tuning | DAX | Data Modeling | Dimension modelingFlexible remote work | Health insurance | Hybrid work model | Life insurance | Paid time offMid-level Full TimeHyderabad, India R7h ago
-
Mid-level Full TimeMumbai, Maharashtra, India8h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India9h ago
-
QE for AI Engineer INR 3000K-4000KAdversarial Testing | Benchmarking | CI/CD | Data Lineage | EvaluationSenior-level Full TimePune, Maharashtra, India9h ago
-
Data & Analytics Engineer - Consultant INR 1500K-3000KData Director | Data Governance | Data Management | Data Quality | ETLSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India9h ago
-
Senior Manager of Software Engineering - Data Engineer INR 4000K-6000KAPI Development | AWS | AWS Glue | AWS Lambda | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Lead - AI Engineer INR 2000K-5000KAgentic AI | Generative AI | Governance | Language Models | Large Language ModelsSenior-level Full TimeBangalore, Bangalore, IN9h ago
-
Asst Mgr - AI Solutions INR 96K-180KAPIs | Artificial Intelligence | Feature Engineering | Generative AI | GitEntry-level Full TimeMumbai A.O, MUM-KND-AFS(FD), IN9h ago
-
Senior Data Engineer INR 3000K-4000KAPI Development | AWS | Algorithms | Amazon Redshift | AzureDiscounted gym memberships | Flexible working | Hybrid working | Life assurance | Life assurance and community involvementSenior-level Full TimeHyderabad, India9h ago
-
API Gateway | AWS CloudWatch | AWS Cost Optimization | AWS Glue | AWS LambdaCollaborative environment | Continuing education | Growth opportunities | Professional training opportunities | Remote work flexibilitySenior-level Full TimeIndia12h ago
-
Senior-level Full TimeIN Office Bangalore13h ago
-
Custom Software Engineer INR 1300K-2000KAgile methodologies | Analytics services | Azure Analytics | Azure Analytics Services | Azure DataMid-level Full TimeBengaluru, BDC14A, India16h ago
-
Custom Software Engineer INR 1300K-2000KAgile | Analytics services | Azure Analytics | Azure Analytics Services | Azure DataMid-level Full TimeBengaluru, BDC14A, India16h ago