Data Engineer 2
IND-CORP Bengaluru-TDIM - PTT, India
INR 2040K-3465K (estimate) Senior-level Full Time
Tasks
- Build data transformation workflows
- Build event-driven workflows
- Build self healing data agents
- Collaborate in agile teams
- Contribute to CI/CD pipelines and infrastructure as code
- Deploy RAG pipelines
- Design Delta Lake and lakehouse models
- Design data ingestion pipelines
- Develop data services and APIs
- Document data models and workflows
- Enable natural language to data queries
- Follow data governance security and compliance
- Implement agentic workflows with LangGraph
- Implement caching and partitioning for data serving
- Implement distributed async task processing
- Implement pipeline monitoring and data quality checks
- Implement structured logging and observability
- Integrate LLM APIs for data enrichment
- Orchestrate data workflows
- Perform code reviews for data quality
- Write SQL for aggregation and validation
- Write unit tests and integration tests
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Azure | Azure Data | Azure Data Factory | Azure OpenAI | Azure Service | Azure Service Bus | CI/CD | Celery | Dapr | Data Factory | Databricks | Databricks Workflows | Delta Lake | Docker | FastAPI | Git | Infrastructure as Code | Kubernetes | LLM | Langchain | Langgraph | Language Processing | NL-to-SQL | Natural Language | Natural Language Processing | PostgreSQL | PySpark | Pydantic | Pytest | Python | RAG | Redis | SQL | Service Bus | “as-code”
Education
Bachelor of Computer Science | Bachelor of Data Science | Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science
Roles
Related jobs
-
Manual QA Engineer – Robotics Automation INR 480K-1000KAPI Testing | Application Testing | Azure DevOps | Case design | Defect TrackingMid-level Full TimePune, India12h ago
-
Data Engineer - Snowflake/DBT INR 1500K-2500KCI/CD | DBT | Data Governance | Data Modeling | Data SecurityMid-level Full TimeBangalore, India12h ago
-
Senior Data Engineer - Snowflake/DBT INR 1500K-2040KCI/CD | DBT | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeBangalore, India12h ago
-
Senior Data Engineer INR 3000K-4000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon S3 | CloudWatchCab facility | Flexible working hours | Free medical insurance | Maternity leave | Meal facilitySenior-level Full TimeGurgaon (SEZ1)13h ago
-
Software Engineer - AI Products INR 2000K-5000KAgent Orchestration | Agentic AI | CI/CD | Dialogue Management | DockerSenior-level Full TimeNew Delhi, DL, India14h ago
-
AI Quality Engineer INR 1800K-3000KApplication Insights | Azure | Behavioral Testing | CI/CD | DataverseSenior-level Full TimeBengaluru, KA, India14h ago
-
Senior-level Full TimeBengaluru, KA, India15h ago
-
Cloud Data Engineer I, Professional Services, Google Cloud INR 1200K-1500KApache Hive | Apache Pig | Apache Spark | Big Data | C plus plusMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Software Engineering, Android Embedded Software INR 850K-1600KAndroid | Artificial Intelligence | Cloud Computing | Data Storage | Distributed SystemsMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Mid-level Full TimeBengaluru, KA, India15h ago
-
Data engineering Analytics INR 1890K-2400KAgile | Cloud platform | GCP | Google Cloud | Google Cloud PlatformSenior-level Full TimeGurugram, HR, India16h ago
-
Lead Software Engineer – Java, DevOps, Cloud, AI Solutions INR 2200K-3500KAWS | AWS CloudWatch | Alerting | Bash | CI/CDSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Applied ML Engineer INR 1000K-2000KApproximate Nearest Neighbor | CTR | Cold Start | Collaborative Filtering | Conversion RateCross-functional collaboration | Full-time employment | Onsite work schedule WFO | Weekly model refresh pipeline ownershipMid-level Full TimeHaryana, Gurugram, India17h ago
-
Python + Gen AI Engineer - Consultant INR 2000K-3300KAPI Development | AWS Bedrock | Asynchronous programming | Azure OpenAI | Distributed SystemsMid-level Full TimeMumbai, Maharashtra, India18h ago
-
Senior-level Full TimeIndia18h ago
-
Assistant Manager - Cloud Engineering INR 1500K-2000KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient relationship management | Consulting experience | Professional developmentMid-level Full TimePune, Maharashtra, India18h ago
-
AI Data Engineer III INR 3000K-3880KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
AWS Glue | AWS IAM | AWS Lambda | Amazon EC2 | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India19h ago
-
AI/ML Engineer INR 2000K-2700KAgentic Systems | Apache Spark | Automated testing | Azure OpenAI | Database ConnectivityEntry-level Full TimeChennai, TN, IN19h ago
-
AI/ML Expert INR 2500K-4500KBERT | Data Preprocessing | Deep learning | Feature Engineering | Fine TuningSenior-level Full Timepune, India19h ago
-
Consultant - AI Engineer with Claude INR 2000K-4000KAWS | Autogen | Azure | Claude | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2400KAI Pipelines | APIs | Alerting | Data Lineage | Data ModelingSenior-level Full Timebangalore, India20h ago
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 60003220h ago
-
ETL QA - Consultant INR 850K-1500KAgile | Case design | Data Mapping | Data Migration | Data QualityMid-level Full TimePune, IN, 41105720h ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon21h ago