Senior Data Engineer - Payment Intelligence
Tasks
- Build Apache Airflow DAGs for pipeline orchestration
- Design data pipelines in Snowflake for healthcare analytics
- Develop ELT processes using Snowflake SQL and stored procedures
- Document pipeline architecture and operational runbooks
- Enforce data quality and governance with access control and masking
- Implement CI CD workflows for database migrations and schema changes
- Integrate APIs and automate web scraping
- Monitor pipelines and troubleshoot incidents
- Write Python scripts for data transformation and validation
Perks/Benefits
- Certification reimbursement
- Flexible paid time off
- Health benefits
- Hybrid work model
- Night shift allowance
- Paid parental leave
- Professional development support
- Referral bonus
- Transportation allowance
- Transportation allowance and night shift allowance
Skills/Tech-stack
API Integration | AWS IAM | AWS Lambda | AWS MWAA | Access Control | Amazon CloudWatch | Amazon S3 | Amazon SNS | Apache Airflow | Bitbucket Pipelines | CI/CD | Data Governance | Data Modeling | Data masking | Dynamic SQL | ELT | Git | Liquibase | Pandas | Python | Role-Based Access | Role-Based Access Control | SQL | Snowflake | Stored Procedures | Web Scraping
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Lead Consultant - Data Engineer INR 2500K-3380KData Governance | Data Integrity | Data Modeling | Databricks | ETLSenior-level Full TimeIndia-Bangalore12h ago
-
Senior Consultant INR 2500K-4000K.Net Core | ASP.Net Core | Azure AI | Azure Machine Learning | Azure OpenAISenior-level Full TimeIN-AP-Hyderabad12h ago
-
AIML Python with AI INR 2500K-3500KAPIs | Computer Vision | Deep learning | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad12h ago
-
AIML Python with AI Architect INR 2500K-4500KComputer Vision | Deep learning | Feature Engineering | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad12h ago
-
AI Solutions Lead INR 2500K-4000KAWS | Data Lake | Data Pipelines | Data Warehousing | Deep learningSenior-level Full TimePune, MAHĀRĀSHTRA, India13h ago
-
Cloud Engineer INR 1000K-1000KAWS | Access Control | Access Control List | Application Firewall | Application Load BalancerFamily wellbeing benefits | Health insurance | Paid time off | Safety and wellbeing support | Wellbeing benefitsMid-level Full TimeHyderabad, India13h ago
-
Executive-level Full TimeBangalore, Karnataka, India14h ago
-
AI Lead - Gen AI Solution INR 2500K-4500KControlNet | Cosmos DB | DETR | Docker | FP8Full-time employment | Hybrid work | Permanent roleSenior-level Full TimeKochi, Kerala, India14h ago
-
Senior-level Full TimeKochi, Kerala, India14h ago
-
Manager - Analytic Engineering INR 2000K-2400KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Apache SparkSenior-level Full TimeThane, Maharashtra, India14h ago
-
Senior-level Full TimeBengaluru, Karnataka, India14h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPIs | Batch Processing | BigQuery | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Gurgaon, Haryana, India14h ago
-
Entry-level Full TimePune, India14h ago
-
Software Engineer II - AI/ML INR 1400K-2000KAWS | Apache Hadoop | Apache Spark | Azure | Computer VisionAgile team | Career growth | Diversity inclusion respectMid-level Full TimeMumbai, Maharashtra, India14h ago
-
Applied AI/ML Senior Associate INR 2500K-4000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Applied AI/ML Lead INR 2500K-3000KApache Hive | Apache Spark | Keras | Language Models | Language ProcessingSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Business Intelligence Engineer INR 1400K-1700KAgile | Jira | SQL | SnowflakeFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R15h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | Cloud Computing | CrewAI | FastAPIMid-level Full TimePune, Maharashtra, India15h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimePune, Maharashtra, India15h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India15h ago
-
Mid-level Full TimeBengaluru, KA, IN15h ago
-
Manager INR 300K-370KApache Airflow | Data Modeling | Data Pipeline Architecture | Data Processing | Data pipelineSenior-level Full TimeIndia16h ago
-
Staff Software Engineer - Machine Learning INR 2500K-3800KAgentic AI | Anthropic | Cost Optimization | Evaluation | Inference OptimizationSenior-level Full TimeHyderabad, India16h ago
-
Senior Big Data Engineer INR 800K-1500KAmazon EMR | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache FlinkSenior-level Full TimeChennai, India16h ago