Senior Data Engineer - Payment Intelligence
Tasks
- Build Apache Airflow DAGs for pipeline orchestration
- Design data pipelines in Snowflake for healthcare analytics
- Develop ELT processes using Snowflake SQL and stored procedures
- Document pipeline architecture and operational runbooks
- Enforce data quality and governance with access control and masking
- Implement CI CD workflows for database migrations and schema changes
- Integrate APIs and automate web scraping
- Monitor pipelines and troubleshoot incidents
- Write Python scripts for data transformation and validation
Perks/Benefits
- Certification reimbursement
- Flexible paid time off
- Health benefits
- Hybrid work model
- Night shift allowance
- Paid parental leave
- Professional development support
- Referral bonus
- Transportation allowance
- Transportation allowance and night shift allowance
Skills/Tech-stack
API Integration | AWS IAM | AWS Lambda | AWS MWAA | Access Control | Amazon CloudWatch | Amazon S3 | Amazon SNS | Apache Airflow | Bitbucket Pipelines | CI/CD | Data Governance | Data Modeling | Data masking | Dynamic SQL | ELT | Git | Liquibase | Pandas | Python | Role-Based Access | Role-Based Access Control | SQL | Snowflake | Stored Procedures | Web Scraping
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India5h ago
-
Senior Data Engineer INR 2800K-4000KAWS Elastic MapReduce | Agile | Apache Spark | Business Intelligence | Data WarehousingAnnual health check eye checkup dental screening OPD reimbursement | Employee assistance program | Free transportation | Leave policy | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Lead Software Engineer INR 3150K-4500KAWS EMR | AWS SNS | AWS SQS | Amazon Web Services | CI/CDCareer development opportunities | Comprehensive benefits | Flexible working arrangements | Work-life balanceSenior-level Full TimeMumbai, India8h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2500K-3630KAWS | Apache Spark | Azure | Computer Vision | Convolutional Neural NetworksSenior-level Full Timebengaluru, India9h ago
-
Data Engineer Azure - Senior INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeGlobal scale | Inclusive culture | Learning culture | Supportive teamSenior-level Full TimePune, MH, IN, 41101410h ago
-
Custom Software Engineer INR 1400K-1848KAirflow | CI/CD | Cause analysis | Change Management | Control-MRotational shifts | Stakeholder communicationMid-level Full TimeBengaluru, BDC7A, India12h ago
-
Mid-level Full TimePLOT NO-1, S.NO. 77, India12h ago
-
.NET | ASP.NET | Amazon Web Services | Angular | Apache AirflowFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India12h ago
-
IN_Senior Associate_SCM_Data and Analytics_Advisory_Bangalore INR 2040K-3380KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India12h ago
-
IN_Associate_Palantir_ Data and Analytics_Advisory_Bangalore INR 3000K-4000KAnalytics Cloud | Business Intelligence | Data Analysis | Data Mining | Data ModelingSenior-level Full TimeBengaluru Millenia, India12h ago
-
Gen AI Engineer / Applied AI Engineer INR 1800K-2500KAI Agents | Cloud Run | Embeddings | Gemini | Generative AIHands on experience with Vertex AI and Gemini ecosystem | Opportunity to work on production systems | Work on challenging problemsMid-level Full TimeGurugram, Haryana, India12h ago
-
Senior PySpark Data Engineer INR 2000K-2800KApache Airflow | CI/CD | Cloudera | Data Modeling | Data WarehousingSenior-level Full TimePLOT NO-1, S.NO. 77, India12h ago
-
Data Engineer 2 INR 1000K-2000KAWS | Acceptance Testing | Amazon Redshift | CI/CD | Cloud ComputingMid-level Full TimeIND-CORP Bengaluru-TDIM - PTT, India12h ago
-
Lead Engineer - Investment Data Platform INR 3000K-4000K.Net Framework | API Management | Agile | Apigee | AzureHybrid work | Work from office 3 days per weekSenior-level Full TimePune, India12h ago
-
Mid-level Full TimeHyderabad, HDC4A, India12h ago
-
Mid-level Full TimePune - Tower 6, India R12h ago
-
Senior-level Full TimeBengaluru, BDC7C, India12h ago
-
Experienced AI Engineer for Storage Domain INR 3200K-4600KCloud Architecture | Deep learning | DevOps | Distributed Computing | ElasticsearchCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Inclusion-focused cultureSenior-level Full TimeBengaluru, Karnātaka, India12h ago
-
Senior-level Full TimeHyderabad, HDC3B, India12h ago
-
Mid-level Full TimeBengaluru, BDC7C, India12h ago
-
Sr. Associate - Commercial Analytics INR 800K-1200KDashboarding | Data Visualization | Data analytics | Excel | ForecastingCareer growth | On site work 4 days per week | Opportunity to contribute to patientsMid-level Full TimeIndia - Hyderabad12h ago
-
Data Engineer (Azure + Databricks) INR 800K-1500KAirflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Data Engineer (Azure + Databricks) INR 1200K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Mid-level Full TimeBengaluru, BDC7C, India12h ago
-
Associate Data Scientist (Commercial) INR 800K-1200KData Analysis | Data Visualization | Experimentation | Exploratory Data Analysis | Feature EngineeringCollaborative environment | Hands-on experience | Mentorship | Structured learningMid-level Full TimeIndia - Hyderabad12h ago