Senior Data Engineer
Navi Mumbai, India (Finicity)
INR 3500K-5000K (estimate) Senior-level Full Time
Tasks
- Administer Databricks workspaces and governance
- Apply DBA fundamentals for indexing and query optimization
- Architect scalable AWS ETL pipelines
- Build AWS Glue pipelines with S3 and IAM
- Build GenAI LLM workflows
- Build REST APIs for model inference and data access
- Design agentic AI solutions
- Design data pipelines for AI workloads
- Develop monitoring diagnostics and reconciliation agents
- Develop production Python applications
- Implement ETL orchestration and error handling
- Implement multi-agent orchestration
- Lead AI ideation for analytics and data platforms
- Manage backup recovery and high availability
- Migrate legacy logic to PySpark on Databricks
- Optimize Databricks and Snowflake costs and performance
- Refactor Python code for scalability and performance
- Tune query and optimize data layout
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Bedrock | AWS Glue | AWS IAM | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SageMaker | Backup and Recovery | CI/CD | Databricks | ETL | Embeddings | FastAPI | Flask | High Availability | Indexing | MongoDB | MySQL | Performance Tuning | PostgreSQL | PySpark | Python | Query Optimization | RAG | REST API | Snowflake | Terraform | Vector Database
Education
N/A
Roles
Related jobs
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 5600663h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 6000323h ago
-
Manager_Python Engineer L4 Expert INR 1500K-3500KAWS Glue | AWS Lambda | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeThane, IN, 4006043h ago
-
APIs | AWS | Algorithms | Azure | CI/CDSenior-level Full TimeKolkata DN 57, India9h ago
-
MDG Data Engineer (SAP Master Data Governance) INR 1524K-2500KAsset Management | Business Partner | Business Rules | Change Request | DRFMid-level Full TimeRMZ Ecoworld 32, India11h ago
-
Associate, Data Analytics // Application Development INR 1000K-1800KAI Development | API Development | Airflow | Application Architecture | AutomationMid-level Full TimeGurgaon12h ago
-
Mid-level Full TimeGurgaon12h ago
-
Senior-level Full TimeGurgaon12h ago
-
Senior-level Full TimeHyderabad, IND-TG, India16h ago
-
Senior-level Full TimeHyderabad, IND-TG, India16h ago
-
Data Engineer INR 1500K-2500KAgile | BeautifulSoup | Browse AI | CSV | Data PipelinesHybrid work | Paid time offMid-level Full TimeHyderabad, India17h ago
-
Senior Automation Specialist INR 1500K-3000KAPI Integration | Access Controls | Alerting | Data Quality | MonitoringSenior-level Full TimeHyderabad, India18h ago
-
Software Engineer (ETL TESTER - DATA WAREHOUSING, DATA PROCESSING, SQL, UAT, SNOWFLAKE) INR 1000K-1500KAirflow | Azure Data | Azure Data Factory | Batch Processing | Control-MEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India18h ago
-
AI QA Engineer INR 2000K-3300KAWS Bedrock | Azure OpenAI | Case design | Content Filtering | Evaluation rubricsImmediate joiner required | Work From Office 2 DaysSenior-level Full TimePune City, India20h ago
-
Mid-level Full TimeIN-AP-Hyderabad20h ago
-
Data Engineering Manager INR 1500K-2500KADLS | Access Management | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India20h ago
-
Computer Vision | Docker | Docker Swarm | Generative AI | JAXCareer growth | Continuous learning | Enterprise scale AI leadership | Global cross functional work environment | Professional developmentSenior-level Full TimeIndia21h ago
-
GCP Data Engineer - Associate Director INR 800K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India21h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Engineer Digital & AI Solutions INR 4000K-6000KAPI Development | Agent systems | CI/CD | Cloud Computing | ContainerizationFood allowance | Health insurance | Hybrid work | Internet allowance | Learning and development programsSenior-level Full TimeHyderabad, Telengana, India22h ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1500K-2200KAWS | Agile | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India22h ago
-
Software Engineer II,Python, Spark INR 1500K-2200KAWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake FormationMid-level Full TimeMumbai, Maharashtra, India23h ago
-
AI QA Engineer - Bangalore, IND INR 2000K-3000KAPI Development | Claude | Docker | Embeddings | Evaluation FrameworksMid-level Full TimeIndia23h ago
-
Lead Software Engineer - Java/Python, AWS,LLM INR 3500K-5000KA/B | A/B Testing | AWS Lambda | Agentic AI | AgileSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India23h ago