Senior Applications Developer : Bigdata - Python, Pyspark
INR 2520K-3500K (estimate) Senior-level Full Time
Tasks
- Analyze requirements and propose solutions
- Build and manage distributed data systems
- Collaborate with cross-functional teams
- Conduct code reviews
- Design data pipelines
- Develop ETL processes
- Develop KYC data solutions
- Develop data applications
- Implement data governance best practices
- Integrate AI features for KYC
- Mentor junior team members
- Optimize data processing
- Optimize database performance
- Troubleshoot data pipeline issues
- Write SQL queries and stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | AWS | AWS Step Functions | Apache Airflow | Apache Spark | Artificial Intelligence | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Databricks | Dataframes | Django | Django REST | Django REST Framework | Docker | EMR | ETL | FastAPI | Flask | GCP | Git | GitLab CI | Hadoop | Hive | Integration Testing | Jenkins | Kafka | Kubernetes | Machine Learning | MongoDB | MySQL | NumPy | ORC | Oracle | Pandas | Parquet | Performance Testing | PostgreSQL | PySpark | PyTorch | Pytest | Python | REST APIs | REST Framework | S3 | SQL | SQL Server | Spark SQL | Spark Streaming | Step Functions | TensorFlow | Unit Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Mid-level Full TimeChennai, India5h ago
-
Senior-level Full TimeChennai, India5h ago
-
Mid-level Full TimeChennai, India5h ago
-
Lead Consultant, ETL Data Engineer and Python INR 2520K-4000KData Governance | Data Modeling | Data Quality | Data Warehousing | Data integrationSenior-level Full TimeIndia-Bangalore6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Gen AI INR 2500K-4512KAPI Development | Chroma | Data Engineering | Faiss | JavaFull-time employmentSenior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer INR 1200K-2040KAWS CDK | AWS Glue | AWS Glue Data Catalog | AWS Lambda | Amazon AthenaSenior-level Full TimeIN-TN-Chennai6h ago
-
ETL Developer INR 800K-1500KBusiness Intelligence | Data Transformation | Data integration | ETL | PySparkSenior-level Full TimeIN-TN-Chennai6h ago
-
Core Data Platform - Software Engineering-Associate-Bengaluru INR 2500K-3500KAWS | AWS Lambda | Agile | CloudFormation | Data ModelingGlobal networks | Mindfulness programs | Personal finance offerings | Training and development | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Mid-level Full TimeGurgaon, Haryana, India6h ago
-
Alteryx & Analytics Developer - Consultant INR 900K-1200KAlteryx Designer | DAX | Data Governance | Data Modeling | Data QualityMid-level Full TimeBangalore, Karnataka, India6h ago
-
Software Engineer (Scala and Spark) INR 2516K-3356KAgile | Apache Spark | Azure | CI/CD | Cause analysisEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
Senior Software Engineer, Cloud Bigtable INR 2000K-3500KBigtable | C++ | CI/CD | Cassandra | Column-storesSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Software Engineer, Cloud Infrastructure Engineering INR 1000K-1500KAPIs | Capacity Planning | Compute Technologies | Data Structures | Data Structures and AlgorithmsMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeMumbai, Maharashtra, India8h ago
-
Azure Data & Fabric Developer -Deputy Manager - RNA INR 1500K-2000KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeMumbai, MH, India8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Mid-level Full TimeGurgaon, HR, India8h ago
-
Assistant Manager - Data Engineering INR 1500K-2000KAPIs | Angular | Apache Airflow | BigQuery | CSSMid-level Full TimeGurgaon, HR, India8h ago
-
DAX | Dashboard Development | Data Documentation | Data Modeling | Data VisualizationMid-level Full TimeGurgaon, Haryana, India8h ago
-
Senior Engineer – AI / Cloud INR 1800K-3500KAPI Integration | AWS ALB | AWS CLI | AWS EC2 | AWS ECSSenior-level Full TimePune, Maharashtra, India9h ago
-
Quant Analytics Associate Senior INR 500K-1039KAgile | Alteryx | Data Mapping | Data Modeling | Data ReconciliationMid-level Full TimeMumbai, Maharashtra, India9h ago
-
AI Engineer INR 2000K-4500KAWS Bedrock | Agent workflows | Alerting | Amazon SageMaker | Automated testingAccreditations | Annual excellence awards | Bike to work | Career development program | Educational assistanceSenior-level Full TimeMumbai, MH, India9h ago
-
Senior PostgreSQL DBA / Database Platform Engineer INR 1500K-3440KAWS | Ansible | Automation | Azure | Azure MonitorSenior-level Full TimeChennai, IN10h ago